Files
OmniRoute/tests/unit/probe-policy.test.ts
Praveen K Palaniswamy 65e81158ab fix(ollama): route models by advertised capability (#11088)
Landed with the design call resolved per the owner's pick — **option 1**: the synced store is now endpoint-agnostic (persistDiscoveredModels and managedModelImport no longer drop non-chat models at write time), and chat selectability moved to read time (auto-pool expansion in autoStrategy applies filterChatSelectableModels; the models-route projection already had its chatOnly filter). Your discovery test now passes end-to-end (3/3): /api/show capabilities persist per connection and image/embedding requests route through the advertising host.

Reconciliation notes: conflicted areas merged onto the current tip (adobe discovery import, requestedModel preflight signature, resolvedProvider fast-path coexists with the synced-route override — explicit resolution wins); carried base-red drains (#10055 memoization, #11071 test variants) dropped as already-landed; the managed-model-import exclusion test was propagated to the new contract (image/video models persist; the read filter still hides them from chat pickers — pinned by a new assertion). Full battery: 205/206 focused (the one red is a confirmed periodic-timer timing flake on the loaded devbox — 20/20 isolated), autoCombo vitest 30/30, combo suites 46/46, gates + typecheck clean.

Thank you @yourspraveen — the capability probe + routing design was right; it just needed the store contract opened up. Fixes #11087.
2026-08-23 11:45:01 -03:00

62 lines
2.2 KiB
TypeScript

import { test } from "node:test";
import assert from "node:assert/strict";
import fs from "node:fs";
import os from "node:os";
import path from "node:path";
const TEST_DATA_DIR = fs.mkdtempSync(path.join(os.tmpdir(), "omniroute-probe-policy-"));
process.env.DATA_DIR = TEST_DATA_DIR;
const core = await import("../../src/lib/db/core.ts");
const settingsDb = await import("../../src/lib/db/settings.ts");
const { runAsProbe, shouldIsolateProbeFailures, isProbeContext } =
await import("../../src/shared/utils/probeOrigin.ts");
test.after(() => {
delete process.env.PROBE_CAN_DISABLE;
core.resetDbInstance();
fs.rmSync(TEST_DATA_DIR, { recursive: true, force: true });
});
test("outside a probe context the decision is always false (real path)", async () => {
await settingsDb.updateSettings({ probeCanDisable: true });
assert.equal(await shouldIsolateProbeFailures(), false);
});
test("probe + default settings => isolation ON (probe never disables)", async () => {
await settingsDb.updateSettings({ probeCanDisable: false });
await runAsProbe(async () => {
assert.equal(await shouldIsolateProbeFailures(), true);
});
});
test("probe + opt-in setting probeCanDisable => isolation OFF (historical behavior)", async () => {
await settingsDb.updateSettings({ probeCanDisable: true });
await runAsProbe(async () => {
assert.equal(await shouldIsolateProbeFailures(), false);
});
});
test("probe + env feature flag PROBE_CAN_DISABLE=true => isolation OFF", async () => {
process.env.PROBE_CAN_DISABLE = "true";
await settingsDb.updateSettings({ probeCanDisable: false });
await runAsProbe(async () => {
assert.equal(await shouldIsolateProbeFailures(), false);
});
});
test("probe + flag false + setting true => setting wins (flag must not re-enable isolation)", async () => {
process.env.PROBE_CAN_DISABLE = "false";
await settingsDb.updateSettings({ probeCanDisable: true });
await runAsProbe(async () => {
assert.equal(await shouldIsolateProbeFailures(), false);
});
});
test("probe context propagation is still pinned (policy uses the same gate)", async () => {
assert.equal(isProbeContext(), false);
await runAsProbe(async () => {
assert.equal(isProbeContext(), true);
});
});