Files
OmniRoute/tests/unit/model-lifecycle.test.ts
Praveen K Palaniswamy 65e81158ab fix(ollama): route models by advertised capability (#11088)
Landed with the design call resolved per the owner's pick — **option 1**: the synced store is now endpoint-agnostic (persistDiscoveredModels and managedModelImport no longer drop non-chat models at write time), and chat selectability moved to read time (auto-pool expansion in autoStrategy applies filterChatSelectableModels; the models-route projection already had its chatOnly filter). Your discovery test now passes end-to-end (3/3): /api/show capabilities persist per connection and image/embedding requests route through the advertising host.

Reconciliation notes: conflicted areas merged onto the current tip (adobe discovery import, requestedModel preflight signature, resolvedProvider fast-path coexists with the synced-route override — explicit resolution wins); carried base-red drains (#10055 memoization, #11071 test variants) dropped as already-landed; the managed-model-import exclusion test was propagated to the new contract (image/video models persist; the read filter still hides them from chat pickers — pinned by a new assertion). Full battery: 205/206 focused (the one red is a confirmed periodic-timer timing flake on the loaded devbox — 20/20 isolated), autoCombo vitest 30/30, combo suites 46/46, gates + typecheck clean.

Thank you @yourspraveen — the capability probe + routing design was right; it just needed the store contract opened up. Fixes #11087.
2026-08-23 11:45:01 -03:00

82 lines
2.5 KiB
TypeScript

import test from "node:test";
import assert from "node:assert/strict";
const {
MODEL_LIFECYCLE_RECORDS,
filterSelectableModels,
formatModelLifecycleMessage,
getModelLifecycleDecision,
isModelSelectable,
} = await import("../../open-sse/services/modelLifecycle.ts");
const CURRENT_DATE = new Date("2026-07-26T00:00:00.000Z");
test("shutdown OpenAI models are rejected with replacement guidance, not rewritten", () => {
const decision = getModelLifecycleDecision("openai", "gpt-5.2-codex", CURRENT_DATE);
assert.equal(decision.status, "shutdown");
assert.equal(decision.action, "reject");
assert.equal(decision.model, "gpt-5.2-codex");
assert.deepEqual(decision.replacement, {
provider: "openai",
model: "gpt-5.6-sol",
});
assert.match(formatModelLifecycleMessage(decision) || "", /cannot be routed automatically/);
});
test("upcoming shutdowns warn before the shutdown date", () => {
const decision = getModelLifecycleDecision("openai", "gpt-5.3-chat-latest", CURRENT_DATE);
assert.equal(decision.status, "deprecated");
assert.equal(decision.action, "warn");
assert.equal(decision.shutdownAt, "2026-08-10");
});
test("lifecycle records are provider-scoped", () => {
const decision = getModelLifecycleDecision("opencode-zen", "gpt-5.2-codex", CURRENT_DATE);
assert.equal(decision.status, "untracked");
assert.equal(decision.action, "allow");
});
test("catalog filtering hides deprecated and shutdown models by default", () => {
const models = [
{ id: "gpt-5.6-sol", name: "GPT-5.6 Sol" },
{ id: "gpt-5.2-codex", name: "GPT-5.2 Codex" },
{ id: "gpt-5.3-chat-latest", name: "GPT-5.3 Chat" },
];
assert.deepEqual(
filterSelectableModels("openai", models, { asOf: CURRENT_DATE }).map((model) => model.id),
["gpt-5.6-sol"]
);
assert.deepEqual(
filterSelectableModels("opencode-zen", models, { asOf: CURRENT_DATE }).map((model) => model.id),
models.map((model) => model.id)
);
});
test("selectability can include deprecated models without reviving shutdown models", () => {
assert.equal(
isModelSelectable("openai", "gpt-5.3-chat-latest", {
asOf: CURRENT_DATE,
includeDeprecated: true,
}),
true
);
assert.equal(
isModelSelectable("openai", "gpt-5.2-codex", {
asOf: CURRENT_DATE,
includeDeprecated: true,
}),
false
);
});
test("the conflicted gpt-4-1106-preview date is not guessed", () => {
assert.equal(
MODEL_LIFECYCLE_RECORDS.some((record) => record.model === "gpt-4-1106-preview"),
false
);
});