Files
OmniRoute/tests/unit/devin-cli-catalog.test.ts
Praveen K Palaniswamy 65e81158ab fix(ollama): route models by advertised capability (#11088)
Landed with the design call resolved per the owner's pick — **option 1**: the synced store is now endpoint-agnostic (persistDiscoveredModels and managedModelImport no longer drop non-chat models at write time), and chat selectability moved to read time (auto-pool expansion in autoStrategy applies filterChatSelectableModels; the models-route projection already had its chatOnly filter). Your discovery test now passes end-to-end (3/3): /api/show capabilities persist per connection and image/embedding requests route through the advertising host.

Reconciliation notes: conflicted areas merged onto the current tip (adobe discovery import, requestedModel preflight signature, resolvedProvider fast-path coexists with the synced-route override — explicit resolution wins); carried base-red drains (#10055 memoization, #11071 test variants) dropped as already-landed; the managed-model-import exclusion test was propagated to the new contract (image/video models persist; the read filter still hides them from chat pickers — pinned by a new assertion). Full battery: 205/206 focused (the one red is a confirmed periodic-timer timing flake on the loaded devbox — 20/20 isolated), autoCombo vitest 30/30, combo suites 46/46, gates + typecheck clean.

Thank you @yourspraveen — the capability probe + routing design was right; it just needed the store contract opened up. Fixes #11087.
2026-08-23 11:45:01 -03:00

56 lines
1.9 KiB
TypeScript

import assert from "node:assert/strict";
import test from "node:test";
import { devin_cliProvider } from "../../open-sse/config/providers/registry/devin-cli/index.ts";
import { devin_desktopProvider } from "../../open-sse/config/providers/registry/devin-desktop/index.ts";
import { DEVIN_MODEL_CATALOG } from "../../open-sse/config/providers/registry/devin/catalog.ts";
test("Devin CLI and Desktop use the shared catalog without duplicate model ids", () => {
const ids = DEVIN_MODEL_CATALOG.map((model) => model.id);
assert.equal(devin_cliProvider.models, DEVIN_MODEL_CATALOG);
assert.equal(devin_desktopProvider.models, DEVIN_MODEL_CATALOG);
assert.equal(new Set(ids).size, ids.length);
assert.ok(ids.every((id) => !id.toLowerCase().includes("byok")));
});
test("Devin CLI catalog includes the refreshed native model ids", () => {
const ids = new Set(DEVIN_MODEL_CATALOG.map((model) => model.id));
for (const id of [
"swe-1-7-lightning",
"claude-5-fable-max",
"gpt-5-6-sol-max",
"gpt-5-5-high",
"glm-5-2-max-1m",
"claude-opus-5-low",
"claude-opus-5-medium",
"claude-opus-5-high",
"claude-opus-5-xhigh",
"claude-opus-5-max",
"gemini-3-7-flash-minimal",
"gemini-3-7-flash-low",
"gemini-3-7-flash-medium",
"gemini-3-7-flash-high",
"kimi-k3-low",
"kimi-k3-high",
"kimi-k3-max",
"inkling-none",
"inkling-low",
"inkling-medium",
"inkling-high",
"inkling-xhigh",
"inkling-max",
]) {
assert.ok(ids.has(id), `expected refreshed Devin model id: ${id}`);
}
});
test("Devin CLI catalog does not expose retired dotted or review model ids", () => {
const ids = new Set(DEVIN_MODEL_CATALOG.map((model) => model.id));
for (const id of ["swe-1.6-fast", "swe-1.6", "claude-opus-4.7-review"]) {
assert.equal(ids.has(id), false, `retired Devin model id must stay absent: ${id}`);
}
});