Files
OmniRoute/tests/unit/proxy-dispatcher-cache-cap.test.ts
Praveen K Palaniswamy 65e81158ab fix(ollama): route models by advertised capability (#11088)
Landed with the design call resolved per the owner's pick — **option 1**: the synced store is now endpoint-agnostic (persistDiscoveredModels and managedModelImport no longer drop non-chat models at write time), and chat selectability moved to read time (auto-pool expansion in autoStrategy applies filterChatSelectableModels; the models-route projection already had its chatOnly filter). Your discovery test now passes end-to-end (3/3): /api/show capabilities persist per connection and image/embedding requests route through the advertising host.

Reconciliation notes: conflicted areas merged onto the current tip (adobe discovery import, requestedModel preflight signature, resolvedProvider fast-path coexists with the synced-route override — explicit resolution wins); carried base-red drains (#10055 memoization, #11071 test variants) dropped as already-landed; the managed-model-import exclusion test was propagated to the new contract (image/video models persist; the read filter still hides them from chat pickers — pinned by a new assertion). Full battery: 205/206 focused (the one red is a confirmed periodic-timer timing flake on the loaded devbox — 20/20 isolated), autoCombo vitest 30/30, combo suites 46/46, gates + typecheck clean.

Thank you @yourspraveen — the capability probe + routing design was right; it just needed the store contract opened up. Fixes #11087.
2026-08-23 11:45:01 -03:00

32 lines
989 B
TypeScript

import { describe, it } from "node:test";
import assert from "node:assert/strict";
import {
setDispatcherCacheEntry,
getDispatcherCache,
clearDispatcherCache,
} from "../../open-sse/utils/proxyDispatcherCache.ts";
describe("proxy dispatcher cache cap (#9158)", () => {
it("evicts and closes the oldest entry at the 512-entry cap", () => {
let closedCount = 0;
const fakeDispatcher = {
close() {
closedCount += 1;
return Promise.resolve();
},
} as never;
for (let i = 0; i <= 512; i += 1) {
setDispatcherCacheEntry(`u${i}`, fakeDispatcher);
}
assert.equal(getDispatcherCache().size, 512, "cache must stay at the cap");
assert.equal(closedCount, 1, "exactly one entry must be evicted and closed");
assert.equal(getDispatcherCache().has("u0"), false, "oldest entry must be evicted");
assert.equal(getDispatcherCache().has("u512"), true, "newest entry must be retained");
clearDispatcherCache();
});
});