Files
OmniRoute/tests/unit/theoldllm-provider-proxy.test.ts
Praveen K Palaniswamy 65e81158ab fix(ollama): route models by advertised capability (#11088)
Landed with the design call resolved per the owner's pick — **option 1**: the synced store is now endpoint-agnostic (persistDiscoveredModels and managedModelImport no longer drop non-chat models at write time), and chat selectability moved to read time (auto-pool expansion in autoStrategy applies filterChatSelectableModels; the models-route projection already had its chatOnly filter). Your discovery test now passes end-to-end (3/3): /api/show capabilities persist per connection and image/embedding requests route through the advertising host.

Reconciliation notes: conflicted areas merged onto the current tip (adobe discovery import, requestedModel preflight signature, resolvedProvider fast-path coexists with the synced-route override — explicit resolution wins); carried base-red drains (#10055 memoization, #11071 test variants) dropped as already-landed; the managed-model-import exclusion test was propagated to the new contract (image/video models persist; the read filter still hides them from chat pickers — pinned by a new assertion). Full battery: 205/206 focused (the one red is a confirmed periodic-timer timing flake on the loaded devbox — 20/20 isolated), autoCombo vitest 30/30, combo suites 46/46, gates + typecheck clean.

Thank you @yourspraveen — the capability probe + routing design was right; it just needed the store contract opened up. Fixes #11087.
2026-08-23 11:45:01 -03:00

63 lines
1.8 KiB
TypeScript

import test from "node:test";
import assert from "node:assert/strict";
import { fetchTheOldLlmWithProviderProxy } from "../../open-sse/executors/theoldllm.ts";
test("theoldllm dispatches through its provider proxy assignment", async () => {
const assignedProxy = {
type: "http",
host: "residential.example",
port: 8080,
username: "user",
password: "secret",
family: "ipv4",
name: "residential-primary",
};
let observedProxy: unknown = null;
let fetchCalls = 0;
const response = await fetchTheOldLlmWithProviderProxy(
{ model: "GPT_5_4", messages: [], stream: true },
new AbortController().signal,
{
resolveProxy: async () => assignedProxy,
runWithProxy: async (proxy, request) => {
observedProxy = proxy;
return request();
},
fetch: (async () => {
fetchCalls++;
return new Response("ok", { status: 200 });
}) as typeof fetch,
}
);
assert.equal(response.status, 200);
assert.equal(fetchCalls, 1);
assert.deepEqual(observedProxy, assignedProxy);
});
test("theoldllm fails closed when an assigned proxy pool has no active proxy", async () => {
let fetchCalls = 0;
await assert.rejects(
() =>
fetchTheOldLlmWithProviderProxy(
{ model: "GPT_5_4", messages: [], stream: true },
new AbortController().signal,
{
resolveProxy: async () => null,
hasBlockingProxyAssignment: () => true,
runWithProxy: async (_proxy, request) => request(),
fetch: (async () => {
fetchCalls++;
return new Response("unexpected", { status: 200 });
}) as typeof fetch,
}
),
/No active proxy is available/
);
assert.equal(fetchCalls, 0, "a dead assigned proxy pool must never fall back to direct egress");
});