Files
OmniRoute/tests/unit/fix-bare-routing-fallback.test.ts
Diego Rodrigues de Sa e Souza 4a3dcf6b0b fix(routing): only let Codex-native bare ids preempt a provider when codex is active (#9447)
* fix(routing): only let Codex-native bare ids preempt a provider when codex is active

#9275 widened CODEX_NATIVE_UNPREFIXED_MODELS from a single id to gpt-5.5 plus the
gpt-5.6-sol/terra/luna tiers, so bare Codex CLI ids would reach the ChatGPT
subscription instead of fanning out to whichever provider won the inference race.
The early return it added never consulted the active-provider set, which made the
codex-only guard 30 lines below unreachable for every id in the set:

  if (CODEX_NATIVE_UNPREFIXED_MODELS.has(modelId)) return { provider: "codex", ... }

An OpenAI-only install therefore had bare gpt-5.5 routed to codex and failed with
'no active credentials for provider: codex' on a model OpenAI serves, and an install
whose codex connection was merely inactive failed identically. This also silently
reverted #5887's compatibility boundary.

The preference now only PREEMPTS another provider when a codex connection is active.
Ids that no other provider catalogs (codex-auto-review) still resolve to codex with no
connection at all — there is nothing to preempt and 'no codex credentials' is the
honest error. With codex active the preference still beats OpenAI, which is the point
of #9275, and an explicit openai/ prefix overrides it either way.

Tests: the three assertions that encode the intended #9275 change now expect codex
(plus a new one pinning the explicit-prefix override); the rest were already correct
and pass again untouched. Adds a regression test for the OpenAI-only case.

* docs(changelog): correct fragment id to #9447

* test(routing): seed an active codex connection in the bare-precedence guards

The two files #9275 added assert that bare gpt-5.5 / gpt-5.6-sol reach codex, but
they ran against an empty database — so they also pinned 'codex wins with no codex
connection at all', which is the regression #9447 removes. That put them in direct
contradiction with plan3-p0 / chat-helpers / codex-gpt55-routing-5887, which assert
openai for the very same input: no implementation could satisfy both, which is why
the release could not go green.

Seeding an active codex connection keeps the contract these files were written to
guard (codex beats openai for a Codex-native bare id) while dropping the accidental
'even with no codex configured' half. Cases that need no connection are left as they
were: the tier-only ids and codex-auto-review have no alternative provider to preempt,
and the explicit-prefix overrides are unaffected.

---------

Co-authored-by: diegosouzapw <diegosouzapw@users.noreply.github.com>
2026-08-04 17:08:08 -03:00

88 lines
3.5 KiB
TypeScript

import test from "node:test";
import assert from "node:assert/strict";
import fs from "node:fs";
import os from "node:os";
import path from "node:path";
const TEST_DATA_DIR = fs.mkdtempSync(path.join(os.tmpdir(), "omniroute-bare-routing-fallback-"));
process.env.DATA_DIR = TEST_DATA_DIR;
const core = await import("../../src/lib/db/core.ts");
const providersDb = await import("../../src/lib/db/providers.ts");
const { getModelInfoCore } = await import("../../open-sse/services/model.ts");
// #FIX: end-to-end precedence checks for bare model routing. These guard
// the contract that:
// - Bare Codex-default model ids (gpt-5.6-sol, gpt-5.5, etc.) route to
// `codex` ahead of any other provider that also catalogs them — bounded by
// #9447 to installs where a codex connection is actually ACTIVE, so an
// OpenAI-only install is not handed a provider it has no credentials for.
// Ids that only codex catalogs (the tier variants) need no connection:
// there is no alternative provider to preempt.
// - Bare model ids shared between providers (e.g. claude-opus-5 across
// anthropic/claude/github/agentrouter/etc.) never silently route to a
// provider whose static registry does NOT actually catalog them (the
// kiro-synced-catalog bug).
// - Explicit `provider/model` prefixes always win over the bare inference.
test.before(async () => {
await providersDb.createProviderConnection({
provider: "codex",
authType: "oauth",
email: "codex@example.com",
providerSpecificData: { workspaceId: "ws-routing-fallback" },
});
});
test.after(() => {
core.resetDbInstance();
fs.rmSync(TEST_DATA_DIR, { recursive: true, force: true });
});
test("bare gpt-5.6-sol routes to codex (precedence via CODEX_NATIVE_UNPREFIXED_MODELS)", async () => {
const info = await getModelInfoCore("gpt-5.6-sol", null);
assert.equal(
info.provider,
"codex",
"bare gpt-5.6-sol must route to codex — the Codex CLI default"
);
});
test("bare gpt-5.5 routes to codex", async () => {
const info = await getModelInfoCore("gpt-5.5", null);
assert.equal(info.provider, "codex");
});
test("bare gpt-5.6-sol-xhigh (a tier id) routes to codex", async () => {
const info = await getModelInfoCore("gpt-5.6-sol-xhigh", null);
assert.equal(info.provider, "codex");
});
test("explicit prefix overrides bare precedence (agentrouter/gpt-5.6-sol)", async () => {
const info = await getModelInfoCore("agentrouter/gpt-5.6-sol", null);
assert.equal(info.provider, "agentrouter");
});
test("explicit prefix overrides bare precedence (openai/gpt-5.6-sol)", async () => {
const info = await getModelInfoCore("openai/gpt-5.6-sol", null);
assert.equal(info.provider, "openai");
});
test("bare claude-opus-5 never resolves to kiro (synced-catalog validation)", async () => {
// The bug: a kiro connection had claude-opus-5 in its synced /v1/models
// cache (likely from a brief upstream quirk). The bare-routing path
// accepted it as a candidate and routed traffic there, which then 404'd
// because kiro's static registry never cataloged claude-opus-5.
// The fix: validated synced candidates against the static registry.
const info = await getModelInfoCore("claude-opus-5", null);
assert.notEqual(
info.provider,
"kiro",
`kiro must NOT win bare claude-opus-5 routing — it does not catalog the model`
);
});
test("bare claude-opus-4-8 also never resolves to kiro (same fix must apply to all shared models)", async () => {
const info = await getModelInfoCore("claude-opus-4-8", null);
assert.notEqual(info.provider, "kiro");
});