mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-08-15 19:52:50 +03:00
* fix(ci): drop unused RadarReferrals type export — dead-code ratchet back to 227 baseline The radar referral-links feature (#9697) exported the inferred type RadarReferrals from feedSchema.ts but nothing imports it (the singular RadarReferral is the consumed type). knip counts it as a new dead export, pushing the dead-code ratchet to 228 > 227 and failing Fast Quality Gates on every PR born after the merge. RadarReferralsSchema itself stays — it is used by RadarFeedSchema. Refs #9737 * fix(ci): clear the 08-08 base-red layer — prod crash in chat.ts, Responses API payload regression, born-red stdio test, gate drifts Six independent base-reds from the 08-07 evening merge batch, each verified against the pure release/v3.8.50 tip: - src/sse/handlers/chat.ts: #9467's squash carried a refactor hunk that renamed the all-rate-limited breaker guard to an UNDEFINED variable (isAllRateLimited) — a production ReferenceError on the all-accounts-429 path (chat.ts is outside typecheck:core scope, so only tests caught it). Restore credentials?.allRateLimited. Guard: chat-rate-limit-body-lock (2/2), also un-breaks batch_api and chat-combo-live-test. - open-sse/utils/stream.ts: #9315 switched providerPayload summaries to the accumulated responseBody, but in passthrough paths that body is synthesized in chat-completion shape — Responses API lost its `response` object in the dashboard payload. Keep the events-derived summary for OPENAI_RESPONSES only. Guard: stream-utils + stream-collector-9315 suites (51/51). - tests/unit/mcp-stdio-json-purity.test.ts: born red — the full CLI chain takes ~10s (2x tsx import + DB init) and the test slept a fixed 4s. Poll for the first stdout line with a 60s deadline instead. - tests/unit/plugins-route-error-sanitization.test.ts: register #9445's new marketplace/install route in PLUGIN_ROUTES (route already sanitizes) (33/33). - tests/unit/provider-models-route-codex.test.ts: realign pinned GPT-5.6 input limit to #9432's deliberate 272000→922000 bump (7/7). - lint: fix 11 no-explicit-any errors in repro-9630 + specialty-9293 tests, prune 1 orphaned suppression, allowlist the opencode-ai devDependency (#8869, publisher-verified), and reword a doc line the fabricated-docs gate misread as an env var. Gates re-verified locally: lint:json --max-warnings 0 exit 0, dead-code 227, typecheck:core clean, check:deps OK, check:fabricated-docs OK. Refs #9737 * fix(ci): clear the third 08-08 base-red layer — invalid ru rule pack, stale event pin, orphaned UI repro test, pack/mutation/file-size drifts Follow-up to the previous layer: the serial fast-gates chain unmasked one more stratum after file-size/dead-code went green, all verified against the merged release/v3.8.50 tip: - compression rules ru/ultra.json (#9581): two rules shipped minIntensity "notes", which is not a valid CavemanIntensity (lite|full|ultra) — loading ANY language pack list threw and killed the rtk-loader suite. Mapped both to "ultra" (they are the most aggressive punctuation/case rules, matching the en pack tiers). 2/2. - plugins-welcome-banner-e2e: #9668 added the onStreamComplete builtin event (real emission path via runOnStreamCompleteHooks) and missed this pinned-list sibling. 35/35. - tests/unit/free-pool-frontend-repro (#9046): landed as .tsx with node:test semantics — no runner collects tests/unit/*.tsx, so it NEVER ran (test-discovery NEW-orphan). It contains zero JSX; renamed to .test.ts so the unit runner's existing glob collects it. 5/5 (first real run). - pack-policy: allow + require bin/mcpStdioConsoleGuard.mjs (#9281) — it is preloaded via node --import by bin/mcp-server.mjs, so a published artifact without it crashes 'omniroute --mcp' at startup. - stryker.conf.json: add 5 covering unit tests from the batch (#8779/#9204/ #9330/#9630/openrouter-passthrough) to tap.testFiles (--strict drift). - file-size-baseline: consolidate the base-drift rebaseline for the 12 files grown by the 08-06..08-08 batches (#9616's entries never reached the base; measured on this branch's tree — this PR's own source edits add zero lines to any frozen file). Local battery: file-size/deps/test-discovery/mutation/pack-policy/dead-code/ duplication/docs-all/secrets/vuln/workflows ratchets all exit 0; full lint gate --max-warnings 0 exit 0. Refs #9737 * fix(types): clear the 3 uncovered open-sse-typecheck regressions + realign combo skip-code siblings Fourth base-red layer unmasked by the serial gates. The other 4 typecheck regressions (codex.ts, kiro.ts, tierResolver.test.ts, translator/index.ts) already have dedicated open [TS7] PRs (#9748/#9753/#9742/#9747) — not duplicated here. This commit covers only what no open PR owns: - devin-agentic/serializer.ts TS2367: drop the dead 'role === "system"' branch — the guard above already narrows role to user|assistant (system throws unsupported_role). Devin suites 104/104. - raycast.ts TS2416: the buildHeaders 'override' never matched the base signature (2nd param is the signed payload string, not the stream boolean) — renamed to a private buildRaycastRequestHeaders helper so a polymorphic buildHeaders(credentials, true) call can never bind here. - modelMetadataRegistry.ts TS2352: PricingByProvider → nested-record cast now goes through unknown (shape is runtime-guarded by findInsensitive). - combo-routing-engine.test.ts: realign 2 pre-dispatch-skip expectations to #9630's deliberate ALL_TARGETS_SKIPPED contract (87/87). Refs #9737 * fix(ci): clear the fifth 08-08 base-red layer — reasoning-placeholder contract sweep, GPT-5.6 limits sweep, vi key parity The 08-08 merges (#9610 reasoning replay, #9432 GPT-5.6 limits, #9630 combo skip codes, #9336 provider key links) each changed a contract and left sibling tests pinning the old one. Full grep sweep per contract, not just the shard that happened to go red: - reasoning placeholder (#9573/#9610): the fix DELIBERATELY removed NON_ANTHROPIC_THINKING_PLACEHOLDER injection on cache miss — the model echoed the placeholder as its own reasoning (empty stop) and re-poisoned cache + client history; DeepSeek's 400 is specific to an EMPTY STRING, not an absent field. Realigned reasoning-cache (2 cases, renamed to describe omission) + tool-request-sanitization (1 case + dead import). 60/60. - GPT-5.6 Codex limits (#9432, 272000 -> 1050000 ctx / 922000 input): realigned vscode-token-routes-gpt56 (2) + vscode-token-routes (3). 43/43 together with t23-t24. - combo skip codes (#9630): t23-t24-fallback-resilience T24 now expects ALL_TARGETS_SKIPPED like the combo-routing-engine siblings. - vi.json key parity: #9336 added providers.getApiKey/getApiKeyDescription to en.json without syncing vi (the only locale with a parity gate). Translated both; providers block reordered to match en key order. 5/5. - pack-artifact-policy.test.ts: sibling of this PR's own required-paths change (bin/mcpStdioConsoleGuard.mjs). 10/10. - combo-routing-engine.test.ts: dropped the 6 comment lines added in the previous commit so the frozen test file-size stays at its baseline (the rationale lives in that commit message, not the test body). Gates: file-size, test-discovery, mutation-test-coverage, pack-policy, open-sse-typecheck, dead-code all exit 0. Refs #9737 * fix(translator): keep the reasoning_content placeholder for Xiaomi MiMo — #9610 traded one live 400 for another The xiaomi-mimo replay test (9router#1321) went red on the base after #9610 removed the NON_ANTHROPIC_THINKING_PLACEHOLDER injection globally. That test is NOT stale — it guards a documented upstream 400 ('Param Incorrect: The reasoning_content in the thinking mode must be passed back to the API'), so realigning it would have masked a reintroduced production bug. Two real bugs conflict here: - #9573: forwarding the placeholder makes the model continue its chain of thought FROM that text (echo -> empty stop) and re-poisons cache/history. - 9router#1321/#1337: omitting reasoning_content on a plain replay turn makes Xiaomi MiMo reject the request outright. #9610's evidence for omitting is provider-specific — it verified that deepseek-v4-flash accepts an ABSENT field. It does not extend to MiMo. So the omission stays for every provider #9610 covered, and the placeholder survives the cache miss only for xiaomi-mimo (new requiresReasoningContentPresence predicate next to isReasoningOnlyReplayTarget). The echo that comes back is still stripped on the way in by isInternalReasoningPlaceholder(), so #9573's cache/history poisoning stays fixed for MiMo too. Both contracts now hold simultaneously: xiaomi-mimo replay + reasoning-cache + tool-request-sanitization 61/61; placeholder-strip/responses/translator/combo regression sweep 168/168. Gates: file-size, open-sse-typecheck, dead-code, mutation-test-coverage exit 0; typecheck:core clean. A live check on the VPS (Hard Rule #18 path 2) is the only way to confirm the DeepSeek half of #9610's empirical claim; flagging it in the PR rather than widening this fix on speculation. Refs #9737 * test(translator): pin the reasoning-placeholder provider scope so neither half of the conflict can silently re-break #9610 removed the placeholder globally on the strength of ONE provider's observed behavior (deepseek-v4-flash accepting an absent reasoning_content), which re-opened the MiMo 400 (9router#1321). The previous commit scoped the placeholder to xiaomi-mimo; this pins BOTH directions in one test so the next global edit fails loudly instead of trading the bugs again: - xiaomi-mimo plain replay turn, cache miss -> reasoning_content present (narrowing the scope away from MiMo re-opens 9router#1321) - deepseek plain replay turn, cache miss -> reasoning_content absent (widening it back to DeepSeek re-opens the #9573 echo bug) Guard verified by mutation: forcing requiresReasoningContentPresence() to return true makes the DeepSeek half fail (1 pass / 1 fail), and the file was restored from the pre-probe copy before committing. Also checked kimi-coding/kimi-coding-apikey, the other strict-contract entries in REASONING_REPLAY_PROVIDERS: their originating PR (#7673) fixes capture and replay of REAL reasoning and documents no 400 on an absent field, so they stay out of the placeholder scope — evidence-scoped, not speculatively widened. Reasoning suites together: 87/87. Gates: file-size, test-discovery, mutation-test-coverage, dead-code exit 0; eslint clean. Refs #9737 --------- Co-authored-by: diegosouzapw <diegosouzapw@users.noreply.github.com>
1254 lines
45 KiB
TypeScript
1254 lines
45 KiB
TypeScript
import test from "node:test";
|
|
import assert from "node:assert/strict";
|
|
import fs from "node:fs";
|
|
import os from "node:os";
|
|
import path from "node:path";
|
|
|
|
const TEST_DATA_DIR = fs.mkdtempSync(path.join(os.tmpdir(), "omniroute-vscode-token-routes-"));
|
|
process.env.DATA_DIR = TEST_DATA_DIR;
|
|
process.env.API_KEY_SECRET = process.env.API_KEY_SECRET || "vscode-token-routes-secret";
|
|
|
|
const core = await import("../../src/lib/db/core.ts");
|
|
const providersDb = await import("../../src/lib/db/providers.ts");
|
|
const settingsDb = await import("../../src/lib/db/settings.ts");
|
|
const apiKeysDb = await import("../../src/lib/db/apiKeys.ts");
|
|
const vscodeRootRoute = await import("../../src/app/api/v1/vscode/[token]/route.ts");
|
|
const vscodeModelsRoute = await import("../../src/app/api/v1/vscode/[token]/models/route.ts");
|
|
const vscodeRawRootRoute = await import("../../src/app/api/v1/vscode/raw/[token]/route.ts");
|
|
const vscodeRawModelsRoute =
|
|
await import("../../src/app/api/v1/vscode/raw/[token]/models/route.ts");
|
|
const vscodeRawVersionRoute =
|
|
await import("../../src/app/api/v1/vscode/raw/[token]/api/version/route.ts");
|
|
const vscodeRawShowRoute =
|
|
await import("../../src/app/api/v1/vscode/raw/[token]/api/show/route.ts");
|
|
const vscodeRawTagsRoute =
|
|
await import("../../src/app/api/v1/vscode/raw/[token]/api/tags/route.ts");
|
|
const vscodeV1ModelsRoute = await import("../../src/app/api/v1/vscode/[token]/v1/models/route.ts");
|
|
const vscodeVersionRoute = await import("../../src/app/api/v1/vscode/[token]/api/version/route.ts");
|
|
const vscodeShowRoute = await import("../../src/app/api/v1/vscode/[token]/api/show/route.ts");
|
|
const vscodeTagsRoute = await import("../../src/app/api/v1/vscode/[token]/api/tags/route.ts");
|
|
const vscodeV1ChatCompletionsRoute =
|
|
await import("../../src/app/api/v1/vscode/[token]/v1/chat/completions/route.ts");
|
|
const vscodeChatCompletionsRoute =
|
|
await import("../../src/app/api/v1/vscode/[token]/chat/completions/route.ts");
|
|
const vscodeResponsesRoute = await import("../../src/app/api/v1/vscode/[token]/responses/route.ts");
|
|
const serviceTierVariants =
|
|
await import("../../src/app/api/v1/vscode/[token]/serviceTierVariants.ts");
|
|
const combosDb = await import("../../src/lib/db/combos.ts");
|
|
|
|
async function resetStorage() {
|
|
core.resetDbInstance();
|
|
apiKeysDb.resetApiKeyState();
|
|
fs.rmSync(TEST_DATA_DIR, { recursive: true, force: true });
|
|
fs.mkdirSync(TEST_DATA_DIR, { recursive: true });
|
|
}
|
|
|
|
async function seedConnection(provider: string, overrides: Record<string, unknown> = {}) {
|
|
return providersDb.createProviderConnection({
|
|
provider,
|
|
authType: (overrides.authType as string) || "apikey",
|
|
name: (overrides.name as string) || `${provider}-${Math.random().toString(16).slice(2, 8)}`,
|
|
apiKey: (overrides.apiKey as string) || "sk-test",
|
|
accessToken: overrides.accessToken as string | undefined,
|
|
isActive: (overrides.isActive as boolean) ?? true,
|
|
testStatus: (overrides.testStatus as string) || "active",
|
|
providerSpecificData: (overrides.providerSpecificData as Record<string, unknown>) || {},
|
|
});
|
|
}
|
|
|
|
test.beforeEach(async () => {
|
|
await resetStorage();
|
|
});
|
|
|
|
test.after(async () => {
|
|
core.resetDbInstance();
|
|
apiKeysDb.resetApiKeyState();
|
|
fs.rmSync(TEST_DATA_DIR, { recursive: true, force: true });
|
|
});
|
|
|
|
test("vscode tokenized root route mirrors the grouped VS Code catalog without combos", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("openai", { name: "openai-vscode-root" });
|
|
const key = await apiKeysDb.createApiKey("vscode-root", "machine-vscode-root");
|
|
await combosDb.createCombo({
|
|
name: "root-hidden-combo",
|
|
strategy: "priority",
|
|
models: [],
|
|
});
|
|
|
|
const response = await vscodeRootRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(Array.isArray(body.data));
|
|
assert.ok(body.data.length > 0);
|
|
assert.equal(
|
|
body.data.some(
|
|
(entry: any) => entry.id === "root-hidden-combo" || entry.name === "root-hidden-combo"
|
|
),
|
|
false
|
|
);
|
|
});
|
|
|
|
test("vscode tokenized root route exposes friendly model names alongside ids", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-root-friendly-name" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-root-friendly-name",
|
|
"machine-vscode-root-friendly-name"
|
|
);
|
|
|
|
const response = await vscodeRootRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
const model = (body.data || []).find((entry: any) => entry.id === "gpt-5.6-sol__provider_cx");
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(model, "missing gpt-5.6-sol__provider_cx in tokenized VS Code root route");
|
|
assert.equal(model.name, "Codex GPT 5.6 Sol (Default)");
|
|
});
|
|
|
|
test("vscode tokenized models route accepts path-scoped API keys", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("openai", { name: "openai-vscode-models" });
|
|
const key = await apiKeysDb.createApiKey("vscode-models", "machine-vscode-models");
|
|
|
|
const response = await vscodeModelsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/models`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(Array.isArray(body.data));
|
|
assert.ok(body.data.length > 0);
|
|
});
|
|
|
|
test("vscode tokenized combos route exposes configured combos via token alias", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
|
|
await seedConnection("codex", { name: "codex-vscode-combos-root-basic" });
|
|
|
|
const key = await apiKeysDb.createApiKey("vscode-combos", "machine-vscode-combos");
|
|
await combosDb.createCombo({
|
|
name: "test-combo",
|
|
strategy: "priority",
|
|
models: [{ kind: "model", model: "codex/gpt-5.6-sol-high", providerId: "codex" }],
|
|
});
|
|
|
|
const combosRoute =
|
|
await import("../../src/app/api/v1/vscode/combos/[token]/[[...slug]]/route.ts");
|
|
const response = await combosRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/combos/${encodeURIComponent(key.key)}`),
|
|
{ params: { token: key.key, slug: undefined } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.object, "list");
|
|
assert.ok(Array.isArray(body.data), "expected data property to be an array");
|
|
assert.ok(
|
|
body.data.some((combo: any) => combo.name === "test-combo"),
|
|
"expected test combo in data response"
|
|
);
|
|
assert.equal("combos" in body, false, "did not expect legacy combos property in response");
|
|
});
|
|
|
|
test("vscode combos route responds to Ollama compatibility check (/api/version)", async () => {
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-combos-version",
|
|
"machine-vscode-combos-version"
|
|
);
|
|
|
|
const combosRoute =
|
|
await import("../../src/app/api/v1/vscode/combos/[token]/[[...slug]]/route.ts");
|
|
const response = await combosRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/combos/${encodeURIComponent(key.key)}/api/version`),
|
|
{ params: { token: key.key, slug: ["api", "version"] } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(body.version, "expected version property in response");
|
|
assert.match(body.version as string, /0\.6\.\d+/, "expected Ollama-compatible version format");
|
|
});
|
|
|
|
test("vscode combos route exposes combos through Ollama api/tags", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
|
|
await seedConnection("codex", { name: "codex-vscode-combos-tags" });
|
|
|
|
const key = await apiKeysDb.createApiKey("vscode-combos-tags", "machine-vscode-combos-tags");
|
|
await combosDb.createCombo({
|
|
name: "tags-combo",
|
|
strategy: "priority",
|
|
models: [{ kind: "model", model: "codex/gpt-5.6-sol-high", providerId: "codex" }],
|
|
});
|
|
|
|
const combosRoute =
|
|
await import("../../src/app/api/v1/vscode/combos/[token]/[[...slug]]/route.ts");
|
|
const response = await combosRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/combos/${encodeURIComponent(key.key)}/api/tags`),
|
|
{ params: { token: key.key, slug: ["api", "tags"] } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(Array.isArray(body.models), "expected models array in api/tags response");
|
|
const combo = body.models.find((entry: any) => entry.name === "tags-combo");
|
|
assert.ok(combo, "expected combo name in api/tags response");
|
|
assert.equal(combo.details.family, "tags-combo");
|
|
assert.deepEqual(combo.supportsReasoningEffort, ["none", "low", "medium", "high", "xhigh"]);
|
|
});
|
|
|
|
test("vscode combos route resolves combo names through Ollama api/show", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
|
|
await seedConnection("codex", { name: "codex-vscode-combos-show" });
|
|
|
|
const key = await apiKeysDb.createApiKey("vscode-combos-show", "machine-vscode-combos-show");
|
|
await combosDb.createCombo({
|
|
name: "show-combo",
|
|
strategy: "priority",
|
|
models: [{ kind: "model", model: "codex/gpt-5.6-sol-high", providerId: "codex" }],
|
|
});
|
|
|
|
const combosRoute =
|
|
await import("../../src/app/api/v1/vscode/combos/[token]/[[...slug]]/route.ts");
|
|
const response = await combosRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/combos/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({ name: "show-combo" }),
|
|
}),
|
|
{ params: { token: key.key, slug: ["api", "show"] } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.model, "show-combo");
|
|
assert.equal(body.modelfile, "FROM show-combo");
|
|
assert.equal(body.details.family, "show-combo");
|
|
assert.equal(body.model_info.context_length, 1050000);
|
|
assert.deepEqual(body.supportsReasoningEffort, ["none", "low", "medium", "high", "xhigh"]);
|
|
assert.equal(body.model_info.capabilities.reasoning, true);
|
|
});
|
|
|
|
test("vscode tokenized combos root route exposes importable combo metadata", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
|
|
await seedConnection("codex", { name: "codex-vscode-combos-root" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-combos-root-rich",
|
|
"machine-vscode-combos-root-rich"
|
|
);
|
|
await combosDb.createCombo({
|
|
name: "balanced-load",
|
|
strategy: "reset-aware",
|
|
models: [{ kind: "model", model: "codex/gpt-5.6-sol-high", providerId: "codex" }],
|
|
});
|
|
|
|
const combosRoute =
|
|
await import("../../src/app/api/v1/vscode/combos/[token]/[[...slug]]/route.ts");
|
|
const response = await combosRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/combos/${encodeURIComponent(key.key)}`),
|
|
{ params: { token: key.key, slug: undefined } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
const combo = body.data.find((entry: any) => entry.id === "balanced-load");
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(combo, "expected balanced-load in combo root response");
|
|
assert.equal(combo.url.includes("/responses#models.ai.azure.com"), true);
|
|
assert.equal(combo.maxInputTokens, 922000);
|
|
assert.equal(combo.toolCalling, true);
|
|
assert.deepEqual(combo.supportsReasoningEffort, ["none", "low", "medium", "high", "xhigh"]);
|
|
});
|
|
|
|
test("vscode tokenized models route exposes reasoning effort metadata for importable chat models", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("github", {
|
|
authType: "oauth",
|
|
apiKey: null,
|
|
accessToken: "gh-test-access-token",
|
|
name: "github-vscode-models-reasoning",
|
|
});
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-models-reasoning",
|
|
"machine-vscode-models-reasoning"
|
|
);
|
|
|
|
const response = await vscodeModelsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/models`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
const model = (body.data || []).find((entry: any) => entry.id === "gpt-5.4__provider_gh");
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(model, "missing gpt-5.4__provider_gh in tokenized VS Code models route");
|
|
assert.equal(model.family, "gpt-5.4");
|
|
assert.deepEqual(model.supportsReasoningEffort, ["none", "low", "medium", "high"]);
|
|
assert.deepEqual(model.supportedReasoningEfforts, ["none", "low", "medium", "high", "xhigh"]);
|
|
assert.deepEqual(model.configurationSchema?.properties?.reasoningEffort?.enum, [
|
|
"none",
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
]);
|
|
assert.equal(model.configurationSchema?.properties?.reasoningEffort?.default, "none");
|
|
assert.equal(
|
|
model.url,
|
|
`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/responses#models.ai.azure.com`
|
|
);
|
|
});
|
|
|
|
test("vscode tokenized models route keeps xhigh for codex models that advertise it", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-models-reasoning" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-models-codex-reasoning",
|
|
"machine-vscode-models-codex-reasoning"
|
|
);
|
|
|
|
const response = await vscodeModelsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/models`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
const model = (body.data || []).find((entry: any) => entry.id === "gpt-5.6-sol__provider_cx");
|
|
const fastModel = (body.data || []).find(
|
|
(entry: any) => entry.id === "gpt-5.6-sol__provider_cx__tier_priority"
|
|
);
|
|
const flexModel = (body.data || []).find(
|
|
(entry: any) => entry.id === "gpt-5.6-sol__provider_cx__tier_flex"
|
|
);
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(model, "missing gpt-5.6-sol__provider_cx in tokenized VS Code models route");
|
|
assert.ok(
|
|
fastModel,
|
|
"missing gpt-5.6-sol__provider_cx__tier_priority in tokenized VS Code models route"
|
|
);
|
|
assert.ok(
|
|
flexModel,
|
|
"missing gpt-5.6-sol__provider_cx__tier_flex in tokenized VS Code models route"
|
|
);
|
|
assert.equal(model.name, "Codex GPT 5.6 Sol (Default)");
|
|
assert.equal(fastModel.name, "Codex GPT 5.6 Sol (Fast)");
|
|
assert.equal(flexModel.name, "Codex GPT 5.6 Sol (Flex)");
|
|
assert.equal(model.toolCalling, true);
|
|
assert.equal(model.vision, true);
|
|
assert.deepEqual(model.supportsReasoningEffort, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.deepEqual(model.supportedReasoningEfforts, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.equal(model.defaultReasoningEffort, "low");
|
|
assert.deepEqual(model.configSchema?.properties?.reasoningEffort?.enum, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.equal(model.configSchema?.properties?.reasoningEffort?.default, "low");
|
|
const importedIds = new Set((body.data || []).map((entry: any) => entry.id));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol__tier_priority"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol__tier_flex"));
|
|
assert.ok(!importedIds.has("codex/gpt-5.6-sol"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol-low"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol-medium"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol-high"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol-xhigh"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol-max"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol-ultra"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol-low__tier_priority"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol-medium__tier_priority"));
|
|
assert.ok(!importedIds.has("cx/gpt-5.6-sol-ultra__tier_flex"));
|
|
assert.equal(
|
|
[...importedIds].some((id) => String(id).includes("gpt-5.4__provider_cx")),
|
|
false
|
|
);
|
|
assert.equal(
|
|
model.url,
|
|
`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/responses#models.ai.azure.com`
|
|
);
|
|
});
|
|
|
|
test("vscode tokenized raw root route mirrors the raw models catalog", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-raw-root" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-raw-root-codex",
|
|
"machine-vscode-raw-root-codex"
|
|
);
|
|
|
|
const response = await vscodeRawRootRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/raw/${encodeURIComponent(key.key)}`),
|
|
{ params: { token: key.key } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(Array.isArray(body.data));
|
|
assert.ok(body.data.some((entry: any) => entry.id === "cx/gpt-5.6-sol"));
|
|
assert.ok(body.data.some((entry: any) => entry.id === "cx/gpt-5.6-sol-low__tier_priority"));
|
|
});
|
|
|
|
test("vscode tokenized raw routes do not publish combo entries", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("openai", { name: "openai-vscode-raw-hide-combos" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-raw-hide-combos",
|
|
"machine-vscode-raw-hide-combos"
|
|
);
|
|
await combosDb.createCombo({
|
|
name: "raw-hidden-combo",
|
|
strategy: "priority",
|
|
models: [],
|
|
});
|
|
|
|
const response = await vscodeRawRootRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/raw/${encodeURIComponent(key.key)}`),
|
|
{ params: { token: key.key } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(Array.isArray(body.data));
|
|
assert.equal(
|
|
body.data.some(
|
|
(entry: any) => entry.id === "raw-hidden-combo" || entry.name === "raw-hidden-combo"
|
|
),
|
|
false
|
|
);
|
|
});
|
|
|
|
test("vscode tokenized raw tags route does not publish combo entries", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-raw-tags-no-combo" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-raw-tags-no-combo",
|
|
"machine-vscode-raw-tags-no-combo"
|
|
);
|
|
await combosDb.createCombo({
|
|
name: "raw-tags-hidden-combo",
|
|
strategy: "priority",
|
|
models: [{ kind: "model", model: "codex/gpt-5.6-sol-high", providerId: "codex" }],
|
|
});
|
|
|
|
const response = await vscodeRawTagsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/raw/${encodeURIComponent(key.key)}/api/tags`),
|
|
{ params: { token: key.key } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(Array.isArray(body.models));
|
|
assert.equal(
|
|
body.models.some((entry: any) => entry.name === "raw-tags-hidden-combo"),
|
|
false
|
|
);
|
|
});
|
|
|
|
test("vscode tokenized raw show route resolves reasoning and service-tier variants independently", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-raw-show-reasoning-tier" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-raw-show-reasoning-tier",
|
|
"machine-vscode-raw-show-reasoning-tier"
|
|
);
|
|
|
|
const response = await vscodeRawShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/raw/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "content-type": "application/json" },
|
|
body: JSON.stringify({ name: "cx/gpt-5.6-sol-low__tier_priority" }),
|
|
}),
|
|
{ params: { token: key.key } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.model, "cx/gpt-5.6-sol-low__tier_priority");
|
|
assert.equal(body.remote_model, "Codex GPT 5.6 Sol (Low) (Fast)");
|
|
assert.equal(body.selectedReasoningEffort, "low");
|
|
assert.equal(body.selected_reasoning_effort, "low");
|
|
assert.equal(body.details.selectedReasoningEffort, "low");
|
|
assert.equal(body.details.selected_reasoning_effort, "low");
|
|
});
|
|
|
|
test("vscode tokenized raw api/show does not resolve combo names", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-raw-show-no-combo" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-raw-show-no-combo",
|
|
"machine-vscode-raw-show-no-combo"
|
|
);
|
|
await combosDb.createCombo({
|
|
name: "raw-show-hidden-combo",
|
|
strategy: "priority",
|
|
models: [{ kind: "model", model: "codex/gpt-5.6-sol-high", providerId: "codex" }],
|
|
});
|
|
|
|
const response = await vscodeRawShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/raw/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "content-type": "application/json" },
|
|
body: JSON.stringify({ name: "raw-show-hidden-combo" }),
|
|
}),
|
|
{ params: { token: key.key } }
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 404);
|
|
assert.equal(body.error, "Model not found: raw-show-hidden-combo");
|
|
});
|
|
|
|
test("vscode tokenized raw version route returns Ollama-compatible version", async () => {
|
|
const response = await vscodeVersionRoute.GET();
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.match(body.version as string, /0\.6\.\d+/);
|
|
});
|
|
|
|
test("vscode tokenized models route prefixes the provider without duplicating brand names", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("gemini", { name: "gemini-vscode-models-labels" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-models-provider-prefix",
|
|
"machine-vscode-models-provider-prefix"
|
|
);
|
|
|
|
const response = await vscodeModelsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/models`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
const model = (body.data || []).find((entry: any) => entry.id === "gemini/gemini-2.5-pro");
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(model, "missing gemini/gemini-2.5-pro in tokenized VS Code models route");
|
|
assert.equal(model.name, "Gemini 2.5 Pro");
|
|
});
|
|
|
|
test("vscode tokenized tags route mirrors the Ollama tags payload", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("openai", { name: "openai-vscode-tags" });
|
|
const key = await apiKeysDb.createApiKey("vscode-tags", "machine-vscode-tags");
|
|
|
|
const response = await vscodeTagsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/tags`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(Array.isArray(body.models));
|
|
assert.ok(body.models.length > 0);
|
|
assert.equal(typeof body.models[0]?.name, "string");
|
|
});
|
|
|
|
test("vscode tokenized tags route exposes reasoning metadata for codex models", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-tags-reasoning" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-tags-reasoning",
|
|
"machine-vscode-tags-reasoning"
|
|
);
|
|
|
|
const response = await vscodeTagsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/tags`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
const model = (body.models || []).find((entry: any) => entry.name === "gpt-5.6-sol__provider_cx");
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(model, "missing gpt-5.6-sol__provider_cx in tokenized VS Code tags route");
|
|
assert.deepEqual(model.supportsReasoningEffort, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.deepEqual(model.supports_reasoning_effort, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.deepEqual(model.supportedReasoningEfforts, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.equal(model.defaultReasoningEffort, "low");
|
|
assert.equal(model.selectedReasoningEffort, "none");
|
|
assert.equal(model.selected_reasoning_effort, "none");
|
|
assert.equal(model.details.family, "gpt-5.6-sol");
|
|
assert.deepEqual(model.configurationSchema?.properties?.reasoningEffort?.enum, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.equal(model.configurationSchema?.properties?.reasoningEffort?.default, "low");
|
|
assert.deepEqual(model.details.configurationSchema?.properties?.reasoningEffort?.enum, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.deepEqual(model.details.supports_reasoning_effort, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.equal(model.details.selected_reasoning_effort, "none");
|
|
assert.ok(
|
|
!(body.models || []).some((entry: any) => entry.name === "cx/gpt-5.6-sol-low"),
|
|
"reasoning variant leaked into grouped VS Code tags route"
|
|
);
|
|
assert.ok(
|
|
!(body.models || []).some((entry: any) => entry.name === "cx/gpt-5.6-sol-low__tier_priority"),
|
|
"tier reasoning variant leaked into grouped VS Code tags route"
|
|
);
|
|
assert.ok(
|
|
(body.models || []).some(
|
|
(entry: any) => entry.name === "gpt-5.6-sol__provider_cx__tier_priority"
|
|
)
|
|
);
|
|
assert.ok(
|
|
(body.models || []).some((entry: any) => entry.name === "gpt-5.6-sol__provider_cx__tier_flex")
|
|
);
|
|
});
|
|
|
|
test("vscode tokenized tags route only exposes usable canonical chat models", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("openai", { name: "openai-vscode-tags-usable" });
|
|
const key = await apiKeysDb.createApiKey("vscode-tags-usable", "machine-vscode-tags-usable");
|
|
|
|
const tagsResponse = await vscodeTagsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/tags`)
|
|
);
|
|
const tagsBody = (await tagsResponse.json()) as any;
|
|
|
|
const modelsResponse = await vscodeModelsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/models`)
|
|
);
|
|
const modelsBody = (await modelsResponse.json()) as any;
|
|
const rawModelsResponse = await vscodeV1ModelsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/v1/models`)
|
|
);
|
|
const rawModelsBody = (await rawModelsResponse.json()) as any;
|
|
|
|
assert.equal(tagsResponse.status, 200);
|
|
assert.equal(modelsResponse.status, 200);
|
|
assert.equal(rawModelsResponse.status, 200);
|
|
|
|
const catalogById = new Map((modelsBody.data || []).map((model: any) => [model.id, model]));
|
|
const rawCatalogById = new Map((rawModelsBody.data || []).map((model: any) => [model.id, model]));
|
|
type CatalogLike = {
|
|
parent?: string | null;
|
|
type?: string;
|
|
api_format?: string;
|
|
supported_endpoints?: string[];
|
|
output_modalities?: string[];
|
|
};
|
|
|
|
for (const tagModel of tagsBody.models || []) {
|
|
const catalogModel = (catalogById.get(tagModel.name) || rawCatalogById.get(tagModel.name)) as
|
|
CatalogLike | undefined;
|
|
assert.ok(catalogModel, `missing catalog model for tag ${tagModel.name}`);
|
|
assert.ok(!catalogModel.parent, `tag ${tagModel.name} should not expose an alias child`);
|
|
assert.ok(
|
|
!catalogModel.type || catalogModel.type === "chat",
|
|
`tag ${tagModel.name} should be chat-capable`
|
|
);
|
|
assert.ok(
|
|
!catalogModel.api_format ||
|
|
["chat-completions", "responses", "openai-responses"].includes(catalogModel.api_format),
|
|
`tag ${tagModel.name} should use a text-generation API format`
|
|
);
|
|
assert.ok(
|
|
!Array.isArray(catalogModel.supported_endpoints) ||
|
|
catalogModel.supported_endpoints.includes("chat") ||
|
|
catalogModel.supported_endpoints.includes("responses"),
|
|
`tag ${tagModel.name} should support text generation`
|
|
);
|
|
assert.ok(
|
|
!Array.isArray(catalogModel.output_modalities) ||
|
|
catalogModel.output_modalities.includes("text"),
|
|
`tag ${tagModel.name} should output text`
|
|
);
|
|
}
|
|
|
|
const unusableCatalogModels = (modelsBody.data || []).filter(
|
|
(model: any) =>
|
|
model.parent ||
|
|
(typeof model.type === "string" && model.type !== "chat") ||
|
|
(typeof model.api_format === "string" &&
|
|
!["chat-completions", "responses", "openai-responses"].includes(model.api_format)) ||
|
|
(Array.isArray(model.supported_endpoints) &&
|
|
!model.supported_endpoints.includes("chat") &&
|
|
!model.supported_endpoints.includes("responses")) ||
|
|
(Array.isArray(model.output_modalities) && !model.output_modalities.includes("text"))
|
|
);
|
|
const tagNames = new Set((tagsBody.models || []).map((model: any) => model.name));
|
|
|
|
for (const model of unusableCatalogModels) {
|
|
assert.ok(!tagNames.has(model.id), `unusable model leaked into tags: ${model.id}`);
|
|
}
|
|
});
|
|
|
|
test("vscode tokenized grouped tags route does not publish combo entries", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-grouped-tags-no-combo" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-grouped-tags-no-combo",
|
|
"machine-vscode-grouped-tags-no-combo"
|
|
);
|
|
await combosDb.createCombo({
|
|
name: "grouped-hidden-combo",
|
|
strategy: "priority",
|
|
models: [{ kind: "model", model: "codex/gpt-5.6-sol-high", providerId: "codex" }],
|
|
});
|
|
|
|
const response = await vscodeTagsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/tags`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(Array.isArray(body.models));
|
|
assert.equal(
|
|
body.models.some((entry: any) => entry.name === "grouped-hidden-combo"),
|
|
false
|
|
);
|
|
});
|
|
|
|
test("vscode tokenized tags route prefers canonical codex models when codex is the only active provider", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-tags-canonical" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-tags-canonical",
|
|
"machine-vscode-tags-canonical"
|
|
);
|
|
|
|
const response = await vscodeTagsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/tags`)
|
|
);
|
|
const body = (await response.json()) as any;
|
|
const tagNames = (body.models || []).map((model: any) => model.name);
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.ok(tagNames.length > 0);
|
|
assert.ok(
|
|
tagNames.some((name: string) => name === "gpt-5.5__provider_cx"),
|
|
`missing family-first codex tag: ${tagNames.join(", ")}`
|
|
);
|
|
assert.ok(tagNames.includes("gpt-5.5__provider_cx"));
|
|
assert.ok(!tagNames.includes("cx/gpt-5.5"));
|
|
assert.ok(!tagNames.includes("cx/gpt-5.5-low"));
|
|
assert.ok(!tagNames.includes("cx/gpt-5.5-medium"));
|
|
assert.ok(!tagNames.includes("cx/gpt-5.5-high"));
|
|
assert.ok(!tagNames.includes("cx/gpt-5.5-xhigh"));
|
|
|
|
for (const name of tagNames) {
|
|
assert.ok(!name.startsWith("oc/"), `opencode tag leaked into codex-only endpoint: ${name}`);
|
|
}
|
|
});
|
|
|
|
test("vscode tokenized api/version route exposes Ollama compatibility version", async () => {
|
|
const response = await vscodeVersionRoute.GET();
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.version, "0.6.4");
|
|
});
|
|
|
|
test("vscode raw tokenized api/version route exposes Ollama compatibility version", async () => {
|
|
const response = await vscodeRawVersionRoute.GET();
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.version, "0.6.4");
|
|
});
|
|
|
|
test("vscode tokenized api/show route resolves a catalog model through the path token", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("openai", { name: "openai-vscode-show" });
|
|
const key = await apiKeysDb.createApiKey("vscode-show", "machine-vscode-show");
|
|
|
|
const modelsResponse = await vscodeV1ModelsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/v1/models`)
|
|
);
|
|
const modelsBody = (await modelsResponse.json()) as any;
|
|
const modelId = modelsBody.data?.[0]?.id;
|
|
|
|
assert.equal(modelsResponse.status, 200);
|
|
assert.equal(typeof modelId, "string");
|
|
|
|
const response = await vscodeShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({ name: modelId }),
|
|
})
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.modelfile, `FROM ${modelId}`);
|
|
assert.ok(Array.isArray(body.capabilities));
|
|
assert.ok(body.capabilities.includes("completion"));
|
|
});
|
|
|
|
test("vscode tokenized tags names stay resolvable by api/show", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("openai", { name: "openai-vscode-tags-show" });
|
|
const key = await apiKeysDb.createApiKey("vscode-tags-show", "machine-vscode-tags-show");
|
|
|
|
const tagsResponse = await vscodeTagsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/tags`)
|
|
);
|
|
const tagsBody = (await tagsResponse.json()) as any;
|
|
const tagModelName = tagsBody.models?.[0]?.name;
|
|
|
|
assert.equal(tagsResponse.status, 200);
|
|
assert.equal(typeof tagModelName, "string");
|
|
|
|
const showResponse = await vscodeShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({ model: tagModelName }),
|
|
})
|
|
);
|
|
const showBody = (await showResponse.json()) as any;
|
|
|
|
assert.equal(showResponse.status, 200);
|
|
assert.equal(showBody.modelfile, `FROM ${tagModelName}`);
|
|
});
|
|
|
|
test("vscode tokenized grouped api/show does not resolve combo names", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-grouped-show-no-combo" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-grouped-show-no-combo",
|
|
"machine-vscode-grouped-show-no-combo"
|
|
);
|
|
await combosDb.createCombo({
|
|
name: "grouped-show-hidden-combo",
|
|
strategy: "priority",
|
|
models: [{ kind: "model", model: "codex/gpt-5.6-sol-high", providerId: "codex" }],
|
|
});
|
|
|
|
const response = await vscodeShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({ name: "grouped-show-hidden-combo" }),
|
|
})
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 404);
|
|
assert.equal(body.error, "Model not found: grouped-show-hidden-combo");
|
|
});
|
|
|
|
test("vscode raw tokenized tags names stay resolvable by raw api/show", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("openai", { name: "openai-vscode-raw-tags-show" });
|
|
const key = await apiKeysDb.createApiKey("vscode-raw-tags-show", "machine-vscode-raw-tags-show");
|
|
|
|
const tagsResponse = await vscodeRawTagsRoute.GET(
|
|
new Request(`http://localhost/api/v1/vscode/raw/${encodeURIComponent(key.key)}/api/tags`),
|
|
{ params: { token: key.key } }
|
|
);
|
|
const tagsBody = (await tagsResponse.json()) as any;
|
|
const tagModelName = tagsBody.models?.[0]?.name;
|
|
|
|
assert.equal(tagsResponse.status, 200);
|
|
assert.equal(typeof tagModelName, "string");
|
|
|
|
const showResponse = await vscodeRawShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/raw/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({ model: tagModelName }),
|
|
}),
|
|
{ params: { token: key.key } }
|
|
);
|
|
const showBody = (await showResponse.json()) as any;
|
|
|
|
assert.equal(showResponse.status, 200);
|
|
assert.equal(showBody.modelfile, `FROM ${tagModelName}`);
|
|
});
|
|
|
|
test("vscode tokenized api/show route exposes explicit reasoning effort metadata", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-show-reasoning" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-show-reasoning",
|
|
"machine-vscode-show-reasoning"
|
|
);
|
|
|
|
const response = await vscodeShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({ name: "gpt-5.6-sol__provider_cx" }),
|
|
})
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.model, "gpt-5.6-sol__provider_cx");
|
|
assert.equal(body.remote_model, "Codex GPT 5.6 Sol (Default)");
|
|
assert.equal(body.details.family, "gpt-5.6-sol");
|
|
assert.deepEqual(body.supportsReasoningEffort, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.deepEqual(body.supports_reasoning_effort, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.deepEqual(body.supportedReasoningEfforts, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.equal(body.defaultReasoningEffort, "low");
|
|
assert.equal(body.selectedReasoningEffort, "none");
|
|
assert.equal(body.selected_reasoning_effort, "none");
|
|
assert.deepEqual(body.configurationSchema?.properties?.reasoningEffort?.enum, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.equal(body.configurationSchema?.properties?.reasoningEffort?.default, "low");
|
|
assert.equal(body.model_info["general.basename"], "Codex GPT 5.6 Sol (Default)");
|
|
assert.equal(body.model_info["general.architecture"], "codex");
|
|
assert.equal(body.model_info["codex.context_length"], 1050000);
|
|
assert.deepEqual(body.model_info.supports_reasoning_effort, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
assert.equal(body.model_info.selected_reasoning_effort, "none");
|
|
assert.deepEqual(body.model_info.capabilities.supports_reasoning_effort, [
|
|
"low",
|
|
"medium",
|
|
"high",
|
|
"xhigh",
|
|
"max",
|
|
"ultra",
|
|
]);
|
|
});
|
|
|
|
test("vscode tokenized api/show route exposes service tier variants with suffixed display names", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-show-tier-priority" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-show-tier-priority",
|
|
"machine-vscode-show-tier-priority"
|
|
);
|
|
|
|
const response = await vscodeShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({ name: "gpt-5.6-sol__provider_cx__tier_priority" }),
|
|
})
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.model, "gpt-5.6-sol__provider_cx__tier_priority");
|
|
assert.equal(body.remote_model, "Codex GPT 5.6 Sol (Fast)");
|
|
assert.equal(body.details.family, "gpt-5.6-sol");
|
|
});
|
|
|
|
test("vscode tokenized chat routes rewrite family-first ids back to the codex provider id", async () => {
|
|
const payload = serviceTierVariants.resolveVscodeServiceTierRequest({
|
|
model: "gpt-5.6-sol__provider_cx__tier_priority",
|
|
});
|
|
|
|
assert.equal(payload.model, "cx/gpt-5.6-sol");
|
|
assert.equal(payload.service_tier, "priority");
|
|
});
|
|
|
|
test("vscode tokenized /chat/completions route applies the path token and codex tier rewrite", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-chat-completions-route",
|
|
"machine-vscode-chat-completions-route"
|
|
);
|
|
|
|
const response = await vscodeChatCompletionsRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/chat/completions`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({
|
|
model: "gpt-5.6-sol__provider_cx__tier_priority",
|
|
messages: [{ role: "user", content: "hi" }],
|
|
max_tokens: 1,
|
|
stream: false,
|
|
}),
|
|
})
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
// Upstream port decolua/9router#336: zero-active-credentials now surfaces as
|
|
// 404 (combo-fallbackable) instead of 400 (combo hard-stop). The 404 OpenAI
|
|
// error code mapping is "model_not_found" (open-sse/config/errorConfig.ts:29).
|
|
assert.equal(response.status, 404);
|
|
assert.equal(body.error?.code, "model_not_found");
|
|
assert.equal(body.error?.message, "No active credentials for provider: codex.");
|
|
});
|
|
|
|
test("vscode tokenized /responses route applies the path token and codex tier rewrite", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-responses-route",
|
|
"machine-vscode-responses-route"
|
|
);
|
|
|
|
const response = await vscodeResponsesRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/responses`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({
|
|
model: "gpt-5.6-sol__provider_cx__tier_priority",
|
|
input: [{ role: "user", content: [{ type: "input_text", text: "hi" }] }],
|
|
max_output_tokens: 1,
|
|
stream: false,
|
|
}),
|
|
})
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
// Upstream port decolua/9router#336: see chat/completions sibling test above.
|
|
assert.equal(response.status, 404);
|
|
assert.equal(body.error?.code, "model_not_found");
|
|
assert.equal(body.error?.message, "No active credentials for provider: codex.");
|
|
});
|
|
|
|
test("vscode tokenized api/show route preserves the selected reasoning effort for codex variants", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-show-reasoning-low" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-show-reasoning-low",
|
|
"machine-vscode-show-reasoning-low"
|
|
);
|
|
|
|
const response = await vscodeShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({ name: "cx/gpt-5.6-sol-low" }),
|
|
})
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.model_info.selected_reasoning_effort, "low");
|
|
assert.equal(body.model_info.capabilities.selected_reasoning_effort, "low");
|
|
});
|
|
|
|
test("vscode tokenized api/show route resolves canonical family aliases", async () => {
|
|
await settingsDb.updateSettings({
|
|
requireLogin: true,
|
|
password: "hashed-password",
|
|
requireAuthForModels: true,
|
|
});
|
|
await seedConnection("codex", { name: "codex-vscode-show-family-alias" });
|
|
const key = await apiKeysDb.createApiKey(
|
|
"vscode-show-family-alias",
|
|
"machine-vscode-show-family-alias"
|
|
);
|
|
|
|
const response = await vscodeShowRoute.POST(
|
|
new Request(`http://localhost/api/v1/vscode/${encodeURIComponent(key.key)}/api/show`, {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify({ name: "gpt-5.6-sol" }),
|
|
})
|
|
);
|
|
const body = (await response.json()) as any;
|
|
|
|
assert.equal(response.status, 200);
|
|
assert.equal(body.model, "gpt-5.6-sol");
|
|
assert.equal(body.details.family, "gpt-5.6-sol");
|
|
});
|
|
|
|
test("vscode tokenized v1 chat route is exposed under the tokenized base path", async () => {
|
|
const response = await vscodeV1ChatCompletionsRoute.OPTIONS();
|
|
|
|
assert.equal(response.status, 204);
|
|
assert.match(response.headers.get("Access-Control-Allow-Methods") || "", /POST/);
|
|
});
|