mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-07-31 20:32:20 +03:00
* chore(release): open v3.8.27 development cycle * fix(security): polynomial ReDoS in comboAgentMiddleware regex (#3982) * fix(security): eliminate polynomial ReDoS in comboAgentMiddleware <omniModel> regex (CodeQL js/polynomial-redos) CACHE_TAG_PATTERN wrapped the tag in an unbounded `(?:\\n|\n|\r)*` prefix/suffix. On an unanchored `.test()`/`.exec()` that is O(n²) on inputs with many newlines (CodeQL js/polynomial-redos, alerts #612/#613). The surrounding runs are irrelevant to detecting/capturing the tag, so the detection pattern now matches only the core `<omniModel>([^<]+)</omniModel>`; the global strip pattern still consumes the wrapping newlines (combo.ts streaming, #531) but BOUNDED ({0,16}) so it stays linear. Behavior preserved: detection, model extraction, multi-tag stripping (#454) and blank-line cleanup all unchanged (107 related tests green). Adds ReDoS-safety regression tests (50k-newline inputs complete in <1ms). * docs(changelog): add #3982 ReDoS fix to [3.8.27] * ci(security): harden workflows — artipacked persist-credentials + cache-poisoning + SC2086 (#3965) * Refine provider quota card display (#3969) Integrated into release/v3.8.27 * feat: add sidebar group separator toggles (#3971) Integrated into release/v3.8.27 * Gate control-plane proxy direct fallback (#3963) Integrated into release/v3.8.27 * Capture actual upstream provider requests (#3941) Integrated into release/v3.8.27 * ci(quality): flip require-tighten + osv + Trivy to blocking (v3.8.27 cycle-end) (#3984) * fix(resilience): respect connection cooldown stored as numeric epoch (#3954) (#3995) rate_limited_until is a TEXT column, but setConnectionRateLimitUntil (Antigravity full-quota path) persists a raw epoch number that SQLite coerces to a numeric string ("1781696905131.0"). The selection predicate isAccountUnavailable then did new Date("1781696905131.0") -> NaN, so the cooling connection was never skipped and the router kept dispatching to rate-limited accounts. Normalize numeric-epoch strings (and number/Date/ISO) via a shared cooldownUntilMs() helper in isAccountUnavailable / getEarliestRateLimitedUntil / filterAvailableAccounts / parseFutureDateMs. ISO behavior preserved. * fix(providers): fetch live /models for LLM7 and BytePlus (#3976) (#3996) llm7 and byteplus carry a real modelsUrl but were not classified by any live-fetch branch of the model-import route, so their hardcoded 4-entry registry catalog was served (source local_catalog) instead of the upstream catalog. Add both to NAMED_OPENAI_STYLE_PROVIDERS so the route probes <baseUrl>/models and serves the live list, falling back to the local catalog only on fetch failure. * fix(dashboard): logs auto-refresh reads live visibility, not a stale mount ref (#3972) (#3997) The auto-refresh interval gated each tick on visibleRef, seeded once at mount and updated only by a visibilitychange event. A tab mounted while document.visibilityState is 'hidden' (background load, bfcache, embedded/proxied webviews) with no later visibilitychange left the ref false forever, so the interval ticked but never fetched — only the manual button worked. Read the live document.visibilityState in the tick instead. * feat(compression): add Indonesian caveman rules and language pack (#3975) Integrated into release/v3.8.27 (cherry picked from commitc9b5b1a892) * fix(combo): shuffle strict-random fallback remainder to spread load (#3959) (#3998) strict-random shuffled only the deck-selected slot 0 and left the fallback remainder in fixed priority order, so after a failing deck pick the chain always fell through to the same top-priority model — a persistently-failing model was retried on essentially every request and fallback load never spread across peers. Shuffle the remainder too (like the random strategy). * Add provider auth visibility controls (#3953) Integrated into release/v3.8.27 * fix(claude): forward client tool-search-tool anthropic-beta on the Claude OAuth path (#3974) (#3999) The client-negotiated anthropic-beta: tool-search-tool-2025-10-19 was dropped on both Claude code paths (default executor rebuilt from static ANTHROPIC_BETA_CLAUDE_OAUTH; selectBetaFlags only read the client beta to gate thinking/effort), so claude.ai rejected deferred-tool requests with 400 'Tool reference not found'. Add an allowlist-merge (mergeClientAnthropicBeta) that unions the client's allowlisted betas into the outbound set on both paths, preserving #3415 (no forced thinking/effort). * feat(providers): add model search filter to provider dashboard (#3950) Integrated into release/v3.8.27 * fix(vision-bridge): force bridge for tokenrouter deepseek models (#3946) Integrated into release/v3.8.27 * fix(executor): strip stream_options on non-streaming requests (#3884) (#4000) Clients that send stream_options:{include_usage:true} regardless of stream (e.g. the OpenAI Python SDK) had it passed through on non-streaming calls; NVIDIA NIM rejected it with 400 'Stream options can only be defined when stream=True'. DefaultExecutor.transformRequest only injected/cleared stream_options on the streaming branch and never stripped a client-sent value when stream=false. Add a !stream strip branch; the streaming injection path is unchanged. Global to openai-compat providers. * fix(qwen-web): cookie validation false-positive - check response body for user object (#3958) Integrated into release/v3.8.27 * fix(db): persist backup retention days (#3970) Integrated into release/v3.8.27 * 大量UI显示和i18n优化 (#3973) Integrated into release/v3.8.27 * deps: bump the npm_and_yarn group across 1 directory with 2 updates (#3943) Integrated into release/v3.8.27 * deps: bump form-data from 4.0.5 to 4.0.6 (#3944) Integrated into release/v3.8.27 * deps: bump vite from 8.0.5 to 8.0.16 (#3942) Integrated into release/v3.8.27 * chore(quality): re-baseline validation.ts 4407->4428 (#3958 qwen body-check) The qwen-web validation body-check merged in #3958 pushed validation.ts past its frozen size on the integrated release tip. Bump the baseline with justification; no logic is separately extractable from the existing qwen-web validation branch. * deps: bump the production group with 13 updates (#3915) Integrated into release/v3.8.27 — low-risk group (playwright 1.60→1.61 minor + transitive patches; fumadocs-core 16.9→16.10 minor). * chore(deps): ignore jscpd major bumps (v5 Rust rewrite breaks the duplication gate) Our duplication ratchet (scripts/check/check-duplication.mjs) is pinned to jscpd@4 and parses jscpd-report.json against a frozen baseline. jscpd v5 is a native Rust binary with no Node.js API and a different report/bin, so a major bump would break the gate. Migrate deliberately, not via dependabot. Closes the noise from #3916. * fix(perplexity-web): parse schematized diff_block stream so answers aren't empty (#4001) Integrated into release/v3.8.27 — schematized diff_block parsing follow-up to #3938. * refactor: modularize providerRegistry.ts into 159 individual provider plugins (#3993) Modularize provider registry (#3594). Integrated into release/v3.8.27 after rebase + behavior-preservation verification (provider-consistency gate 159/232/0, typecheck, registry tests, build 556/556). Co-authored-by: diegosouzapw <diegosouza.pw@gmail.com> * fix(registry): restore byteplus + mimocode dropped by #3993 modularization The provider-registry modularization (#3993) was cut from a base predating the byteplus (#3877) and mimocode (#3837) registry entries, so merging it silently dropped both providers (getRegistryEntry returned undefined → validation reported 'not supported'). Re-add them as registry modules in the new structure; registered count 159→161, provider-consistency 161/232/0. Also align the pre-existing qwen-web validator test to #3958: since the validator now requires a real `user` object in the 200 body, the mock must carry one. * refactor: modularize schemas (non-stacked) (#3988) Modularize validation schemas (#3594). Integrated into release/v3.8.27 after rebase (reconciled the merged hiddenSidebarGroupLabels #3971 + intelligenceSyncRequestSchema into the new modules) + behavior verification (typecheck, 195 schema/settings/validation tests, build 556/556). Co-authored-by: diegosouzapw <diegosouza.pw@gmail.com> * fix(default-executor): honor custom providerSpecificData.baseUrl for OpenAI-format providers (#4002) Integrated into release/v3.8.27 — honor custom providerSpecificData.baseUrl in DefaultExecutor (openai-format), tested. * feat(openai): honor custom base URL in model discovery + complete openai/codex pricing (#4005) Integrated into release/v3.8.27 — openai model-discovery honors custom base URL (SSRF-guarded) + pricing rows for new openai/codex models. Tested + baselines bumped. * fix(live-ws): bridge sidecar events to dashboard (#4004) Integrated into release/v3.8.27 — repair LiveWS sidecar (startup, same-origin /live-ws, main→sidecar compression.completed bridge, early-msg queue). Fixed the cookie-parse regex (\s) + added a focused unit test; baseline bumped for the non-blocking chatCore bridge. * docs(troubleshooting): note MITM proxy cannot intercept Windows-host apps under WSL (#4003) Integrated into release/v3.8.27 — MITM/WSL troubleshooting note. * fix(repo): untrack accidentally-committed root node_modules symlink + gitignore it A worktree node_modules symlink (-> the main checkout's node_modules) was staged by a `git add -A` during the #3988 merge and committed into05213ac6a. The symlink points at the repo's own node_modules path, so checking it out turns the main checkout's node_modules into a self-referential symlink (breaking tsx/all node ops). Untrack it and add a root-anchored /node_modules ignore so the symlink form can't be re-committed (the existing 'node_modules/' only matches directories). * fix(quality): allowlist socks dep (declared by #4004, never allowlisted) socks@^2.8.7 was added to package.json in #4004 (LiveWS sidecar,02302131f) as a phantom-dep cleanup but never added to dependency-allowlist.json, so check:deps has been red on the release tip ever since. socks is the standard SOCKS proxy client (dep of fetch-socks), legitimate and years old. * feat(sse): real LLMLingua-2 ONNX compression engine (stable) (#4014) Integrated into release/v3.8.27. Adjustments before merge: - Synced with the current release tip (was 11 commits behind). - Added the 3 LLMLingua-2 ONNX optional-runtime deps to dependency-allowlist.json (@atjsh/llmlingua-2, @tensorflow/tfjs, js-tiktoken) — the only gate that was red. - socks was allowlisted directly on release (separate fix d7db5c73d; it was declared by #4004 but never allowlisted, leaving check:deps red release-wide). Verified locally: check:deps OK, file-size OK, public-creds OK, provider-consistency 161/232/0, typecheck:core clean, 24/24 LLMLingua tests pass. The only remaining Fast-QG red is the pre-existing #3972 orphan test (request-logger-autorefresh-visibility-3972.test.tsx), which is release-wide and unrelated to this PR. * test(dashboard): rehome #3972 logs auto-refresh test so a runner collects it tests/unit/request-logger-autorefresh-visibility-3972.test.tsx (added by #3972 via #3997) sat at the top level of tests/unit/ as a .tsx vitest test, which NO runner collects: the node runner only globs *.test.ts, and test:vitest:ui only runs tests/unit/ui. So the #3972 regression guard never executed in CI and check:test-discovery was red release-wide. Move it under tests/unit/ui/ (the collected vitest:ui path) and fix the relative import depth. Verified: the test now runs and passes (2/2), and check:test-discovery is green. * feat(compression): capture per-engine analytics (#3960) + Lite schema fix (#3952) (#4018) Captures the net-new value from #3960 (per-engine breakdown analytics) and #3952 (Lite engine schema fix) onto release/v3.8.27. Fast QG green; 622/622 compression+analytics tests pass. * fix(sse): guard model-less registry entries in getUnsupportedParams (mimocode) (#4015) Real bugfix: guard model-less registry entries (mimocode) in getUnsupportedParams so handleChatCore no longer throws 'entry.models is not iterable' / reports 'All models failed' for unrelated requests. Includes a regression test. Fast QG green. * feat(ci): Quality Gate v2 — Onda 0 + Onda 1 (gate flips, TIA, SAST, DAST-smoke, mutation infra) (#4016) * docs(ops): add quality-gate assessment + replication playbook (Fase 9 foundation) * feat(ci): flip oasdiff breaking-change gate to blocking (ratchet) * docs(ops): deliver main branch-protection ruleset for owner to apply * fix(ci): run typecheck:core in PR->release fast-gates (close fast-gates hole, part 1) * perf(mutation): enable Stryker incremental mode + cache (scales the 60/80 rollout) * feat(ci): commit CodeQL advanced config (security-extended), replacing default-setup * feat(ci): version semgrep SAST workflow (owasp/secrets), advisory * feat(quality): TIA test-impact map builder (import-graph; map built at runtime, gitignored) * feat(quality): TIA impacted-test selector with run-all fail-safe * fix(ci): run TIA-impacted unit tests in PR->release fast-gates (build map at runtime, fail-safe full) * feat(ci): DAST-smoke per-PR (schemathesis subset + promptfoo injection-guard, blocking) * fix(ci): unbreak Fase 9 PR CI (MDX frontmatter, CodeQL conflict, dast-smoke advisory) - Add MDX frontmatter to docs/ops/{BRANCH_PROTECTION_MAIN,QUALITY_GATE_PLAYBOOK}.md. fumadocs rejects frontmatter-less docs -> 'npm run build' failed -> broke dast-smoke's build step (the release fast-gates never runs build, so this only surfaced on the PR). - codeql.yml: workflow_dispatch-only until the owner switches repo CodeQL Default->Advanced (advanced configs cannot be processed while default setup is enabled; documented inline). - dast-smoke.yml: job-level continue-on-error (advisory) so this brand-new gate matures before it blocks (repo convention: advisory -> blocking). * ci(quality): make TIA unit-test step advisory until release test-debt is cleared release/v3.8.27 carries ~17 pre-existing failing unit tests (budget #3537, apiKey #3552, several Zod schemas, Puter/Qwen executors, mimocode entry, etc.) unrelated to this PR — the new 'run tests on PR->release' gate surfaced them. Per the repo's advisory->blocking convention, this step enters advisory (it still runs + reports) so pre-existing debt doesn't block the gate program. typecheck:core stays blocking. Flip to blocking (remove continue-on-error) once the release suite is green. * fix(sse): preserve Kiro streaming finish_reason tool_calls (#3980) (#4025) * fix(guardrails): preserve original image when vision-bridge describe fails (#4012) (#4026) * feat(api): advertise combo capabilities on import surfaces (#3979) (#4027) * feat(sse): delegated Anthropic Context Editing for Claude (clear_tool_uses) (#4021) Opt-in Claude-only delegated compression: injects context_management.clear_tool_uses_20250919 at the Claude pre-serialization chokepoint (composes with clear_thinking, thinking first), threaded via ExecuteInput from handleChatCore. Pure edit-builder + 11 tests (7 unit + 4 e2e fetch-capture). Beta context-management-2025-06-27 already advertised; allowlist done. Telemetry/400-fallback/claude-web coverage deferred. * fix(opencode): map x-session-affinity to x-opencode-session for custom providers (#4022) (#4028) * fix(dashboard): Playground Compare tab loading + HTTP method guard (#4024) randomUUID non-HTTPS fallback + static CompareTab import; raw HTTP TRACE->405 method guard wired into dev + standalone servers. Integrated into release/v3.8.27. * refactor(dashboard): settings UI layout + API Keys naming (#4020) Presentation/relabel refactor of the Settings dashboard (API Manager -> API Keys), card relocations, Toggle adoption, present-but-disabled engine steps. Auth-file changes are string/comment-only (no behavior change). Integrated into release/v3.8.27. * fix: restore unit regressions dropped by lossy schema/registry modularizations (#4030) Restores schema fields (combo reasoningTokenBuffer, budget-0 #3537, openrouter preset, proxy family #3777, resilience degradation/providerCooldown), qwen-web v2 endpoint+catalog, mimocode models key — all dropped by #3988/#3993 — and aligns 3 tests to #3941/#3993. Verified: 8 failing regression tests on release tip -> 131/131 green on this branch. Integrated into release/v3.8.27. * fix(api): return 400 (not 500) for malformed JSON on /api/auth/login (#4031) Wrap request.json() so a malformed/non-JSON login body returns a structured 400 instead of falling through to the 500 catch. Fixes the schemathesis high-risk-endpoint DAST finding (verified: schemathesis step now passes). +TDD test. Integrated into release/v3.8.27. * feat(dashboard): real circuit-breaker state in the Combo Live cascade (U1b) (#4029) Overlays real provider circuit-breaker state (GET /api/monitoring/health) onto the Combo Live cascade as a 'CB: OPEN · 41s' badge. Pure enrichRunWithBreakers + fail-soft useProviderBreakerHealth poll; graceful when health is absent. +13 tests. Integrated into release/v3.8.27. * Fix promptfoo security assertion parsing (#4032) * chore(deps): dependabot security bumps + drop unused gray-matter (#4036) Integrated into release/v3.8.27 — dependabot security bumps (form-data/js-yaml/protobufjs/dompurify/hono) + drop unused gray-matter. Unblocks the npm audit:deps gate (Lint) branch-wide. * fix(ci): scope TIA to node:test unit files only (mirror test:unit glob) (#4035) Integrated into release/v3.8.27 — scopes the advisory TIA step to the test:unit node:test glob, fixing the 99 false failures. +4 TDD. * Refine compression settings, storage labels, and sidebar grouping (#4033) Integrated into release/v3.8.27 — relocate Token Saver into Compression Settings (controlled component), reorder Security/Authz tabs, storage labels + i18n relabel. Thanks @rdself! * [codex] add per-key local usage command (#4034) Integrated into release/v3.8.27 — per-key local @@om-usage command (cached quota, no upstream routing). Rebased onto modularized schemas/keys.ts + file-size rebaseline. Thanks @Witroch4! * chore(release): reconcile v3.8.27 CHANGELOG + i18n mirrors * ci(quality): unblock v3.8.27 release gates (zizmor pin + test-masking allowlist) - zizmor ratchet (151→139, no regression): SHA-pin every action ref ADDED this cycle — codeql/dast-smoke/semgrep (3 new workflows) + trivy-action (docker-publish) + actions/cache (nightly-mutation). Pre-existing tag refs keep the repo convention. - test-masking: add config/quality/test-masking-allowlist.json + allowlist support in check-test-masking.mjs (exempts ONLY the net-assert-reduction signal; tautology/skip/ deletion still fire). Allowlists 2 verified-legitimate reductions: appearance-widget-settings-schema (#4033 removed showTokenSaverOnEndpoint field) and dashboard-shell-tabs (#3973 tabs→redirect refactor, asserts replaced). +4 gate tests. * test(quality): reword test-masking self-test comments to avoid literal masking patterns The added allowlist-test comments contained the literal strings 'assert.ok(true)' and '.skip' which the masking detector's own regexes match as text — making the gate flag its own test file (net +1 tautology/skip/extended-tautology vs main). Reworded to plain prose ('a new tautology', 'a new skip marker'); test logic unchanged (24/24 pass). * fix(quality): unblock v3.8.27 release — align 3 stale tests + restore modularized settings-schema parity Release-PR full CI surfaced 3 deterministic test failures (no live product regression), all stale vs legitimate cycle changes: - settings-schema parity (#3988): the modularized updateSettingsSchema barrel (schemas/settings.ts) had diverged from the canonical settingsSchemas.ts (45 vs 85 fields — 40 dropped + 6 extra), a lossy-modularization dead-code copy. Re-export from the canonical source so the barrel can never diverge again (runtime already uses canonical). Parity test now passes. - api-manager permissions modal: #4034 added a 4th self-service switch (per-key usage allowance); a11y invariant (every switch type="button") still holds. Updated the static count 3 -> 4. - pack-artifact policy: dist/http-method-guard.cjs became a required runtime path; added it to the test's expected missing-paths list. Also documents the gate gap for Fase 9 (QUALITY_GATE_PLAYBOOK Parte 6): G1 run the deterministic unit layer + test-masking on PR->release (not just PR->main), G2 a modularization-parity gate (would have caught the #3988 drop at its PR), G3 flake quarantine. Env flakes (LiveWS startup timeout, integration server-startup cascade) are pre-existing/CI-env, triaged separately. --------- Co-authored-by: Randi <55005611+rdself@users.noreply.github.com> Co-authored-by: Veier04 <118300867+Veier04@users.noreply.github.com> Co-authored-by: Felipe Sartori <felipesartori.ti@gmail.com> Co-authored-by: WormAlien <164898390+WormAlien@users.noreply.github.com> Co-authored-by: thezukiru <121331256+thezukiru@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: NOXX - Commiter <artur1992123@mail.ru> Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com> Co-authored-by: Demiurge The Single <megamen932@gmail.com> Co-authored-by: Witroch4 <witalo_rocha@hotmail.com>
1336 lines
42 KiB
TypeScript
1336 lines
42 KiB
TypeScript
import test from "node:test";
|
|
import assert from "node:assert/strict";
|
|
|
|
import {
|
|
CodexExecutor,
|
|
__setCodexWebSocketTransportForTesting,
|
|
encodeResponseSseEvent,
|
|
getCodexModelScope,
|
|
getCodexRateLimitKey,
|
|
getCodexResetTime,
|
|
getCodexUpstreamModel,
|
|
isCodexResponsesWebSocketRequired,
|
|
parseCodexQuotaHeaders,
|
|
} from "../../open-sse/executors/codex.ts";
|
|
import {
|
|
clearRememberedResponseFunctionCallsForTesting,
|
|
rememberResponseConversationState,
|
|
rememberResponseFunctionCalls,
|
|
} from "../../open-sse/services/responsesToolCallState.ts";
|
|
import { sanitizeReasoningEffortForProvider } from "../../open-sse/executors/base.ts";
|
|
import {
|
|
DEFAULT_THINKING_CONFIG,
|
|
setThinkingBudgetConfig,
|
|
ThinkingMode,
|
|
} from "../../open-sse/services/thinkingBudget.ts";
|
|
import { runWithCapture } from "../../open-sse/utils/providerRequestLogging.ts";
|
|
import { CODEX_CHAT_DEFAULT_INSTRUCTIONS } from "../../open-sse/config/codexInstructions.ts";
|
|
|
|
type MockCodexWebSocket = {
|
|
send: (data: string) => void;
|
|
close: (code?: number, reason?: string) => void;
|
|
onmessage: ((event: { data: unknown }) => void) | null;
|
|
onerror: ((event: { message?: string }) => void) | null;
|
|
onclose: (() => void) | null;
|
|
};
|
|
|
|
function getRecord(value: unknown): Record<string, unknown> {
|
|
assert.equal(typeof value, "object");
|
|
assert.notEqual(value, null);
|
|
assert.equal(Array.isArray(value), false);
|
|
return value as Record<string, unknown>;
|
|
}
|
|
|
|
test.afterEach(() => {
|
|
setThinkingBudgetConfig(DEFAULT_THINKING_CONFIG);
|
|
__setCodexWebSocketTransportForTesting(undefined);
|
|
});
|
|
|
|
async function withEnv<T>(entries: Record<string, string | undefined>, fn: () => T | Promise<T>) {
|
|
const previous = new Map();
|
|
|
|
for (const [key, value] of Object.entries(entries)) {
|
|
previous.set(key, process.env[key]);
|
|
if (value === undefined) {
|
|
delete process.env[key];
|
|
} else {
|
|
process.env[key] = value;
|
|
}
|
|
}
|
|
|
|
try {
|
|
return await fn();
|
|
} finally {
|
|
for (const [key, value] of previous.entries()) {
|
|
if (value === undefined) {
|
|
delete process.env[key];
|
|
} else {
|
|
process.env[key] = value;
|
|
}
|
|
}
|
|
}
|
|
}
|
|
|
|
test("Codex helper functions isolate rate-limit scopes and parse quota headers", () => {
|
|
const quota = parseCodexQuotaHeaders({
|
|
"x-codex-5h-usage": "100",
|
|
"x-codex-5h-limit": "500",
|
|
"x-codex-5h-reset-at": new Date(Date.now() + 60_000).toISOString(),
|
|
"x-codex-7d-usage": "1000",
|
|
"x-codex-7d-limit": "5000",
|
|
"x-codex-7d-reset-at": new Date(Date.now() + 120_000).toISOString(),
|
|
});
|
|
|
|
assert.equal(getCodexModelScope("codex-spark-mini"), "spark");
|
|
assert.equal(getCodexModelScope("gpt-5.3-codex"), "codex");
|
|
assert.equal(getCodexModelScope("gpt-5.5-xhigh"), "codex");
|
|
assert.equal(getCodexUpstreamModel("gpt-5.5-xhigh"), "gpt-5.5");
|
|
assert.equal(getCodexUpstreamModel("gpt-5.5-medium"), "gpt-5.5");
|
|
// With mock WS transport + codexTransport=websocket, gpt-5.5 models require WS
|
|
__setCodexWebSocketTransportForTesting(
|
|
async (): Promise<MockCodexWebSocket> => ({
|
|
send() {},
|
|
close() {},
|
|
onmessage: null,
|
|
onerror: null,
|
|
onclose: null,
|
|
})
|
|
);
|
|
assert.equal(
|
|
isCodexResponsesWebSocketRequired("gpt-5.5-xhigh", {
|
|
providerSpecificData: { codexTransport: "websocket" },
|
|
}),
|
|
true
|
|
);
|
|
assert.equal(
|
|
isCodexResponsesWebSocketRequired("gpt-5.5-medium", {
|
|
providerSpecificData: { codexTransport: "websocket" },
|
|
}),
|
|
true
|
|
);
|
|
// Without codexTransport setting, defaults to HTTP (false)
|
|
assert.equal(isCodexResponsesWebSocketRequired("gpt-5.5-xhigh", {}), false);
|
|
assert.equal(isCodexResponsesWebSocketRequired("gpt-5.5-medium", {}), false);
|
|
__setCodexWebSocketTransportForTesting(undefined);
|
|
assert.equal(getCodexRateLimitKey("acct-1", "codex-spark-mini"), "acct-1:spark");
|
|
assert.equal(quota.usage5h, 100);
|
|
assert.equal(quota.limit7d, 5000);
|
|
assert.ok(getCodexResetTime(quota) >= new Date(quota.resetAt7d).getTime());
|
|
});
|
|
|
|
test("isCodexResponsesWebSocketRequired: OMNIROUTE_CODEX_WS_ENABLED=false forces HTTP even with codexTransport=websocket", () => {
|
|
// Transport available + per-connection opt-in would normally enable WS…
|
|
__setCodexWebSocketTransportForTesting(
|
|
() =>
|
|
({
|
|
send() {},
|
|
close() {},
|
|
onmessage: null,
|
|
onopen: null,
|
|
onerror: null,
|
|
onclose: null,
|
|
}) as unknown as ReturnType<typeof Object>
|
|
);
|
|
const prev = process.env.OMNIROUTE_CODEX_WS_ENABLED;
|
|
process.env.OMNIROUTE_CODEX_WS_ENABLED = "false";
|
|
try {
|
|
// …but the global kill-switch (default ON) overrides it to false.
|
|
assert.equal(
|
|
isCodexResponsesWebSocketRequired("gpt-5.5-xhigh", {
|
|
providerSpecificData: { codexTransport: "websocket" },
|
|
}),
|
|
false
|
|
);
|
|
} finally {
|
|
if (prev === undefined) delete process.env.OMNIROUTE_CODEX_WS_ENABLED;
|
|
else process.env.OMNIROUTE_CODEX_WS_ENABLED = prev;
|
|
__setCodexWebSocketTransportForTesting(undefined);
|
|
}
|
|
});
|
|
|
|
test("CodexExecutor.buildUrl honors /responses subpaths and compact mode", () => {
|
|
const executor = new CodexExecutor();
|
|
|
|
assert.equal(
|
|
executor.buildUrl("gpt-5.3-codex", true, 0, {}),
|
|
"https://chatgpt.com/backend-api/codex/responses"
|
|
);
|
|
assert.equal(
|
|
executor.buildUrl("gpt-5.3-codex", true, 0, { requestEndpointPath: "/responses" }),
|
|
"https://chatgpt.com/backend-api/codex/responses"
|
|
);
|
|
assert.equal(
|
|
executor.buildUrl("gpt-5.3-codex", true, 0, { requestEndpointPath: "/responses/compact" }),
|
|
"https://chatgpt.com/backend-api/codex/responses/compact"
|
|
);
|
|
});
|
|
|
|
test("CodexExecutor.buildHeaders binds workspace ids and disables SSE accept for compact responses", () => {
|
|
const executor = new CodexExecutor();
|
|
const standardHeaders = executor.buildHeaders(
|
|
{
|
|
accessToken: "codex-token",
|
|
providerSpecificData: { workspaceId: "workspace-1" },
|
|
},
|
|
true
|
|
);
|
|
const compactHeaders = executor.buildHeaders(
|
|
{
|
|
accessToken: "codex-token",
|
|
requestEndpointPath: "/responses/compact",
|
|
},
|
|
true
|
|
);
|
|
|
|
assert.equal(standardHeaders.Authorization, "Bearer codex-token");
|
|
assert.equal(standardHeaders.Accept, "text/event-stream");
|
|
assert.equal(standardHeaders["chatgpt-account-id"], "workspace-1");
|
|
assert.equal(standardHeaders.Version, "0.132.0");
|
|
assert.equal(standardHeaders["Openai-Beta"], "responses=experimental");
|
|
assert.equal(standardHeaders["X-Codex-Beta-Features"], "responses_websockets");
|
|
assert.equal(standardHeaders["User-Agent"], "codex-cli/0.132.0 (Windows 10.0.26200; x64)");
|
|
assert.equal(compactHeaders.Accept, "application/json");
|
|
});
|
|
|
|
test("CodexExecutor.buildHeaders honors safe env overrides for Version and User-Agent", async () => {
|
|
const executor = new CodexExecutor();
|
|
|
|
await withEnv(
|
|
{
|
|
CODEX_CLIENT_VERSION: "0.132.0",
|
|
CODEX_USER_AGENT: undefined,
|
|
},
|
|
() => {
|
|
const headers = executor.buildHeaders({ accessToken: "codex-token" }, true);
|
|
assert.equal(headers.Version, "0.132.0");
|
|
assert.equal(headers["User-Agent"], "codex-cli/0.132.0 (Windows 10.0.26200; x64)");
|
|
}
|
|
);
|
|
|
|
await withEnv(
|
|
{
|
|
CODEX_CLIENT_VERSION: "bad version value",
|
|
CODEX_USER_AGENT: "custom-codex/9.9.9",
|
|
},
|
|
() => {
|
|
const headers = executor.buildHeaders({ accessToken: "codex-token" }, true);
|
|
assert.equal(headers.Version, "0.132.0");
|
|
assert.equal(headers["User-Agent"], "custom-codex/9.9.9");
|
|
}
|
|
);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest injects default instructions, clamps reasoning and strips unsupported fields", () => {
|
|
const executor = new CodexExecutor();
|
|
const body = {
|
|
model: "gpt-5-mini",
|
|
messages: [{ role: "user", content: "hello" }],
|
|
tools: [{ type: "function", function: { name: "test_tool" } }],
|
|
prompt: "legacy",
|
|
stream_options: { include_usage: true },
|
|
instructions: "",
|
|
reasoning_effort: "xhigh",
|
|
service_tier: "fast",
|
|
temperature: 0.4,
|
|
user: "cursor",
|
|
};
|
|
|
|
const result = executor.transformRequest("gpt-5-mini-xhigh", body, false, {
|
|
requestEndpointPath: "/responses",
|
|
});
|
|
|
|
assert.equal(result.stream, true);
|
|
assert.equal(result.store, false);
|
|
assert.equal(result.instructions.length > 0, true);
|
|
assert.equal(result.reasoning.effort, "high");
|
|
assert.equal(result.service_tier, "priority");
|
|
assert.equal(result.messages, undefined);
|
|
assert.equal(result.prompt, undefined);
|
|
assert.equal(result.temperature, undefined);
|
|
assert.equal(result.user, undefined);
|
|
assert.equal(result.stream_options, undefined);
|
|
});
|
|
|
|
// Issue #2608: gpt-5.5 models reject residual Chat Completions fields via Codex OAuth.
|
|
// The non-passthrough path must strip ALL non-Responses-API fields using an allowlist.
|
|
test("CodexExecutor.transformRequest non-passthrough allowlist strips all residual Chat Completions fields (#2608)", () => {
|
|
const executor = new CodexExecutor();
|
|
const body = {
|
|
model: "gpt-5.5",
|
|
messages: [{ role: "user", content: "hello" }],
|
|
instructions: "",
|
|
// All of these are Chat Completions fields that must be stripped:
|
|
temperature: 0.7,
|
|
top_p: 0.9,
|
|
frequency_penalty: 0.5,
|
|
presence_penalty: 0.3,
|
|
logprobs: true,
|
|
top_logprobs: 3,
|
|
n: 2,
|
|
seed: 42,
|
|
stop: ["\n"],
|
|
response_format: { type: "json_object" },
|
|
logit_bias: { "123": 1 },
|
|
function_call: "auto",
|
|
functions: [{ name: "test", parameters: {} }],
|
|
max_completion_tokens: 1000,
|
|
parallel_tool_calls: true,
|
|
user: "cursor-user",
|
|
metadata: { key: "value" },
|
|
stream_options: { include_usage: true },
|
|
safety_identifier: "safe-1",
|
|
suffix: "end",
|
|
// Custom/arbitrary fields that could be injected by middleware
|
|
custom_field: "should be stripped",
|
|
_internal_marker: true,
|
|
};
|
|
|
|
const result = executor.transformRequest("gpt-5.5", body, false, {
|
|
requestEndpointPath: "/responses",
|
|
});
|
|
|
|
// Allowed Responses API fields should survive
|
|
assert.equal(result.model, "gpt-5.5");
|
|
assert.ok(Array.isArray(result.input));
|
|
assert.equal(typeof result.instructions, "string");
|
|
assert.equal(result.store, false);
|
|
assert.equal(result.stream, true);
|
|
|
|
// All Chat Completions fields must be stripped
|
|
assert.equal(result.temperature, undefined, "temperature should be stripped");
|
|
assert.equal(result.top_p, undefined, "top_p should be stripped");
|
|
assert.equal(result.frequency_penalty, undefined, "frequency_penalty should be stripped");
|
|
assert.equal(result.presence_penalty, undefined, "presence_penalty should be stripped");
|
|
assert.equal(result.logprobs, undefined, "logprobs should be stripped");
|
|
assert.equal(result.top_logprobs, undefined, "top_logprobs should be stripped");
|
|
assert.equal(result.n, undefined, "n should be stripped");
|
|
assert.equal(result.seed, undefined, "seed should be stripped");
|
|
assert.equal(result.stop, undefined, "stop should be stripped");
|
|
assert.equal(result.response_format, undefined, "response_format should be stripped");
|
|
assert.equal(result.logit_bias, undefined, "logit_bias should be stripped");
|
|
assert.equal(result.function_call, undefined, "function_call should be stripped");
|
|
assert.equal(result.functions, undefined, "functions should be stripped");
|
|
assert.equal(result.max_completion_tokens, undefined, "max_completion_tokens should be stripped");
|
|
assert.equal(result.parallel_tool_calls, undefined, "parallel_tool_calls should be stripped");
|
|
assert.equal(result.user, undefined, "user should be stripped");
|
|
assert.equal(result.metadata, undefined, "metadata should be stripped");
|
|
assert.equal(result.stream_options, undefined, "stream_options should be stripped");
|
|
assert.equal(result.safety_identifier, undefined, "safety_identifier should be stripped");
|
|
assert.equal(result.suffix, undefined, "suffix should be stripped");
|
|
assert.equal(result.custom_field, undefined, "arbitrary custom fields should be stripped");
|
|
assert.equal(result._internal_marker, undefined, "internal markers should be stripped");
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest normalizes max reasoning_effort to xhigh", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.5",
|
|
{
|
|
model: "gpt-5.5",
|
|
input: [],
|
|
reasoning_effort: "max",
|
|
},
|
|
false,
|
|
{
|
|
requestEndpointPath: "/responses",
|
|
}
|
|
);
|
|
|
|
assert.equal(result.reasoning.effort, "xhigh");
|
|
assert.equal(result.reasoning_effort, undefined);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest sends neutral instructions for bare chat requests", () => {
|
|
const executor = new CodexExecutor();
|
|
const body = {
|
|
model: "gpt-5.5-medium",
|
|
input: [
|
|
{
|
|
type: "message",
|
|
role: "user",
|
|
content: [
|
|
{
|
|
type: "input_text",
|
|
text: "Calculate 79530+41475, and reply with the result only.",
|
|
},
|
|
],
|
|
},
|
|
],
|
|
instructions: "",
|
|
stream: false,
|
|
};
|
|
|
|
const result = executor.transformRequest("gpt-5.5-medium", body, false, {
|
|
requestEndpointPath: "/responses",
|
|
});
|
|
|
|
assert.equal(result.instructions, CODEX_CHAT_DEFAULT_INSTRUCTIONS);
|
|
assert.equal(result.stream, true);
|
|
assert.equal(result.model, "gpt-5.5");
|
|
assert.equal(result.input.length, 1);
|
|
assert.equal(result.tools, undefined);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest preserves compact requests and native passthrough semantics", () => {
|
|
const executor = new CodexExecutor();
|
|
const body = {
|
|
_nativeCodexPassthrough: true,
|
|
instructions: "keep this",
|
|
stream: false,
|
|
};
|
|
const result = executor.transformRequest("gpt-5.3-codex", body, false, {
|
|
requestEndpointPath: "/responses/compact",
|
|
providerSpecificData: {
|
|
requestDefaults: { serviceTier: "priority" },
|
|
},
|
|
});
|
|
|
|
assert.equal(result._nativeCodexPassthrough, undefined);
|
|
assert.equal(result.stream, undefined);
|
|
assert.equal(result.service_tier, "priority");
|
|
assert.equal(result.reasoning.effort, "medium");
|
|
assert.equal(result.store, undefined);
|
|
assert.equal(result.instructions, "keep this");
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest applies flex request default service tier", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest("gpt-5.5", { input: "hello" }, false, {
|
|
requestEndpointPath: "/responses",
|
|
providerSpecificData: {
|
|
requestDefaults: { serviceTier: "flex" },
|
|
},
|
|
});
|
|
|
|
assert.equal(result.service_tier, "flex");
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest preserves store-enabled responses state when explicitly enabled", () => {
|
|
const executor = new CodexExecutor();
|
|
const body = {
|
|
_nativeCodexPassthrough: true,
|
|
_omnirouteResponsesStore: true,
|
|
instructions: "keep this",
|
|
previous_response_id: "resp_prev_123",
|
|
stream: false,
|
|
};
|
|
|
|
const result = executor.transformRequest("gpt-5.3-codex", body, false, {
|
|
requestEndpointPath: "/responses",
|
|
providerSpecificData: {
|
|
openaiStoreEnabled: true,
|
|
requestDefaults: { serviceTier: "priority" },
|
|
},
|
|
});
|
|
|
|
assert.equal(result._omnirouteResponsesStore, undefined);
|
|
assert.equal(result.store, true);
|
|
assert.equal(result.previous_response_id, "resp_prev_123");
|
|
});
|
|
test("CodexExecutor.transformRequest strips store from compact requests even when store is enabled", () => {
|
|
const executor = new CodexExecutor();
|
|
const body = {
|
|
_nativeCodexPassthrough: true,
|
|
_omnirouteResponsesStore: true,
|
|
instructions: "keep this",
|
|
store: true,
|
|
stream: false,
|
|
};
|
|
|
|
const result = executor.transformRequest("gpt-5.3-codex", body, false, {
|
|
requestEndpointPath: "/responses/compact",
|
|
providerSpecificData: {
|
|
openaiStoreEnabled: true,
|
|
requestDefaults: { serviceTier: "priority" },
|
|
},
|
|
});
|
|
|
|
assert.equal(result._omnirouteResponsesStore, undefined);
|
|
assert.equal(result.store, undefined);
|
|
assert.equal(result.stream, undefined);
|
|
assert.equal(result.instructions, "keep this");
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest preserves native assistant commentary history", () => {
|
|
const executor = new CodexExecutor();
|
|
const body = {
|
|
_nativeCodexPassthrough: true,
|
|
input: [
|
|
{
|
|
type: "message",
|
|
role: "user",
|
|
content: [{ type: "input_text", text: "Use the tool result." }],
|
|
},
|
|
{
|
|
type: "message",
|
|
role: "assistant",
|
|
phase: "commentary",
|
|
content: [{ type: "output_text", text: "Need maybe inspect tool output first." }],
|
|
},
|
|
{
|
|
type: "message",
|
|
role: "assistant",
|
|
phase: "final",
|
|
content: [{ type: "output_text", text: "Visible final assistant answer." }],
|
|
},
|
|
{
|
|
type: "message",
|
|
role: "assistant",
|
|
phase: "final_answer",
|
|
content: [{ type: "output_text", text: "Visible final_answer assistant answer." }],
|
|
},
|
|
{
|
|
type: "message",
|
|
role: "assistant",
|
|
content: [{ type: "output_text", text: "Visible assistant history without phase." }],
|
|
},
|
|
{
|
|
type: "reasoning",
|
|
summary: [{ type: "summary_text", text: "formal reasoning item" }],
|
|
},
|
|
{
|
|
type: "function_call",
|
|
call_id: "call_keep_123",
|
|
name: "workspace_read_file",
|
|
arguments: '{"path":"README.md"}',
|
|
},
|
|
{
|
|
type: "function_call_output",
|
|
call_id: "call_keep_123",
|
|
output: '{"ok":true}',
|
|
},
|
|
],
|
|
stream: false,
|
|
};
|
|
|
|
const result = executor.transformRequest("gpt-5.5-low", body, false, {
|
|
requestEndpointPath: "/responses",
|
|
});
|
|
|
|
assert.equal(
|
|
result.input.some((item) => JSON.stringify(item).includes("Need maybe inspect tool output")),
|
|
true
|
|
);
|
|
assert.equal(
|
|
result.input.some((item) => JSON.stringify(item).includes("Visible final assistant answer")),
|
|
true
|
|
);
|
|
assert.equal(
|
|
result.input.some((item) =>
|
|
JSON.stringify(item).includes("Visible final_answer assistant answer")
|
|
),
|
|
true
|
|
);
|
|
assert.equal(
|
|
result.input.some((item) =>
|
|
JSON.stringify(item).includes("Visible assistant history without phase")
|
|
),
|
|
true
|
|
);
|
|
assert.equal(
|
|
result.input.some((item) => item.type === "reasoning"),
|
|
true
|
|
);
|
|
assert.equal(
|
|
result.input.some((item) => item.type === "function_call"),
|
|
true
|
|
);
|
|
assert.equal(
|
|
result.input.some((item) => item.type === "function_call_output"),
|
|
true
|
|
);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest still strips assistant commentary outside native passthrough", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.5-low",
|
|
{
|
|
input: [
|
|
{
|
|
type: "message",
|
|
role: "user",
|
|
content: [{ type: "input_text", text: "Continue." }],
|
|
},
|
|
{
|
|
type: "message",
|
|
role: "assistant",
|
|
phase: "commentary",
|
|
content: [{ type: "output_text", text: "Internal progress note." }],
|
|
},
|
|
{
|
|
type: "message",
|
|
role: "assistant",
|
|
phase: "final_answer",
|
|
content: [{ type: "output_text", text: "Visible final answer." }],
|
|
},
|
|
],
|
|
stream: false,
|
|
},
|
|
false,
|
|
{ requestEndpointPath: "/responses" }
|
|
);
|
|
|
|
assert.equal(
|
|
result.input.some((item) => JSON.stringify(item).includes("Internal progress note")),
|
|
false
|
|
);
|
|
assert.equal(
|
|
result.input.some((item) => JSON.stringify(item).includes("Visible final answer")),
|
|
true
|
|
);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest inserts missing function_call_output items", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.5-xhigh",
|
|
{
|
|
_nativeCodexPassthrough: true,
|
|
input: [
|
|
{
|
|
type: "message",
|
|
role: "user",
|
|
content: [{ type: "input_text", text: "Continue." }],
|
|
},
|
|
{
|
|
type: "function_call",
|
|
call_id: "call_missing_result",
|
|
name: "read_file",
|
|
arguments: "{}",
|
|
},
|
|
{
|
|
type: "message",
|
|
role: "user",
|
|
content: [{ type: "input_text", text: "Next turn." }],
|
|
},
|
|
],
|
|
stream: false,
|
|
},
|
|
false,
|
|
{
|
|
requestEndpointPath: "/responses",
|
|
}
|
|
);
|
|
|
|
const missingOutputIndex = result.input.findIndex(
|
|
(item) => item.type === "function_call_output" && item.call_id === "call_missing_result"
|
|
);
|
|
const functionCallIndex = result.input.findIndex(
|
|
(item) => item.type === "function_call" && item.call_id === "call_missing_result"
|
|
);
|
|
|
|
assert.equal(missingOutputIndex, functionCallIndex + 1);
|
|
assert.deepEqual(result.input[missingOutputIndex], {
|
|
type: "function_call_output",
|
|
call_id: "call_missing_result",
|
|
output: "",
|
|
});
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest preserves native assistant commentary before mapping messages to input", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.5-low",
|
|
{
|
|
_nativeCodexPassthrough: true,
|
|
messages: [
|
|
{ role: "user", content: "Continue." },
|
|
{
|
|
role: "assistant",
|
|
phase: "commentary",
|
|
content: "Need maybe update PR body first.",
|
|
},
|
|
{
|
|
role: "assistant",
|
|
phase: "final",
|
|
content: "Visible final assistant answer.",
|
|
},
|
|
],
|
|
stream: false,
|
|
},
|
|
false,
|
|
{ requestEndpointPath: "/responses" }
|
|
);
|
|
|
|
assert.equal(
|
|
result.input.some((item) => JSON.stringify(item).includes("Need maybe update PR body")),
|
|
true
|
|
);
|
|
assert.equal(
|
|
result.input.some((item) => JSON.stringify(item).includes("Visible final assistant answer")),
|
|
true
|
|
);
|
|
assert.equal(result.messages, undefined);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest does not locally replay previous_response_id tool follow-ups", () => {
|
|
const executor = new CodexExecutor();
|
|
const body = {
|
|
_nativeCodexPassthrough: true,
|
|
previous_response_id: "resp_prev_tool_123",
|
|
input: [
|
|
{
|
|
type: "function_call_output",
|
|
call_id: "call_tool_123",
|
|
output: '{"ok":true}',
|
|
},
|
|
],
|
|
stream: false,
|
|
};
|
|
|
|
const result = executor.transformRequest("gpt-5.5-low", body, false, {
|
|
requestEndpointPath: "/responses",
|
|
});
|
|
|
|
assert.equal(result.previous_response_id, "resp_prev_tool_123");
|
|
assert.equal(result.store, false);
|
|
assert.equal(result.input.length, 1);
|
|
assert.deepEqual(result.input[0], {
|
|
type: "function_call_output",
|
|
call_id: "call_tool_123",
|
|
output: '{"ok":true}',
|
|
});
|
|
});
|
|
test("CodexExecutor.transformRequest applies per-connection reasoning and service tier defaults", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.3-codex",
|
|
{ model: "gpt-5.3-codex", input: [] },
|
|
false,
|
|
{
|
|
providerSpecificData: {
|
|
requestDefaults: {
|
|
reasoningEffort: "high",
|
|
serviceTier: "priority",
|
|
},
|
|
},
|
|
}
|
|
);
|
|
|
|
assert.equal(result.reasoning.effort, "high");
|
|
assert.equal(result.service_tier, "priority");
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest keeps explicit request values ahead of connection defaults", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.3-codex",
|
|
{
|
|
model: "gpt-5.3-codex",
|
|
input: [],
|
|
reasoning_effort: "none",
|
|
service_tier: "standard",
|
|
},
|
|
false,
|
|
{
|
|
providerSpecificData: {
|
|
requestDefaults: {
|
|
reasoningEffort: "high",
|
|
serviceTier: "priority",
|
|
},
|
|
},
|
|
}
|
|
);
|
|
|
|
assert.equal(result.reasoning.effort, "none");
|
|
assert.equal(result.service_tier, "standard");
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest lets model suffix beat connection reasoning defaults", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.3-codex-high",
|
|
{ model: "gpt-5.3-codex-high", input: [] },
|
|
false,
|
|
{
|
|
providerSpecificData: {
|
|
requestDefaults: {
|
|
reasoningEffort: "low",
|
|
},
|
|
},
|
|
}
|
|
);
|
|
|
|
assert.equal(result.model, "gpt-5.3-codex");
|
|
assert.equal(result.reasoning.effort, "high");
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest keeps gpt-5.5 as the model and applies xhigh reasoning", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.5-xhigh",
|
|
{ model: "gpt-5.5-xhigh", input: [] },
|
|
false,
|
|
{}
|
|
);
|
|
|
|
assert.equal(result.model, "gpt-5.5");
|
|
assert.equal(result.reasoning.effort, "xhigh");
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest keeps GPT 5.3 Codex reasoning in Responses shape", () => {
|
|
const executor = new CodexExecutor();
|
|
const transformed = executor.transformRequest(
|
|
"gpt-5.3-codex",
|
|
{
|
|
model: "gpt-5.3-codex",
|
|
input: [],
|
|
reasoning_effort: "high",
|
|
},
|
|
true,
|
|
{
|
|
requestEndpointPath: "/responses",
|
|
}
|
|
);
|
|
const sanitized = sanitizeReasoningEffortForProvider(
|
|
transformed,
|
|
"codex",
|
|
"gpt-5.3-codex",
|
|
null
|
|
) as Record<string, unknown>;
|
|
const reasoning = getRecord(sanitized.reasoning);
|
|
|
|
assert.equal(sanitized.model, "gpt-5.3-codex");
|
|
assert.equal(reasoning.effort, "high");
|
|
assert.equal(sanitized.reasoning_effort, undefined);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest passes GPT 5.4 Mini xhigh reasoning through unchanged in Responses shape (#3756)", () => {
|
|
const executor = new CodexExecutor();
|
|
const transformed = executor.transformRequest(
|
|
"gpt-5.4-mini",
|
|
{
|
|
model: "gpt-5.4-mini",
|
|
input: [],
|
|
reasoning: { effort: "xhigh", summary: "auto" },
|
|
},
|
|
true,
|
|
{
|
|
requestEndpointPath: "/responses",
|
|
}
|
|
);
|
|
const sanitized = sanitizeReasoningEffortForProvider(
|
|
transformed,
|
|
"codex",
|
|
"gpt-5.4-mini",
|
|
null
|
|
) as Record<string, unknown>;
|
|
const reasoning = getRecord(sanitized.reasoning);
|
|
|
|
assert.equal(sanitized.model, "gpt-5.4-mini");
|
|
// #3756: xhigh now passes through by default. gpt-5.4-mini has no
|
|
// supportsXHighEffort:false flag (and ships a gpt-5.4-mini-xhigh catalog
|
|
// variant), so the effort is preserved instead of downgraded to "high".
|
|
assert.equal(reasoning.effort, "xhigh");
|
|
assert.equal(reasoning.summary, "auto");
|
|
assert.equal(sanitized.reasoning_effort, undefined);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest merges Codex installation metadata", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.5",
|
|
{
|
|
model: "gpt-5.5",
|
|
input: [],
|
|
client_metadata: { existing: "keep" },
|
|
},
|
|
true,
|
|
{
|
|
providerSpecificData: {
|
|
codexClientIdentity: {
|
|
sessionId: "session-1",
|
|
turnId: "turn-1",
|
|
windowId: "session-1:0",
|
|
installationId: "11111111-1111-4111-a111-111111111111",
|
|
},
|
|
},
|
|
}
|
|
);
|
|
|
|
assert.deepEqual(result.client_metadata, {
|
|
existing: "keep",
|
|
"x-codex-installation-id": "11111111-1111-4111-a111-111111111111",
|
|
});
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest omits client metadata for compact requests", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.5",
|
|
{
|
|
model: "gpt-5.5",
|
|
input: [],
|
|
client_metadata: { existing: "drop" },
|
|
_nativeCodexPassthrough: true,
|
|
},
|
|
false,
|
|
{
|
|
requestEndpointPath: "/responses/compact",
|
|
providerSpecificData: {
|
|
codexClientIdentity: {
|
|
sessionId: "session-1",
|
|
turnId: "turn-1",
|
|
windowId: "session-1:0",
|
|
installationId: "11111111-1111-4111-a111-111111111111",
|
|
},
|
|
},
|
|
}
|
|
);
|
|
|
|
assert.equal(result.client_metadata, undefined);
|
|
});
|
|
|
|
test("CodexExecutor.execute falls back to HTTP when websocket transport is unavailable", async () => {
|
|
__setCodexWebSocketTransportForTesting(null);
|
|
const executor = new CodexExecutor();
|
|
const originalFetch = globalThis.fetch;
|
|
|
|
globalThis.fetch = async () =>
|
|
new Response(JSON.stringify({ id: "resp_http_fallback", object: "response" }), {
|
|
status: 200,
|
|
headers: { "Content-Type": "application/json" },
|
|
});
|
|
|
|
try {
|
|
const result = await executor.execute({
|
|
model: "gpt-5.5-xhigh",
|
|
body: { model: "gpt-5.5-xhigh", input: [{ role: "user", content: "hello" }] },
|
|
stream: true,
|
|
credentials: {
|
|
accessToken: "codex-token",
|
|
providerSpecificData: { codexTransport: "websocket" },
|
|
},
|
|
});
|
|
|
|
// When WS transport is unavailable, isCodexResponsesWebSocketRequired returns false
|
|
// and the executor falls back to HTTP via super.execute()
|
|
assert.equal(result.response.status, 200);
|
|
assert.equal(getRecord(result.transformedBody).model, "gpt-5.5");
|
|
} finally {
|
|
globalThis.fetch = originalFetch;
|
|
}
|
|
});
|
|
|
|
test("CodexExecutor.execute captures the exact websocket request body before send", async () => {
|
|
const executor = new CodexExecutor();
|
|
let sent: string | null = null;
|
|
let sendStarted = false;
|
|
let prepared: unknown = null;
|
|
let preparedBeforeSend = false;
|
|
const ws: MockCodexWebSocket = {
|
|
send(data) {
|
|
sendStarted = true;
|
|
sent = data;
|
|
queueMicrotask(() => {
|
|
ws.onmessage?.({
|
|
data: JSON.stringify({ type: "response.completed", response: { status: "completed" } }),
|
|
});
|
|
});
|
|
},
|
|
close() {},
|
|
onmessage: null,
|
|
onerror: null,
|
|
onclose: null,
|
|
};
|
|
__setCodexWebSocketTransportForTesting(async () => ws);
|
|
|
|
const requestCapture = {
|
|
capture(request) {
|
|
preparedBeforeSend = !sendStarted;
|
|
prepared = request.body;
|
|
},
|
|
body(fallback) {
|
|
return prepared ?? fallback;
|
|
},
|
|
latest() {
|
|
return null;
|
|
},
|
|
};
|
|
const result = await runWithCapture(requestCapture, () =>
|
|
executor.execute({
|
|
model: "gpt-5.5-xhigh",
|
|
body: { model: "gpt-5.5-xhigh", input: [{ role: "user", content: "hello" }] },
|
|
stream: true,
|
|
credentials: {
|
|
accessToken: "codex-token",
|
|
providerSpecificData: { codexTransport: "websocket" },
|
|
},
|
|
})
|
|
);
|
|
await result.response.text();
|
|
|
|
assert.ok(sent);
|
|
const sentBody = JSON.parse(sent);
|
|
assert.equal(preparedBeforeSend, true);
|
|
assert.deepEqual(prepared, sentBody);
|
|
assert.equal(sentBody.type, "response.create");
|
|
assert.equal(sentBody.model, "gpt-5.5");
|
|
});
|
|
|
|
test("CodexExecutor.execute adds CLI-like session identity headers without changing response flow", async () => {
|
|
const executor = new CodexExecutor();
|
|
const originalFetch = globalThis.fetch;
|
|
let capturedBody: Record<string, unknown> | null = null;
|
|
let capturedHeaders: Headers | null = null;
|
|
|
|
globalThis.fetch = async (_url, init) => {
|
|
capturedHeaders = new Headers(init?.headers as HeadersInit);
|
|
capturedBody = JSON.parse(String(init?.body || "{}"));
|
|
return new Response(JSON.stringify({ id: "resp_identity", object: "response" }), {
|
|
status: 200,
|
|
headers: { "Content-Type": "application/json" },
|
|
});
|
|
};
|
|
|
|
try {
|
|
const result = await executor.execute({
|
|
model: "gpt-5.5",
|
|
body: {
|
|
model: "gpt-5.5",
|
|
session_id: "conversation-1",
|
|
input: [{ role: "user", content: "hello" }],
|
|
},
|
|
stream: true,
|
|
credentials: {
|
|
accessToken: "codex-token",
|
|
providerSpecificData: { workspaceId: "workspace-1" },
|
|
},
|
|
});
|
|
|
|
assert.equal(result.response.status, 200);
|
|
assert.equal(capturedHeaders?.get("session_id"), "conversation-1");
|
|
assert.equal(capturedHeaders?.get("x-client-request-id"), "conversation-1");
|
|
assert.equal(capturedHeaders?.get("x-codex-window-id"), "conversation-1:0");
|
|
const turnMetadata = JSON.parse(capturedHeaders?.get("x-codex-turn-metadata") || "{}");
|
|
assert.equal(turnMetadata.session_id, "conversation-1");
|
|
assert.equal(turnMetadata.thread_source, "user");
|
|
assert.equal(turnMetadata.sandbox, "none");
|
|
assert.equal(typeof turnMetadata.turn_id, "string");
|
|
assert.equal(capturedBody?.prompt_cache_key, "conversation-1");
|
|
assert.equal(
|
|
(capturedBody?.client_metadata as Record<string, unknown>)?.["x-codex-installation-id"],
|
|
"7f06a8ee-2981-4c81-a4ca-e443b5400a63"
|
|
);
|
|
} finally {
|
|
globalThis.fetch = originalFetch;
|
|
}
|
|
});
|
|
|
|
test("CodexExecutor.execute skips identity headers for unsafe session ids", async () => {
|
|
const executor = new CodexExecutor();
|
|
const originalFetch = globalThis.fetch;
|
|
let capturedHeaders: Headers | null = null;
|
|
|
|
globalThis.fetch = async (_url, init) => {
|
|
capturedHeaders = new Headers(init?.headers as HeadersInit);
|
|
return new Response(JSON.stringify({ id: "resp_identity", object: "response" }), {
|
|
status: 200,
|
|
headers: { "Content-Type": "application/json" },
|
|
});
|
|
};
|
|
|
|
try {
|
|
await executor.execute({
|
|
model: "gpt-5.5",
|
|
body: {
|
|
model: "gpt-5.5",
|
|
session_id: "bad\r\nheader",
|
|
input: [{ role: "user", content: "hello" }],
|
|
},
|
|
stream: true,
|
|
credentials: { accessToken: "codex-token" },
|
|
});
|
|
|
|
assert.equal(capturedHeaders?.get("x-client-request-id"), null);
|
|
assert.equal(capturedHeaders?.get("x-codex-window-id"), null);
|
|
assert.equal(capturedHeaders?.get("x-codex-turn-metadata"), null);
|
|
} finally {
|
|
globalThis.fetch = originalFetch;
|
|
}
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest preserves namespace MCP tools and hosted tool types", () => {
|
|
// Regression: PR #1581 đã vô tình xoá nhánh `namespace` + whitelist hosted tools
|
|
// trong normalizeCodexTools, khiến MCP tool group (vd. mcp__atlassian__) bị strip
|
|
// trước khi forward lên Codex Responses API. Test này khoá lại hành vi đúng.
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.4",
|
|
{
|
|
model: "gpt-5.4",
|
|
input: [],
|
|
tools: [
|
|
{ type: "function", name: "exec_command", parameters: { type: "object" } },
|
|
{
|
|
type: "namespace",
|
|
name: "mcp__atlassian__",
|
|
description: "Tools in the mcp__atlassian__ namespace.",
|
|
tools: [
|
|
{ type: "function", name: "jira_get_issue", parameters: { type: "object" } },
|
|
{ type: "function", name: "jira_search", parameters: { type: "object" } },
|
|
],
|
|
},
|
|
{ type: "image_generation", output_format: "png" },
|
|
{ type: "tool_search" },
|
|
{ type: "web_search" },
|
|
{ type: "unknown_hosted_tool" },
|
|
],
|
|
tool_choice: { type: "function", name: "jira_get_issue" },
|
|
},
|
|
false,
|
|
{}
|
|
);
|
|
|
|
const types = (result.tools as Array<Record<string, unknown>>).map((tool) => tool.type);
|
|
assert.deepEqual(types, [
|
|
"function",
|
|
"namespace",
|
|
"image_generation",
|
|
"tool_search",
|
|
"web_search",
|
|
]);
|
|
|
|
const namespaceTool = (result.tools as Array<Record<string, unknown>>).find(
|
|
(tool) => tool.type === "namespace"
|
|
);
|
|
assert.equal((namespaceTool as { name: string }).name, "mcp__atlassian__");
|
|
assert.equal(((namespaceTool as { tools: unknown[] }).tools ?? []).length, 2);
|
|
|
|
// tool_choice trỏ vào sub-tool của namespace phải được giữ nguyên (không bị xoá
|
|
// do tên nằm trong namespace.tools[*].name đã được đăng ký vào validToolNames).
|
|
assert.deepEqual(result.tool_choice, { type: "function", name: "jira_get_issue" });
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest preserves native Codex custom tools", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.5",
|
|
{
|
|
_nativeCodexPassthrough: true,
|
|
model: "gpt-5.5",
|
|
input: [],
|
|
tools: [
|
|
{
|
|
type: "custom",
|
|
name: "apply_patch",
|
|
description: "Use the apply_patch tool to edit files.",
|
|
format: {
|
|
type: "grammar",
|
|
syntax: "lark",
|
|
definition: "start: /.+/",
|
|
},
|
|
},
|
|
{
|
|
type: "function",
|
|
name: "exec_command",
|
|
description: "Runs a command.",
|
|
parameters: { type: "object", properties: {} },
|
|
strict: false,
|
|
},
|
|
],
|
|
},
|
|
true,
|
|
{ requestEndpointPath: "/responses" }
|
|
);
|
|
|
|
const tools = result.tools as Array<Record<string, unknown>>;
|
|
assert.equal(tools.length, 2);
|
|
assert.deepEqual(tools[0], {
|
|
type: "custom",
|
|
name: "apply_patch",
|
|
description: "Use the apply_patch tool to edit files.",
|
|
format: {
|
|
type: "grammar",
|
|
syntax: "lark",
|
|
definition: "start: /.+/",
|
|
},
|
|
});
|
|
assert.equal(tools[1].strict, false);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest still drops custom tools outside native passthrough", () => {
|
|
const executor = new CodexExecutor();
|
|
const result = executor.transformRequest(
|
|
"gpt-5.5",
|
|
{
|
|
model: "gpt-5.5",
|
|
input: [],
|
|
tools: [
|
|
{ type: "custom", name: "apply_patch", format: { type: "grammar" } },
|
|
{ type: "function", name: "exec_command", parameters: { type: "object" } },
|
|
],
|
|
},
|
|
true,
|
|
{ requestEndpointPath: "/responses" }
|
|
);
|
|
|
|
const tools = result.tools as Array<Record<string, unknown>>;
|
|
assert.deepEqual(
|
|
tools.map((tool) => tool.name),
|
|
["exec_command"]
|
|
);
|
|
});
|
|
|
|
test("CodexExecutor maps Codex websocket error events to response.failed SSE", () => {
|
|
const raw = JSON.stringify({
|
|
type: "error",
|
|
status_code: 429,
|
|
error: {
|
|
type: "usage_limit_reached",
|
|
message: "The usage limit has been reached",
|
|
},
|
|
});
|
|
|
|
const result = encodeResponseSseEvent(raw);
|
|
assert.equal(result.terminal, true);
|
|
assert.match(result.sse, /^event: response\.failed/m);
|
|
|
|
const dataLine = result.sse.split("\n").find((line) => line.startsWith("data: "));
|
|
assert.ok(dataLine);
|
|
const payload = JSON.parse(dataLine.slice("data: ".length));
|
|
assert.equal(payload.type, "response.failed");
|
|
assert.equal(payload.response.status, "failed");
|
|
assert.equal(payload.response.error.code, "usage_limit_reached");
|
|
assert.equal(payload.response.error.status_code, 429);
|
|
});
|
|
|
|
test("CodexExecutor.transformRequest does not apply connection reasoning defaults when Thinking Budget is not passthrough", () => {
|
|
const executor = new CodexExecutor();
|
|
setThinkingBudgetConfig({ mode: ThinkingMode.AUTO });
|
|
|
|
const noDefaults = executor.transformRequest(
|
|
"gpt-5.3-codex",
|
|
{ model: "gpt-5.3-codex", input: [] },
|
|
false,
|
|
{
|
|
providerSpecificData: {
|
|
requestDefaults: {
|
|
reasoningEffort: "high",
|
|
},
|
|
},
|
|
}
|
|
);
|
|
const explicit = executor.transformRequest(
|
|
"gpt-5.3-codex",
|
|
{ model: "gpt-5.3-codex", input: [], reasoning_effort: "high" },
|
|
false,
|
|
{
|
|
providerSpecificData: {
|
|
requestDefaults: {
|
|
reasoningEffort: "low",
|
|
},
|
|
},
|
|
}
|
|
);
|
|
|
|
assert.equal(noDefaults.reasoning, undefined);
|
|
assert.equal(explicit.reasoning.effort, "high");
|
|
});
|
|
|
|
test("CodexExecutor.refreshCredentials refreshes OAuth tokens and returns null without a refresh token", async () => {
|
|
const executor = new CodexExecutor();
|
|
const originalFetch = globalThis.fetch;
|
|
globalThis.fetch = async (url) => {
|
|
assert.match(String(url), /auth\.openai\.com\/oauth\/token$/);
|
|
return new Response(
|
|
JSON.stringify({
|
|
access_token: "new-token",
|
|
refresh_token: "new-refresh",
|
|
expires_in: 3600,
|
|
}),
|
|
{ status: 200, headers: { "Content-Type": "application/json" } }
|
|
);
|
|
};
|
|
|
|
try {
|
|
assert.equal(await executor.refreshCredentials({}, null), null);
|
|
const refreshed = await executor.refreshCredentials({ refreshToken: "refresh-me" }, null);
|
|
assert.deepEqual(refreshed, {
|
|
accessToken: "new-token",
|
|
refreshToken: "new-refresh",
|
|
expiresIn: 3600,
|
|
});
|
|
} finally {
|
|
globalThis.fetch = originalFetch;
|
|
}
|
|
});
|
|
|
|
test("CodexExecutor.refreshCredentials returns null for unrecoverable errors to preserve original credentials", async () => {
|
|
// Source intentionally returns null (not an error object) so that base.ts does
|
|
// not spread stale error fields onto activeCredentials. The upstream 401/403
|
|
// drives the proper re-auth / mark-expired path instead.
|
|
// Source: open-sse/executors/codex.ts — refreshCredentials(), lines ~1205-1216.
|
|
const executor = new CodexExecutor();
|
|
const originalFetch = globalThis.fetch;
|
|
globalThis.fetch = async () =>
|
|
new Response(
|
|
JSON.stringify({ error: "invalid_grant", error_description: "Refresh token expired" }),
|
|
{ status: 400, headers: { "Content-Type": "application/json" } }
|
|
);
|
|
|
|
try {
|
|
const result = await executor.refreshCredentials({ refreshToken: "dead-token" }, null);
|
|
assert.equal(result, null, "should return null to leave original credentials untouched");
|
|
} finally {
|
|
globalThis.fetch = originalFetch;
|
|
}
|
|
});
|
|
|
|
test("CodexExecutor maps usage_limit_reached websocket failures without explicit status to 429", () => {
|
|
const raw = JSON.stringify({
|
|
type: "response.failed",
|
|
response: {
|
|
id: "resp_usage_limit",
|
|
status: "failed",
|
|
error: {
|
|
code: "usage_limit_reached",
|
|
message: "Your weekly usage limit has been reached",
|
|
},
|
|
},
|
|
});
|
|
|
|
const result = encodeResponseSseEvent(raw);
|
|
assert.equal(result.terminal, true);
|
|
|
|
const dataLine = result.sse.split("\n").find((line) => line.startsWith("data: "));
|
|
assert.ok(dataLine);
|
|
const payload = JSON.parse(dataLine.slice("data: ".length));
|
|
assert.equal(payload.type, "response.failed");
|
|
assert.equal(payload.response.id, "resp_usage_limit");
|
|
assert.equal(payload.response.error.code, "usage_limit_reached");
|
|
assert.equal(payload.response.error.status_code, 429);
|
|
});
|
|
|
|
test("Codex internal websocket bridge secret comparison handles mismatched lengths safely", async () => {
|
|
const { bridgeSecretMatches } =
|
|
await import("../../src/app/api/internal/codex-responses-ws/route.ts");
|
|
|
|
assert.equal(bridgeSecretMatches("bridge-secret", "bridge-secret"), true);
|
|
assert.equal(bridgeSecretMatches("bridge-secret", "bridge-secret-extra"), false);
|
|
assert.equal(bridgeSecretMatches("bridge-secret", ""), false);
|
|
});
|
|
|
|
test("Codex internal websocket bridge rejects non-object JSON payloads", async () => {
|
|
await withEnv({ OMNIROUTE_WS_BRIDGE_SECRET: "bridge-secret" }, async () => {
|
|
const { POST } = await import("../../src/app/api/internal/codex-responses-ws/route.ts");
|
|
|
|
const response = await POST(
|
|
new Request("http://omniroute.local/api/internal/codex-responses-ws", {
|
|
method: "POST",
|
|
headers: {
|
|
"content-type": "application/json",
|
|
"x-omniroute-ws-bridge-secret": "bridge-secret",
|
|
},
|
|
body: JSON.stringify(["invalid"]),
|
|
})
|
|
);
|
|
const body = await response.json();
|
|
|
|
assert.equal(response.status, 400);
|
|
assert.equal(body.error.code, "invalid_json");
|
|
assert.match(body.error.message, /JSON object/);
|
|
});
|
|
});
|