Files
OmniRoute/tests/unit/review-reviews-v3814-fixes.test.ts
Diego Rodrigues de Sa e Souza 7db430a352 Release v3.8.14 (#3340)
* chore(release): open v3.8.14 development cycle

Version bump 3.8.13 -> 3.8.14 (root + electron + open-sse + openapi + lockfiles).
Seed the v3.8.14 changelog with the four post-tag hotfixes that shipped to
Docker/Electron in v3.8.13 but missed the immutable npm 3.8.13 (#3336 SSRF /
CodeQL #323, #3334/#3335/#3339 Electron packaging). i18n CHANGELOG mirrors get
the in-progress placeholder section.

* feat: add per-provider custom headers support for OpenAI/Anthropic-compatible nodes (#3338)

Integrated into release/v3.8.14

* fix: Kiro Builder ID token import fails with Bad credentials (#3333)

Integrated into release/v3.8.14 — adds Builder ID cached-creds + OIDC refresh path for Kiro token import, with regression tests (#3333).

* Improve code quality: auto-pr/docstrings-1780792063 (#3337)

Integrated into release/v3.8.14 — docstring for context analytics route re-export.

* fix(catalog): remove minimaxai/minimax-m3 from NVIDIA NIM tier (404 upstream) (#3329) (#3341)

NVIDIA NIM does not host minimaxai/minimax-m3 — every request returns
404 page not found, while sibling minimaxai/minimax-m2.7 on the same provider
works. Advertising a model that 404s is a catalog bug; remove it from the nvidia
tier (it remains on the tiers that actually serve MiniMax M3). Re-add only once
NVIDIA serves it.

Co-authored-by: mikmaneggahommie <mikmaneggahommie@users.noreply.github.com>

* fix(cli): write OpenCode config to ~/.config on all platforms incl. Windows (#3330) (#3343)

resolveOpencodeConfigDir used %APPDATA% on Windows, but OpenCode reads its
config from XDG ~/.config/opencode/ on every platform (on Windows:
%USERPROFILE%\.config\opencode\, NOT %APPDATA%). So a Windows user who
configured OpenCode via the dashboard had the file written where OpenCode never
looks — it silently had no effect.

Use the XDG path (XDG_CONFIG_HOME || ~/.config) unconditionally. Update the UI
note + route JSDoc, and flip the three tests that encoded the old %APPDATA%
behavior (t40 per-platform + card-note, cli-runtime-extended getCliConfigPaths).

Co-authored-by: abdulkadirozyurt <abdulkadirozyurt@users.noreply.github.com>

* fix(proxy): make auto-selection fallback opt-in (#3332) (#3344)

selectWorkingProxyFallback (Step 11 of resolveProxyForConnection) listed ALL
registry proxies, ignoring assignments and per-connection proxy_enabled, and
returned the first working one with level:'autoSelect'. So a single proxy added
to the registry silently became a global fallback for every connection's traffic.

Gate it behind a new PROXY_AUTO_SELECT_ENABLED feature flag (default off): the
fallback now no-ops unless the operator opts in. No registry proxy becomes a
silent global default anymore.

Co-authored-by: hertznsk <hertznsk@users.noreply.github.com>

* fix(sse): treat MiniMax M3 as multimodal so vision isn't stripped (#3328) (#3342)

MiniMax M3 via the opencode provider (oc/minimax-m3-free) appeared blind:
image inputs didn't reach the model, while the same model in Cline could
see them. Verified empirically that MiniMax M3 on the opencode upstream IS
multimodal -- a base64 image is described correctly (it returns 403 only
for remote image URLs, which it doesn't accept).

Root cause: OmniRoute treated MiniMax M3 as a non-vision model in two
places, so when compression was active the image was replaced with a text
placeholder before dispatch:
- compression's modelSupportsVision() heuristic (lite.ts) only matched
  gpt-4/4o/claude-3/gemini/vision -- minimax was absent -> replaceImageUrls
  stripped the image.
- the opencode minimax-m3-free catalog entry lacked supportsVision, so the
  combo vision-capability gate could also exclude/mishandle it.

Add 'minimax-m3' to the vision heuristic and supportsVision: true to the
opencode minimax-m3-free entry. TDD: a failing-then-passing test in
compression/lite.test.ts proves replaceImageUrls now keeps images for
minimax-m3 ids, plus a registry assertion mirroring the #2822 qwen test.

Reported-by: @mikmaneggahommie

* docs(i18n): translate 25 core documentation files to Indonesian (#3348)

Integrated into release/v3.8.14 — Indonesian i18n docs.

* fix(review): resolve /review-reviews battery findings (LEDGER-1..11) on v3.8.14 (#3350)

Integrated into release/v3.8.14 — /review-reviews battery hardening (LEDGER-1..11) for #3338 custom-headers + #3333 kiro, plus cycle-test drift fixes (#3329/#3330/#3332).

* fix(provider-proxy): honor per-account proxy toggles (#3349)

Integrated into release/v3.8.14 — honor per-account proxy toggles + auto-fallback opt-in via PROXY_AUTO_SELECT_ENABLED.

* fix(dashboard): remove duplicate Distribute Proxies button on provider page (#3352)

* fix(providers): reduce proxy label noise (#3346)

Integrated into release/v3.8.14 — reduce proxy label noise + a11y (aria-label/sr-only).

* fix(duckduckgo): restore bare Response contract and rebase onto release/v3.8.14 (#3323)

Integrated into release/v3.8.14 — browser-backed cookie providers (duckduckgo/claude-web) with restored executor contract + unit tests.

* fix(noauth): expose only usable model aliases (#3345)

Integrated into release/v3.8.14 — noauth usable-alias filtering + registry alias plumbing (veo-free).

* fix(dashboard): stop infinite config-load loop on Hermes Agent detail page (#3353)

* fix(electron): tree-kill the server on exit/update to release the omniroute.exe lock (#3347) (#3354)

* chore(release): finalize v3.8.14 changelog + clear release-gate drift

- CHANGELOG: finalize the v3.8.14 section (date, full New Features/Bug Fixes/
  Maintenance coverage of all 16 cycle commits, Contributors hall of 12).
- docs: document OMNIROUTE_BROWSER_POOL + WEB_COOKIE_USE_BROWSER (#3323) in
  .env.example + ENVIRONMENT.md; regenerate the id/llm.txt strict mirror (#3348
  had translated it; llm.txt mirrors must match root).
- test(proxy-fetch): #3323 made tlsClient.available a computed getter — stub it
  via Object.defineProperty instead of assignment (5 tests were red on the base).

* fix(translator): coerce Gemini functionDeclaration parameters to an OBJECT schema (#3357) (#3360)

* fix(gemini): resolve truncation/suppression of false positive textual tool call markers in backticks (#3358)

Integrated into release/v3.8.14 — Gemini/Antigravity textual tool-call marker normalization (no false-positive suppression + split-chunk buffering).

* docs(changelog): add #3358 Gemini textual tool-call normalization to v3.8.14

* fix(dashboard): surface real analytics error instead of generic placeholder (#3356) (#3361)

The Analytics page discarded the server's error body on a non-OK response and
rendered a generic "An error occurred", so users (and maintainers) could not see
why /api/usage/analytics 500'd after an upgrade. Now the route returns the real
reason via buildErrorBody (sanitized, Hard Rule #12) and the page surfaces it via
a new readFetchErrorMessage helper that handles both the OpenAI-style and legacy
error shapes.

Reported-by: @superti4r

---------

Co-authored-by: PizzaV <103120356+pizzav-xyz@users.noreply.github.com>
Co-authored-by: Someres <168349709+quanturbo@users.noreply.github.com>
Co-authored-by: Dong Mengzhe <154944819+Lang-Qiu@users.noreply.github.com>
Co-authored-by: mikmaneggahommie <mikmaneggahommie@users.noreply.github.com>
Co-authored-by: abdulkadirozyurt <abdulkadirozyurt@users.noreply.github.com>
Co-authored-by: hertznsk <hertznsk@users.noreply.github.com>
Co-authored-by: Krisna Santosa <54174372+KrisnaSantosa15@users.noreply.github.com>
Co-authored-by: Randi <55005611+rdself@users.noreply.github.com>
Co-authored-by: Wilson <pedbookmed@gmail.com>
Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com>
Co-authored-by: Ardem2025 <ardemb22@gmail.com>
2026-06-07 07:20:02 -03:00

235 lines
8.6 KiB
TypeScript

/**
* Regression guards for the /review-reviews battery findings (v3.8.14).
* Each test maps to a LEDGER-* item from the consolidated review.
*/
import test from "node:test";
import assert from "node:assert/strict";
import fs from "node:fs";
import os from "node:os";
import path from "node:path";
const TEST_DATA_DIR = fs.mkdtempSync(path.join(os.tmpdir(), "omniroute-review-reviews-"));
process.env.DATA_DIR = TEST_DATA_DIR;
const core = await import("../../src/lib/db/core.ts");
const providersDb = await import("../../src/lib/db/providers.ts");
const { createProviderNodeSchema } = await import("../../src/shared/validation/schemas.ts");
const { DefaultExecutor } = await import("../../open-sse/executors/default.ts");
const { REGISTRY } = await import("../../open-sse/config/providerRegistry.ts");
test.beforeEach(() => {
core.resetDbInstance();
fs.rmSync(TEST_DATA_DIR, { recursive: true, force: true });
fs.mkdirSync(TEST_DATA_DIR, { recursive: true });
});
test.after(() => {
core.resetDbInstance();
fs.rmSync(TEST_DATA_DIR, { recursive: true, force: true });
});
// ── LEDGER-1: updateProviderNode must preserve custom headers on partial update ──
test("LEDGER-1: updateProviderNode preserves customHeaders when the field is omitted", async () => {
const created = await providersDb.createProviderNode({
type: "openai-compatible",
name: "node-a",
prefix: "nodea",
apiType: "chat",
baseUrl: "https://proxy.example.com/v1",
customHeaders: { "X-Tenant": "acme", "X-Env": "prod" },
});
// Partial update that does NOT resend customHeaders (only renames the node).
const updated = await providersDb.updateProviderNode(created.id as string, { name: "node-a2" });
assert.deepEqual(
updated?.customHeaders,
{ "X-Tenant": "acme", "X-Env": "prod" },
"omitting customHeaders on update must NOT wipe stored headers"
);
// And reading it back confirms persistence.
const fetched = await providersDb.getProviderNodeById(created.id as string);
assert.deepEqual(fetched?.customHeaders, { "X-Tenant": "acme", "X-Env": "prod" });
});
test("LEDGER-1: updateProviderNode still clears headers when explicitly set to null", async () => {
const created = await providersDb.createProviderNode({
type: "openai-compatible",
name: "node-b",
prefix: "nodeb",
apiType: "chat",
baseUrl: "https://proxy.example.com/v1",
customHeaders: { "X-Tenant": "acme" },
});
const updated = await providersDb.updateProviderNode(created.id as string, {
customHeaders: null,
});
assert.equal(updated?.customHeaders, null, "explicit null must clear headers");
});
// ── LEDGER-2 / LEDGER-3: schema reuses canonical guards + rejects auth headers ──
test("LEDGER-2: customHeaders rejects CRLF / control-char values", () => {
const bad = createProviderNodeSchema.safeParse({
type: "openai-compatible",
name: "n",
prefix: "n",
apiType: "chat",
baseUrl: "https://x/v1",
customHeaders: { "X-Inject": "foo\r\nX-Evil: bar" },
});
assert.equal(bad.success, false, "CRLF in a header value must be rejected at the schema");
});
test("LEDGER-2: customHeaders rejects control-char / whitespace / ':' in names", () => {
for (const badName of ["X Bad", "X:Bad", "X\r\nBad"]) {
const res = createProviderNodeSchema.safeParse({
type: "openai-compatible",
name: "n",
prefix: "n",
apiType: "chat",
baseUrl: "https://x/v1",
customHeaders: { [badName]: "v" },
});
assert.equal(res.success, false, `header name "${badName}" must be rejected`);
}
});
test("LEDGER-2: customHeaders rejects more than 16 entries", () => {
const many: Record<string, string> = {};
for (let i = 0; i < 17; i++) many[`X-H${i}`] = "v";
const res = createProviderNodeSchema.safeParse({
type: "openai-compatible",
name: "n",
prefix: "n",
apiType: "chat",
baseUrl: "https://x/v1",
customHeaders: many,
});
assert.equal(res.success, false, "more than 16 custom headers must be rejected");
});
test("LEDGER-3: customHeaders rejects auth header names at the schema boundary", () => {
for (const authName of ["Authorization", "x-api-key", "X-Goog-Api-Key", "api-key"]) {
const res = createProviderNodeSchema.safeParse({
type: "openai-compatible",
name: "n",
prefix: "n",
apiType: "chat",
baseUrl: "https://x/v1",
customHeaders: { [authName]: "Bearer x" },
});
assert.equal(res.success, false, `auth header "${authName}" must be rejected (no silent drop)`);
}
});
test("LEDGER-2: valid custom headers still pass", () => {
const res = createProviderNodeSchema.safeParse({
type: "openai-compatible",
name: "n",
prefix: "n",
apiType: "chat",
baseUrl: "https://x/v1",
customHeaders: { "X-Tenant": "acme", "X-Trace-Id": "abc-123" },
});
assert.equal(res.success, true, res.success ? "" : JSON.stringify(res.error?.issues));
});
// ── LEDGER-4: every minimax-m3 registry entry is flagged multimodal ──
test("LEDGER-4: all minimax-m3 registry entries set supportsVision (matches lite.ts)", () => {
const entries: { id: string; supportsVision?: boolean }[] = [];
for (const provider of Object.values(
REGISTRY as Record<string, { models?: { id: string; supportsVision?: boolean }[] }>
)) {
for (const m of provider.models || []) {
if (/minimax-m3/i.test(m.id)) entries.push(m);
}
}
assert.ok(entries.length >= 6, `expected several minimax-m3 entries, got ${entries.length}`);
const unflagged = entries.filter((m) => m.supportsVision !== true).map((m) => m.id);
assert.deepEqual(
unflagged,
[],
`these minimax-m3 entries miss supportsVision: ${unflagged.join(", ")}`
);
});
// ── LEDGER-5: anthropic-compatible-cc-* nodes honor custom headers ──
test("LEDGER-5: custom headers reach the wire for anthropic-compatible-cc-* nodes", () => {
const executor = new DefaultExecutor("anthropic-compatible-cc-test");
const headers = executor.buildHeaders(
{
accessToken: "tok",
providerSpecificData: { customHeaders: { "X-CC-Custom": "yes" } },
},
false
) as Record<string, string>;
assert.equal(headers["X-CC-Custom"], "yes", "CC node must apply operator custom headers");
});
// ── LEDGER-10: case-insensitive override — no duplicate Content-Type/Accept ──
test("LEDGER-10: a custom content-type overrides (not duplicates) the executor's Content-Type", () => {
const executor = new DefaultExecutor("openai-compatible-test");
const headers = executor.buildHeaders(
{
apiKey: "k",
providerSpecificData: {
baseUrl: "https://x/v1",
customHeaders: { "content-type": "application/custom" },
},
},
false
) as Record<string, string>;
const ctKeys = Object.keys(headers).filter((k) => k.toLowerCase() === "content-type");
assert.equal(
ctKeys.length,
1,
`exactly one content-type header expected, got ${ctKeys.join(", ")}`
);
assert.equal(headers[ctKeys[0]], "application/custom");
});
test("LEDGER-3: executor still drops auth/forbidden custom headers (defense-in-depth)", () => {
const executor = new DefaultExecutor("openai-compatible-test");
const headers = executor.buildHeaders(
{
apiKey: "real-key",
providerSpecificData: {
baseUrl: "https://x/v1",
customHeaders: { Authorization: "Bearer evil", Host: "evil.example", "X-Ok": "ok" },
},
},
false
) as Record<string, string>;
assert.equal(headers["X-Ok"], "ok");
assert.notEqual(
headers["Authorization"],
"Bearer evil",
"auth must not be overridden by a custom header"
);
assert.ok(!Object.keys(headers).some((k) => k.toLowerCase() === "host"));
});
// ── LEDGER-9: rowToCamel normalizes a NULL _json column to the base key ──
test("LEDGER-9: rowToCamel surfaces a NULL _json column under the base key as null", () => {
const row = { id: "x", custom_headers_json: null, name: "n" };
const camel = core.rowToCamel(row);
assert.equal(camel?.customHeaders, null, "NULL _json column should be customHeaders: null");
assert.ok(
!("customHeadersJson" in (camel as object)),
"the suffixed key must not leak on the null path"
);
});
// ── LEDGER-11: a node created on a fresh DB round-trips the custom_headers_json column ──
test("LEDGER-11: fresh-DB migration leaves provider_nodes.custom_headers_json usable", async () => {
const created = await providersDb.createProviderNode({
type: "openai-compatible",
name: "fresh",
prefix: "fresh",
apiType: "chat",
baseUrl: "https://x/v1",
customHeaders: { "X-A": "1" },
});
const fetched = await providersDb.getProviderNodeById(created.id as string);
assert.deepEqual(fetched?.customHeaders, { "X-A": "1" });
});