mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-07-26 09:52:11 +03:00
* chore(release): open v3.8.20 development cycle * fix(images): prefer bare combos over image aliases (#3527) Integrated into release/v3.8.20 * fix(translator): map Codex local_shell tool (#3534) Integrated into release/v3.8.20 * fix(usage): make opencode-go quota fetcher fail-open instead of throwing 500 (#3522) Integrated into release/v3.8.20 * Fix Runtime page breaker state rendering (#3533) Integrated into release/v3.8.20 * Expose provider breaker degradation threshold setting (#3535) Integrated into release/v3.8.20 * fix(executor): strip provider prefix from versioned built-in tool model field (#3532) Integrated into release/v3.8.20 * feat(providers): add Claude Fable 5 support (#3524) Integrated into release/v3.8.20 * feat(resilience): add global provider cooldown tracking to prevent combo re-walking (#3556) Integrated into release/v3.8.20 (default OFF, opt-in) * fix(translator): scope thoughtSignature bypass to Antigravity/CLI only (#3560) Integrated into release/v3.8.20. Co-authored-by: Six7Day <six7day@gmail.com> * fix(routing): normalize thinking:disabled for combo-substituted models that reject it (#3554) (#3563) Integrated into release/v3.8.20 * fix(usage): accept 0/empty budget limits so the dashboard can save and clear (#3537) (#3564) Integrated into release/v3.8.20 * docs(changelog): credit @Six7Day for #3560 thoughtSignature fix (#3414) The #3560 squash co-author trailer landed inline (unparsed by GitHub), so add an explicit CHANGELOG credit ensuring @Six7Day (original #3414) and @oyi77 are on the public record for the Gemini thoughtSignature fix. * fix(gamification): dedup badge unlock via user_badges so events don't re-fire every request (#3472) (#3565) Integrated into release/v3.8.20 * fix(routing): pass through 'auto' keyword on codex /v1/responses instead of rewriting to codex/auto (#3509) (#3566) Integrated into release/v3.8.20 * fix(cli-tools): normalize apiKey null in guide-settings schema so cloud-mode config saves (#3552) (#3567) Integrated into release/v3.8.20 * fix(catalog): reclassify PublicAI from keyless to one-time-initial (requires API key) (#3558) (#3568) Integrated into release/v3.8.20 * fix(gemini-web): surface missing Playwright browser as actionable 503 + cooldown hint, not a retryable 500 loop (#3516) (#3570) Integrated into release/v3.8.20 * fix(security): sanitize raw err.message in web executors + embeddings/search response bodies (Rule #12) (#3494, #3495) (#3573) Integrated into release/v3.8.20 * fix(dashboard): point CustomHostsManager + FeatureFlagsGrid at real routes (#3486, #3487) (#3574) Integrated into release/v3.8.20 * chore(providers): remove dead krutrim entry (#3483) + docs(api): fix agent-bridge per-agent state route (#3489) (#3575) Integrated into release/v3.8.20 * docs(api): correct API_REFERENCE.md paths for skills/plugins/admin/cache/acp/system-info (#3497) (#3577) Integrated into release/v3.8.20 * fix(proxy): drive SOCKS5 UI option from runtime ENABLE_SOCKS5_PROXY, not build-time NEXT_PUBLIC (#3508) (#3579) Integrated into release/v3.8.20 * fix(playground): filter playground models by node prefix so custom-endpoint models appear (#3505) (#3581) Integrated into release/v3.8.20 * fix(usage): show an informative message instead of a blank Kiro quota card when no usage breakdown (#3506) (#3582) Integrated into release/v3.8.20 * docs(changelog): add the #3506 Kiro quota entry (missed in #3582 due to a stale-base CHANGELOG anchor) (#3583) Integrated into release/v3.8.20 * fix(auto-update): use stable PROJECT_ROOT walker, not frozen process.cwd() (#3561) Integrated into release/v3.8.20. Auto-update PROJECT_ROOT now uses a stable __dirname-anchored upward walker instead of the no-op process.cwd() resolver. * fix: address PR #3518 review comments (lifecycle hooks, regex, indentation, route params) (#3562) Integrated into release/v3.8.20. Addresses #3518 review: regex literals, logs/[id] route params (Next 16), indentation, and wires plugin lifecycle hooks (onInstall/onActivate/onDeactivate/onUninstall) in the loader so manager.ts can register them. Adds Rule #18 regression test. * docs(changelog): credit @ViFigueiredo (#3423) for PROJECT_ROOT + log #3561/#3562 (v3.8.20) * fix: openai to gemini incorrectly translates historical tool calls into text (#3569) Integrated into release/v3.8.20. Standard Gemini direct path now maps historical tool calls to native functionCall/functionResponse parts (signaturelessToolCallMode: native) instead of inert text — validated against the real Gemini API (gemini-2.5-flash returns 200 for signatureless native functionCall, even with tools+thinking; Hard Rule #18). Eliminates the text-serialization leak. Antigravity/CLI sentinel path (#3560) untouched. * docs(changelog)+test: reconcile standard-Gemini native mode (#3569) — update round-2 rationale comment + log VPS validation * docs(changelog): reconcile v3.8.20 — add 9 missing bullets + move [Unreleased] to versioned section * docs(changelog): complete v3.8.20 reconciliation — 27 bullets, 11 contributors --------- Co-authored-by: Alexander Averyanov <alex@averyan.ru> Co-authored-by: Hakan Kurşun <bykamaka@gmail.com> Co-authored-by: Wilson <pedbookmed@gmail.com> Co-authored-by: Randi <55005611+rdself@users.noreply.github.com> Co-authored-by: Giorgos Giakoumettis <giorgos@yiakoumettis.gr> Co-authored-by: PizzaV <103120356+pizzav-xyz@users.noreply.github.com> Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com> Co-authored-by: Markus Hartung <mail@hartmark.se>
261 lines
12 KiB
JavaScript
261 lines
12 KiB
JavaScript
#!/usr/bin/env node
|
|
// scripts/check/check-error-helper.mjs
|
|
// Gate Hard Rule #12 (error sanitization): error responses/results built in
|
|
// open-sse/executors/ and open-sse/handlers/ MUST route through the helpers in
|
|
// open-sse/utils/error.ts (buildErrorBody / errorResponse / sanitizeErrorMessage /
|
|
// sanitizeUpstreamDetails / makeExecutorErrorResult / formatProviderError / …) so
|
|
// raw err.stack / err.message / upstream body.error.message never reach a client.
|
|
//
|
|
// The risk: a file that builds its own `new Response(JSON.stringify({ error: {
|
|
// message: err.message } }))` (or a result object with `error: <raw msg>`) and does
|
|
// NOT import the sanitizer leaks stack traces / absolute paths / upstream internals.
|
|
// CodeQL's js/stack-trace-exposure does not understand the custom sanitizer, so this
|
|
// static gate is the canonical enforcement. See docs/security/ERROR_SANITIZATION.md.
|
|
//
|
|
// Conservative by design: a file is flagged ONLY when it both (a) appears to forward
|
|
// a RAW error value into a response/result body AND (b) imports nothing from a
|
|
// utils/error path. Files that import the helper are trusted (the `body.error.message`
|
|
// they reference is the sanitized output of buildErrorBody, not raw upstream).
|
|
import fs from "node:fs";
|
|
import path from "node:path";
|
|
import { pathToFileURL } from "node:url";
|
|
|
|
const cwd = process.cwd();
|
|
const SCAN_DIRS = [
|
|
path.join(cwd, "open-sse/executors"),
|
|
path.join(cwd, "open-sse/handlers"),
|
|
];
|
|
|
|
// Pre-existing violators frozen so the gate is green NOW and blocks only NEW leaks.
|
|
// Each entry is a real Rule #12 gap (raw err.message forwarded into a response body
|
|
// with no utils/error import) and should become a tracked cleanup issue: route the
|
|
// message through sanitizeErrorMessage()/buildErrorBody()/makeExecutorErrorResult().
|
|
// Do NOT add new entries without a justification — that defeats the gate.
|
|
export const KNOWN_MISSING_ERROR_HELPER = new Set([]);
|
|
|
|
// Import specifiers that count as "uses the error helper" (path ends in utils/error).
|
|
const ERROR_HELPER_IMPORT =
|
|
/\bfrom\s*["'](?:\.{1,2}\/)*(?:open-sse\/)?utils\/error(?:\.[tj]s)?["']|@omniroute\/open-sse\/utils\/error/;
|
|
|
|
// A caught-error identifier whose .message/.stack is RAW (not sanitized): the leading
|
|
// token must be exactly `err` / `error` / `e` (optionally `(err as Error)` cast), and
|
|
// NOT preceded by a member access — so `event.error.message` (an upstream-event read)
|
|
// does not match, only our own caught `err.message` / `error.stack` / `(err as …).msg`.
|
|
// The `(?<![.\w])` lookbehind is non-consuming so it works mid-template (e.g. `${err…`).
|
|
const RAW_ERR = String.raw`(?:\((?:err|error|e)\s+as\s+[^)]+\)|(?<![.\w])(?:err|error|e))\.(?:message|stack)\b`;
|
|
|
|
// Lines that are internal sinks (never reach the client) — excluded so the gate does
|
|
// not false-positive on logging, DB audit rows, thrown Errors, or rejected promises.
|
|
const INTERNAL_SINK =
|
|
/\b(?:log\??\.\w+\??\.?\(|console\.\w+\(|saveCallLog\s*\(|reqLogger\.|throw\s+new\s+\w*Error|reject\s*\(|\.error\??\.\(|finish\s*\()/;
|
|
|
|
// Internal-sink CALL openers — when a raw-error field sits inside one of these calls'
|
|
// argument object (e.g. `saveCallLog({ … error: err.message … })`), it is a DB audit
|
|
// row / log entry, not a client response. Matched against the line that opens the
|
|
// nearest still-unclosed call enclosing the flagged line.
|
|
const INTERNAL_SINK_CALL =
|
|
/\b(?:saveCallLog|log\??\.\w+|console\.\w+|reqLogger\.\w+)\s*\(\s*\{?\s*$/;
|
|
|
|
// A line that is constructing a client-facing response/result body.
|
|
const RESPONSE_LINE =
|
|
/new\s+Response\s*\(|\bresponse\s*:|\berrResp\s*\(|\bmakeErrorResponse\s*\(|\berrorResponse\s*\(/;
|
|
|
|
function walk(dir, acc = []) {
|
|
if (!fs.existsSync(dir)) return acc;
|
|
for (const e of fs.readdirSync(dir, { withFileTypes: true })) {
|
|
const p = path.join(dir, e.name);
|
|
if (e.isDirectory()) walk(p, acc);
|
|
else if (/\.tsx?$/.test(e.name) && !/\.test\.tsx?$/.test(e.name)) acc.push(p);
|
|
}
|
|
return acc;
|
|
}
|
|
|
|
// A raw caught-error value assigned to / interpolated into a `message:`/`error:` field.
|
|
const RAW_ERR_FIELD = new RegExp(String.raw`\b(?:message|error)\s*:\s*` + RAW_ERR);
|
|
const RAW_ERR_FIELD_INTERP = new RegExp(
|
|
String.raw`\b(?:message|error)\s*:\s*[\`"'][^\n]*\$\{[^}]*` + RAW_ERR
|
|
);
|
|
|
|
// A raw caught-error value interpolated anywhere on a line that also builds a Response.
|
|
const RAW_ERR_INTERP = new RegExp(String.raw`\$\{[^}]*` + RAW_ERR);
|
|
|
|
// Upstream `body.error.message` forwarded into a field without a sanitize call.
|
|
const RAW_BODY_ERR = /\b(?:message|error)\s*:\s*[^,}\n]*\bbody\.error\.message\b/;
|
|
|
|
// A response-builder CALL that takes a message argument (client-facing). A tainted
|
|
// local variable (assigned from a raw error) passed here is a leak.
|
|
const RESPONSE_BUILDER_CALL =
|
|
/\b(?:errResp|makeErrorResponse|errorResponse)\s*\(|\bresponse\s*:\s*(?:errResp|makeErrorResponse|errorResponse|new\s+Response)\s*\(/;
|
|
|
|
// `const|let <id> = <expr containing a raw caught-error>` — a tainted local holding a
|
|
// raw, unsanitized error string. Captures the variable name for downstream tracking.
|
|
const TAINT_DECL = new RegExp(
|
|
String.raw`\b(?:const|let|var)\s+([A-Za-z_$][\w$]*)\s*=\s*[^;\n]*` + RAW_ERR
|
|
);
|
|
|
|
/**
|
|
* Does this source forward a RAW error value into a CLIENT-FACING response/result body?
|
|
*
|
|
* Line-anchored + sink-aware so it does not false-positive on logging, DB audit rows
|
|
* (saveCallLog), thrown Errors, rejected promises, or parsed upstream-event reads.
|
|
*
|
|
* A line is a violation when, after skipping internal-sink lines, it either:
|
|
* - assigns/interpolates a raw caught-error into a `message:`/`error:` field, or
|
|
* - interpolates a raw caught-error AND is itself a Response/result-builder line, or
|
|
* - forwards upstream `body.error.message` into a field without sanitizing, or
|
|
* - passes a TAINTED local (a var assigned from a raw error, never sanitized) into a
|
|
* response-builder call (errResp / makeErrorResponse / errorResponse / new Response).
|
|
*/
|
|
function forwardsRawError(source) {
|
|
const lines = source.split("\n").map((l) => l.replace(/\/\/.*$/, ""));
|
|
|
|
// Pass 1: collect tainted local variables (raw error, no sanitize on the line).
|
|
const tainted = new Set();
|
|
for (const line of lines) {
|
|
if (INTERNAL_SINK.test(line)) continue;
|
|
const m = line.match(TAINT_DECL);
|
|
if (m && !/sanitize/i.test(line)) tainted.add(m[1]);
|
|
}
|
|
const taintedUse =
|
|
tainted.size > 0
|
|
? new RegExp(String.raw`\b(?:${[...tainted].join("|")})\b`)
|
|
: null;
|
|
|
|
// Pass 2: scan for leak lines.
|
|
for (let i = 0; i < lines.length; i++) {
|
|
const line = lines[i];
|
|
if (!line.trim()) continue;
|
|
if (INTERNAL_SINK.test(line)) continue; // log / audit / throw / reject
|
|
if (TAINT_DECL.test(line)) continue; // the assignment itself is not the leak
|
|
|
|
const directLeak =
|
|
RAW_ERR_FIELD.test(line) ||
|
|
RAW_ERR_FIELD_INTERP.test(line) ||
|
|
(RAW_ERR_INTERP.test(line) && RESPONSE_LINE.test(line)) ||
|
|
// Multi-line OpenAI error envelope: a raw-error interpolation that sits inside
|
|
// an enclosing `error: {` / `message:` field of a `new Response(` body.
|
|
(RAW_ERR_INTERP.test(line) && enclosedByErrorResponseBody(lines, i)) ||
|
|
(RAW_BODY_ERR.test(line) && !/sanitize/i.test(line));
|
|
|
|
const taintedLeak =
|
|
taintedUse !== null && RESPONSE_BUILDER_CALL.test(line) && taintedUse.test(line);
|
|
|
|
// The raw error reaches a client body unless it lives inside an internal-sink
|
|
// call's argument object (saveCallLog / log / console / reqLogger).
|
|
if ((directLeak || taintedLeak) && !enclosedByInternalSinkCall(lines, i)) return true;
|
|
}
|
|
return false;
|
|
}
|
|
|
|
/**
|
|
* Walk back from `idx`, tracking net brace/paren depth, to find the line that opens
|
|
* the call enclosing `idx`. Returns true if that opener is an internal-sink call.
|
|
* Bounded lookback (sink-call argument objects are small) keeps this cheap.
|
|
*/
|
|
function enclosedByInternalSinkCall(lines, idx) {
|
|
let depth = 0;
|
|
for (let j = idx; j >= 0 && idx - j < 80; j--) {
|
|
const l = lines[j].replace(/\/\/.*$/, "");
|
|
for (let k = l.length - 1; k >= 0; k--) {
|
|
const ch = l[k];
|
|
if (ch === ")" || ch === "}") depth++;
|
|
else if (ch === "(" || ch === "{") {
|
|
if (depth === 0) {
|
|
// Unbalanced opener at this position — the enclosing construct starts here.
|
|
return INTERNAL_SINK_CALL.test(l.slice(0, k + 1));
|
|
}
|
|
depth--;
|
|
}
|
|
}
|
|
}
|
|
return false;
|
|
}
|
|
|
|
// Field opener that is part of an OpenAI-style error envelope (`error: {` / `message:`).
|
|
const ERROR_FIELD_OPENER = /\b(?:error|message)\s*:\s*[`{]?\s*$/;
|
|
|
|
/**
|
|
* Walk back from `idx` to the nearest enclosing `{`/`(` opener; if it opens an error
|
|
* envelope field (`error: {` / `message:`) AND a `new Response(` / `response:` builder
|
|
* appears just above it, the raw error reaches a client error body. Conservative: only
|
|
* the canonical error-envelope shape qualifies (not `content:` / data fields).
|
|
*/
|
|
function enclosedByErrorResponseBody(lines, idx) {
|
|
let depth = 0;
|
|
for (let j = idx; j >= 0 && idx - j < 80; j--) {
|
|
const l = lines[j].replace(/\/\/.*$/, "");
|
|
for (let k = l.length - 1; k >= 0; k--) {
|
|
const ch = l[k];
|
|
if (ch === ")" || ch === "}") depth++;
|
|
else if (ch === "(" || ch === "{") {
|
|
if (depth === 0) {
|
|
if (!ERROR_FIELD_OPENER.test(l.slice(0, k + 1))) return false;
|
|
// Confirm a Response builder sits in the few lines above the envelope.
|
|
const window = lines.slice(Math.max(0, j - 8), j + 1).join("\n");
|
|
return /new\s+Response\s*\(|\bresponse\s*:/.test(window);
|
|
}
|
|
depth--;
|
|
}
|
|
}
|
|
}
|
|
return false;
|
|
}
|
|
|
|
export function findErrorHelperViolations(files, allowlist) {
|
|
const violations = [];
|
|
for (const { path: rel, source } of files) {
|
|
if (allowlist.has(rel)) continue;
|
|
if (ERROR_HELPER_IMPORT.test(source)) continue; // trusts the helper
|
|
if (forwardsRawError(source)) violations.push(rel);
|
|
}
|
|
return violations;
|
|
}
|
|
|
|
function collectFiles() {
|
|
const files = [];
|
|
for (const dir of SCAN_DIRS) {
|
|
for (const p of walk(dir)) {
|
|
files.push({
|
|
path: path.relative(cwd, p).replace(/\\/g, "/"),
|
|
source: fs.readFileSync(p, "utf8"),
|
|
});
|
|
}
|
|
}
|
|
return files;
|
|
}
|
|
|
|
function main() {
|
|
const files = collectFiles();
|
|
const violations = findErrorHelperViolations(files, KNOWN_MISSING_ERROR_HELPER);
|
|
|
|
// Surface allowlist drift: entries that no longer match a real file (cleaned up or
|
|
// renamed) so the allowlist does not rot. This is a warning, not a failure.
|
|
const present = new Set(files.map((f) => f.path));
|
|
const stale = [...KNOWN_MISSING_ERROR_HELPER].filter((p) => !present.has(p));
|
|
if (stale.length) {
|
|
console.warn(
|
|
`[check-error-helper] WARN: ${stale.length} allowlist entr${
|
|
stale.length === 1 ? "y" : "ies"
|
|
} no longer match a file (remove from KNOWN_MISSING_ERROR_HELPER):\n` +
|
|
stale.map((p) => " - " + p).join("\n")
|
|
);
|
|
}
|
|
|
|
if (violations.length) {
|
|
console.error(
|
|
`[check-error-helper] ${violations.length} file(s) build an error response/result with a ` +
|
|
`raw err.message/err.stack/body.error.message but do NOT import open-sse/utils/error:\n` +
|
|
violations.map((v) => " ✗ " + v).join("\n") +
|
|
`\n → route the message through buildErrorBody()/sanitizeErrorMessage()/` +
|
|
`makeExecutorErrorResult() (see docs/security/ERROR_SANITIZATION.md), or — if it is a ` +
|
|
`false positive — add it to KNOWN_MISSING_ERROR_HELPER with a justification.`
|
|
);
|
|
process.exit(1);
|
|
}
|
|
console.log(
|
|
`[check-error-helper] OK (${files.length} files scanned, ${KNOWN_MISSING_ERROR_HELPER.size} known-missing frozen)`
|
|
);
|
|
}
|
|
|
|
if (import.meta.url === pathToFileURL(process.argv[1] || "").href) main();
|