mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-08-03 05:45:04 +03:00
* chore(release): open v3.8.23 development cycle
* fix(anthropic): strip top_p when temperature is set to avoid 400 (#3691)
Integrated into release/v3.8.23
* fix(vertex): support Vertex AI Express-mode API keys (#3690)
Integrated into release/v3.8.23
* fix(stream): error on empty Claude SSE instead of synthetic success (#3689)
Integrated into release/v3.8.23
* fix(oauth): stop token-refresh invalidation loop + harden proxy resolution (#3692)
Integrated into release/v3.8.23
* docs: add FUNDING.yml and Support section to README (#3698)
Integrated into release/v3.8.23
* feat: gemini - handle known ratelimits (#3686)
Integrated into release/v3.8.23
* fix: stream combo fails over on empty content-filtered response (#3685) (#3702)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix(antigravity): preserve gemini-3.1-pro high/low budget tiers (#3696) (#3703)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
* feat(auto-combo): add auto-updating model intelligence scoring (#3660)
Integrated into release/v3.8.23
* fix(gemini): context-mode fallback for signatureless tool calls (#3688) (#3704)
* chore(quality-gate): reconcile file-size baseline (27 files + providerLimits.ts) (#3705)
* feat(vertex): dynamic model discovery via Generative Language models API (#3712)
Integrated into release/v3.8.23. Vertex dynamic model discovery — surfaces image models (imagen-*, gemini-*-image), embeddings and audio from the live Generative Language catalog, with cached→static fallback and the shared parseGeminiModelsList helper. Validated: parser test 5/5, typecheck:core clean.
* fix(combo): gate reasoning token buffer (#3700)
Integrated into release/v3.8.23. Makes the #3588 reasoning token buffer safe and configurable: only inflates max_tokens when the model has a known, non-default output cap and the buffered value fits inside it; otherwise preserves/clamps the client limit. Adds the reasoningTokenBufferEnabled kill switch (default ON). Validated: combo-routing-engine 81/81, combo-config 25/25, combo-quality-validator-reasoning 12/12, phase1f 10/10, typecheck:core clean.
* refactor(#3501): god-component Phase 1g-1j — client 4062→3408 LOC (-654) (#3717)
Phase 1g-1j of #3501: client 4062→3408 LOC. Pure extraction (ProviderPlaygroundPanel, useCommandCodeAuth, useExternalLinkFlow+ExternalLinkModal, useAuthFileHandlers) + loadConnProxies ReferenceError fix + phase1f test path fix.
Co-authored-by: oyi77 <14921983+oyi77@users.noreply.github.com>
* refactor(#3501): god-component Phase 1k-1m — client 3408→2553 LOC (-855) (#3721)
Phase 1k-1m of #3501: client 3408→2553 LOC. Pure extraction (useModelImportHandlers+ImportProgressModal, useModelVisibilityHandlers, ProviderModelsSection).
Co-authored-by: oyi77 <14921983+oyi77@users.noreply.github.com>
* docs(changelog): restore #3590 bullet lost on the v3.8.20 release branch
The fix itself reached main pre-tag via cherry-pick #3591, but its changelog
bullet (commit e33fdd4ab) only ever existed on release/v3.8.20 after the
squash-merge. Restored under [3.8.20] per the 2026-06-12 release-branch
leftover audit (_tasks/release-audit/release-leftovers-audit-2026-06-12.md).
* fix(kiro): resolve quota for IAM Identity Center accounts missing a profileArn (#3722)
Integrated into release/v3.8.23
* refactor(#3501): god-component Phase 1n-1s — client 2553→1376 LOC (-1177) (#3725)
Phase 1n-1s of #3501: client 2553→1376 LOC. Pure extraction (ConnectionsListPanel, ConnectionsHeaderToolbar, ZedImportCard, BatchTestResultsModal, AdaptaTutorialModal, useApiKeySave + helpers).
Co-authored-by: oyi77 <14921983+oyi77@users.noreply.github.com>
* feat(model-lockout): settings UI, backend integration, error classification, and success-decay recovery (#3629)
Integrated into release/v3.8.23
* refactor(#3501): god-component Phase 1t — client 1376→781 LOC (≤800 TARGET REACHED ✅) (#3727)
Phase 1t of #3501: client 1376→781 LOC (≤800 reached). Original god-component 12,882→781 (−94%).
Co-authored-by: oyi77 <14921983+oyi77@users.noreply.github.com>
* fix: bundle @omniroute/opencode-plugin inside omniroute + add 'setup opencode' CLI command (#3726)
Integrated into release/v3.8.23
* feat(vertex): self-tracked USD spend since account added (#3724)
Integrated into release/v3.8.23
* fix(qwen-web): migrate to v2 chat API with full cookie-jar replay (#3288) (#3723)
Integrated into release/v3.8.23
* fix(sse): make safeLogEvents async — 'await' in a sync function broke every chatHelpers import
#3692 added a lazy 'await import(proxyEgress)' for egress-IP visibility inside
safeLogEvents, which is a sync function — an ES syntax error. It went unnoticed
because typecheck:core does not cover src/sse and no test in the merge gates
loaded chatHelpers via tsx; any consumer that did (chat-context-relay and
chat-route-coverage suites, integration harnesses) failed at module load with
'await can only be used inside an async function'.
safeLogEvents is fire-and-forget logging with an outer try/catch, so making it
async (and 'void'-ing the single chat.ts call site) preserves behavior exactly.
Validation: tests/unit/chat-context-relay.test.ts + chat-route-coverage.test.ts
went from failing-at-load to green (+14 tests destravados).
* fix(sse): remove cross-provider credential leak in emergency fallback + combo/proxy audit fixes (#3699)
Integrated into release/v3.8.23
* fix(executors): inject MiMoCode anti-abuse marker so free endpoint stops 403ing (#3728)
Integrated into release/v3.8.23
* fix(dashboard): repair "Test all models" — toast crash, status icons, auto-hide (#3729)
Integrated into release/v3.8.23
* chore(deps): bump actions/upload-artifact from 4 to 7 (#3735)
Integrated into release/v3.8.23 — aligns upload-artifact to v7 (already used across ci.yml).
* chore(deps): bump actions/cache from 4 to 5 (#3734)
Integrated into release/v3.8.23 — actions/cache v4→v5.
* chore(deps): bump actions/download-artifact from 4 to 8 (#3733)
Integrated into release/v3.8.23 — download-artifact v4→v8.
* feat(fallback): add OMNIROUTE_EMERGENCY_FALLBACK env switch (#3741)
Adds an OMNIROUTE_EMERGENCY_FALLBACK env switch to disable the emergency budget-exhaustion fallback (reroute to free nvidia/gpt-oss-120b). Default unchanged (enabled). Closes #3739, related #2879.
Integrated into release/v3.8.23.
* i18n: comprehensive zh-CN translation improvements (#3736)
Aligns zh-CN to en (hundreds of entries), translates batch-action labels + settings sidebar menu, adds categoryConfig/endpointTokenSaver keys, resolves __MISSING__ stubs. Sidebar/SidebarTab hardcoded strings replaced with t(). en.json purely additive (8 new sidebar.* keys, 0 removed); cli-i18n gate green.
Integrated into release/v3.8.23.
* chore(release): v3.8.23 — 2026-06-12
- CHANGELOG: complete v3.8.23 section (28 bullets, 27 commits)
- fix(webdav): resolve promise on writeStream finish, not req end — eliminates
intermittent 500 on PUT update (writeStream may not have flushed at rename time)
- test(autoCombo): stub DB calls from PR #3660 in tieredRotation.test.ts to prevent
5s timeout in vitest (getModelIntelligenceBySource DB init path)
- chore(env-sync): add XDG_DATA_HOME + OMNIROUTE_OPENCODE_PLUGIN_DIR to IGNORE_FROM_CODE
allowlist (introduced by PR #3726 setup-open-code.mjs, not OmniRoute config vars)
- chore(cli): regenerated bin/cli/api-commands/*.mjs (7 new, 27 updated)
* fix(model-family): fallback lookup also tries bare model name with dots
getNextFamilyFallback normalized dots-to-hyphens ("gemini-3.1-pro-high" →
"gemini-3-1-pro-high") but MODEL_FAMILIES keys use the literal dot form. The
lookup always missed, returning null for any model whose dots are part of the
name rather than a version separator.
Fallback: try MODEL_FAMILIES[lookupKey] ?? MODEL_FAMILIES[bareModel] so both
naming conventions are covered. Fixes T30 test (pre-existing since v3.8.22).
* feat: expose API key cost drilldown + quota % used (#3742)
Adds all-time USD cost per API key in the API Key Manager, a per-key deep-link into the Cost Explorer (filtered + grouped by model), URL-param hydration of range/groupBy/apiKeyIds, and a '% used' quota display. Review adjustments: extracted URL-param parsers to a tested module (Rule #18), i18n'd the new strings (en + zh-CN), dropped the redundant webdav-handler entry already on release.
Integrated into release/v3.8.23.
* feat: add provider display modes — All / Configured / Compact (#3743)
Replaces the Providers page configured-only toggle with All/Configured/Compact display modes (Compact = flat deduped grid, no-auth last). Persists the preference and migrates the legacy localStorage key. Rebased onto release/v3.8.23.
Integrated into release/v3.8.23.
* fix(cache): scope semantic-cache signature to API key (#3740)
Adds the api_key_id dimension to generateSignature's SHA-256 hash so two callers with different API keys never receive each other's cached responses. Threads apiKeyId through checkSemanticCache + both write sites; migration 098 clears pre-existing key-less entries; unauthenticated requests stay isolated from keyed ones. 3 TDD tests.
Integrated into release/v3.8.23.
* fix(responses): apply OpenAI Responses API stream=false spec default (#3708)
resolveStreamFlag now applies the stream=false-when-omitted default for sourceFormat=openai-responses (same as the existing claude path), so spec-compliant /v1/responses upstreams that return JSON no longer fall through to the wildcard-Accept heuristic and trigger STREAM_EARLY_EOF / 502. Codex CLI (stream:true) and explicit text/event-stream clients unaffected.
Integrated into release/v3.8.23.
* chore(release): reconcile CI gates for v3.8.23
- file-size baseline: re-freeze 8 files grown by PRs #3742/#3743/#3740
(cost drilldown, provider display modes, cache key isolation)
- ARCHITECTURE.md: update executor count 55→60 (check:docs-counts drift)
- .env.example: add OMNIROUTE_EMERGENCY_FALLBACK (#3741, env-doc-sync)
- CHANGELOG: add formatted bullets for #3742, #3743, #3708, #3740,
model-family-fallback fix; remove duplicate raw ### Fixed section
* test: restore assert count to satisfy check:test-masking gate
Three test files had net assertion removals after behavior-changing PRs:
- chatcore-translation-paths: emergency fallback moved to routing layer
(#3699) — add body error assertion + model-name guard
- executor-vertex-extended: non-JSON is now Express API key (#3690) —
add projects/-path guard to the express-key URL test
- stream-utils: empty streams now emit error (#3685) — add code/message/
status/completePayload guards to both passthrough and translate variants
All new assertions are meaningful (code enum value, 5xx range, non-empty
message, onComplete must-not-fire contract).
* fix(ci): move rtl-logical-classes test to ui/ so vitest:ui runner collects it
---------
Co-authored-by: Felipe Almeman <4226997+zhiru@users.noreply.github.com>
Co-authored-by: NOXX - Commiter <artur1992123@mail.ru>
Co-authored-by: Nick Sullivan <142708+TechNickAI@users.noreply.github.com>
Co-authored-by: Markus Hartung <mail@hartmark.se>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: PizzaV <103120356+pizzav-xyz@users.noreply.github.com>
Co-authored-by: Randi <55005611+rdself@users.noreply.github.com>
Co-authored-by: oyi77 <14921983+oyi77@users.noreply.github.com>
Co-authored-by: Chewji <126886556+Chewji9875@users.noreply.github.com>
Co-authored-by: Hernan Javier Ardila Sanchez <hjasgr@gmail.com>
Co-authored-by: Felipe Sartori <felipesartori.ti@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Zois Pagoulatos <zpagoulatos@hotmail.com>
Co-authored-by: sdfsdfw2 <167810361+sdfsdfw2@users.noreply.github.com>
Co-authored-by: Witroch4 <witalo_rocha@hotmail.com>
586 lines
23 KiB
TypeScript
586 lines
23 KiB
TypeScript
/**
|
|
* Integration Wiring Verification Tests
|
|
*
|
|
* Validates that backend modules are correctly wired into the current
|
|
* OmniRoute architecture (TypeScript + App Router route.ts files).
|
|
*/
|
|
|
|
import { describe, it } from "node:test";
|
|
import assert from "node:assert/strict";
|
|
import { readFileSync, existsSync, readdirSync } from "node:fs";
|
|
import { join, dirname } from "node:path";
|
|
import { fileURLToPath } from "node:url";
|
|
|
|
const __dirname = dirname(fileURLToPath(import.meta.url));
|
|
const ROOT = join(__dirname, "..", "..");
|
|
|
|
function readProjectFile(relPath: string) {
|
|
const full = join(ROOT, relPath);
|
|
if (!existsSync(full)) return null;
|
|
return readFileSync(full, "utf8");
|
|
}
|
|
|
|
function assertFileExists(relPath: string) {
|
|
const full = join(ROOT, relPath);
|
|
assert.ok(existsSync(full), `${relPath} should exist`);
|
|
return full;
|
|
}
|
|
|
|
function assertRouteMethods(relPath: string, methods: string[]) {
|
|
const src = readProjectFile(relPath);
|
|
assert.ok(src, `${relPath} should exist`);
|
|
for (const method of methods) {
|
|
assert.match(src, new RegExp(`export\\s+async\\s+function\\s+${method}\\s*\\(`));
|
|
}
|
|
}
|
|
|
|
function listProjectFiles(relPath: string): string[] {
|
|
const full = join(ROOT, relPath);
|
|
if (!existsSync(full)) return [];
|
|
|
|
return readdirSync(full, { withFileTypes: true }).flatMap((entry) => {
|
|
const childRelPath = `${relPath}/${entry.name}`;
|
|
if (entry.isDirectory()) return listProjectFiles(childRelPath);
|
|
return childRelPath;
|
|
});
|
|
}
|
|
|
|
// ─── Pipeline Wiring ─────────────────────────────────
|
|
|
|
describe("Pipeline Wiring — server-init.ts", () => {
|
|
const src = readProjectFile("src/server-init.ts");
|
|
|
|
it("should initialize compliance audit log", () => {
|
|
assert.ok(src, "src/server-init.ts should exist");
|
|
assert.match(src, /initAuditLog/);
|
|
});
|
|
|
|
it("should cleanup expired logs", () => {
|
|
assert.match(src, /cleanupExpiredLogs/);
|
|
});
|
|
|
|
it("should enforce secrets before startup", () => {
|
|
assert.match(src, /enforceSecrets/);
|
|
});
|
|
|
|
it("should enforce web runtime env before startup", () => {
|
|
assert.match(src, /enforceWebRuntimeEnv/);
|
|
});
|
|
|
|
it("should log server.start audit event", () => {
|
|
assert.match(src, /server\.start/);
|
|
});
|
|
|
|
it("should use the structured startup logger instead of direct console calls", () => {
|
|
assert.match(src, /createLogger\("server-init"\)/);
|
|
assert.doesNotMatch(src, /console\.(log|warn|error|info|debug)\(/);
|
|
});
|
|
});
|
|
|
|
describe("Pipeline Wiring — instrumentation-node.ts", () => {
|
|
const src = readProjectFile("src/instrumentation-node.ts");
|
|
|
|
it("should seed default model aliases during startup restore", () => {
|
|
assert.ok(src, "src/instrumentation-node.ts should exist");
|
|
assert.match(src, /seedDefaultModelAliases/);
|
|
});
|
|
});
|
|
|
|
describe("Pipeline Wiring — sse chat handler", () => {
|
|
const src = readProjectFile("src/sse/handlers/chat.ts");
|
|
const coreSrc = readProjectFile("open-sse/handlers/chatCore.ts");
|
|
|
|
it("should import and use guardrail pre-call validation", () => {
|
|
assert.ok(src, "src/sse/handlers/chat.ts should exist");
|
|
assert.match(src, /guardrailRegistry/);
|
|
assert.match(src, /runPreCallHooks/);
|
|
});
|
|
|
|
it("should import circuit breaker integration", () => {
|
|
assert.match(src, /getCircuitBreaker|CircuitBreakerOpenError/);
|
|
});
|
|
|
|
it("should use credential preflight instead of global model quarantine gates", () => {
|
|
assert.match(src, /getProviderCredentialsWithQuotaPreflight/);
|
|
});
|
|
|
|
it("should import request telemetry integration", () => {
|
|
assert.match(src, /RequestTelemetry|recordTelemetry/);
|
|
});
|
|
|
|
it("should import request id generation", () => {
|
|
assert.match(src, /generateRequestId/);
|
|
});
|
|
|
|
it("should keep cost tracking integration in the chat pipeline", () => {
|
|
assert.ok(coreSrc, "open-sse/handlers/chatCore.ts should exist");
|
|
assert.match(coreSrc, /calculateCost/);
|
|
assert.match(coreSrc, /recordCost/);
|
|
});
|
|
|
|
it("should not track backup artifacts in the active src/sse shim", () => {
|
|
const trackedArtifactNames = listProjectFiles("src/sse").filter((file) =>
|
|
/\.(orig|bak|backup)$/i.test(file)
|
|
);
|
|
|
|
assert.deepEqual(trackedArtifactNames, []);
|
|
});
|
|
});
|
|
|
|
describe("Pipeline Wiring — middleware proxy", () => {
|
|
const proxySrc = readProjectFile("src/proxy.ts");
|
|
const pipelineSrc = readProjectFile("src/server/authz/pipeline.ts");
|
|
|
|
it("should exist and delegate to authz pipeline", () => {
|
|
assert.ok(proxySrc, "src/proxy.ts should exist");
|
|
assert.match(proxySrc, /runAuthzPipeline/);
|
|
});
|
|
|
|
it("should generate request id for tracing in the authz pipeline", () => {
|
|
assert.ok(pipelineSrc, "src/server/authz/pipeline.ts should exist");
|
|
assert.match(pipelineSrc, /generateRequestId|X-Request-Id/);
|
|
});
|
|
|
|
it("should enforce body size guard in the authz pipeline", () => {
|
|
assert.match(pipelineSrc, /checkBodySize|getBodySizeLimit|bodySize/i);
|
|
});
|
|
|
|
it("should resolve JWT secret in the authz pipeline", () => {
|
|
assert.match(pipelineSrc, /getJwtSecret|jwtSecret|JWT_SECRET/i);
|
|
});
|
|
});
|
|
|
|
// ─── API Routes ──────────────────────────────────────
|
|
|
|
describe("API Routes — existence check", () => {
|
|
const routes = [
|
|
"src/app/api/cache/stats/route.ts",
|
|
"src/app/api/telemetry/summary/route.ts",
|
|
"src/app/api/usage/budget/route.ts",
|
|
"src/app/api/usage/quota/route.ts",
|
|
"src/app/api/fallback/chains/route.ts",
|
|
"src/app/api/compliance/audit-log/route.ts",
|
|
"src/app/api/evals/route.ts",
|
|
"src/app/api/evals/[suiteId]/route.ts",
|
|
"src/app/api/policies/route.ts",
|
|
];
|
|
|
|
for (const route of routes) {
|
|
it(`route file should exist: ${route}`, () => {
|
|
assertFileExists(route);
|
|
});
|
|
}
|
|
});
|
|
|
|
describe("API Routes — export HTTP methods", () => {
|
|
it("/api/cache/stats should export GET and DELETE", () => {
|
|
assertRouteMethods("src/app/api/cache/stats/route.ts", ["GET", "DELETE"]);
|
|
});
|
|
|
|
it("/api/telemetry/summary should export GET", () => {
|
|
assertRouteMethods("src/app/api/telemetry/summary/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/usage/budget should export GET and POST", () => {
|
|
assertRouteMethods("src/app/api/usage/budget/route.ts", ["GET", "POST"]);
|
|
});
|
|
|
|
it("/api/usage/quota should export GET", () => {
|
|
assertRouteMethods("src/app/api/usage/quota/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/fallback/chains should export GET, POST, DELETE", () => {
|
|
assertRouteMethods("src/app/api/fallback/chains/route.ts", ["GET", "POST", "DELETE"]);
|
|
});
|
|
|
|
it("/api/compliance/audit-log should export GET", () => {
|
|
assertRouteMethods("src/app/api/compliance/audit-log/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/evals should export GET and POST", () => {
|
|
assertRouteMethods("src/app/api/evals/route.ts", ["GET", "POST"]);
|
|
});
|
|
|
|
it("/api/evals/[suiteId] should export GET", () => {
|
|
assertRouteMethods("src/app/api/evals/[suiteId]/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/policies should export GET and POST", () => {
|
|
assertRouteMethods("src/app/api/policies/route.ts", ["GET", "POST"]);
|
|
});
|
|
});
|
|
|
|
describe("API Routes — dashboard and tool consumers", () => {
|
|
it("keeps model-combo mapping APIs wired through routing settings", () => {
|
|
const settingsPage = readProjectFile("src/app/(dashboard)/dashboard/settings/routing/page.tsx");
|
|
const modelRoutingSection = readProjectFile("src/shared/components/ModelRoutingSection.tsx");
|
|
|
|
assert.ok(settingsPage, "settings page should exist");
|
|
assert.ok(modelRoutingSection, "ModelRoutingSection should exist");
|
|
assert.match(settingsPage, /ModelRoutingSection/);
|
|
assert.match(modelRoutingSection, /fetch\("\/api\/model-combo-mappings"\)/);
|
|
assert.match(modelRoutingSection, /fetch\(`\/api\/model-combo-mappings\/\$\{editingId\}`/);
|
|
assert.match(modelRoutingSection, /method:\s*"DELETE"/);
|
|
assertRouteMethods("src/app/api/model-combo-mappings/route.ts", ["GET", "POST"]);
|
|
assertRouteMethods("src/app/api/model-combo-mappings/[id]/route.ts", ["GET", "PUT", "DELETE"]);
|
|
});
|
|
|
|
it.skip("keeps log APIs wired through the consolidated logs dashboard", () => {
|
|
const logsPage = readProjectFile("src/app/(dashboard)/dashboard/logs/page.tsx");
|
|
const requestLogger = readProjectFile("src/shared/components/RequestLoggerV2.tsx");
|
|
const proxyLogger = readProjectFile("src/shared/components/ProxyLogger.tsx");
|
|
const consoleLogger = readProjectFile("src/shared/components/ConsoleLogViewer.tsx");
|
|
|
|
assert.ok(logsPage, "logs page should exist");
|
|
assert.ok(requestLogger, "RequestLoggerV2 should exist");
|
|
assert.ok(proxyLogger, "ProxyLogger should exist");
|
|
assert.ok(consoleLogger, "ConsoleLogViewer should exist");
|
|
assert.match(logsPage, /RequestLoggerV2/);
|
|
assert.match(logsPage, /EmailPrivacyToggle/);
|
|
assert.match(logsPage, /ProxyLogger/);
|
|
assert.match(logsPage, /ConsoleLogViewer/);
|
|
// AuditLogTab removed: audit moved to its own /dashboard/audit page (#2859).
|
|
assert.match(logsPage, /\/api\/logs\/export/);
|
|
assert.match(requestLogger, /\/api\/usage\/call-logs/);
|
|
assert.match(requestLogger, /\/api\/logs\/\$\{/);
|
|
assert.doesNotMatch(requestLogger, /\/api\/logs\/active/);
|
|
assert.match(requestLogger, /\/api\/logs\/detail/);
|
|
assert.match(requestLogger, /useEmailPrivacyStore/);
|
|
assert.match(requestLogger, /maskAccount\(log\.account, emailsVisible\)/);
|
|
assert.match(requestLogger, /emailsVisible=\{emailsVisible\}/);
|
|
assert.match(proxyLogger, /\/api\/usage\/proxy-logs/);
|
|
assert.match(consoleLogger, /\/api\/logs\/console/);
|
|
assertRouteMethods("src/app/api/logs/console/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/logs/detail/route.ts", ["GET", "POST"]);
|
|
assertRouteMethods("src/app/api/logs/export/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/proxy-logs/route.ts", ["GET", "DELETE"]);
|
|
assertRouteMethods("src/app/api/usage/call-logs/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/call-logs/[id]/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("keeps request log surfaces on opaque theme colors", () => {
|
|
const requestLogger = readProjectFile("src/shared/components/RequestLoggerV2.tsx");
|
|
const globals = readProjectFile("src/app/globals.css");
|
|
|
|
assert.ok(requestLogger, "RequestLoggerV2 should exist");
|
|
assert.ok(globals, "globals.css should exist");
|
|
assert.match(globals, /--color-card:\s+#ffffff/);
|
|
assert.match(globals, /--color-card:\s+#161b22/);
|
|
assert.match(globals, /--color-card:\s+var\(--color-card\)/);
|
|
assert.match(requestLogger, /bg-black\/5 dark:bg-black\/20/);
|
|
assert.doesNotMatch(requestLogger, /\/api\/logs\/active/);
|
|
});
|
|
|
|
it("keeps usage quota wired through A2A and MCP tools", () => {
|
|
const quotaSkill = readProjectFile("src/lib/a2a/skills/quotaManagement.ts");
|
|
const mcpAdvancedTools = readProjectFile("open-sse/mcp-server/tools/advancedTools.ts");
|
|
const mcpServer = readProjectFile("open-sse/mcp-server/server.ts");
|
|
|
|
assert.ok(quotaSkill, "quotaManagement skill should exist");
|
|
assert.ok(mcpAdvancedTools, "advanced MCP tools should exist");
|
|
assert.ok(mcpServer, "MCP server should exist");
|
|
assert.match(quotaSkill, /\/api\/usage\/quota/);
|
|
assert.match(mcpAdvancedTools, /\/api\/usage\/quota/);
|
|
assert.match(mcpServer, /\/api\/usage\/quota/);
|
|
assertRouteMethods("src/app/api/usage/quota/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("keeps legacy usage history and raw request-log APIs explicitly classified", () => {
|
|
const usageStats = readProjectFile("src/shared/components/UsageStats.tsx");
|
|
const apiReference = readProjectFile("docs/reference/API_REFERENCE.md");
|
|
const openApi = readProjectFile("docs/reference/openapi.yaml");
|
|
|
|
assert.ok(usageStats, "UsageStats compatibility component should exist");
|
|
assert.ok(apiReference, "API reference should exist");
|
|
assert.ok(openApi, "OpenAPI document should exist");
|
|
assert.match(usageStats, /\/api\/usage\/history/);
|
|
assert.match(apiReference, /\/api\/usage\/history/);
|
|
assert.match(apiReference, /\/api\/usage\/request-logs/);
|
|
assert.match(openApi, /\/api\/usage\/history:/);
|
|
assert.match(openApi, /\/api\/usage\/request-logs:/);
|
|
assertRouteMethods("src/app/api/usage/history/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/request-logs/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/logs/route.ts", ["GET"]);
|
|
});
|
|
});
|
|
|
|
describe("API Routes — T09 /v1 catalog consistency", () => {
|
|
const v1RouteSrc = readProjectFile("src/app/api/v1/route.ts");
|
|
const v1ModelsRouteSrc = readProjectFile("src/app/api/v1/models/route.ts");
|
|
const v1CatalogSrc = readProjectFile("src/app/api/v1/models/catalog.ts");
|
|
|
|
it("/api/v1 should delegate model catalog to unified builder", () => {
|
|
assert.ok(v1RouteSrc, "src/app/api/v1/route.ts should exist");
|
|
assert.match(v1RouteSrc, /getUnifiedModelsResponse/);
|
|
assert.match(v1RouteSrc, /from\s+["']\.\/models\/catalog["']/);
|
|
assert.doesNotMatch(v1RouteSrc, /const\s+models\s*=\s*\[/);
|
|
});
|
|
|
|
it("/api/v1/models route should only consume unified model catalog builder", () => {
|
|
assert.ok(v1ModelsRouteSrc, "src/app/api/v1/models/route.ts should exist");
|
|
assert.match(v1ModelsRouteSrc, /from\s+["']\.\/catalog["']/);
|
|
assert.doesNotMatch(
|
|
v1ModelsRouteSrc,
|
|
/export\s+async\s+function\s+getUnifiedModelsResponse\s*\(/
|
|
);
|
|
});
|
|
|
|
it("/api/v1/models/catalog should export unified model catalog builder", () => {
|
|
assert.ok(v1CatalogSrc, "src/app/api/v1/models/catalog.ts should exist");
|
|
assert.match(v1CatalogSrc, /export\s+async\s+function\s+getUnifiedModelsResponse\s*\(/);
|
|
});
|
|
});
|
|
|
|
describe("Dashboard Wiring — T05 payload rules", () => {
|
|
const settingsPageSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/settings/advanced/page.tsx"
|
|
);
|
|
const payloadRulesTabSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/settings/components/PayloadRulesTab.tsx"
|
|
);
|
|
const openapiSrc = readProjectFile("docs/reference/openapi.yaml");
|
|
|
|
it.skip("settings page should surface payload rules inside advanced settings", () => {
|
|
assert.ok(settingsPageSrc, "settings page source should exist");
|
|
assert.match(
|
|
settingsPageSrc,
|
|
/import PayloadRulesTab from "\.\.\/components\/PayloadRulesTab"/
|
|
);
|
|
assert.match(settingsPageSrc, /<PayloadRulesTab\s*\/>/);
|
|
});
|
|
|
|
it("payload rules tab should read and write through the dedicated settings endpoint", () => {
|
|
assert.ok(payloadRulesTabSrc, "payload rules tab source should exist");
|
|
assert.match(payloadRulesTabSrc, /fetch\("\/api\/settings\/payload-rules"\)/);
|
|
assert.match(payloadRulesTabSrc, /fetch\("\/api\/settings\/payload-rules",\s*\{/);
|
|
assert.match(payloadRulesTabSrc, /method:\s*"PUT"/);
|
|
assert.match(payloadRulesTabSrc, /default-raw/);
|
|
});
|
|
|
|
it("openapi should document the payload rules management surface", () => {
|
|
assert.ok(openapiSrc, "docs/reference/openapi.yaml should exist");
|
|
assert.match(openapiSrc, /\/api\/settings\/payload-rules:/);
|
|
assert.match(openapiSrc, /summary:\s+Get payload rules configuration/);
|
|
assert.match(openapiSrc, /ManagementSessionAuth:/);
|
|
assert.match(openapiSrc, /PayloadRulesConfig:/);
|
|
});
|
|
});
|
|
|
|
// ─── Barrel Exports ─────────────────────────────────
|
|
|
|
describe("Barrel Exports — shared/components", () => {
|
|
const src = readProjectFile("src/shared/components/index.tsx");
|
|
|
|
it("should export key shared UI modules", () => {
|
|
assert.ok(src, "src/shared/components/index.tsx should exist");
|
|
for (const name of [
|
|
"Breadcrumbs",
|
|
"EmptyState",
|
|
"NotificationToast",
|
|
"FilterBar",
|
|
"ColumnToggle",
|
|
"DataTable",
|
|
]) {
|
|
assert.match(src, new RegExp(name));
|
|
}
|
|
});
|
|
|
|
it("should re-export layouts", () => {
|
|
assert.match(src, /export\s+\*\s+from\s+"\.\/layouts"/);
|
|
});
|
|
});
|
|
|
|
describe("Barrel Exports — store", () => {
|
|
const src = readProjectFile("src/store/index.ts");
|
|
|
|
it("should export useNotificationStore", () => {
|
|
assert.ok(src, "src/store/index.ts should exist");
|
|
assert.match(src, /useNotificationStore/);
|
|
});
|
|
});
|
|
|
|
describe("Barrel Exports — shared/components/layouts", () => {
|
|
const src = readProjectFile("src/shared/components/layouts/index.tsx");
|
|
|
|
it("should export DashboardLayout and AuthLayout", () => {
|
|
assert.ok(src, "src/shared/components/layouts/index.tsx should exist");
|
|
assert.match(src, /DashboardLayout/);
|
|
assert.match(src, /AuthLayout/);
|
|
});
|
|
});
|
|
|
|
// ─── Layout and Page Integration ────────────────────
|
|
|
|
describe("DashboardLayout Integration", () => {
|
|
const src = readProjectFile("src/shared/components/layouts/DashboardLayout.tsx");
|
|
|
|
it("should render NotificationToast globally", () => {
|
|
assert.ok(src, "src/shared/components/layouts/DashboardLayout.tsx should exist");
|
|
assert.match(src, /NotificationToast/);
|
|
});
|
|
|
|
it.skip("should include Breadcrumbs in page wrapper", () => {
|
|
assert.match(src, /Breadcrumbs/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — logs page wiring", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/logs/page.tsx");
|
|
|
|
it.skip("should wire segmented log tabs", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/logs/page.tsx should exist");
|
|
assert.match(src, /SegmentedControl/);
|
|
assert.match(src, /RequestLoggerV2/);
|
|
assert.match(src, /ProxyLogger/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — settings page wiring", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/settings/resilience/page.tsx");
|
|
const memorySkillsTab = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/settings/components/MemorySkillsTab.tsx"
|
|
);
|
|
|
|
it("should include resilience tab in advanced settings", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/settings/resilience/page.tsx should exist");
|
|
assert.match(src, /ResilienceTab/);
|
|
});
|
|
|
|
it("should not label the active skills settings card as a placeholder", () => {
|
|
assert.ok(memorySkillsTab, "MemorySkillsTab should exist");
|
|
assert.doesNotMatch(memorySkillsTab, /Skills Settings \(placeholder\)/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — cache page wiring", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/cache/page.tsx");
|
|
|
|
it("should consolidate prompt cache metrics directly into cache management", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/cache/page.tsx should exist");
|
|
assert.doesNotMatch(src, /CacheStatsCard/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — cost explorer wiring", () => {
|
|
const costsPage = readProjectFile("src/app/(dashboard)/dashboard/costs/CostOverviewTab.tsx");
|
|
const costExplorerUtils = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/costs/costExplorerUtils.ts"
|
|
);
|
|
|
|
it("should expose an interactive grouped Cost Explorer on the costs dashboard", () => {
|
|
assert.ok(costsPage, "CostOverviewTab should exist");
|
|
assert.ok(costExplorerUtils, "costExplorerUtils should exist");
|
|
assert.match(costsPage, /CostExplorerCard/);
|
|
assert.match(costsPage, /EXPLORER_GROUP_OPTIONS/);
|
|
assert.match(costsPage, /byServiceTier/);
|
|
assert.match(costExplorerUtils, /buildCostExplorerRows/);
|
|
assert.match(costExplorerUtils, /serviceTier/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — combos page empty state", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/combos/page.tsx");
|
|
|
|
it("should use EmptyState when there are no combos", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/combos/page.tsx should exist");
|
|
assert.match(src, /EmptyState/);
|
|
});
|
|
|
|
it("should use notification store for UX feedback", () => {
|
|
assert.match(src, /useNotificationStore/);
|
|
});
|
|
|
|
it("should persist usage guide visibility and allow reopening", () => {
|
|
assert.match(src, /COMBO_USAGE_GUIDE_STORAGE_KEY/);
|
|
assert.match(src, /localStorage/);
|
|
assert.match(src, /handleShowUsageGuide/);
|
|
});
|
|
|
|
it("should expose quick templates and post-create quick test CTA", () => {
|
|
assert.match(src, /COMBO_TEMPLATES/);
|
|
assert.match(src, /applyTemplate/);
|
|
assert.match(src, /recentlyCreatedCombo/);
|
|
assert.match(src, /testNow/);
|
|
});
|
|
|
|
it("should include cost-optimized pricing coverage UX", () => {
|
|
assert.match(src, /hasPricingForModel/);
|
|
assert.match(src, /pricingCoveragePercent/);
|
|
assert.match(src, /pricingCoverage/);
|
|
assert.match(src, /warningCostOptimizedPartialPricing/);
|
|
});
|
|
|
|
it("should wire combo account labels to the global email privacy toggle", () => {
|
|
assert.match(src, /EmailPrivacyToggle/);
|
|
assert.match(src, /useEmailPrivacyStore/);
|
|
assert.match(src, /pickDisplayValue/);
|
|
assert.match(src, /emailVisibilityTooltip/);
|
|
});
|
|
|
|
it("should mask combo test result labels with the global email privacy toggle", () => {
|
|
assert.match(src, /function TestResultsView/);
|
|
assert.match(src, /pickDisplayValue\(\[r\.label\], emailsVisible, r\.model\)/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — provider test results privacy", () => {
|
|
const providersSrc = readProjectFile("src/app/(dashboard)/dashboard/providers/page.tsx");
|
|
const providerDetailSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx"
|
|
);
|
|
|
|
it("should mask provider test batch names with the global email privacy toggle", () => {
|
|
assert.ok(providersSrc, "src/app/(dashboard)/dashboard/providers/page.tsx should exist");
|
|
assert.match(providersSrc, /useEmailPrivacyStore/);
|
|
assert.match(
|
|
providersSrc,
|
|
/pickDisplayValue\(\[r\.connectionName\], emailsVisible, r\.connectionName\)/
|
|
);
|
|
});
|
|
|
|
it("should mask provider detail test result names with the global email privacy toggle", () => {
|
|
assert.ok(
|
|
providerDetailSrc,
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
|
|
);
|
|
assert.match(providerDetailSrc, /const emailsVisible = useEmailPrivacyStore/);
|
|
assert.match(
|
|
providerDetailSrc,
|
|
/pickDisplayValue\(\s*\[r\.connectionName\],\s*emailsVisible,\s*r\.connectionName\s*\)/
|
|
);
|
|
});
|
|
|
|
it("should resolve provider detail metadata through the shared dashboard catalog", () => {
|
|
assert.ok(
|
|
providerDetailSrc,
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
|
|
);
|
|
assert.match(providerDetailSrc, /resolveDashboardProviderInfo/);
|
|
});
|
|
|
|
it("should treat upstream proxy entries as a dedicated management surface", () => {
|
|
assert.ok(
|
|
providerDetailSrc,
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
|
|
);
|
|
assert.match(providerDetailSrc, /isUpstreamProxyProvider/);
|
|
assert.match(providerDetailSrc, /Managed via Upstream Proxy Settings/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — legacy provider create route retirement", () => {
|
|
const legacyProviderNewSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/providers/new/page.tsx"
|
|
);
|
|
|
|
it("should redirect legacy /dashboard/providers/new to the canonical providers flow", () => {
|
|
assert.ok(
|
|
legacyProviderNewSrc,
|
|
"src/app/(dashboard)/dashboard/providers/new/page.tsx should exist"
|
|
);
|
|
assert.match(legacyProviderNewSrc, /redirect\("\/dashboard\/providers"\)/);
|
|
assert.doesNotMatch(legacyProviderNewSrc, /authMethod:\s*"api_key"/);
|
|
assert.doesNotMatch(legacyProviderNewSrc, /displayName/);
|
|
});
|
|
});
|