Files
OmniRoute/tests/integration/integration-wiring.test.ts
Diego Rodrigues de Sa e Souza cadc3f10b7 Release v3.8.35 (#4743)
* chore(release): open v3.8.35 development cycle

* fix db vacuum scheduler settings (#4726)

Scheduled VACUUM now follows Storage page settings (scheduledVacuum/vacuumHour) as single source of truth; env-flag control path removed. 11/11 vacuum-scheduler tests pass against release/v3.8.35 tip; no orphaned env refs. Integrated into release/v3.8.35.

* fix(tier): noAuth providers count as free; free filter returns empty … (#4753)

noAuth providers now classified free (union of legacy list + NOAUTH_PROVIDERS chat-tier derivation), -free arena_elo alias, and auto/<cat>:free returns an empty pool when no free candidate matches (opt-in legacy fallback via OMNIROUTE_AUTO_FREE_FALLBACK_TO_FULL_POOL). New env var documented in .env.example + ENVIRONMENT.md; CHANGELOG bullet added (maintainer co-author). 46/46 node + 56/56 vitest tests pass on release tip; env-doc-sync, docs-sync, typecheck:core, lint, file-size all green. Integrated into release/v3.8.35.

* refactor(chatCore): extrai 11 helpers de nível superior para 6 leaves puros (#3501) (#4571)

chatCore god-file decomposition (#3501): extract 6 pure leaves (cacheUsageMeta, executorClientHeaders, nonStreamingResponseBody, skillsFormat, streamErrorResult, streamFinalize) from chatCore.ts. Rebased onto release/v3.8.35 tip (resolved single chatCore.ts conflict — removed now-extracted inline buildExecutorClientHeaders). 265/265 chatcore tests, 26/26 new leaf tests, typecheck:core, cycles, file-size all green. Integrated into release/v3.8.35.

* refactor(chatCore): extrai resolveExecutorWithProxy + getExecutionCredentials para leaves (#3501) (#4646)

chatCore #3501: extract resolveExecutorWithProxy + getExecutionCredentials to leaves (executorProxy.ts, executionCredentials.ts). Clean cherry-pick onto release tip post-#4571. 12/12 new leaf tests, typecheck:core, cycles, file-size green. Integrated into release/v3.8.35.

* refactor(chatCore): extrai transforms de mensagens Claude p/ leaf (#3501) (#4708)

chatCore #3501: extract Claude upstream-message transforms to leaf (claudeUpstreamMessages.ts + claudeMessageTypes.ts). Clean cherry-pick post-#4646. 8/8 new leaf tests, typecheck/cycles/file-size green. Integrated into release/v3.8.35.

* refactor(chatCore): extrai persistAttemptLogs para leaf (#3501) (#4717)

chatCore #3501: extract persistAttemptLogs to leaf (attemptLogging.ts). Rebased onto release tip post-#4708 (resolved imports conflict: kept tip's resolveCompressionHeader from compression Phase 3, dropped now-unused logTruncation import moved into the leaf). 288/288 chatcore tests, typecheck/cycles/file-size green. Integrated into release/v3.8.35.

* refactor(chatCore): extrai stageTrace + compressionUsageReceipt para leaves (#3501) (#4721)

chatCore #3501: extract stageTrace + compressionUsageReceipt to leaves. Clean cherry-pick post-#4717. 6/6 new leaf tests, typecheck/cycles/file-size green. Integrated into release/v3.8.35.

* refactor(chatCore): extrai prepareUpstreamBody (1ª sub-fatia do executeProviderRequest, #3501) (#4730)

chatCore #3501: extract prepareUpstreamBody (first sub-slice of executeProviderRequest) to leaf (upstreamBody.ts). Clean cherry-pick post-#4721. 7/7 new leaf tests, full 301/301 chatcore suite, typecheck/cycles/file-size green. Completes the 6-PR chatCore decomposition stack into release/v3.8.35.

* fix(db): make db-backup import size cap configurable (#4719) (#4757)

Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>

* chore(quality): expand check:release-green to the FULL release-PR gate set (#4758)

The release-green pre-flight (Solution C) previously covered only a subset of the
gates that run exclusively on the release PR (PR→main), so reds still accrued
silently on release/** and surfaced in ~40-min layers at release time (v3.8.34:
3 CI rounds — CodeQL sanitization, then the fail-fast Quality Ratchet revealing
openapi then cyclomatic-complexity one push at a time, plus zizmor/integration).

Now check:release-green reproduces the COMPLETE release-PR gate set and reports
EVERY red in one pass (collected, not fail-fast):

- New DRIFT ratchets (report-only, rebaselined at release, never block):
  cyclomatic complexity, dead-code, type-coverage, compression-budget,
  openapi-coverage, workflow-lint (zizmor), codeql-ratchet.
- New HARD gates (real defects): docs-all (fabricated-docs strict + i18n mirror
  sync) and the integration test suite (gated behind !--quick).

The only release-PR gates it still cannot reproduce locally are GitHub-side CodeQL
semantic analysis and SonarQube/SonarCloud (external services).

The nightly-release-green workflow and /green-prs inherit the expanded coverage
automatically (they invoke this script), so cycle drift is now surfaced
continuously and the release PR is green on its first CI run.

Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>

* fix(dashboard): add missing onboarding.tiers step title (#4698) (#4755)

Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>

* feat(compression): Output Styles registry + D0 telemetry (Phase 4A) (#4694)

Phase 4A: Output Styles registry + D0 telemetry. Integrated into release/v3.8.35.

* feat(compression): SLM tier for ultra (Phase 4B) [stacked on #4694] (#4707)

Phase 4B: SLM tier for ultra. Integrated into release/v3.8.35.

* feat(compression): context-budget adaptive compression (Phase 4C) [stacked on #4707] (#4716)

Phase 4C: adaptive context-budget compression. Integrated into release/v3.8.35.

* feat(compression): offline evaluation harness (Phase 4 D1) [stacked on #4716] (#4720)

Phase 4 D1: offline evaluation harness. Integrated into release/v3.8.35.

* fix(sse): deepseek-web folds role:tool results into prompt transcript (#4712) (#4756)

Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>

* fix(dashboard): remove dead unconditional useLiveRequests call in HomePageClient (#4759, #4745, #4596) (#4761)

Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>

* fix(dashboard): dedupe provider nodes by id on compatible-provider add (#4746) (#4768)

Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>

* chore(db): re-export compressionRunTelemetry from localDb to satisfy db-rules (#4775)

Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>

* docs(security): add canonical STRIDE-based threat model (#4783)

Canonical STRIDE threat model. Integrated into release/v3.8.35.

* test(dashboard): add smoke test for home client dashboard (#4793)

Smoke test guarding the dashboard home client render (regression #4745/#4759). Code fix already landed via #4761; this PR's jsdom smoke test is the net-new regression guard. Integrated into release/v3.8.35.

* fix(combos): auto-promote zeroLatencyOptimizationsEnabled so legacy configs (pre-3.8.33 fallbackCompressionMode="lite") round-trip on the first GUI edit (#4774)

Auto-promote zeroLatencyOptimizationsEnabled + strip v3.8.31-era removed keys so legacy combo configs round-trip through PUT /api/combos/{id} on first GUI edit (closes #4382 followup). Pre-merge: rewrote the now-stale reject test to assert auto-promotion + added passthrough/round-trip regression guards; reconciled combos/page.tsx file-size baseline. Integrated into release/v3.8.35.

* refactor(chatCore): extrai parse + usage-stats não-streaming do executeProviderRequest (#3501) (#4762)

chatCore #3501: extract parseNonStreamingResponseBody + recordNonStreamingUsageStats. Integrated into release/v3.8.35.

* refactor(chatCore): extrai recordContextEditingTelemetryHook (#3501) (#4779)

chatCore #3501: extract recordContextEditingTelemetryHook. Integrated into release/v3.8.35.

* refactor(chatCore): extrai recordCompressionCacheStats (#3501) (#4792)

chatCore #3501: extract recordCompressionCacheStats. Integrated into release/v3.8.35.

* refactor(chatCore): extrai writeCavemanOutputAnalytics (#3501) (#4794)

chatCore #3501: extract writeCavemanOutputAnalytics. Integrated into release/v3.8.35.

* refactor(chatCore): extrai scheduleQuotaShareConsumption (POST-hook não-streaming, #3501) (#4780)

chatCore #3501: extract scheduleQuotaShareConsumption (non-streaming POST-hook). Integrated into release/v3.8.35.

* refactor(chatCore): extrai emitRequestGamificationEvent (helper compartilhado DRY, #3501) (#4776)

chatCore #3501: extract emitRequestGamificationEvent (DRY streaming/non-streaming). Integrated into release/v3.8.35.

* refactor(chatCore): extrai runPluginOnResponseHook (#3501) (#4782)

chatCore #3501: extract runPluginOnResponseHook. Integrated into release/v3.8.35.

* refactor(chatCore): extrai scheduleStreamingQuotaShareConsumption (POST-hook streaming, #3501) (#4784)

chatCore #3501: extract scheduleStreamingQuotaShareConsumption (streaming POST-hook). Integrated into release/v3.8.35.

* refactor(chatCore): extrai recordStreamingUsageStats (analytics de usage streaming, #3501) (#4791)

chatCore #3501: extract recordStreamingUsageStats. Integrated into release/v3.8.35.

* refactor(chatCore): extrai recordStreamingCost (custo por-request streaming, #3501) (#4790)

chatCore #3501: extract recordStreamingCost (per-request streaming cost). Integrated into release/v3.8.35.

* docs(readme): credit ponytail + OmniCompress; restore env-doc-sync release-green (#4799)

README compression credits (ponytail/OmniCompress) + env-doc-sync ignore for eval-only OMNIROUTE_EVAL_CREDENTIALS (restores release-green after #4720). Integrated into release/v3.8.35.

* chore(quality): trim combo-config.test.ts comments under file-size cap (#4774 follow-up) (#4800)

Restore file-size release-green. Integrated into release/v3.8.35.

* feat(api-docs): Redoc-rendered /api/docs + consolidate OpenAPI spec to docs/openapi.yaml (#4781)

Redoc /api/docs + OpenAPI spec consolidated to docs/openapi.yaml (canonical 201-path complete spec; old path → legacy fallback). All refs/gates/tests/CI updated. Integrated into release/v3.8.35.

* docs(compression): declare Phase 4 layers — Output Styles, adaptive dial, per-request control (#4801)

The README compression section listed the 9 input engines but not the Phase 4
layers now in production:
- Output Styles (output-axis steering: terse-prose / less-code / terse-cjk, lite/full/ultra)
- adaptive context-budget dial (reserve-output|percentage|absolute · floor|replace-autotrigger|off)
- per-request x-omniroute-compression precedence + the offline eval harness
Also bumped the highlights range to v3.8.35, expanded the compression feature bullet,
and marked the GUIDE's Phase 4 row Shipped (was 'Planned' — it's merged on v3.8.35).

Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

* chore(release): finalize v3.8.35 CHANGELOG + docs reconciliation

- CHANGELOG: complete 3.8.35 section (all 35 commits since v3.8.34,
  contributor attribution: @rdself @megamen32 @KooshaPari @JxnLexn)
- docs(security): align THREAT_MODEL.md refs with real code
  (routeGuard.ts, tokenLimits.ts, /api/monitoring/health) — fabricated-docs gate
- check:fabricated-docs: skip docs/superpowers/specs (dated research reports)
- i18n: sync 3.8.35 section into 41 CHANGELOG mirrors (docs-sync size gate)
- ratchet rebaseline: cyclomatic 1916->1920, eslintWarnings 3907->3912
  (inherited cycle drift; release-finalize diff is docs-only)

* fix(release): resolve inherited base-reds surfaced by v3.8.35 release CI

Cycle base-reds that only run on PR→main (not the PR→release fast-path):

- test(autoCombo): suffixComposition-4517 used node:test in a vitest-only dir
  (#4753) → vitest found no suite. Switch to the vitest API. (Vitest job)
- test(agentSkills): openapiParser fixture wrote docs/reference/openapi.yaml;
  parser reads docs/openapi.yaml since #4781 → point fixture at the new path.
  (Unit/Coverage/Node24/Node26 shard 4)
- test(integration): proxy-pipeline source-scan expected inline streaming-cost
  code that #4790/#3501 extracted to the recordStreamingCost leaf → assert the
  delegation instead. (Integration 1/2)
- fix(chatCore): derive the log trace id from crypto, not Math.random
  (CodeQL js/insecure-randomness — log-correlation id, not a secret).
- test(resilience): circuit-breaker invalid-cooldown fallback asserted t>29000,
  flaking on slow CI where ~1.6s elapsed gave t=28401 → tolerate wall-clock
  drift (t>25000). (Unit 6/8)

* fix(usage): derive pending-request id from crypto, not Math.random

CodeQL js/insecure-randomness (#669): the pending-request id generated in
trackPendingRequest (usageHistory.ts) flows into attempt logging and was flagged
as insecure randomness in a security context. It's a log-correlation id, not a
secret — switch to crypto RNG to clear the alert. Pairs with the chatCore traceId
fix in 37c49781a (same sink).

---------

Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
Co-authored-by: Randi <55005611+rdself@users.noreply.github.com>
Co-authored-by: Demiurge The Single <megamen932@gmail.com>
Co-authored-by: KooshaPari <42529354+KooshaPari@users.noreply.github.com>
Co-authored-by: Jan Leon <Jan.gaschler@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-23 17:06:18 -03:00

620 lines
25 KiB
TypeScript

/**
* Integration Wiring Verification Tests
*
* Validates that backend modules are correctly wired into the current
* OmniRoute architecture (TypeScript + App Router route.ts files).
*/
import { describe, it } from "node:test";
import assert from "node:assert/strict";
import { readFileSync, existsSync, readdirSync } from "node:fs";
import { join, dirname } from "node:path";
import { fileURLToPath } from "node:url";
const __dirname = dirname(fileURLToPath(import.meta.url));
const ROOT = join(__dirname, "..", "..");
function readProjectFile(relPath: string) {
const full = join(ROOT, relPath);
if (!existsSync(full)) return null;
return readFileSync(full, "utf8");
}
function assertFileExists(relPath: string) {
const full = join(ROOT, relPath);
assert.ok(existsSync(full), `${relPath} should exist`);
return full;
}
function assertRouteMethods(relPath: string, methods: string[]) {
const src = readProjectFile(relPath);
assert.ok(src, `${relPath} should exist`);
for (const method of methods) {
assert.match(src, new RegExp(`export\\s+async\\s+function\\s+${method}\\s*\\(`));
}
}
function listProjectFiles(relPath: string): string[] {
const full = join(ROOT, relPath);
if (!existsSync(full)) return [];
return readdirSync(full, { withFileTypes: true }).flatMap((entry) => {
const childRelPath = `${relPath}/${entry.name}`;
if (entry.isDirectory()) return listProjectFiles(childRelPath);
return childRelPath;
});
}
// ─── Pipeline Wiring ─────────────────────────────────
describe("Pipeline Wiring — server-init.ts", () => {
const src = readProjectFile("src/server-init.ts");
it("should initialize compliance audit log", () => {
assert.ok(src, "src/server-init.ts should exist");
assert.match(src, /initAuditLog/);
});
it("should cleanup expired logs", () => {
assert.match(src, /cleanupExpiredLogs/);
});
it("should enforce secrets before startup", () => {
assert.match(src, /enforceSecrets/);
});
it("should enforce web runtime env before startup", () => {
assert.match(src, /enforceWebRuntimeEnv/);
});
it("should log server.start audit event", () => {
assert.match(src, /server\.start/);
});
it("should use the structured startup logger instead of direct console calls", () => {
assert.match(src, /createLogger\("server-init"\)/);
assert.doesNotMatch(src, /console\.(log|warn|error|info|debug)\(/);
});
});
describe("Pipeline Wiring — instrumentation-node.ts", () => {
const src = readProjectFile("src/instrumentation-node.ts");
it("should seed default model aliases during startup restore", () => {
assert.ok(src, "src/instrumentation-node.ts should exist");
assert.match(src, /seedDefaultModelAliases/);
});
it("should initialize Arena ELO sync on the live startup path (on by default, opt-out)", () => {
// The Next standalone runtime boots through instrumentation-node, NOT server-init.ts.
// The Arena ELO sync (which feeds the Free Provider Rankings page) must be wired here,
// or it never runs in production. initArenaEloSync self-gates through the feature flag
// resolver so ARENA_ELO_SYNC_ENABLED and dashboard overrides still apply.
assert.match(src, /initArenaEloSync/);
assert.match(src, /const started = await initArenaEloSync\(\)/);
});
it("should initialize pricing + models.dev sync on the live startup path (self-gated, opt-in)", () => {
// Same dead-path bug as Arena: these were only wired into the never-executed server-init.ts
// (models.dev had no caller at all), so their toggles were inert. They self-gate internally
// (PRICING_SYNC_ENABLED / settings.modelsDevSyncEnabled), so calling them here preserves opt-in.
assert.match(src, /initPricingSync/);
assert.match(src, /initModelsDevSync/);
});
});
describe("Pipeline Wiring — sse chat handler", () => {
const src = readProjectFile("src/sse/handlers/chat.ts");
const coreSrc = readProjectFile("open-sse/handlers/chatCore.ts");
it("should import and use guardrail pre-call validation", () => {
assert.ok(src, "src/sse/handlers/chat.ts should exist");
assert.match(src, /guardrailRegistry/);
assert.match(src, /runPreCallHooks/);
});
it("should import circuit breaker integration", () => {
assert.match(src, /getCircuitBreaker|CircuitBreakerOpenError/);
});
it("should use credential preflight instead of global model quarantine gates", () => {
assert.match(src, /getProviderCredentialsWithQuotaPreflight/);
});
it("should import request telemetry integration", () => {
assert.match(src, /RequestTelemetry|recordTelemetry/);
});
it("should import request id generation", () => {
assert.match(src, /generateRequestId/);
});
it("should keep cost tracking integration in the chat pipeline", () => {
assert.ok(coreSrc, "open-sse/handlers/chatCore.ts should exist");
assert.match(coreSrc, /calculateCost/);
assert.match(coreSrc, /recordCost/);
});
it("should not track backup artifacts in the active src/sse shim", () => {
const trackedArtifactNames = listProjectFiles("src/sse").filter((file) =>
/\.(orig|bak|backup)$/i.test(file)
);
assert.deepEqual(trackedArtifactNames, []);
});
});
describe("Pipeline Wiring — middleware proxy", () => {
const proxySrc = readProjectFile("src/proxy.ts");
const pipelineSrc = readProjectFile("src/server/authz/pipeline.ts");
it("should exist and delegate to authz pipeline", () => {
assert.ok(proxySrc, "src/proxy.ts should exist");
assert.match(proxySrc, /runAuthzPipeline/);
});
it("should generate request id for tracing in the authz pipeline", () => {
assert.ok(pipelineSrc, "src/server/authz/pipeline.ts should exist");
assert.match(pipelineSrc, /generateRequestId|X-Request-Id/);
});
it("should enforce body size guard in the authz pipeline", () => {
assert.match(pipelineSrc, /checkBodySize|getBodySizeLimit|bodySize/i);
});
it("should resolve JWT secret in the authz pipeline", () => {
assert.match(pipelineSrc, /getJwtSecret|jwtSecret|JWT_SECRET/i);
});
});
// ─── API Routes ──────────────────────────────────────
describe("API Routes — existence check", () => {
const routes = [
"src/app/api/cache/stats/route.ts",
"src/app/api/telemetry/summary/route.ts",
"src/app/api/usage/budget/route.ts",
"src/app/api/usage/quota/route.ts",
"src/app/api/fallback/chains/route.ts",
"src/app/api/compliance/audit-log/route.ts",
"src/app/api/evals/route.ts",
"src/app/api/evals/[suiteId]/route.ts",
"src/app/api/policies/route.ts",
];
for (const route of routes) {
it(`route file should exist: ${route}`, () => {
assertFileExists(route);
});
}
});
describe("API Routes — export HTTP methods", () => {
it("/api/cache/stats should export GET and DELETE", () => {
assertRouteMethods("src/app/api/cache/stats/route.ts", ["GET", "DELETE"]);
});
it("/api/telemetry/summary should export GET", () => {
assertRouteMethods("src/app/api/telemetry/summary/route.ts", ["GET"]);
});
it("/api/usage/budget should export GET and POST", () => {
assertRouteMethods("src/app/api/usage/budget/route.ts", ["GET", "POST"]);
});
it("/api/usage/quota should export GET", () => {
assertRouteMethods("src/app/api/usage/quota/route.ts", ["GET"]);
});
it("/api/fallback/chains should export GET, POST, DELETE", () => {
assertRouteMethods("src/app/api/fallback/chains/route.ts", ["GET", "POST", "DELETE"]);
});
it("/api/compliance/audit-log should export GET", () => {
assertRouteMethods("src/app/api/compliance/audit-log/route.ts", ["GET"]);
});
it("/api/evals should export GET and POST", () => {
assertRouteMethods("src/app/api/evals/route.ts", ["GET", "POST"]);
});
it("/api/evals/[suiteId] should export GET", () => {
assertRouteMethods("src/app/api/evals/[suiteId]/route.ts", ["GET"]);
});
it("/api/policies should export GET and POST", () => {
assertRouteMethods("src/app/api/policies/route.ts", ["GET", "POST"]);
});
});
describe("API Routes — dashboard and tool consumers", () => {
it("keeps model-combo mapping APIs wired through routing settings", () => {
const settingsPage = readProjectFile("src/app/(dashboard)/dashboard/settings/routing/page.tsx");
const modelRoutingSection = readProjectFile("src/shared/components/ModelRoutingSection.tsx");
assert.ok(settingsPage, "settings page should exist");
assert.ok(modelRoutingSection, "ModelRoutingSection should exist");
assert.match(settingsPage, /ModelRoutingSection/);
assert.match(modelRoutingSection, /fetch\("\/api\/model-combo-mappings"\)/);
assert.match(modelRoutingSection, /fetch\(`\/api\/model-combo-mappings\/\$\{editingId\}`/);
assert.match(modelRoutingSection, /method:\s*"DELETE"/);
assertRouteMethods("src/app/api/model-combo-mappings/route.ts", ["GET", "POST"]);
assertRouteMethods("src/app/api/model-combo-mappings/[id]/route.ts", ["GET", "PUT", "DELETE"]);
});
it.skip("keeps log APIs wired through the consolidated logs dashboard", () => {
const logsPage = readProjectFile("src/app/(dashboard)/dashboard/logs/page.tsx");
const requestLogger = readProjectFile("src/shared/components/RequestLoggerV2.tsx");
const proxyLogger = readProjectFile("src/shared/components/ProxyLogger.tsx");
const consoleLogger = readProjectFile("src/shared/components/ConsoleLogViewer.tsx");
assert.ok(logsPage, "logs page should exist");
assert.ok(requestLogger, "RequestLoggerV2 should exist");
assert.ok(proxyLogger, "ProxyLogger should exist");
assert.ok(consoleLogger, "ConsoleLogViewer should exist");
assert.match(logsPage, /RequestLoggerV2/);
assert.match(logsPage, /EmailPrivacyToggle/);
assert.match(logsPage, /ProxyLogger/);
assert.match(logsPage, /ConsoleLogViewer/);
// AuditLogTab removed: audit moved to its own /dashboard/audit page (#2859).
assert.match(logsPage, /\/api\/logs\/export/);
assert.match(requestLogger, /\/api\/usage\/call-logs/);
assert.match(requestLogger, /\/api\/logs\/\$\{/);
assert.doesNotMatch(requestLogger, /\/api\/logs\/active/);
assert.match(requestLogger, /\/api\/logs\/detail/);
assert.match(requestLogger, /useEmailPrivacyStore/);
assert.match(requestLogger, /maskAccount\(log\.account, emailsVisible\)/);
assert.match(requestLogger, /emailsVisible=\{emailsVisible\}/);
assert.match(proxyLogger, /\/api\/usage\/proxy-logs/);
assert.match(consoleLogger, /\/api\/logs\/console/);
assertRouteMethods("src/app/api/logs/console/route.ts", ["GET"]);
assertRouteMethods("src/app/api/logs/detail/route.ts", ["GET", "POST"]);
assertRouteMethods("src/app/api/logs/export/route.ts", ["GET"]);
assertRouteMethods("src/app/api/usage/proxy-logs/route.ts", ["GET", "DELETE"]);
assertRouteMethods("src/app/api/usage/call-logs/route.ts", ["GET"]);
assertRouteMethods("src/app/api/usage/call-logs/[id]/route.ts", ["GET"]);
});
it("keeps request log surfaces on opaque theme colors", () => {
const requestLogger = readProjectFile("src/shared/components/RequestLoggerV2.tsx");
const globals = readProjectFile("src/app/globals.css");
assert.ok(requestLogger, "RequestLoggerV2 should exist");
assert.ok(globals, "globals.css should exist");
assert.match(globals, /--color-card:\s+#ffffff/);
assert.match(globals, /--color-card:\s+#161b22/);
assert.match(globals, /--color-card:\s+var\(--color-card\)/);
// #4233 ("opaque tables D9") replaced the bg-black/5 tint — which lost to
// bg-surface via tailwind-merge — with the opaque bg-surface theme color.
// The intent here (request log surface stays opaque over theme colors) is now
// expressed by bg-surface itself.
assert.match(requestLogger, /bg-surface/);
assert.doesNotMatch(requestLogger, /\/api\/logs\/active/);
});
it("keeps usage quota wired through A2A and MCP tools", () => {
const quotaSkill = readProjectFile("src/lib/a2a/skills/quotaManagement.ts");
const mcpAdvancedTools = readProjectFile("open-sse/mcp-server/tools/advancedTools.ts");
const mcpServer = readProjectFile("open-sse/mcp-server/server.ts");
assert.ok(quotaSkill, "quotaManagement skill should exist");
assert.ok(mcpAdvancedTools, "advanced MCP tools should exist");
assert.ok(mcpServer, "MCP server should exist");
assert.match(quotaSkill, /\/api\/usage\/quota/);
assert.match(mcpAdvancedTools, /\/api\/usage\/quota/);
assert.match(mcpServer, /\/api\/usage\/quota/);
assertRouteMethods("src/app/api/usage/quota/route.ts", ["GET"]);
});
it("keeps legacy usage history and raw request-log APIs explicitly classified", () => {
const usageStats = readProjectFile("src/shared/components/UsageStats.tsx");
const apiReference = readProjectFile("docs/reference/API_REFERENCE.md");
const openApi = readProjectFile("docs/openapi.yaml");
assert.ok(usageStats, "UsageStats compatibility component should exist");
assert.ok(apiReference, "API reference should exist");
assert.ok(openApi, "OpenAPI document should exist");
assert.match(usageStats, /\/api\/usage\/history/);
assert.match(apiReference, /\/api\/usage\/history/);
assert.match(apiReference, /\/api\/usage\/request-logs/);
assert.match(openApi, /\/api\/usage\/history:/);
assert.match(openApi, /\/api\/usage\/request-logs:/);
assertRouteMethods("src/app/api/usage/history/route.ts", ["GET"]);
assertRouteMethods("src/app/api/usage/request-logs/route.ts", ["GET"]);
assertRouteMethods("src/app/api/usage/logs/route.ts", ["GET"]);
});
});
describe("API Routes — T09 /v1 catalog consistency", () => {
const v1RouteSrc = readProjectFile("src/app/api/v1/route.ts");
const v1ModelsRouteSrc = readProjectFile("src/app/api/v1/models/route.ts");
const v1CatalogSrc = readProjectFile("src/app/api/v1/models/catalog.ts");
it("/api/v1 should delegate model catalog to unified builder", () => {
assert.ok(v1RouteSrc, "src/app/api/v1/route.ts should exist");
assert.match(v1RouteSrc, /getUnifiedModelsResponse/);
assert.match(v1RouteSrc, /from\s+["']\.\/models\/catalog["']/);
assert.doesNotMatch(v1RouteSrc, /const\s+models\s*=\s*\[/);
});
it("/api/v1/models route should only consume unified model catalog builder", () => {
assert.ok(v1ModelsRouteSrc, "src/app/api/v1/models/route.ts should exist");
assert.match(v1ModelsRouteSrc, /from\s+["']\.\/catalog["']/);
assert.doesNotMatch(
v1ModelsRouteSrc,
/export\s+async\s+function\s+getUnifiedModelsResponse\s*\(/
);
});
it("/api/v1/models/catalog should export unified model catalog builder", () => {
assert.ok(v1CatalogSrc, "src/app/api/v1/models/catalog.ts should exist");
assert.match(v1CatalogSrc, /export\s+async\s+function\s+getUnifiedModelsResponse\s*\(/);
});
});
describe("Dashboard Wiring — T05 payload rules", () => {
const settingsPageSrc = readProjectFile(
"src/app/(dashboard)/dashboard/settings/advanced/page.tsx"
);
const payloadRulesTabSrc = readProjectFile(
"src/app/(dashboard)/dashboard/settings/components/PayloadRulesTab.tsx"
);
const openapiSrc = readProjectFile("docs/openapi.yaml");
it.skip("settings page should surface payload rules inside advanced settings", () => {
assert.ok(settingsPageSrc, "settings page source should exist");
assert.match(
settingsPageSrc,
/import PayloadRulesTab from "\.\.\/components\/PayloadRulesTab"/
);
assert.match(settingsPageSrc, /<PayloadRulesTab\s*\/>/);
});
it("payload rules tab should read and write through the dedicated settings endpoint", () => {
assert.ok(payloadRulesTabSrc, "payload rules tab source should exist");
assert.match(payloadRulesTabSrc, /fetch\("\/api\/settings\/payload-rules"\)/);
assert.match(payloadRulesTabSrc, /fetch\("\/api\/settings\/payload-rules",\s*\{/);
assert.match(payloadRulesTabSrc, /method:\s*"PUT"/);
assert.match(payloadRulesTabSrc, /default-raw/);
});
it("openapi should document the payload rules management surface", () => {
assert.ok(openapiSrc, "docs/openapi.yaml should exist");
assert.match(openapiSrc, /\/api\/settings\/payload-rules:/);
assert.match(openapiSrc, /summary:\s+Get payload rules configuration/);
assert.match(openapiSrc, /ManagementSessionAuth:/);
assert.match(openapiSrc, /PayloadRulesConfig:/);
});
});
// ─── Barrel Exports ─────────────────────────────────
describe("Barrel Exports — shared/components", () => {
const src = readProjectFile("src/shared/components/index.tsx");
it("should export key shared UI modules", () => {
assert.ok(src, "src/shared/components/index.tsx should exist");
for (const name of [
"Breadcrumbs",
"EmptyState",
"NotificationToast",
"FilterBar",
"ColumnToggle",
"DataTable",
]) {
assert.match(src, new RegExp(name));
}
});
it("should re-export layouts", () => {
assert.match(src, /export\s+\*\s+from\s+"\.\/layouts"/);
});
});
describe("Barrel Exports — store", () => {
const src = readProjectFile("src/store/index.ts");
it("should export useNotificationStore", () => {
assert.ok(src, "src/store/index.ts should exist");
assert.match(src, /useNotificationStore/);
});
});
describe("Barrel Exports — shared/components/layouts", () => {
const src = readProjectFile("src/shared/components/layouts/index.tsx");
it("should export DashboardLayout and AuthLayout", () => {
assert.ok(src, "src/shared/components/layouts/index.tsx should exist");
assert.match(src, /DashboardLayout/);
assert.match(src, /AuthLayout/);
});
});
// ─── Layout and Page Integration ────────────────────
describe("DashboardLayout Integration", () => {
const src = readProjectFile("src/shared/components/layouts/DashboardLayout.tsx");
it("should render NotificationToast globally", () => {
assert.ok(src, "src/shared/components/layouts/DashboardLayout.tsx should exist");
assert.match(src, /NotificationToast/);
});
it.skip("should include Breadcrumbs in page wrapper", () => {
assert.match(src, /Breadcrumbs/);
});
});
describe("Page Integration — logs page wiring", () => {
const src = readProjectFile("src/app/(dashboard)/dashboard/logs/page.tsx");
it.skip("should wire segmented log tabs", () => {
assert.ok(src, "src/app/(dashboard)/dashboard/logs/page.tsx should exist");
assert.match(src, /SegmentedControl/);
assert.match(src, /RequestLoggerV2/);
assert.match(src, /ProxyLogger/);
});
});
describe("Page Integration — settings page wiring", () => {
const src = readProjectFile("src/app/(dashboard)/dashboard/settings/resilience/page.tsx");
const memorySkillsTab = readProjectFile(
"src/app/(dashboard)/dashboard/settings/components/MemorySkillsTab.tsx"
);
it("should include resilience tab in advanced settings", () => {
assert.ok(src, "src/app/(dashboard)/dashboard/settings/resilience/page.tsx should exist");
assert.match(src, /ResilienceTab/);
});
it("should not label the active skills settings card as a placeholder", () => {
assert.ok(memorySkillsTab, "MemorySkillsTab should exist");
assert.doesNotMatch(memorySkillsTab, /Skills Settings \(placeholder\)/);
});
});
describe("Page Integration — cache page wiring", () => {
const src = readProjectFile("src/app/(dashboard)/dashboard/cache/page.tsx");
it("should consolidate prompt cache metrics directly into cache management", () => {
assert.ok(src, "src/app/(dashboard)/dashboard/cache/page.tsx should exist");
assert.doesNotMatch(src, /CacheStatsCard/);
});
});
describe("Page Integration — cost explorer wiring", () => {
const costsPage = readProjectFile("src/app/(dashboard)/dashboard/costs/CostOverviewTab.tsx");
const costExplorerUtils = readProjectFile(
"src/app/(dashboard)/dashboard/costs/costExplorerUtils.ts"
);
it("should expose an interactive grouped Cost Explorer on the costs dashboard", () => {
assert.ok(costsPage, "CostOverviewTab should exist");
assert.ok(costExplorerUtils, "costExplorerUtils should exist");
assert.match(costsPage, /CostExplorerCard/);
assert.match(costsPage, /EXPLORER_GROUP_OPTIONS/);
assert.match(costsPage, /byServiceTier/);
assert.match(costExplorerUtils, /buildCostExplorerRows/);
assert.match(costExplorerUtils, /serviceTier/);
});
});
describe("Page Integration — combos page empty state", () => {
const src = readProjectFile("src/app/(dashboard)/dashboard/combos/page.tsx");
it("should use EmptyState when there are no combos", () => {
assert.ok(src, "src/app/(dashboard)/dashboard/combos/page.tsx should exist");
assert.match(src, /EmptyState/);
});
it("should use notification store for UX feedback", () => {
assert.match(src, /useNotificationStore/);
});
it("should persist usage guide visibility and allow reopening", () => {
assert.match(src, /COMBO_USAGE_GUIDE_STORAGE_KEY/);
assert.match(src, /localStorage/);
assert.match(src, /handleShowUsageGuide/);
});
it("should expose quick templates and post-create quick test CTA", () => {
assert.match(src, /COMBO_TEMPLATES/);
assert.match(src, /applyTemplate/);
assert.match(src, /recentlyCreatedCombo/);
assert.match(src, /testNow/);
});
it("should include cost-optimized pricing coverage UX", () => {
assert.match(src, /hasPricingForModel/);
assert.match(src, /pricingCoveragePercent/);
assert.match(src, /pricingCoverage/);
assert.match(src, /warningCostOptimizedPartialPricing/);
});
it("should wire combo account labels to the global email privacy toggle", () => {
// #3822: the per-page EmailPrivacyToggle (and its emailVisibilityTooltip) was removed in
// favor of the single global switch in Settings → Appearance. The combos page still
// consumes the store and masks account labels via pickDisplayValue.
assert.match(src, /useEmailPrivacyStore/);
assert.match(src, /pickDisplayValue/);
});
it("should mask combo test result labels with the global email privacy toggle", () => {
assert.match(src, /function TestResultsView/);
assert.match(src, /pickDisplayValue\(\[r\.label\], emailsVisible, r\.model\)/);
});
});
describe("Page Integration — provider test results privacy", () => {
const providersSrc = readProjectFile("src/app/(dashboard)/dashboard/providers/page.tsx");
const providerDetailSrc = readProjectFile(
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx"
);
// #3501 strangler-fig decomposition moved the test-results masking and the upstream-proxy
// surface out of the page client into dedicated components.
const batchTestResultsSrc = readProjectFile(
"src/app/(dashboard)/dashboard/providers/[id]/components/BatchTestResultsModal.tsx"
);
const upstreamProxyCardSrc = readProjectFile(
"src/app/(dashboard)/dashboard/providers/[id]/components/UpstreamProxyCard.tsx"
);
it("should mask provider test batch names with the global email privacy toggle", () => {
assert.ok(providersSrc, "src/app/(dashboard)/dashboard/providers/page.tsx should exist");
assert.match(providersSrc, /useEmailPrivacyStore/);
assert.match(
providersSrc,
/pickDisplayValue\(\[r\.connectionName\], emailsVisible, r\.connectionName\)/
);
});
it("should mask provider detail test result names with the global email privacy toggle", () => {
assert.ok(
providerDetailSrc,
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
);
assert.match(providerDetailSrc, /const emailsVisible = useEmailPrivacyStore/);
// The per-connection test-result masking now lives in the decomposed BatchTestResultsModal.
assert.ok(batchTestResultsSrc, "BatchTestResultsModal.tsx should exist");
assert.match(
batchTestResultsSrc,
/pickDisplayValue\(\s*\[r\.connectionName\],\s*emailsVisible,\s*r\.connectionName\s*\)/
);
});
it("should resolve provider detail metadata through the shared dashboard catalog", () => {
assert.ok(
providerDetailSrc,
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
);
assert.match(providerDetailSrc, /resolveDashboardProviderInfo/);
});
it("should treat upstream proxy entries as a dedicated management surface", () => {
assert.ok(
providerDetailSrc,
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
);
assert.match(providerDetailSrc, /isUpstreamProxyProvider/);
// The "managed elsewhere" copy now lives in the decomposed UpstreamProxyCard component.
assert.ok(upstreamProxyCardSrc, "UpstreamProxyCard.tsx should exist");
assert.match(upstreamProxyCardSrc, /Managed via Upstream Proxy Settings/);
});
});
describe("Page Integration — legacy provider create route retirement", () => {
const legacyProviderNewSrc = readProjectFile(
"src/app/(dashboard)/dashboard/providers/new/page.tsx"
);
it("should redirect legacy /dashboard/providers/new to the canonical providers flow", () => {
assert.ok(
legacyProviderNewSrc,
"src/app/(dashboard)/dashboard/providers/new/page.tsx should exist"
);
assert.match(legacyProviderNewSrc, /redirect\("\/dashboard\/providers"\)/);
assert.doesNotMatch(legacyProviderNewSrc, /authMethod:\s*"api_key"/);
assert.doesNotMatch(legacyProviderNewSrc, /displayName/);
});
});