mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-08-03 05:45:04 +03:00
* chore(release): open v3.8.35 development cycle
* fix db vacuum scheduler settings (#4726)
Scheduled VACUUM now follows Storage page settings (scheduledVacuum/vacuumHour) as single source of truth; env-flag control path removed. 11/11 vacuum-scheduler tests pass against release/v3.8.35 tip; no orphaned env refs. Integrated into release/v3.8.35.
* fix(tier): noAuth providers count as free; free filter returns empty … (#4753)
noAuth providers now classified free (union of legacy list + NOAUTH_PROVIDERS chat-tier derivation), -free arena_elo alias, and auto/<cat>:free returns an empty pool when no free candidate matches (opt-in legacy fallback via OMNIROUTE_AUTO_FREE_FALLBACK_TO_FULL_POOL). New env var documented in .env.example + ENVIRONMENT.md; CHANGELOG bullet added (maintainer co-author). 46/46 node + 56/56 vitest tests pass on release tip; env-doc-sync, docs-sync, typecheck:core, lint, file-size all green. Integrated into release/v3.8.35.
* refactor(chatCore): extrai 11 helpers de nível superior para 6 leaves puros (#3501) (#4571)
chatCore god-file decomposition (#3501): extract 6 pure leaves (cacheUsageMeta, executorClientHeaders, nonStreamingResponseBody, skillsFormat, streamErrorResult, streamFinalize) from chatCore.ts. Rebased onto release/v3.8.35 tip (resolved single chatCore.ts conflict — removed now-extracted inline buildExecutorClientHeaders). 265/265 chatcore tests, 26/26 new leaf tests, typecheck:core, cycles, file-size all green. Integrated into release/v3.8.35.
* refactor(chatCore): extrai resolveExecutorWithProxy + getExecutionCredentials para leaves (#3501) (#4646)
chatCore #3501: extract resolveExecutorWithProxy + getExecutionCredentials to leaves (executorProxy.ts, executionCredentials.ts). Clean cherry-pick onto release tip post-#4571. 12/12 new leaf tests, typecheck:core, cycles, file-size green. Integrated into release/v3.8.35.
* refactor(chatCore): extrai transforms de mensagens Claude p/ leaf (#3501) (#4708)
chatCore #3501: extract Claude upstream-message transforms to leaf (claudeUpstreamMessages.ts + claudeMessageTypes.ts). Clean cherry-pick post-#4646. 8/8 new leaf tests, typecheck/cycles/file-size green. Integrated into release/v3.8.35.
* refactor(chatCore): extrai persistAttemptLogs para leaf (#3501) (#4717)
chatCore #3501: extract persistAttemptLogs to leaf (attemptLogging.ts). Rebased onto release tip post-#4708 (resolved imports conflict: kept tip's resolveCompressionHeader from compression Phase 3, dropped now-unused logTruncation import moved into the leaf). 288/288 chatcore tests, typecheck/cycles/file-size green. Integrated into release/v3.8.35.
* refactor(chatCore): extrai stageTrace + compressionUsageReceipt para leaves (#3501) (#4721)
chatCore #3501: extract stageTrace + compressionUsageReceipt to leaves. Clean cherry-pick post-#4717. 6/6 new leaf tests, typecheck/cycles/file-size green. Integrated into release/v3.8.35.
* refactor(chatCore): extrai prepareUpstreamBody (1ª sub-fatia do executeProviderRequest, #3501) (#4730)
chatCore #3501: extract prepareUpstreamBody (first sub-slice of executeProviderRequest) to leaf (upstreamBody.ts). Clean cherry-pick post-#4721. 7/7 new leaf tests, full 301/301 chatcore suite, typecheck/cycles/file-size green. Completes the 6-PR chatCore decomposition stack into release/v3.8.35.
* fix(db): make db-backup import size cap configurable (#4719) (#4757)
Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
* chore(quality): expand check:release-green to the FULL release-PR gate set (#4758)
The release-green pre-flight (Solution C) previously covered only a subset of the
gates that run exclusively on the release PR (PR→main), so reds still accrued
silently on release/** and surfaced in ~40-min layers at release time (v3.8.34:
3 CI rounds — CodeQL sanitization, then the fail-fast Quality Ratchet revealing
openapi then cyclomatic-complexity one push at a time, plus zizmor/integration).
Now check:release-green reproduces the COMPLETE release-PR gate set and reports
EVERY red in one pass (collected, not fail-fast):
- New DRIFT ratchets (report-only, rebaselined at release, never block):
cyclomatic complexity, dead-code, type-coverage, compression-budget,
openapi-coverage, workflow-lint (zizmor), codeql-ratchet.
- New HARD gates (real defects): docs-all (fabricated-docs strict + i18n mirror
sync) and the integration test suite (gated behind !--quick).
The only release-PR gates it still cannot reproduce locally are GitHub-side CodeQL
semantic analysis and SonarQube/SonarCloud (external services).
The nightly-release-green workflow and /green-prs inherit the expanded coverage
automatically (they invoke this script), so cycle drift is now surfaced
continuously and the release PR is green on its first CI run.
Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
* fix(dashboard): add missing onboarding.tiers step title (#4698) (#4755)
Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
* feat(compression): Output Styles registry + D0 telemetry (Phase 4A) (#4694)
Phase 4A: Output Styles registry + D0 telemetry. Integrated into release/v3.8.35.
* feat(compression): SLM tier for ultra (Phase 4B) [stacked on #4694] (#4707)
Phase 4B: SLM tier for ultra. Integrated into release/v3.8.35.
* feat(compression): context-budget adaptive compression (Phase 4C) [stacked on #4707] (#4716)
Phase 4C: adaptive context-budget compression. Integrated into release/v3.8.35.
* feat(compression): offline evaluation harness (Phase 4 D1) [stacked on #4716] (#4720)
Phase 4 D1: offline evaluation harness. Integrated into release/v3.8.35.
* fix(sse): deepseek-web folds role:tool results into prompt transcript (#4712) (#4756)
Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
* fix(dashboard): remove dead unconditional useLiveRequests call in HomePageClient (#4759, #4745, #4596) (#4761)
Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
* fix(dashboard): dedupe provider nodes by id on compatible-provider add (#4746) (#4768)
Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
* chore(db): re-export compressionRunTelemetry from localDb to satisfy db-rules (#4775)
Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
* docs(security): add canonical STRIDE-based threat model (#4783)
Canonical STRIDE threat model. Integrated into release/v3.8.35.
* test(dashboard): add smoke test for home client dashboard (#4793)
Smoke test guarding the dashboard home client render (regression #4745/#4759). Code fix already landed via #4761; this PR's jsdom smoke test is the net-new regression guard. Integrated into release/v3.8.35.
* fix(combos): auto-promote zeroLatencyOptimizationsEnabled so legacy configs (pre-3.8.33 fallbackCompressionMode="lite") round-trip on the first GUI edit (#4774)
Auto-promote zeroLatencyOptimizationsEnabled + strip v3.8.31-era removed keys so legacy combo configs round-trip through PUT /api/combos/{id} on first GUI edit (closes #4382 followup). Pre-merge: rewrote the now-stale reject test to assert auto-promotion + added passthrough/round-trip regression guards; reconciled combos/page.tsx file-size baseline. Integrated into release/v3.8.35.
* refactor(chatCore): extrai parse + usage-stats não-streaming do executeProviderRequest (#3501) (#4762)
chatCore #3501: extract parseNonStreamingResponseBody + recordNonStreamingUsageStats. Integrated into release/v3.8.35.
* refactor(chatCore): extrai recordContextEditingTelemetryHook (#3501) (#4779)
chatCore #3501: extract recordContextEditingTelemetryHook. Integrated into release/v3.8.35.
* refactor(chatCore): extrai recordCompressionCacheStats (#3501) (#4792)
chatCore #3501: extract recordCompressionCacheStats. Integrated into release/v3.8.35.
* refactor(chatCore): extrai writeCavemanOutputAnalytics (#3501) (#4794)
chatCore #3501: extract writeCavemanOutputAnalytics. Integrated into release/v3.8.35.
* refactor(chatCore): extrai scheduleQuotaShareConsumption (POST-hook não-streaming, #3501) (#4780)
chatCore #3501: extract scheduleQuotaShareConsumption (non-streaming POST-hook). Integrated into release/v3.8.35.
* refactor(chatCore): extrai emitRequestGamificationEvent (helper compartilhado DRY, #3501) (#4776)
chatCore #3501: extract emitRequestGamificationEvent (DRY streaming/non-streaming). Integrated into release/v3.8.35.
* refactor(chatCore): extrai runPluginOnResponseHook (#3501) (#4782)
chatCore #3501: extract runPluginOnResponseHook. Integrated into release/v3.8.35.
* refactor(chatCore): extrai scheduleStreamingQuotaShareConsumption (POST-hook streaming, #3501) (#4784)
chatCore #3501: extract scheduleStreamingQuotaShareConsumption (streaming POST-hook). Integrated into release/v3.8.35.
* refactor(chatCore): extrai recordStreamingUsageStats (analytics de usage streaming, #3501) (#4791)
chatCore #3501: extract recordStreamingUsageStats. Integrated into release/v3.8.35.
* refactor(chatCore): extrai recordStreamingCost (custo por-request streaming, #3501) (#4790)
chatCore #3501: extract recordStreamingCost (per-request streaming cost). Integrated into release/v3.8.35.
* docs(readme): credit ponytail + OmniCompress; restore env-doc-sync release-green (#4799)
README compression credits (ponytail/OmniCompress) + env-doc-sync ignore for eval-only OMNIROUTE_EVAL_CREDENTIALS (restores release-green after #4720). Integrated into release/v3.8.35.
* chore(quality): trim combo-config.test.ts comments under file-size cap (#4774 follow-up) (#4800)
Restore file-size release-green. Integrated into release/v3.8.35.
* feat(api-docs): Redoc-rendered /api/docs + consolidate OpenAPI spec to docs/openapi.yaml (#4781)
Redoc /api/docs + OpenAPI spec consolidated to docs/openapi.yaml (canonical 201-path complete spec; old path → legacy fallback). All refs/gates/tests/CI updated. Integrated into release/v3.8.35.
* docs(compression): declare Phase 4 layers — Output Styles, adaptive dial, per-request control (#4801)
The README compression section listed the 9 input engines but not the Phase 4
layers now in production:
- Output Styles (output-axis steering: terse-prose / less-code / terse-cjk, lite/full/ultra)
- adaptive context-budget dial (reserve-output|percentage|absolute · floor|replace-autotrigger|off)
- per-request x-omniroute-compression precedence + the offline eval harness
Also bumped the highlights range to v3.8.35, expanded the compression feature bullet,
and marked the GUIDE's Phase 4 row Shipped (was 'Planned' — it's merged on v3.8.35).
Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* chore(release): finalize v3.8.35 CHANGELOG + docs reconciliation
- CHANGELOG: complete 3.8.35 section (all 35 commits since v3.8.34,
contributor attribution: @rdself @megamen32 @KooshaPari @JxnLexn)
- docs(security): align THREAT_MODEL.md refs with real code
(routeGuard.ts, tokenLimits.ts, /api/monitoring/health) — fabricated-docs gate
- check:fabricated-docs: skip docs/superpowers/specs (dated research reports)
- i18n: sync 3.8.35 section into 41 CHANGELOG mirrors (docs-sync size gate)
- ratchet rebaseline: cyclomatic 1916->1920, eslintWarnings 3907->3912
(inherited cycle drift; release-finalize diff is docs-only)
* fix(release): resolve inherited base-reds surfaced by v3.8.35 release CI
Cycle base-reds that only run on PR→main (not the PR→release fast-path):
- test(autoCombo): suffixComposition-4517 used node:test in a vitest-only dir
(#4753) → vitest found no suite. Switch to the vitest API. (Vitest job)
- test(agentSkills): openapiParser fixture wrote docs/reference/openapi.yaml;
parser reads docs/openapi.yaml since #4781 → point fixture at the new path.
(Unit/Coverage/Node24/Node26 shard 4)
- test(integration): proxy-pipeline source-scan expected inline streaming-cost
code that #4790/#3501 extracted to the recordStreamingCost leaf → assert the
delegation instead. (Integration 1/2)
- fix(chatCore): derive the log trace id from crypto, not Math.random
(CodeQL js/insecure-randomness — log-correlation id, not a secret).
- test(resilience): circuit-breaker invalid-cooldown fallback asserted t>29000,
flaking on slow CI where ~1.6s elapsed gave t=28401 → tolerate wall-clock
drift (t>25000). (Unit 6/8)
* fix(usage): derive pending-request id from crypto, not Math.random
CodeQL js/insecure-randomness (#669): the pending-request id generated in
trackPendingRequest (usageHistory.ts) flows into attempt logging and was flagged
as insecure randomness in a security context. It's a log-correlation id, not a
secret — switch to crypto RNG to clear the alert. Pairs with the chatCore traceId
fix in 37c49781a (same sink).
---------
Co-authored-by: Diego Rodrigues de Sa e Souza <souzamiriamrodrigues790@gmail.com>
Co-authored-by: Randi <55005611+rdself@users.noreply.github.com>
Co-authored-by: Demiurge The Single <megamen932@gmail.com>
Co-authored-by: KooshaPari <42529354+KooshaPari@users.noreply.github.com>
Co-authored-by: Jan Leon <Jan.gaschler@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
620 lines
25 KiB
TypeScript
620 lines
25 KiB
TypeScript
/**
|
|
* Integration Wiring Verification Tests
|
|
*
|
|
* Validates that backend modules are correctly wired into the current
|
|
* OmniRoute architecture (TypeScript + App Router route.ts files).
|
|
*/
|
|
|
|
import { describe, it } from "node:test";
|
|
import assert from "node:assert/strict";
|
|
import { readFileSync, existsSync, readdirSync } from "node:fs";
|
|
import { join, dirname } from "node:path";
|
|
import { fileURLToPath } from "node:url";
|
|
|
|
const __dirname = dirname(fileURLToPath(import.meta.url));
|
|
const ROOT = join(__dirname, "..", "..");
|
|
|
|
function readProjectFile(relPath: string) {
|
|
const full = join(ROOT, relPath);
|
|
if (!existsSync(full)) return null;
|
|
return readFileSync(full, "utf8");
|
|
}
|
|
|
|
function assertFileExists(relPath: string) {
|
|
const full = join(ROOT, relPath);
|
|
assert.ok(existsSync(full), `${relPath} should exist`);
|
|
return full;
|
|
}
|
|
|
|
function assertRouteMethods(relPath: string, methods: string[]) {
|
|
const src = readProjectFile(relPath);
|
|
assert.ok(src, `${relPath} should exist`);
|
|
for (const method of methods) {
|
|
assert.match(src, new RegExp(`export\\s+async\\s+function\\s+${method}\\s*\\(`));
|
|
}
|
|
}
|
|
|
|
function listProjectFiles(relPath: string): string[] {
|
|
const full = join(ROOT, relPath);
|
|
if (!existsSync(full)) return [];
|
|
|
|
return readdirSync(full, { withFileTypes: true }).flatMap((entry) => {
|
|
const childRelPath = `${relPath}/${entry.name}`;
|
|
if (entry.isDirectory()) return listProjectFiles(childRelPath);
|
|
return childRelPath;
|
|
});
|
|
}
|
|
|
|
// ─── Pipeline Wiring ─────────────────────────────────
|
|
|
|
describe("Pipeline Wiring — server-init.ts", () => {
|
|
const src = readProjectFile("src/server-init.ts");
|
|
|
|
it("should initialize compliance audit log", () => {
|
|
assert.ok(src, "src/server-init.ts should exist");
|
|
assert.match(src, /initAuditLog/);
|
|
});
|
|
|
|
it("should cleanup expired logs", () => {
|
|
assert.match(src, /cleanupExpiredLogs/);
|
|
});
|
|
|
|
it("should enforce secrets before startup", () => {
|
|
assert.match(src, /enforceSecrets/);
|
|
});
|
|
|
|
it("should enforce web runtime env before startup", () => {
|
|
assert.match(src, /enforceWebRuntimeEnv/);
|
|
});
|
|
|
|
it("should log server.start audit event", () => {
|
|
assert.match(src, /server\.start/);
|
|
});
|
|
|
|
it("should use the structured startup logger instead of direct console calls", () => {
|
|
assert.match(src, /createLogger\("server-init"\)/);
|
|
assert.doesNotMatch(src, /console\.(log|warn|error|info|debug)\(/);
|
|
});
|
|
});
|
|
|
|
describe("Pipeline Wiring — instrumentation-node.ts", () => {
|
|
const src = readProjectFile("src/instrumentation-node.ts");
|
|
|
|
it("should seed default model aliases during startup restore", () => {
|
|
assert.ok(src, "src/instrumentation-node.ts should exist");
|
|
assert.match(src, /seedDefaultModelAliases/);
|
|
});
|
|
|
|
it("should initialize Arena ELO sync on the live startup path (on by default, opt-out)", () => {
|
|
// The Next standalone runtime boots through instrumentation-node, NOT server-init.ts.
|
|
// The Arena ELO sync (which feeds the Free Provider Rankings page) must be wired here,
|
|
// or it never runs in production. initArenaEloSync self-gates through the feature flag
|
|
// resolver so ARENA_ELO_SYNC_ENABLED and dashboard overrides still apply.
|
|
assert.match(src, /initArenaEloSync/);
|
|
assert.match(src, /const started = await initArenaEloSync\(\)/);
|
|
});
|
|
|
|
it("should initialize pricing + models.dev sync on the live startup path (self-gated, opt-in)", () => {
|
|
// Same dead-path bug as Arena: these were only wired into the never-executed server-init.ts
|
|
// (models.dev had no caller at all), so their toggles were inert. They self-gate internally
|
|
// (PRICING_SYNC_ENABLED / settings.modelsDevSyncEnabled), so calling them here preserves opt-in.
|
|
assert.match(src, /initPricingSync/);
|
|
assert.match(src, /initModelsDevSync/);
|
|
});
|
|
});
|
|
|
|
describe("Pipeline Wiring — sse chat handler", () => {
|
|
const src = readProjectFile("src/sse/handlers/chat.ts");
|
|
const coreSrc = readProjectFile("open-sse/handlers/chatCore.ts");
|
|
|
|
it("should import and use guardrail pre-call validation", () => {
|
|
assert.ok(src, "src/sse/handlers/chat.ts should exist");
|
|
assert.match(src, /guardrailRegistry/);
|
|
assert.match(src, /runPreCallHooks/);
|
|
});
|
|
|
|
it("should import circuit breaker integration", () => {
|
|
assert.match(src, /getCircuitBreaker|CircuitBreakerOpenError/);
|
|
});
|
|
|
|
it("should use credential preflight instead of global model quarantine gates", () => {
|
|
assert.match(src, /getProviderCredentialsWithQuotaPreflight/);
|
|
});
|
|
|
|
it("should import request telemetry integration", () => {
|
|
assert.match(src, /RequestTelemetry|recordTelemetry/);
|
|
});
|
|
|
|
it("should import request id generation", () => {
|
|
assert.match(src, /generateRequestId/);
|
|
});
|
|
|
|
it("should keep cost tracking integration in the chat pipeline", () => {
|
|
assert.ok(coreSrc, "open-sse/handlers/chatCore.ts should exist");
|
|
assert.match(coreSrc, /calculateCost/);
|
|
assert.match(coreSrc, /recordCost/);
|
|
});
|
|
|
|
it("should not track backup artifacts in the active src/sse shim", () => {
|
|
const trackedArtifactNames = listProjectFiles("src/sse").filter((file) =>
|
|
/\.(orig|bak|backup)$/i.test(file)
|
|
);
|
|
|
|
assert.deepEqual(trackedArtifactNames, []);
|
|
});
|
|
});
|
|
|
|
describe("Pipeline Wiring — middleware proxy", () => {
|
|
const proxySrc = readProjectFile("src/proxy.ts");
|
|
const pipelineSrc = readProjectFile("src/server/authz/pipeline.ts");
|
|
|
|
it("should exist and delegate to authz pipeline", () => {
|
|
assert.ok(proxySrc, "src/proxy.ts should exist");
|
|
assert.match(proxySrc, /runAuthzPipeline/);
|
|
});
|
|
|
|
it("should generate request id for tracing in the authz pipeline", () => {
|
|
assert.ok(pipelineSrc, "src/server/authz/pipeline.ts should exist");
|
|
assert.match(pipelineSrc, /generateRequestId|X-Request-Id/);
|
|
});
|
|
|
|
it("should enforce body size guard in the authz pipeline", () => {
|
|
assert.match(pipelineSrc, /checkBodySize|getBodySizeLimit|bodySize/i);
|
|
});
|
|
|
|
it("should resolve JWT secret in the authz pipeline", () => {
|
|
assert.match(pipelineSrc, /getJwtSecret|jwtSecret|JWT_SECRET/i);
|
|
});
|
|
});
|
|
|
|
// ─── API Routes ──────────────────────────────────────
|
|
|
|
describe("API Routes — existence check", () => {
|
|
const routes = [
|
|
"src/app/api/cache/stats/route.ts",
|
|
"src/app/api/telemetry/summary/route.ts",
|
|
"src/app/api/usage/budget/route.ts",
|
|
"src/app/api/usage/quota/route.ts",
|
|
"src/app/api/fallback/chains/route.ts",
|
|
"src/app/api/compliance/audit-log/route.ts",
|
|
"src/app/api/evals/route.ts",
|
|
"src/app/api/evals/[suiteId]/route.ts",
|
|
"src/app/api/policies/route.ts",
|
|
];
|
|
|
|
for (const route of routes) {
|
|
it(`route file should exist: ${route}`, () => {
|
|
assertFileExists(route);
|
|
});
|
|
}
|
|
});
|
|
|
|
describe("API Routes — export HTTP methods", () => {
|
|
it("/api/cache/stats should export GET and DELETE", () => {
|
|
assertRouteMethods("src/app/api/cache/stats/route.ts", ["GET", "DELETE"]);
|
|
});
|
|
|
|
it("/api/telemetry/summary should export GET", () => {
|
|
assertRouteMethods("src/app/api/telemetry/summary/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/usage/budget should export GET and POST", () => {
|
|
assertRouteMethods("src/app/api/usage/budget/route.ts", ["GET", "POST"]);
|
|
});
|
|
|
|
it("/api/usage/quota should export GET", () => {
|
|
assertRouteMethods("src/app/api/usage/quota/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/fallback/chains should export GET, POST, DELETE", () => {
|
|
assertRouteMethods("src/app/api/fallback/chains/route.ts", ["GET", "POST", "DELETE"]);
|
|
});
|
|
|
|
it("/api/compliance/audit-log should export GET", () => {
|
|
assertRouteMethods("src/app/api/compliance/audit-log/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/evals should export GET and POST", () => {
|
|
assertRouteMethods("src/app/api/evals/route.ts", ["GET", "POST"]);
|
|
});
|
|
|
|
it("/api/evals/[suiteId] should export GET", () => {
|
|
assertRouteMethods("src/app/api/evals/[suiteId]/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/policies should export GET and POST", () => {
|
|
assertRouteMethods("src/app/api/policies/route.ts", ["GET", "POST"]);
|
|
});
|
|
});
|
|
|
|
describe("API Routes — dashboard and tool consumers", () => {
|
|
it("keeps model-combo mapping APIs wired through routing settings", () => {
|
|
const settingsPage = readProjectFile("src/app/(dashboard)/dashboard/settings/routing/page.tsx");
|
|
const modelRoutingSection = readProjectFile("src/shared/components/ModelRoutingSection.tsx");
|
|
|
|
assert.ok(settingsPage, "settings page should exist");
|
|
assert.ok(modelRoutingSection, "ModelRoutingSection should exist");
|
|
assert.match(settingsPage, /ModelRoutingSection/);
|
|
assert.match(modelRoutingSection, /fetch\("\/api\/model-combo-mappings"\)/);
|
|
assert.match(modelRoutingSection, /fetch\(`\/api\/model-combo-mappings\/\$\{editingId\}`/);
|
|
assert.match(modelRoutingSection, /method:\s*"DELETE"/);
|
|
assertRouteMethods("src/app/api/model-combo-mappings/route.ts", ["GET", "POST"]);
|
|
assertRouteMethods("src/app/api/model-combo-mappings/[id]/route.ts", ["GET", "PUT", "DELETE"]);
|
|
});
|
|
|
|
it.skip("keeps log APIs wired through the consolidated logs dashboard", () => {
|
|
const logsPage = readProjectFile("src/app/(dashboard)/dashboard/logs/page.tsx");
|
|
const requestLogger = readProjectFile("src/shared/components/RequestLoggerV2.tsx");
|
|
const proxyLogger = readProjectFile("src/shared/components/ProxyLogger.tsx");
|
|
const consoleLogger = readProjectFile("src/shared/components/ConsoleLogViewer.tsx");
|
|
|
|
assert.ok(logsPage, "logs page should exist");
|
|
assert.ok(requestLogger, "RequestLoggerV2 should exist");
|
|
assert.ok(proxyLogger, "ProxyLogger should exist");
|
|
assert.ok(consoleLogger, "ConsoleLogViewer should exist");
|
|
assert.match(logsPage, /RequestLoggerV2/);
|
|
assert.match(logsPage, /EmailPrivacyToggle/);
|
|
assert.match(logsPage, /ProxyLogger/);
|
|
assert.match(logsPage, /ConsoleLogViewer/);
|
|
// AuditLogTab removed: audit moved to its own /dashboard/audit page (#2859).
|
|
assert.match(logsPage, /\/api\/logs\/export/);
|
|
assert.match(requestLogger, /\/api\/usage\/call-logs/);
|
|
assert.match(requestLogger, /\/api\/logs\/\$\{/);
|
|
assert.doesNotMatch(requestLogger, /\/api\/logs\/active/);
|
|
assert.match(requestLogger, /\/api\/logs\/detail/);
|
|
assert.match(requestLogger, /useEmailPrivacyStore/);
|
|
assert.match(requestLogger, /maskAccount\(log\.account, emailsVisible\)/);
|
|
assert.match(requestLogger, /emailsVisible=\{emailsVisible\}/);
|
|
assert.match(proxyLogger, /\/api\/usage\/proxy-logs/);
|
|
assert.match(consoleLogger, /\/api\/logs\/console/);
|
|
assertRouteMethods("src/app/api/logs/console/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/logs/detail/route.ts", ["GET", "POST"]);
|
|
assertRouteMethods("src/app/api/logs/export/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/proxy-logs/route.ts", ["GET", "DELETE"]);
|
|
assertRouteMethods("src/app/api/usage/call-logs/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/call-logs/[id]/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("keeps request log surfaces on opaque theme colors", () => {
|
|
const requestLogger = readProjectFile("src/shared/components/RequestLoggerV2.tsx");
|
|
const globals = readProjectFile("src/app/globals.css");
|
|
|
|
assert.ok(requestLogger, "RequestLoggerV2 should exist");
|
|
assert.ok(globals, "globals.css should exist");
|
|
assert.match(globals, /--color-card:\s+#ffffff/);
|
|
assert.match(globals, /--color-card:\s+#161b22/);
|
|
assert.match(globals, /--color-card:\s+var\(--color-card\)/);
|
|
// #4233 ("opaque tables D9") replaced the bg-black/5 tint — which lost to
|
|
// bg-surface via tailwind-merge — with the opaque bg-surface theme color.
|
|
// The intent here (request log surface stays opaque over theme colors) is now
|
|
// expressed by bg-surface itself.
|
|
assert.match(requestLogger, /bg-surface/);
|
|
assert.doesNotMatch(requestLogger, /\/api\/logs\/active/);
|
|
});
|
|
|
|
it("keeps usage quota wired through A2A and MCP tools", () => {
|
|
const quotaSkill = readProjectFile("src/lib/a2a/skills/quotaManagement.ts");
|
|
const mcpAdvancedTools = readProjectFile("open-sse/mcp-server/tools/advancedTools.ts");
|
|
const mcpServer = readProjectFile("open-sse/mcp-server/server.ts");
|
|
|
|
assert.ok(quotaSkill, "quotaManagement skill should exist");
|
|
assert.ok(mcpAdvancedTools, "advanced MCP tools should exist");
|
|
assert.ok(mcpServer, "MCP server should exist");
|
|
assert.match(quotaSkill, /\/api\/usage\/quota/);
|
|
assert.match(mcpAdvancedTools, /\/api\/usage\/quota/);
|
|
assert.match(mcpServer, /\/api\/usage\/quota/);
|
|
assertRouteMethods("src/app/api/usage/quota/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("keeps legacy usage history and raw request-log APIs explicitly classified", () => {
|
|
const usageStats = readProjectFile("src/shared/components/UsageStats.tsx");
|
|
const apiReference = readProjectFile("docs/reference/API_REFERENCE.md");
|
|
const openApi = readProjectFile("docs/openapi.yaml");
|
|
|
|
assert.ok(usageStats, "UsageStats compatibility component should exist");
|
|
assert.ok(apiReference, "API reference should exist");
|
|
assert.ok(openApi, "OpenAPI document should exist");
|
|
assert.match(usageStats, /\/api\/usage\/history/);
|
|
assert.match(apiReference, /\/api\/usage\/history/);
|
|
assert.match(apiReference, /\/api\/usage\/request-logs/);
|
|
assert.match(openApi, /\/api\/usage\/history:/);
|
|
assert.match(openApi, /\/api\/usage\/request-logs:/);
|
|
assertRouteMethods("src/app/api/usage/history/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/request-logs/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/logs/route.ts", ["GET"]);
|
|
});
|
|
});
|
|
|
|
describe("API Routes — T09 /v1 catalog consistency", () => {
|
|
const v1RouteSrc = readProjectFile("src/app/api/v1/route.ts");
|
|
const v1ModelsRouteSrc = readProjectFile("src/app/api/v1/models/route.ts");
|
|
const v1CatalogSrc = readProjectFile("src/app/api/v1/models/catalog.ts");
|
|
|
|
it("/api/v1 should delegate model catalog to unified builder", () => {
|
|
assert.ok(v1RouteSrc, "src/app/api/v1/route.ts should exist");
|
|
assert.match(v1RouteSrc, /getUnifiedModelsResponse/);
|
|
assert.match(v1RouteSrc, /from\s+["']\.\/models\/catalog["']/);
|
|
assert.doesNotMatch(v1RouteSrc, /const\s+models\s*=\s*\[/);
|
|
});
|
|
|
|
it("/api/v1/models route should only consume unified model catalog builder", () => {
|
|
assert.ok(v1ModelsRouteSrc, "src/app/api/v1/models/route.ts should exist");
|
|
assert.match(v1ModelsRouteSrc, /from\s+["']\.\/catalog["']/);
|
|
assert.doesNotMatch(
|
|
v1ModelsRouteSrc,
|
|
/export\s+async\s+function\s+getUnifiedModelsResponse\s*\(/
|
|
);
|
|
});
|
|
|
|
it("/api/v1/models/catalog should export unified model catalog builder", () => {
|
|
assert.ok(v1CatalogSrc, "src/app/api/v1/models/catalog.ts should exist");
|
|
assert.match(v1CatalogSrc, /export\s+async\s+function\s+getUnifiedModelsResponse\s*\(/);
|
|
});
|
|
});
|
|
|
|
describe("Dashboard Wiring — T05 payload rules", () => {
|
|
const settingsPageSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/settings/advanced/page.tsx"
|
|
);
|
|
const payloadRulesTabSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/settings/components/PayloadRulesTab.tsx"
|
|
);
|
|
const openapiSrc = readProjectFile("docs/openapi.yaml");
|
|
|
|
it.skip("settings page should surface payload rules inside advanced settings", () => {
|
|
assert.ok(settingsPageSrc, "settings page source should exist");
|
|
assert.match(
|
|
settingsPageSrc,
|
|
/import PayloadRulesTab from "\.\.\/components\/PayloadRulesTab"/
|
|
);
|
|
assert.match(settingsPageSrc, /<PayloadRulesTab\s*\/>/);
|
|
});
|
|
|
|
it("payload rules tab should read and write through the dedicated settings endpoint", () => {
|
|
assert.ok(payloadRulesTabSrc, "payload rules tab source should exist");
|
|
assert.match(payloadRulesTabSrc, /fetch\("\/api\/settings\/payload-rules"\)/);
|
|
assert.match(payloadRulesTabSrc, /fetch\("\/api\/settings\/payload-rules",\s*\{/);
|
|
assert.match(payloadRulesTabSrc, /method:\s*"PUT"/);
|
|
assert.match(payloadRulesTabSrc, /default-raw/);
|
|
});
|
|
|
|
it("openapi should document the payload rules management surface", () => {
|
|
assert.ok(openapiSrc, "docs/openapi.yaml should exist");
|
|
assert.match(openapiSrc, /\/api\/settings\/payload-rules:/);
|
|
assert.match(openapiSrc, /summary:\s+Get payload rules configuration/);
|
|
assert.match(openapiSrc, /ManagementSessionAuth:/);
|
|
assert.match(openapiSrc, /PayloadRulesConfig:/);
|
|
});
|
|
});
|
|
|
|
// ─── Barrel Exports ─────────────────────────────────
|
|
|
|
describe("Barrel Exports — shared/components", () => {
|
|
const src = readProjectFile("src/shared/components/index.tsx");
|
|
|
|
it("should export key shared UI modules", () => {
|
|
assert.ok(src, "src/shared/components/index.tsx should exist");
|
|
for (const name of [
|
|
"Breadcrumbs",
|
|
"EmptyState",
|
|
"NotificationToast",
|
|
"FilterBar",
|
|
"ColumnToggle",
|
|
"DataTable",
|
|
]) {
|
|
assert.match(src, new RegExp(name));
|
|
}
|
|
});
|
|
|
|
it("should re-export layouts", () => {
|
|
assert.match(src, /export\s+\*\s+from\s+"\.\/layouts"/);
|
|
});
|
|
});
|
|
|
|
describe("Barrel Exports — store", () => {
|
|
const src = readProjectFile("src/store/index.ts");
|
|
|
|
it("should export useNotificationStore", () => {
|
|
assert.ok(src, "src/store/index.ts should exist");
|
|
assert.match(src, /useNotificationStore/);
|
|
});
|
|
});
|
|
|
|
describe("Barrel Exports — shared/components/layouts", () => {
|
|
const src = readProjectFile("src/shared/components/layouts/index.tsx");
|
|
|
|
it("should export DashboardLayout and AuthLayout", () => {
|
|
assert.ok(src, "src/shared/components/layouts/index.tsx should exist");
|
|
assert.match(src, /DashboardLayout/);
|
|
assert.match(src, /AuthLayout/);
|
|
});
|
|
});
|
|
|
|
// ─── Layout and Page Integration ────────────────────
|
|
|
|
describe("DashboardLayout Integration", () => {
|
|
const src = readProjectFile("src/shared/components/layouts/DashboardLayout.tsx");
|
|
|
|
it("should render NotificationToast globally", () => {
|
|
assert.ok(src, "src/shared/components/layouts/DashboardLayout.tsx should exist");
|
|
assert.match(src, /NotificationToast/);
|
|
});
|
|
|
|
it.skip("should include Breadcrumbs in page wrapper", () => {
|
|
assert.match(src, /Breadcrumbs/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — logs page wiring", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/logs/page.tsx");
|
|
|
|
it.skip("should wire segmented log tabs", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/logs/page.tsx should exist");
|
|
assert.match(src, /SegmentedControl/);
|
|
assert.match(src, /RequestLoggerV2/);
|
|
assert.match(src, /ProxyLogger/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — settings page wiring", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/settings/resilience/page.tsx");
|
|
const memorySkillsTab = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/settings/components/MemorySkillsTab.tsx"
|
|
);
|
|
|
|
it("should include resilience tab in advanced settings", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/settings/resilience/page.tsx should exist");
|
|
assert.match(src, /ResilienceTab/);
|
|
});
|
|
|
|
it("should not label the active skills settings card as a placeholder", () => {
|
|
assert.ok(memorySkillsTab, "MemorySkillsTab should exist");
|
|
assert.doesNotMatch(memorySkillsTab, /Skills Settings \(placeholder\)/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — cache page wiring", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/cache/page.tsx");
|
|
|
|
it("should consolidate prompt cache metrics directly into cache management", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/cache/page.tsx should exist");
|
|
assert.doesNotMatch(src, /CacheStatsCard/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — cost explorer wiring", () => {
|
|
const costsPage = readProjectFile("src/app/(dashboard)/dashboard/costs/CostOverviewTab.tsx");
|
|
const costExplorerUtils = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/costs/costExplorerUtils.ts"
|
|
);
|
|
|
|
it("should expose an interactive grouped Cost Explorer on the costs dashboard", () => {
|
|
assert.ok(costsPage, "CostOverviewTab should exist");
|
|
assert.ok(costExplorerUtils, "costExplorerUtils should exist");
|
|
assert.match(costsPage, /CostExplorerCard/);
|
|
assert.match(costsPage, /EXPLORER_GROUP_OPTIONS/);
|
|
assert.match(costsPage, /byServiceTier/);
|
|
assert.match(costExplorerUtils, /buildCostExplorerRows/);
|
|
assert.match(costExplorerUtils, /serviceTier/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — combos page empty state", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/combos/page.tsx");
|
|
|
|
it("should use EmptyState when there are no combos", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/combos/page.tsx should exist");
|
|
assert.match(src, /EmptyState/);
|
|
});
|
|
|
|
it("should use notification store for UX feedback", () => {
|
|
assert.match(src, /useNotificationStore/);
|
|
});
|
|
|
|
it("should persist usage guide visibility and allow reopening", () => {
|
|
assert.match(src, /COMBO_USAGE_GUIDE_STORAGE_KEY/);
|
|
assert.match(src, /localStorage/);
|
|
assert.match(src, /handleShowUsageGuide/);
|
|
});
|
|
|
|
it("should expose quick templates and post-create quick test CTA", () => {
|
|
assert.match(src, /COMBO_TEMPLATES/);
|
|
assert.match(src, /applyTemplate/);
|
|
assert.match(src, /recentlyCreatedCombo/);
|
|
assert.match(src, /testNow/);
|
|
});
|
|
|
|
it("should include cost-optimized pricing coverage UX", () => {
|
|
assert.match(src, /hasPricingForModel/);
|
|
assert.match(src, /pricingCoveragePercent/);
|
|
assert.match(src, /pricingCoverage/);
|
|
assert.match(src, /warningCostOptimizedPartialPricing/);
|
|
});
|
|
|
|
it("should wire combo account labels to the global email privacy toggle", () => {
|
|
// #3822: the per-page EmailPrivacyToggle (and its emailVisibilityTooltip) was removed in
|
|
// favor of the single global switch in Settings → Appearance. The combos page still
|
|
// consumes the store and masks account labels via pickDisplayValue.
|
|
assert.match(src, /useEmailPrivacyStore/);
|
|
assert.match(src, /pickDisplayValue/);
|
|
});
|
|
|
|
it("should mask combo test result labels with the global email privacy toggle", () => {
|
|
assert.match(src, /function TestResultsView/);
|
|
assert.match(src, /pickDisplayValue\(\[r\.label\], emailsVisible, r\.model\)/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — provider test results privacy", () => {
|
|
const providersSrc = readProjectFile("src/app/(dashboard)/dashboard/providers/page.tsx");
|
|
const providerDetailSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx"
|
|
);
|
|
// #3501 strangler-fig decomposition moved the test-results masking and the upstream-proxy
|
|
// surface out of the page client into dedicated components.
|
|
const batchTestResultsSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/providers/[id]/components/BatchTestResultsModal.tsx"
|
|
);
|
|
const upstreamProxyCardSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/providers/[id]/components/UpstreamProxyCard.tsx"
|
|
);
|
|
|
|
it("should mask provider test batch names with the global email privacy toggle", () => {
|
|
assert.ok(providersSrc, "src/app/(dashboard)/dashboard/providers/page.tsx should exist");
|
|
assert.match(providersSrc, /useEmailPrivacyStore/);
|
|
assert.match(
|
|
providersSrc,
|
|
/pickDisplayValue\(\[r\.connectionName\], emailsVisible, r\.connectionName\)/
|
|
);
|
|
});
|
|
|
|
it("should mask provider detail test result names with the global email privacy toggle", () => {
|
|
assert.ok(
|
|
providerDetailSrc,
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
|
|
);
|
|
assert.match(providerDetailSrc, /const emailsVisible = useEmailPrivacyStore/);
|
|
// The per-connection test-result masking now lives in the decomposed BatchTestResultsModal.
|
|
assert.ok(batchTestResultsSrc, "BatchTestResultsModal.tsx should exist");
|
|
assert.match(
|
|
batchTestResultsSrc,
|
|
/pickDisplayValue\(\s*\[r\.connectionName\],\s*emailsVisible,\s*r\.connectionName\s*\)/
|
|
);
|
|
});
|
|
|
|
it("should resolve provider detail metadata through the shared dashboard catalog", () => {
|
|
assert.ok(
|
|
providerDetailSrc,
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
|
|
);
|
|
assert.match(providerDetailSrc, /resolveDashboardProviderInfo/);
|
|
});
|
|
|
|
it("should treat upstream proxy entries as a dedicated management surface", () => {
|
|
assert.ok(
|
|
providerDetailSrc,
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
|
|
);
|
|
assert.match(providerDetailSrc, /isUpstreamProxyProvider/);
|
|
// The "managed elsewhere" copy now lives in the decomposed UpstreamProxyCard component.
|
|
assert.ok(upstreamProxyCardSrc, "UpstreamProxyCard.tsx should exist");
|
|
assert.match(upstreamProxyCardSrc, /Managed via Upstream Proxy Settings/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — legacy provider create route retirement", () => {
|
|
const legacyProviderNewSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/providers/new/page.tsx"
|
|
);
|
|
|
|
it("should redirect legacy /dashboard/providers/new to the canonical providers flow", () => {
|
|
assert.ok(
|
|
legacyProviderNewSrc,
|
|
"src/app/(dashboard)/dashboard/providers/new/page.tsx should exist"
|
|
);
|
|
assert.match(legacyProviderNewSrc, /redirect\("\/dashboard\/providers"\)/);
|
|
assert.doesNotMatch(legacyProviderNewSrc, /authMethod:\s*"api_key"/);
|
|
assert.doesNotMatch(legacyProviderNewSrc, /displayName/);
|
|
});
|
|
});
|