mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-07-26 09:52:11 +03:00
* perf: startup parallelization, stream TextEncoder lift, auth middleware bottlenecks
Startup (~100-300ms faster cold start):
- Parallelize 4 early imports via Promise.all() in registerNodejs()
- Parallelize 10 independent background services via Promise.allSettled()
- Each service has independent try/catch — no failure domino effect
Streaming pipeline (8 fewer TextEncoder GC allocations per SSE event):
- Lift new TextEncoder() from per-chunk inside buildClaudeStreamingResponse
to function scope alongside existing decoder singleton
Auth middleware bottlenecks (from PerfBottleneckAnalysis):
- Backoff decay loop: replace updateProviderConnection (full CRUD:
SELECT+encrypt+cache-invalidate+backup) with resetConnectionBackoff
(targeted UPDATE of backoff/error columns only)
- Dual .filter() for quota: replace two passes calling
isQuotaExhaustedForRequest per connection with a single for loop
partitioning into withQuota/exhaustedQuota
- Debug-log filter recomputation: capture connectionFilterStatus Map
during the filter pass; debug loop reads 6 string comparisons instead
of 6 function calls per connection
Supporting:
- Add resetConnectionBackoff to src/lib/db/providers.ts (patterned after
clearConnectionErrorIfUnchanged, no CAS check)
- Re-export resetConnectionBackoff from src/lib/localDb.ts
- Update integration-wiring.test.ts regex for parallelized dynamic import
* perf: P2C quota cache, lazy provider init, structuredClone elimination, getSettings→getCachedSettings
- **auth.ts: P2C quota re-evaluation cache** — quotaResults Map threaded
through selectPoolSubset → compareP2CConnections → getP2CConnectionScore.
Populated during filter + partition passes, eliminating redundant
evaluateQuotaLimitPolicy / isQuotaExhaustedForRequest calls when the
P2C comparator re-evaluates previously-scored connections.
- **constants.ts: lazy PROVIDERS via Proxy** — replaces eager
generateLegacyProviders() + loadProviderCredentials() at module load
with Proxy delegating to deferred init on first property access.
- **providerModels.ts: lazy PROVIDER_MODELS + PROVIDER_ID_TO_ALIAS** —
same Proxy pattern for both exports; generateModels()/generateAliasMap()
deferred until first read.
- **stream.ts: structuredClone → minimal object spread** — replaces
O(n) deep clone of SSE response chunks with targeted reconstruction
of only mutated fields (usage, delta.content, finish_reason).
- **progressTracker.ts: TextDecoder lift** — module-level decoder
instead of per-chunk new TextDecoder().
- **Route files: getSettings() → getCachedSettings()** — 13 API route
files converted from uncached per-request DB reads to TTL-cached
wrapper (5s default), eliminating redundant queries on every request.
- **settings.ts: re-export getCachedSettings** from readCache for
non-localDb consumers.
- **Remove settingsCache.ts** — dead file, no imports reference it.
TS compile: 0 errors. Auth tests: 225/225 pass. Services: 269/269 pass.
* perf: Phase 1 tangible wins — egressCache eviction, mmap_size PRAGMA, composite indexes, proxyFallback lazy import
- egressCache: lazy TTL eviction on getCachedEgressIp access (bounds memory
leak to distinct proxy URLs, typically <100)
- mmap_size: apply stored PRAGMA from key_value table (256MiB default) after
applyStoredDatabaseOptimizationSettings — setting was stored but never applied
- schemaColumns: add idx_uh_provider_model_timestamp (covers getModelLatencyStats)
and idx_pc_provider_auth_type (covers 6+ provider_connections queries)
- proxyFallback: convert static import to dynamic import() inside error handler
(defers 210ms module load from startup to first proxy-retry scenario)
* perf: add dedup expression index, unref() sweep timers
- Add COALESCE expression index idx_uh_dedup on usage_history
matching the exact dedup query pattern. Eliminates FULL TABLE
SCAN on every saveRequestUsage insert.
- Add composite idx_uh_provider_model_timestamp on usage_history.
- Add composite idx_pc_provider_auth_type on provider_connections.
- Add .unref() to setInterval in batchProcessor.ts (polling loop).
- Add .unref() to setInterval in runtimeHeartbeat.ts (heartbeat).
* perf: bump SQLite cache_size default from 16MB to 64MB
New installs now start with 64MB page cache (was 16MB). Existing
users' stored settings are unchanged. Reduces disk reads for the
typical ~250MB database by keeping ~25% of pages in memory.
Also resolved pre-existing merge conflict in webhooks.ts.
* docs: add Redis production config guide and proxy port clash investigation report
- docs/redis-production-config.md: comprehensive Redis tuning guide
covering client options, server config, Docker settings, scaling,
and monitoring for all three Redis workloads (rate limiting,
auth cache, quota store)
- docs/proxy-port-clash-report.md: investigation confirming proxy
subsystem has no port binding issues; real EADDRINUSE history
traced to process supervisor crash-loop restart race (#4425) and
live-dashboard port clash (#6324), both already fixed
* fix: address PR #7893 review — add Proxy traps, extract migrations to reduce providers.ts size
- Add set trap to PROVIDER_ID_TO_ALIAS Proxy (providerModels.ts)
- Add deleteProperty traps to all three lazy Proxies (PROVIDERS,
PROVIDER_MODELS, PROVIDER_ID_TO_ALIAS)
- Extract autoMigrateLegacyEncryptedConnections and getGheCopilotHosts
from providers.ts (1129→1036 lines, -93) into providers/migrations.ts
- Both functions re-exported via providers.ts for backward compat
File-size ratchet resolved: src/lib/db/providers.ts now 1036 lines.
* fix: resolve merge conflict markers in 3 route/test files
- model-combo-mappings/route.ts: kept upstream version (Zod pagination
via validateBody + isValidationFailure), restored missing return
statement for GET handler
- playground/presets/route.ts: kept stashed version details (satisfies
type-narrowing + inlined Response) — functionally identical
- error-sanitization.test.ts: matches upstream exactly (no diff)
Test verification: same 7 pre-existing failures confirmed on upstream
baseline (c1bdd91e7). Zero regressions from conflict resolution.
Closes remaining uncommitted work from PR #7046 rebase.
* test(db): add resetConnectionBackoff coverage + fix file-size ratchet regression
- Add tests/unit/reset-connection-backoff.test.ts: covers the new
resetConnectionBackoff lightweight-UPDATE helper (clears backoff/error
columns and re-activates a connection, unconditional-write behavior on
terminal statuses, no-op for empty/unknown ids). Zero prior coverage
per pre-merge review of PR #7893 (Hard Rule #8).
- open-sse/services/batchProcessor.ts: fold the new unref() call into the
existing setInterval(...).unref() chain instead of a separate statement,
keeping the file at the frozen 915-line ratchet (Timeout.unref() already
returns `this`, so no type cast is needed).
- src/lib/localDb.ts: drop one blank separator line so the new
resetConnectionBackoff re-export stays within the frozen 808-line ratchet.
Pre-merge fix for PR #7893 (perf/startup-stream-auth-optimizations) per
/green-prs plan-file _tasks/pipeline/prs/1-analyzed/7893-*.plan.md.
Co-authored-by: Diego Rodrigues de Sa e Souza <diegosouzapw@users.noreply.github.com>
---------
Co-authored-by: oyi77 <oyi77@users.noreply.github.com>
Co-authored-by: Diego Rodrigues de Sa e Souza <diegosouza.pw@gmail.com>
Co-authored-by: Diego Rodrigues de Sa e Souza <diegosouzapw@users.noreply.github.com>
617 lines
26 KiB
TypeScript
617 lines
26 KiB
TypeScript
/**
|
|
* Integration Wiring Verification Tests
|
|
*
|
|
* Validates that backend modules are correctly wired into the current
|
|
* OmniRoute architecture (TypeScript + App Router route.ts files).
|
|
*/
|
|
|
|
import { describe, it } from "node:test";
|
|
import assert from "node:assert/strict";
|
|
import { readFileSync, existsSync, readdirSync } from "node:fs";
|
|
import { join, dirname } from "node:path";
|
|
import { fileURLToPath } from "node:url";
|
|
|
|
const __dirname = dirname(fileURLToPath(import.meta.url));
|
|
const ROOT = join(__dirname, "..", "..");
|
|
|
|
function readProjectFile(relPath: string) {
|
|
const full = join(ROOT, relPath);
|
|
if (!existsSync(full)) return null;
|
|
return readFileSync(full, "utf8");
|
|
}
|
|
|
|
function assertFileExists(relPath: string) {
|
|
const full = join(ROOT, relPath);
|
|
assert.ok(existsSync(full), `${relPath} should exist`);
|
|
return full;
|
|
}
|
|
|
|
function assertRouteMethods(relPath: string, methods: string[]) {
|
|
const src = readProjectFile(relPath);
|
|
assert.ok(src, `${relPath} should exist`);
|
|
for (const method of methods) {
|
|
assert.match(src, new RegExp(`export\\s+async\\s+function\\s+${method}\\s*\\(`));
|
|
}
|
|
}
|
|
|
|
function listProjectFiles(relPath: string): string[] {
|
|
const full = join(ROOT, relPath);
|
|
if (!existsSync(full)) return [];
|
|
|
|
return readdirSync(full, { withFileTypes: true }).flatMap((entry) => {
|
|
const childRelPath = `${relPath}/${entry.name}`;
|
|
if (entry.isDirectory()) return listProjectFiles(childRelPath);
|
|
return childRelPath;
|
|
});
|
|
}
|
|
|
|
// ─── Pipeline Wiring ─────────────────────────────────
|
|
|
|
describe("Pipeline Wiring — server-init.ts", () => {
|
|
const src = readProjectFile("src/server-init.ts");
|
|
|
|
it("should initialize compliance audit log", () => {
|
|
assert.ok(src, "src/server-init.ts should exist");
|
|
assert.match(src, /initAuditLog/);
|
|
});
|
|
|
|
it("should cleanup expired logs", () => {
|
|
assert.match(src, /cleanupExpiredLogs/);
|
|
});
|
|
|
|
it("should enforce secrets before startup", () => {
|
|
assert.match(src, /enforceSecrets/);
|
|
});
|
|
|
|
it("should enforce web runtime env before startup", () => {
|
|
assert.match(src, /enforceWebRuntimeEnv/);
|
|
});
|
|
|
|
it("should log server.start audit event", () => {
|
|
assert.match(src, /server\.start/);
|
|
});
|
|
|
|
it("should use the structured startup logger instead of direct console calls", () => {
|
|
assert.match(src, /createLogger\("server-init"\)/);
|
|
assert.doesNotMatch(src, /console\.(log|warn|error|info|debug)\(/);
|
|
});
|
|
});
|
|
|
|
describe("Pipeline Wiring — instrumentation-node.ts", () => {
|
|
const src = readProjectFile("src/instrumentation-node.ts");
|
|
|
|
it("should seed default model aliases during startup restore", () => {
|
|
assert.ok(src, "src/instrumentation-node.ts should exist");
|
|
assert.match(src, /seedDefaultModelAliases/);
|
|
});
|
|
|
|
it("should initialize Arena ELO sync on the live startup path (on by default, opt-out)", () => {
|
|
// The Next standalone runtime boots through instrumentation-node, NOT server-init.ts.
|
|
// The Arena ELO sync (which feeds the Free Provider Rankings page) must be wired here,
|
|
// or it never runs in production. initArenaEloSync self-gates through the feature flag
|
|
// resolver so ARENA_ELO_SYNC_ENABLED and dashboard overrides still apply.
|
|
assert.match(src, /initArenaEloSync/);
|
|
assert.match(src, /m\.initArenaEloSync\(\)/);
|
|
});
|
|
|
|
it("should initialize pricing + models.dev sync on the live startup path (self-gated, opt-in)", () => {
|
|
// Same dead-path bug as Arena: these were only wired into the never-executed server-init.ts
|
|
// (models.dev had no caller at all), so their toggles were inert. They self-gate internally
|
|
// (PRICING_SYNC_ENABLED / settings.modelsDevSyncEnabled), so calling them here preserves opt-in.
|
|
assert.match(src, /initPricingSync/);
|
|
assert.match(src, /initModelsDevSync/);
|
|
});
|
|
});
|
|
|
|
describe("Pipeline Wiring — sse chat handler", () => {
|
|
const src = readProjectFile("src/sse/handlers/chat.ts");
|
|
const coreSrc = readProjectFile("open-sse/handlers/chatCore.ts");
|
|
|
|
it("should import and use guardrail pre-call validation", () => {
|
|
assert.ok(src, "src/sse/handlers/chat.ts should exist");
|
|
assert.match(src, /guardrailRegistry/);
|
|
assert.match(src, /runPreCallHooks/);
|
|
});
|
|
|
|
it("should import circuit breaker integration", () => {
|
|
assert.match(src, /getCircuitBreaker|CircuitBreakerOpenError/);
|
|
});
|
|
|
|
it("should use credential preflight instead of global model quarantine gates", () => {
|
|
assert.match(src, /getProviderCredentialsWithQuotaPreflight/);
|
|
});
|
|
|
|
it("should import request telemetry integration", () => {
|
|
assert.match(src, /RequestTelemetry|recordTelemetry/);
|
|
});
|
|
|
|
it("should import request id generation", () => {
|
|
assert.match(src, /generateRequestId/);
|
|
});
|
|
|
|
it("should keep cost tracking integration in the chat pipeline", () => {
|
|
assert.ok(coreSrc, "open-sse/handlers/chatCore.ts should exist");
|
|
assert.match(coreSrc, /calculateCost/);
|
|
assert.match(coreSrc, /recordCost/);
|
|
});
|
|
|
|
it("should not track backup artifacts in the active src/sse shim", () => {
|
|
const trackedArtifactNames = listProjectFiles("src/sse").filter((file) =>
|
|
/\.(orig|bak|backup)$/i.test(file)
|
|
);
|
|
|
|
assert.deepEqual(trackedArtifactNames, []);
|
|
});
|
|
});
|
|
|
|
describe("Pipeline Wiring — middleware proxy", () => {
|
|
const proxySrc = readProjectFile("src/proxy.ts");
|
|
const pipelineSrc = readProjectFile("src/server/authz/pipeline.ts");
|
|
|
|
it("should exist and delegate to authz pipeline", () => {
|
|
assert.ok(proxySrc, "src/proxy.ts should exist");
|
|
assert.match(proxySrc, /runAuthzPipeline/);
|
|
});
|
|
|
|
it("should generate request id for tracing in the authz pipeline", () => {
|
|
assert.ok(pipelineSrc, "src/server/authz/pipeline.ts should exist");
|
|
assert.match(pipelineSrc, /generateRequestId|X-Request-Id/);
|
|
});
|
|
|
|
it("should enforce body size guard in the authz pipeline", () => {
|
|
assert.match(pipelineSrc, /checkBodySize|getBodySizeLimit|bodySize/i);
|
|
});
|
|
|
|
it("should resolve JWT secret in the authz pipeline", () => {
|
|
assert.match(pipelineSrc, /getJwtSecret|jwtSecret|JWT_SECRET/i);
|
|
});
|
|
});
|
|
|
|
// ─── API Routes ──────────────────────────────────────
|
|
|
|
describe("API Routes — existence check", () => {
|
|
const routes = [
|
|
"src/app/api/cache/stats/route.ts",
|
|
"src/app/api/telemetry/summary/route.ts",
|
|
"src/app/api/usage/budget/route.ts",
|
|
"src/app/api/usage/quota/route.ts",
|
|
"src/app/api/fallback/chains/route.ts",
|
|
"src/app/api/compliance/audit-log/route.ts",
|
|
"src/app/api/evals/route.ts",
|
|
"src/app/api/evals/[suiteId]/route.ts",
|
|
"src/app/api/policies/route.ts",
|
|
];
|
|
|
|
for (const route of routes) {
|
|
it(`route file should exist: ${route}`, () => {
|
|
assertFileExists(route);
|
|
});
|
|
}
|
|
});
|
|
|
|
describe("API Routes — export HTTP methods", () => {
|
|
it("/api/cache/stats should export GET and DELETE", () => {
|
|
assertRouteMethods("src/app/api/cache/stats/route.ts", ["GET", "DELETE"]);
|
|
});
|
|
|
|
it("/api/telemetry/summary should export GET", () => {
|
|
assertRouteMethods("src/app/api/telemetry/summary/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/usage/budget should export GET and POST", () => {
|
|
assertRouteMethods("src/app/api/usage/budget/route.ts", ["GET", "POST"]);
|
|
});
|
|
|
|
it("/api/usage/quota should export GET", () => {
|
|
assertRouteMethods("src/app/api/usage/quota/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/fallback/chains should export GET, POST, DELETE", () => {
|
|
assertRouteMethods("src/app/api/fallback/chains/route.ts", ["GET", "POST", "DELETE"]);
|
|
});
|
|
|
|
it("/api/compliance/audit-log should export GET", () => {
|
|
assertRouteMethods("src/app/api/compliance/audit-log/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/evals should export GET and POST", () => {
|
|
assertRouteMethods("src/app/api/evals/route.ts", ["GET", "POST"]);
|
|
});
|
|
|
|
it("/api/evals/[suiteId] should export GET", () => {
|
|
assertRouteMethods("src/app/api/evals/[suiteId]/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("/api/policies should export GET and POST", () => {
|
|
assertRouteMethods("src/app/api/policies/route.ts", ["GET", "POST"]);
|
|
});
|
|
});
|
|
|
|
describe("API Routes — dashboard and tool consumers", () => {
|
|
it("keeps model-combo mapping APIs wired through routing settings", () => {
|
|
const settingsPage = readProjectFile("src/app/(dashboard)/dashboard/settings/routing/page.tsx");
|
|
const modelRoutingSection = readProjectFile("src/shared/components/ModelRoutingSection.tsx");
|
|
|
|
assert.ok(settingsPage, "settings page should exist");
|
|
assert.ok(modelRoutingSection, "ModelRoutingSection should exist");
|
|
assert.match(settingsPage, /ModelRoutingSection/);
|
|
assert.match(modelRoutingSection, /fetch\("\/api\/model-combo-mappings"\)/);
|
|
assert.match(modelRoutingSection, /fetch\(`\/api\/model-combo-mappings\/\$\{editingId\}`/);
|
|
assert.match(modelRoutingSection, /method:\s*"DELETE"/);
|
|
assertRouteMethods("src/app/api/model-combo-mappings/route.ts", ["GET", "POST"]);
|
|
assertRouteMethods("src/app/api/model-combo-mappings/[id]/route.ts", ["GET", "PUT", "DELETE"]);
|
|
});
|
|
|
|
it.skip("keeps log APIs wired through the consolidated logs dashboard", () => {
|
|
const logsPage = readProjectFile("src/app/(dashboard)/dashboard/logs/page.tsx");
|
|
const requestLogger = readProjectFile("src/shared/components/RequestLoggerV2.tsx");
|
|
const proxyLogger = readProjectFile("src/shared/components/ProxyLogger.tsx");
|
|
const consoleLogger = readProjectFile("src/shared/components/ConsoleLogViewer.tsx");
|
|
|
|
assert.ok(logsPage, "logs page should exist");
|
|
assert.ok(requestLogger, "RequestLoggerV2 should exist");
|
|
assert.ok(proxyLogger, "ProxyLogger should exist");
|
|
assert.ok(consoleLogger, "ConsoleLogViewer should exist");
|
|
assert.match(logsPage, /RequestLoggerV2/);
|
|
assert.match(logsPage, /EmailPrivacyToggle/);
|
|
assert.match(logsPage, /ProxyLogger/);
|
|
assert.match(logsPage, /ConsoleLogViewer/);
|
|
// AuditLogTab removed: audit moved to its own /dashboard/audit page (#2859).
|
|
assert.match(logsPage, /\/api\/logs\/export/);
|
|
assert.match(requestLogger, /\/api\/usage\/call-logs/);
|
|
assert.match(requestLogger, /\/api\/logs\/\$\{/);
|
|
assert.doesNotMatch(requestLogger, /\/api\/logs\/active/);
|
|
assert.match(requestLogger, /\/api\/logs\/detail/);
|
|
assert.match(requestLogger, /useEmailPrivacyStore/);
|
|
assert.match(requestLogger, /maskAccount\(log\.account, emailsVisible\)/);
|
|
assert.match(requestLogger, /emailsVisible=\{emailsVisible\}/);
|
|
assert.match(proxyLogger, /\/api\/usage\/proxy-logs/);
|
|
assert.match(consoleLogger, /\/api\/logs\/console/);
|
|
assertRouteMethods("src/app/api/logs/console/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/logs/detail/route.ts", ["GET", "POST"]);
|
|
assertRouteMethods("src/app/api/logs/export/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/proxy-logs/route.ts", ["GET", "DELETE"]);
|
|
assertRouteMethods("src/app/api/usage/call-logs/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/call-logs/[id]/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("keeps request log surfaces on opaque theme colors", () => {
|
|
const requestLogger = readProjectFile("src/shared/components/RequestLoggerV2.tsx");
|
|
const globals = readProjectFile("src/app/globals.css");
|
|
|
|
assert.ok(requestLogger, "RequestLoggerV2 should exist");
|
|
assert.ok(globals, "globals.css should exist");
|
|
assert.match(globals, /--color-card:\s+#ffffff/);
|
|
assert.match(globals, /--color-card:\s+#161b22/);
|
|
assert.match(globals, /--color-card:\s+var\(--color-card\)/);
|
|
// #4233 ("opaque tables D9") replaced the bg-black/5 tint — which lost to
|
|
// bg-surface via tailwind-merge — with the opaque bg-surface theme color.
|
|
// The intent here (request log surface stays opaque over theme colors) is now
|
|
// expressed by bg-surface itself.
|
|
assert.match(requestLogger, /bg-surface/);
|
|
assert.doesNotMatch(requestLogger, /\/api\/logs\/active/);
|
|
});
|
|
|
|
it("keeps usage quota wired through A2A and MCP tools", () => {
|
|
const quotaSkill = readProjectFile("src/lib/a2a/skills/quotaManagement.ts");
|
|
const mcpAdvancedTools = readProjectFile("open-sse/mcp-server/tools/advancedTools.ts");
|
|
const mcpServer = readProjectFile("open-sse/mcp-server/server.ts");
|
|
|
|
assert.ok(quotaSkill, "quotaManagement skill should exist");
|
|
assert.ok(mcpAdvancedTools, "advanced MCP tools should exist");
|
|
assert.ok(mcpServer, "MCP server should exist");
|
|
assert.match(quotaSkill, /\/api\/usage\/quota/);
|
|
assert.match(mcpAdvancedTools, /\/api\/usage\/quota/);
|
|
assert.match(mcpServer, /\/api\/usage\/quota/);
|
|
assertRouteMethods("src/app/api/usage/quota/route.ts", ["GET"]);
|
|
});
|
|
|
|
it("keeps legacy usage history and raw request-log APIs explicitly classified", () => {
|
|
const usageStats = readProjectFile("src/shared/components/UsageStats.tsx");
|
|
const apiReference = readProjectFile("docs/reference/API_REFERENCE.md");
|
|
const openApi = readProjectFile("docs/openapi.yaml");
|
|
|
|
assert.ok(usageStats, "UsageStats compatibility component should exist");
|
|
assert.ok(apiReference, "API reference should exist");
|
|
assert.ok(openApi, "OpenAPI document should exist");
|
|
assert.match(usageStats, /\/api\/usage\/history/);
|
|
assert.match(apiReference, /\/api\/usage\/history/);
|
|
assert.match(apiReference, /\/api\/usage\/request-logs/);
|
|
assert.match(openApi, /\/api\/usage\/history:/);
|
|
assert.match(openApi, /\/api\/usage\/request-logs:/);
|
|
assertRouteMethods("src/app/api/usage/history/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/request-logs/route.ts", ["GET"]);
|
|
assertRouteMethods("src/app/api/usage/logs/route.ts", ["GET"]);
|
|
});
|
|
});
|
|
|
|
describe("API Routes — T09 /v1 catalog consistency", () => {
|
|
const v1RouteSrc = readProjectFile("src/app/api/v1/route.ts");
|
|
const v1ModelsRouteSrc = readProjectFile("src/app/api/v1/models/route.ts");
|
|
const v1CatalogSrc = readProjectFile("src/app/api/v1/models/catalog.ts");
|
|
|
|
it("/api/v1 should delegate model catalog to unified builder", () => {
|
|
assert.ok(v1RouteSrc, "src/app/api/v1/route.ts should exist");
|
|
assert.match(v1RouteSrc, /getUnifiedModelsResponse/);
|
|
assert.match(v1RouteSrc, /from\s+["']\.\/models\/catalog["']/);
|
|
assert.doesNotMatch(v1RouteSrc, /const\s+models\s*=\s*\[/);
|
|
});
|
|
|
|
it("/api/v1/models route should only consume unified model catalog builder", () => {
|
|
assert.ok(v1ModelsRouteSrc, "src/app/api/v1/models/route.ts should exist");
|
|
assert.match(v1ModelsRouteSrc, /from\s+["']\.\/catalog["']/);
|
|
assert.doesNotMatch(
|
|
v1ModelsRouteSrc,
|
|
/export\s+async\s+function\s+getUnifiedModelsResponse\s*\(/
|
|
);
|
|
});
|
|
|
|
it("/api/v1/models/catalog should export unified model catalog builder", () => {
|
|
assert.ok(v1CatalogSrc, "src/app/api/v1/models/catalog.ts should exist");
|
|
assert.match(v1CatalogSrc, /export\s+async\s+function\s+getUnifiedModelsResponse\s*\(/);
|
|
});
|
|
});
|
|
|
|
describe("Dashboard Wiring — T05 payload rules", () => {
|
|
const settingsPageSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/settings/advanced/page.tsx"
|
|
);
|
|
const payloadRulesTabSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/settings/components/PayloadRulesTab.tsx"
|
|
);
|
|
const openapiSrc = readProjectFile("docs/openapi.yaml");
|
|
|
|
it.skip("settings page should surface payload rules inside advanced settings", () => {
|
|
assert.ok(settingsPageSrc, "settings page source should exist");
|
|
assert.match(
|
|
settingsPageSrc,
|
|
/import PayloadRulesTab from "\.\.\/components\/PayloadRulesTab"/
|
|
);
|
|
assert.match(settingsPageSrc, /<PayloadRulesTab\s*\/>/);
|
|
});
|
|
|
|
it("payload rules tab should read and write through the dedicated settings endpoint", () => {
|
|
assert.ok(payloadRulesTabSrc, "payload rules tab source should exist");
|
|
assert.match(payloadRulesTabSrc, /fetch\("\/api\/settings\/payload-rules"\)/);
|
|
assert.match(payloadRulesTabSrc, /fetch\("\/api\/settings\/payload-rules",\s*\{/);
|
|
assert.match(payloadRulesTabSrc, /method:\s*"PUT"/);
|
|
assert.match(payloadRulesTabSrc, /default-raw/);
|
|
});
|
|
|
|
it("openapi should document the payload rules management surface", () => {
|
|
assert.ok(openapiSrc, "docs/openapi.yaml should exist");
|
|
assert.match(openapiSrc, /\/api\/settings\/payload-rules:/);
|
|
assert.match(openapiSrc, /summary:\s+Get payload rules configuration/);
|
|
assert.match(openapiSrc, /ManagementSessionAuth:/);
|
|
assert.match(openapiSrc, /PayloadRulesConfig:/);
|
|
});
|
|
});
|
|
|
|
// ─── Barrel Exports ─────────────────────────────────
|
|
|
|
describe("Barrel Exports — shared/components", () => {
|
|
const src = readProjectFile("src/shared/components/index.tsx");
|
|
|
|
it("should export key shared UI modules", () => {
|
|
assert.ok(src, "src/shared/components/index.tsx should exist");
|
|
for (const name of [
|
|
"Breadcrumbs",
|
|
"EmptyState",
|
|
"NotificationToast",
|
|
"FilterBar",
|
|
"ColumnToggle",
|
|
"DataTable",
|
|
]) {
|
|
assert.match(src, new RegExp(name));
|
|
}
|
|
});
|
|
|
|
it("should re-export layouts", () => {
|
|
assert.match(src, /export\s+\*\s+from\s+"\.\/layouts"/);
|
|
});
|
|
});
|
|
|
|
describe("Barrel Exports — store", () => {
|
|
const src = readProjectFile("src/store/index.ts");
|
|
|
|
it("should export useNotificationStore", () => {
|
|
assert.ok(src, "src/store/index.ts should exist");
|
|
assert.match(src, /useNotificationStore/);
|
|
});
|
|
});
|
|
|
|
describe("Barrel Exports — shared/components/layouts", () => {
|
|
const src = readProjectFile("src/shared/components/layouts/index.tsx");
|
|
|
|
it("should export DashboardLayout and AuthLayout", () => {
|
|
assert.ok(src, "src/shared/components/layouts/index.tsx should exist");
|
|
assert.match(src, /DashboardLayout/);
|
|
assert.match(src, /AuthLayout/);
|
|
});
|
|
});
|
|
|
|
// ─── Layout and Page Integration ────────────────────
|
|
|
|
describe("DashboardLayout Integration", () => {
|
|
const src = readProjectFile("src/shared/components/layouts/DashboardLayout.tsx");
|
|
|
|
it("should render NotificationToast globally", () => {
|
|
assert.ok(src, "src/shared/components/layouts/DashboardLayout.tsx should exist");
|
|
assert.match(src, /NotificationToast/);
|
|
});
|
|
|
|
it.skip("should include Breadcrumbs in page wrapper", () => {
|
|
assert.match(src, /Breadcrumbs/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — logs page wiring", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/logs/page.tsx");
|
|
|
|
it.skip("should wire segmented log tabs", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/logs/page.tsx should exist");
|
|
assert.match(src, /SegmentedControl/);
|
|
assert.match(src, /RequestLoggerV2/);
|
|
assert.match(src, /ProxyLogger/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — settings page wiring", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/settings/resilience/page.tsx");
|
|
const memorySkillsTab = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/settings/components/MemorySkillsTab.tsx"
|
|
);
|
|
|
|
it("should include resilience tab in advanced settings", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/settings/resilience/page.tsx should exist");
|
|
assert.match(src, /ResilienceTab/);
|
|
});
|
|
|
|
it("should not label the active skills settings card as a placeholder", () => {
|
|
assert.ok(memorySkillsTab, "MemorySkillsTab should exist");
|
|
assert.doesNotMatch(memorySkillsTab, /Skills Settings \(placeholder\)/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — cache page wiring", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/cache/page.tsx");
|
|
|
|
it("should consolidate prompt cache metrics directly into cache management", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/cache/page.tsx should exist");
|
|
assert.doesNotMatch(src, /CacheStatsCard/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — cost explorer wiring", () => {
|
|
const costsPage = readProjectFile("src/app/(dashboard)/dashboard/costs/CostOverviewTab.tsx");
|
|
const costExplorerUtils = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/costs/costExplorerUtils.ts"
|
|
);
|
|
|
|
it("should expose an interactive grouped Cost Explorer on the costs dashboard", () => {
|
|
assert.ok(costsPage, "CostOverviewTab should exist");
|
|
assert.ok(costExplorerUtils, "costExplorerUtils should exist");
|
|
assert.match(costsPage, /CostExplorerCard/);
|
|
assert.match(costsPage, /EXPLORER_GROUP_OPTIONS/);
|
|
assert.match(costsPage, /byServiceTier/);
|
|
assert.match(costExplorerUtils, /buildCostExplorerRows/);
|
|
assert.match(costExplorerUtils, /serviceTier/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — combos page empty state", () => {
|
|
const src = readProjectFile("src/app/(dashboard)/dashboard/combos/page.tsx");
|
|
|
|
it("should use EmptyState when there are no combos", () => {
|
|
assert.ok(src, "src/app/(dashboard)/dashboard/combos/page.tsx should exist");
|
|
assert.match(src, /EmptyState/);
|
|
});
|
|
|
|
it("should use notification store for UX feedback", () => {
|
|
assert.match(src, /useNotificationStore/);
|
|
});
|
|
|
|
it("should persist usage guide visibility and allow reopening", () => {
|
|
assert.match(src, /COMBO_USAGE_GUIDE_STORAGE_KEY/);
|
|
assert.match(src, /localStorage/);
|
|
assert.match(src, /handleShowUsageGuide/);
|
|
});
|
|
|
|
it("should expose quick templates and post-create quick test CTA", () => {
|
|
assert.match(src, /COMBO_TEMPLATES/);
|
|
assert.match(src, /applyTemplate/);
|
|
assert.match(src, /recentlyCreatedCombo/);
|
|
assert.match(src, /testNow/);
|
|
});
|
|
|
|
it("should include cost-optimized pricing coverage UX", () => {
|
|
assert.match(src, /hasPricingForModel/);
|
|
assert.match(src, /pricingCoveragePercent/);
|
|
assert.match(src, /pricingCoverage/);
|
|
assert.match(src, /warningCostOptimizedPartialPricing/);
|
|
});
|
|
|
|
it("should wire combo account labels to the global email privacy toggle", () => {
|
|
// #3822: the per-page EmailPrivacyToggle (and its emailVisibilityTooltip) was removed in
|
|
// favor of the single global switch in Settings → Appearance. The combos page still
|
|
// consumes the store and masks account labels via pickDisplayValue.
|
|
assert.match(src, /useEmailPrivacyStore/);
|
|
assert.match(src, /pickDisplayValue/);
|
|
});
|
|
|
|
it("should mask combo test result labels with the global email privacy toggle", () => {
|
|
assert.match(src, /function TestResultsView/);
|
|
assert.match(src, /pickDisplayValue\(\[r\.label\], emailsVisible, r\.model\)/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — provider test results privacy", () => {
|
|
const providersSrc = readProjectFile("src/app/(dashboard)/dashboard/providers/page.tsx");
|
|
const providerDetailSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx"
|
|
);
|
|
// #3501 strangler-fig decomposition moved the test-results masking and the upstream-proxy
|
|
// surface out of the page client into dedicated components.
|
|
const batchTestResultsSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/providers/[id]/components/BatchTestResultsModal.tsx"
|
|
);
|
|
const upstreamProxyCardSrc = readProjectFile(
|
|
"src/app/(dashboard)/dashboard/providers/[id]/components/UpstreamProxyCard.tsx"
|
|
);
|
|
|
|
it("should mask provider test batch names with the global email privacy toggle", () => {
|
|
assert.ok(providersSrc, "src/app/(dashboard)/dashboard/providers/page.tsx should exist");
|
|
assert.match(providersSrc, /useEmailPrivacyStore/);
|
|
assert.match(
|
|
providersSrc,
|
|
/pickDisplayValue\(\[r\.connectionName\], emailsVisible, r\.connectionName\)/
|
|
);
|
|
});
|
|
|
|
it("should mask provider detail test result names with the global email privacy toggle", () => {
|
|
assert.ok(
|
|
providerDetailSrc,
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
|
|
);
|
|
assert.match(providerDetailSrc, /const emailsVisible = useEmailPrivacyStore/);
|
|
// The per-connection test-result masking now lives in the decomposed BatchTestResultsModal.
|
|
assert.ok(batchTestResultsSrc, "BatchTestResultsModal.tsx should exist");
|
|
assert.match(
|
|
batchTestResultsSrc,
|
|
/pickDisplayValue\(\s*\[r\.connectionName\],\s*emailsVisible,\s*r\.connectionName\s*\)/
|
|
);
|
|
});
|
|
|
|
it("should resolve provider detail metadata through the shared dashboard catalog", () => {
|
|
assert.ok(
|
|
providerDetailSrc,
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
|
|
);
|
|
assert.match(providerDetailSrc, /resolveDashboardProviderInfo/);
|
|
});
|
|
|
|
it("should treat upstream proxy entries as a dedicated management surface", () => {
|
|
assert.ok(
|
|
providerDetailSrc,
|
|
"src/app/(dashboard)/dashboard/providers/[id]/ProviderDetailPageClient.tsx should exist"
|
|
);
|
|
assert.match(providerDetailSrc, /isUpstreamProxyProvider/);
|
|
// The "managed elsewhere" copy now lives in the decomposed UpstreamProxyCard component.
|
|
assert.ok(upstreamProxyCardSrc, "UpstreamProxyCard.tsx should exist");
|
|
assert.match(upstreamProxyCardSrc, /Managed via Upstream Proxy Settings/);
|
|
});
|
|
});
|
|
|
|
describe("Page Integration — provider create route renders the onboarding wizard (#5427)", () => {
|
|
const providerNewSrc = readProjectFile("src/app/(dashboard)/dashboard/providers/new/page.tsx");
|
|
|
|
it("renders ProviderOnboardingWizard instead of redirecting (#5427)", () => {
|
|
// #5427 reversed the earlier redirect-stub retirement: /dashboard/providers/new now
|
|
// renders the previously-orphaned ProviderOnboardingWizard directly (auth enforced by
|
|
// the (dashboard) layout). The dedicated guard is tests/unit/onboarding-wizard-route-5427.
|
|
assert.ok(providerNewSrc, "src/app/(dashboard)/dashboard/providers/new/page.tsx should exist");
|
|
assert.match(providerNewSrc, /ProviderOnboardingWizard/);
|
|
assert.doesNotMatch(providerNewSrc, /redirect\("\/dashboard\/providers"\)/);
|
|
});
|
|
});
|