Files
OmniRoute/tests/unit/db-logs-cache-3500.test.ts
Diego Rodrigues de Sa e Souza 9350a5d6c6 Release v3.8.22 (#3623)
* chore(release): open v3.8.22 development cycle

* refactor(dashboard): extract ProviderDetailPageClient — #3501 Phase 0 (#3633)

#3501 Phase 0: extract ProviderDetailPageClient + smoke test.

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>

* refactor(dashboard): extract auth-import modals — #3501 Phase 1a (#3634)

#3501 Phase 1a: extract 3 auth-import modal clusters.

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>

* fix(db): reclassify localDb unexported modules as intentionally-internal (#3499) (#3635)

Closes #3499 — reclassify localDb unexported modules as intentionally-internal (audit + honest gate framing).

* refactor(db): move call_logs aggregations into callLogStats db module (#3500) (#3636)

#3500 slice 1: call_logs aggregations → src/lib/db/callLogStats.ts (Rule #5). Byte-identical queries; TDD 6/6.

* refactor(dashboard): extract EditCompatibleNodeModal — #3501 Phase 1b (#3638)

#3501 Phase 1b: extract EditCompatibleNodeModal (cycle-safe via leaf constants module).

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>

* refactor(db): move community_servers SQL into gamification db module (#3500 slice 3) (#3639)

#3500 slice 3: community_servers SQL → gamification db module.

* refactor(db): move usage_history SQL into usageAnalytics module (#3500 slice 2) (#3644)

#3500 slice 2: usage_history/daily_usage_summary SQL → usageAnalytics db module.

* refactor(db): move skills UPDATE + db-backups SQL into db modules (#3500 slice 5) (#3647)

#3500 slice 5: skills UPDATE (allowlist) + db-backups SQL → db modules.

* refactor(db): move usage_logs/semantic_cache/proxy_logs SQL into db modules (#3500 slice 4) (#3648)

#3500 slice 4: usage_logs/semantic_cache/proxy_logs SQL → db modules. All internal routes done (2 external by-design remain).

* chore(db-gate): reclassify external-DB reads, fully close #3500 (#3649)

Closes #3500: reclassify external-DB reads; all internal raw-SQL migrated to db/ modules.

* refactor(dashboard): extract pure helpers to providerPageHelpers — #3501 Phase 2 (#3653)

#3501 Phase 2: extract pure helpers to providerPageHelpers (leaf, cycle-safe).

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>

* refactor(dashboard): extract remaining shared helpers to providerPageHelpers — #3501 Phase 2b (#3658)

#3501 Phase 2b: extract remaining shared helpers to providerPageHelpers (leaf, cycle-safe). Heavy modals unblocked.

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>

* fix(reasoning): replay reasoning_content on plain DeepSeek turns (#1682) (#3632)

Integrated into release/v3.8.22

* fix(kiro): route enterprise IAM Identity Center accounts to their regional endpoint (#3631)

Integrated into release/v3.8.22

* refactor: small code cleanup (#3523)

Integrated into release/v3.8.22

* fix(combo): skip same-provider targets on 408/500/502/503/504/524 errors (#3637)

Integrated into release/v3.8.22 — circuit-breaker guard added in review (#1731v2)

* feat(providers): add MiMoCode free-tier provider with bootstrap JWT auth (#3659)

Integrated into release/v3.8.22 — page.tsx conflict resolved + NoAuthAccountCard re-applied to ProviderDetailPageClient in review. MiMoCode endpoint validated live.

* Log Responses WebSocket calls in history (#3616)

Integrated into release/v3.8.22 — Codex Responses WebSocket call history logging.

* Add Claude Code routing preference for unprefixed Claude models (#3540)

Integrated into release/v3.8.22 — page.tsx conflict resolved (re-applied toggle to ProviderDetailPageClient) + disable-test updated for catalog drift in review.

* docs(changelog): credit #3632/#3631/#3637/#3659/#3540/#3616/#3523 (v3.8.22 targeted review round)

* fix(mimocode): add required authHeader:"none" to registry entry (#3659 follow-up)

The mimocode RegistryEntry omitted the required authHeader field, which broke
typecheck:core (TS2741). Match the no-auth convention (authType:"none" + authHeader:"none")
used by veoaifree-web and other free providers. Follow-up to #3659 (@pizzav-xyz).

* fix(responses): detect stream readiness for tool-call-only and object-less chunks (#3612) (#3661)

Closes #3612

* fix(mitm): remove duplicated 'Command failed:' error prefix (#3641) (#3662)

Closes #3641

* fix(cli): honor HERMES_HOME for Hermes Agent config path (#3628) (#3663)

Closes #3628

* fix(api): fetch live OpenCode model catalog for no-auth model picker (#3611) (#3664)

Closes #3611

* fix(api): flag provider topology error state by current status, not stale history (#3619) (#3666)

Closes #3619

* fix(electron): launch peer-stamping server-ws.mjs entrypoint to avoid 403 LOCAL_ONLY (#3386) (#3665)

Closes #3386

* fix(dashboard): restore home topology live in-flight pulse (#3507) (#3667)

Closes #3507

* fix(oauth): name Kiro/AWS auto-imported accounts and dedupe by profileArn (#3615) (#3671)

Closes #3615

* fix(resilience): clear stale transient connection cooldowns on startup (#3625) (#3672)

Closes #3625

* fix(i18n): use logical CSS direction utilities for sidebar and key overlays (RTL #3541) (#3670)

Closes #3541

* fix(dashboard): honor auto-hide and switch to visible filter on passthrough Test-all (#3610) (#3669)

Closes #3610

* refactor(dashboard): extract AddApiKeyModal + EditConnectionModal — #3501 Phase 1c (#3674)

#3501 Phase 1c: extract AddApiKeyModal, EditConnectionModal, WebSessionCredentialGuide into components/; god-component 10,166->8,092 LOC. Reconciles the v3.8.22 file-size drift for this file.

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>

* docs(changelog): reconcile v3.8.22 — credit #3621/#3622 + MiMoCode follow-up roll-up

* refactor(dashboard): extract ConnectionRow + ModelCompatPopover + SiliconFlowEndpointModal — #3501 Phase 1d (#3676)

#3501 Phase 1d: god-component 8,092->6,838 LOC.

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>

* feat(obsidian): add WebDAV config route + encrypt creds at rest (#3485 part 1) (#3677)

Part 1 of #3485. Adds /api/settings/obsidian/webdav (GET/POST/DELETE) wiring the ready obsidianSync lib, encrypts webdav password + obsidian token at rest, removes the duplicate UI block, drops the KNOWN_MISSING entry. WebDAV file server is part 2.

* feat(obsidian): add /api/v1/webdav file server for Obsidian vault sync (#3485 part 2) (#3678)

Part 2 of #3485. WebDAV server (PROPFIND/GET/PUT/DELETE/MKCOL/MOVE/OPTIONS) handled in the custom server layer (standalone-server-ws.mjs) since the App Router cannot export WebDAV methods. Basic-Auth (constant-time), path-traversal hardened, password decrypt ported from encryption.ts (parity-tested), DATA_DIR resolution parity-tested against dataPaths.ts. End-to-end Obsidian-over-Tailscale validation is a live VPS step (Rule #18).

* fix(combo): stop premature context compaction — real auto-combo windows + per-target compression limit (#3680)

Integrated into release/v3.8.22

* feat(dashboard): deactivate/activate accounts from the quota overview (#3675)

Integrated into release/v3.8.22

* fix(dashboard): close review gaps in bulk provider connection actions (#3271 follow-up) (#3673)

Integrated into release/v3.8.22 — page.tsx conflict (god-component split #3501) resolved by re-applying the bulk-action deltas to ProviderDetailPageClient.tsx

* refactor(dashboard): extract useModelCompatState hook + model sections — #3501 Phase 1e (#3683)

#3501 Phase 1e: extract useModelCompatState hook (unblocks the model sections) + ModelRow/PassthroughModelsSection/PassthroughModelRow/CustomModelsSection/CompatibleModelsSection. god-component 6,838->4,921 LOC.

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>

* refactor(dashboard): extract useProviderConnections/Settings/Models hooks — #3501 Phase 1f (#3684)

#3501 Phase 1f: god-component 4,948->4,062 LOC. Connection state+handlers, settings, and model metadata moved into hooks/.

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>

* chore(release): v3.8.22 CHANGELOG + env-doc sync

- Set release date in CHANGELOG [3.8.22] to 2026-06-11
- Add HERMES_HOME to .env.example (from #3628/#3663)
- Add HERMES_HOME + OMNIROUTE_PREFER_CLAUDE_CODE_FOR_UNPREFIXED_CLAUDE_MODELS to ENVIRONMENT.md (#3628/#3540)

* docs(changelog): credit #3673 + #3675 — leninejunior bulk-actions + quota-toggle

---------

Co-authored-by: oyi77 <oyi77@users.noreply.github.com>
Co-authored-by: Abhishek Divekar <adivekar@utexas.edu>
Co-authored-by: NOXX - Commiter <artur1992123@mail.ru>
Co-authored-by: Nicolas Lorin <androw95220@gmail.com>
Co-authored-by: Hernan Javier Ardila Sanchez <hjasgr@gmail.com>
Co-authored-by: PizzaV <103120356+pizzav-xyz@users.noreply.github.com>
Co-authored-by: kkkayye <98376609+kkkayye@users.noreply.github.com>
Co-authored-by: Witroch4 <witalo_rocha@hotmail.com>
Co-authored-by: Lenine Júnior <lenine@engrene.com.br>
2026-06-11 18:52:29 -03:00

349 lines
12 KiB
TypeScript

/**
* #3500 — usage_logs / semantic_cache / proxy_logs SQL extracted into db modules
* (Hard Rule #5, slice 4).
*
* Seeds an in-memory temp SQLite DB for each table and asserts each new db
* function returns the correct rows / counts. DB handles are released in
* test.after to prevent Node native test runner from hanging
* (CLAUDE.md PII/Stream Learnings #3).
*/
import test from "node:test";
import assert from "node:assert/strict";
import fs from "node:fs";
import os from "node:os";
import path from "node:path";
const TEST_DATA_DIR = fs.mkdtempSync(path.join(os.tmpdir(), "omni-db-logs-cache-3500-"));
process.env.DATA_DIR = TEST_DATA_DIR;
const core = await import("../../src/lib/db/core.ts");
const usageLogs = await import("../../src/lib/db/usageLogs.ts");
const semanticCache = await import("../../src/lib/db/semanticCache.ts");
const proxyLogs = await import("../../src/lib/db/proxyLogs.ts");
// ---------------------------------------------------------------------------
// Helpers — usage_logs seeding
// usage_logs is NOT in the core.ts schema; create it as a lightweight table
// mirroring the columns used by the auto-routing queries (model, provider).
// ---------------------------------------------------------------------------
function ensureUsageLogsTable() {
const db = core.getDbInstance();
db.prepare(
`CREATE TABLE IF NOT EXISTS usage_logs (
id INTEGER PRIMARY KEY AUTOINCREMENT,
model TEXT NOT NULL,
provider TEXT NOT NULL,
timestamp TEXT NOT NULL
)`
).run();
}
function insertUsageLog(row: { model: string; provider: string }) {
const db = core.getDbInstance();
db.prepare(
`INSERT INTO usage_logs (model, provider, timestamp) VALUES (?, ?, ?)`
).run(row.model, row.provider, new Date().toISOString());
}
// ---------------------------------------------------------------------------
// Helpers — semantic_cache seeding
// ---------------------------------------------------------------------------
function insertSemanticCache(row: {
id: string;
signature: string;
model: string;
hit_count?: number;
tokens_saved?: number;
}) {
const db = core.getDbInstance();
db.prepare(
`INSERT INTO semantic_cache
(id, signature, model, prompt_hash, response, tokens_saved, hit_count, created_at, expires_at)
VALUES
(?, ?, ?, ?, ?, ?, ?, datetime('now'), datetime('now', '+1 hour'))`
).run(
row.id,
row.signature,
row.model,
"hash_" + row.id,
"{}",
row.tokens_saved ?? 0,
row.hit_count ?? 0,
);
}
// ---------------------------------------------------------------------------
// Helpers — proxy_logs seeding
// ---------------------------------------------------------------------------
function insertProxyLog(row: { id: string; timestamp: string; provider?: string }) {
const db = core.getDbInstance();
db.prepare(
`INSERT INTO proxy_logs (id, timestamp, provider, status, proxy_type) VALUES (?, ?, ?, ?, ?)`
).run(row.id, row.timestamp, row.provider ?? "openai", "ok", "http");
}
// ---------------------------------------------------------------------------
// Lifecycle
// ---------------------------------------------------------------------------
test.before(() => {
core.resetDbInstance();
ensureUsageLogsTable();
});
test.after(() => {
core.resetDbInstance();
fs.rmSync(TEST_DATA_DIR, { recursive: true, force: true });
});
// ===========================================================================
// usageLogs — getAutoRoutingTotalCount
// ===========================================================================
test("#3500 getAutoRoutingTotalCount — returns 0 when no rows", () => {
const result = usageLogs.getAutoRoutingTotalCount();
assert.equal(result.count, 0);
});
test("#3500 getAutoRoutingTotalCount — counts auto and auto/* models", () => {
insertUsageLog({ model: "auto", provider: "openai" });
insertUsageLog({ model: "auto/fast", provider: "anthropic" });
insertUsageLog({ model: "gpt-4", provider: "openai" }); // must NOT be counted
const result = usageLogs.getAutoRoutingTotalCount();
assert.ok(result.count >= 2, `expected >= 2, got ${result.count}`);
});
// ===========================================================================
// usageLogs — getAutoRoutingVariantBreakdown
// ===========================================================================
test("#3500 getAutoRoutingVariantBreakdown — maps auto → default, auto/X → X", () => {
// Insert another auto and auto/fast to have stable counts
insertUsageLog({ model: "auto", provider: "openai" });
insertUsageLog({ model: "auto/fast", provider: "anthropic" });
const rows = usageLogs.getAutoRoutingVariantBreakdown();
const byVariant: Record<string, number> = {};
for (const r of rows) byVariant[r.variant] = r.count;
assert.ok("default" in byVariant, "should have a 'default' variant for bare 'auto'");
assert.ok("fast" in byVariant, "should have a 'fast' variant for 'auto/fast'");
assert.ok(byVariant["default"] >= 1, "default count >= 1");
assert.ok(byVariant["fast"] >= 1, "fast count >= 1");
});
// ===========================================================================
// usageLogs — getAutoRoutingTopProviders
// ===========================================================================
test("#3500 getAutoRoutingTopProviders — returns top providers for auto/* models", () => {
const rows = usageLogs.getAutoRoutingTopProviders();
assert.ok(Array.isArray(rows), "result is array");
assert.ok(rows.length > 0, "at least one provider row");
for (const r of rows) {
assert.equal(typeof r.provider, "string");
assert.equal(typeof r.count, "number");
}
// Should be ordered descending by count (first row has highest count)
if (rows.length > 1) {
assert.ok(rows[0].count >= rows[1].count, "ordered descending by count");
}
});
// ===========================================================================
// semanticCache — listSemanticCacheEntries
// ===========================================================================
test("#3500 listSemanticCacheEntries — returns entries with pagination", () => {
insertSemanticCache({ id: "sc-1", signature: "sig-alpha", model: "gpt-4", hit_count: 5 });
insertSemanticCache({ id: "sc-2", signature: "sig-beta", model: "claude-3", hit_count: 2 });
insertSemanticCache({ id: "sc-3", signature: "sig-gamma", model: "gpt-4", hit_count: 1 });
const result = semanticCache.listSemanticCacheEntries({
page: 1,
limit: 10,
search: "",
model: "",
sortBy: "hit_count",
sortOrder: "desc",
});
assert.ok(result.total >= 3, `total >= 3, got ${result.total}`);
assert.ok(result.entries.length >= 3, "at least 3 entries returned");
// First entry should have highest hit_count (sorted desc)
if (result.entries.length >= 2) {
assert.ok(
result.entries[0].hit_count >= result.entries[1].hit_count,
"sorted desc by hit_count"
);
}
});
test("#3500 listSemanticCacheEntries — search filter narrows results", () => {
const result = semanticCache.listSemanticCacheEntries({
page: 1,
limit: 10,
search: "sig-alpha",
model: "",
sortBy: "created_at",
sortOrder: "desc",
});
assert.ok(result.total >= 1, "should find at least 1 matching entry");
assert.ok(
result.entries.some((e) => e.signature === "sig-alpha"),
"sig-alpha in results"
);
});
test("#3500 listSemanticCacheEntries — model filter works", () => {
const result = semanticCache.listSemanticCacheEntries({
page: 1,
limit: 10,
search: "",
model: "claude-3",
sortBy: "created_at",
sortOrder: "desc",
});
assert.ok(result.total >= 1, "at least 1 claude-3 entry");
for (const e of result.entries) {
assert.equal(e.model, "claude-3", "all entries are claude-3");
}
});
test("#3500 listSemanticCacheEntries — pagination offset works", () => {
const p1 = semanticCache.listSemanticCacheEntries({
page: 1,
limit: 2,
search: "",
model: "",
sortBy: "created_at",
sortOrder: "asc",
});
const p2 = semanticCache.listSemanticCacheEntries({
page: 2,
limit: 2,
search: "",
model: "",
sortBy: "created_at",
sortOrder: "asc",
});
if (p1.entries.length > 0 && p2.entries.length > 0) {
assert.notEqual(
p1.entries[0].id,
p2.entries[0].id,
"page 1 and page 2 must not have the same first entry"
);
}
});
// ===========================================================================
// semanticCache — deleteSemanticCacheBySignature
// ===========================================================================
test("#3500 deleteSemanticCacheBySignature — deletes exactly the matching entry", () => {
insertSemanticCache({ id: "sc-del-sig", signature: "sig-to-delete", model: "gpt-4" });
// Verify it exists first
const before = semanticCache.listSemanticCacheEntries({
page: 1,
limit: 100,
search: "sig-to-delete",
model: "",
sortBy: "created_at",
sortOrder: "desc",
});
assert.ok(before.total >= 1, "entry exists before delete");
const result = semanticCache.deleteSemanticCacheBySignature("sig-to-delete");
assert.equal(result.deleted, 1);
const after = semanticCache.listSemanticCacheEntries({
page: 1,
limit: 100,
search: "sig-to-delete",
model: "",
sortBy: "created_at",
sortOrder: "desc",
});
assert.equal(after.total, 0, "entry removed after delete");
});
// ===========================================================================
// semanticCache — deleteSemanticCacheByModel
// ===========================================================================
test("#3500 deleteSemanticCacheByModel — deletes all entries for the given model", () => {
insertSemanticCache({ id: "sc-m1", signature: "sig-model-a-1", model: "model-to-purge" });
insertSemanticCache({ id: "sc-m2", signature: "sig-model-a-2", model: "model-to-purge" });
const before = semanticCache.listSemanticCacheEntries({
page: 1,
limit: 100,
search: "",
model: "model-to-purge",
sortBy: "created_at",
sortOrder: "desc",
});
assert.ok(before.total >= 2, "2 entries before delete");
const result = semanticCache.deleteSemanticCacheByModel("model-to-purge");
assert.ok(result.deleted >= 2, `deleted >= 2, got ${result.deleted}`);
const after = semanticCache.listSemanticCacheEntries({
page: 1,
limit: 100,
search: "",
model: "model-to-purge",
sortBy: "created_at",
sortOrder: "desc",
});
assert.equal(after.total, 0, "no entries remain after delete");
});
// ===========================================================================
// proxyLogs — exportProxyLogsSince
// ===========================================================================
test("#3500 exportProxyLogsSince — returns rows with timestamp >= since", () => {
const base = new Date("2025-01-15T10:00:00.000Z");
const old = new Date("2025-01-14T10:00:00.000Z");
insertProxyLog({ id: "pl-new-1", timestamp: new Date("2025-01-15T11:00:00.000Z").toISOString(), provider: "openai" });
insertProxyLog({ id: "pl-new-2", timestamp: new Date("2025-01-15T12:00:00.000Z").toISOString(), provider: "anthropic" });
insertProxyLog({ id: "pl-old-1", timestamp: old.toISOString(), provider: "openai" }); // outside window
const rows = proxyLogs.exportProxyLogsSince(base.toISOString());
assert.ok(Array.isArray(rows), "result is array");
const ids = rows.map((r) => (r as { id: string }).id);
assert.ok(ids.includes("pl-new-1"), "pl-new-1 included");
assert.ok(ids.includes("pl-new-2"), "pl-new-2 included");
assert.ok(!ids.includes("pl-old-1"), "pl-old-1 excluded (before since)");
});
test("#3500 exportProxyLogsSince — results are ordered descending by timestamp", () => {
const rows = proxyLogs.exportProxyLogsSince(new Date("2025-01-01T00:00:00.000Z").toISOString());
assert.ok(rows.length >= 2, "at least 2 rows");
// Verify descending order
for (let i = 1; i < rows.length; i++) {
const prev = (rows[i - 1] as { timestamp: string }).timestamp;
const curr = (rows[i] as { timestamp: string }).timestamp;
assert.ok(prev >= curr, `row ${i - 1} timestamp (${prev}) >= row ${i} (${curr})`);
}
});
test("#3500 exportProxyLogsSince — returns empty array when no rows match", () => {
const future = new Date(Date.now() + 86_400_000 * 365).toISOString();
const rows = proxyLogs.exportProxyLogsSince(future);
assert.deepEqual(rows, []);
});