Files
OmniRoute/tests/unit/batch-processor-expiration.test.ts
Diego Rodrigues de Sa e Souza 68d5a0ab27 Release v3.8.10 (#3140)
* chore(release): open v3.8.10 development cycle

Bump 3.8.9 → 3.8.10 across package.json, lockfile, electron, open-sse, and
docs/reference/openapi.yaml; add the [3.8.10] CHANGELOG section (root + 41 i18n
mirrors) as the integration target for the cycle. Entries land here as work
merges into release/v3.8.10; finalized by the release flow.

* fix(providers): resolve web provider alias collisions

Assign unique aliases to HuggingChat, Kimi Web, and Qwen Web so they no longer shadow primary providers or trigger startup warnings.

Add a unit test to enforce provider alias uniqueness and prevent future collisions. Also expand local ignore and VS Code exclude rules for agent, build, and worktree artifacts.

* fix(responses): normalize image_url parts across input paths (#3150)

Normalize image_url parts across all Responses input paths. Integrated into release/v3.8.10.

* fix(api-manager): preserve API key expiration local time (#3146)

Preserve API key expiration local time + clear button. Integrated into release/v3.8.10.

* Strip previous_response_id for stateless Responses upstreams (#3143)

Strip previous_response_id for stateless Responses upstreams (auto/strip/preserve). Integrated into release/v3.8.10.

* fix(opencode-plugin): map thinking cap to interleaved in model+combo (#3138)

Map caps.thinking to ModelV2.capabilities.interleaved for opencode-plugin. Integrated into release/v3.8.10.

* fix(providers): use synced models as fallback for all providers (#3148)

Use synced models as authoritative local catalog for all providers (+regression test). Integrated into release/v3.8.10.

* fix(qoder): bifurcate validation by token type — PAT→Cosy, regular API key→dashscope (#3149)

Bifurcate Qoder validation by token type (PAT→Cosy, regular→dashscope) +regression test. Integrated into release/v3.8.10.

* fix(antigravity): dynamic model resolution via MITM alias table (#3144)

Dynamic antigravity MITM model resolution in the executor (+bug fix +regression test; DB import dropped from client-reachable config). Integrated into release/v3.8.10.

* Feature/batch allow big (#3128)

Podman deployment options + larger upload body-size limits (+CONTAINER_HOST docs). Integrated into release/v3.8.10.

* fix(fireworks): preserve fully-qualified router/model IDs (#3133) (#3160)

Fireworks router IDs (accounts/fireworks/routers/...) were double-prefixed
with accounts/fireworks/models/ → upstream 404. Add optional
acceptedModelIdPrefixes to the registry entry and skip the prepend when the
model already starts with an accepted prefix.

Co-authored-by: KooshaPari <KooshaPari@users.noreply.github.com>

* fix(llama-cpp): route to configured local baseUrl instead of OpenAI (#3136) (#3161)

llama-cpp was missing from the local-provider group in buildUrl(), so it
fell through to the OpenAI baseUrl and returned an OpenAI 401. Add the
case to resolve the connection's providerSpecificData.baseUrl.

Co-authored-by: tjengbudi <tjengbudi@users.noreply.github.com>

* fix(t3-chat-web): parse cookies + convexSessionId from stored credential (#3007) (#3162)

The executor read credentials.cookies/convexSessionId, but the pipeline
only stores the pasted string under apiKey → t3.chat always 400'd. Parse
both values from apiKey (fallback accessToken), mirroring validation.ts.

Co-authored-by: minhtran162 <minhtran162@users.noreply.github.com>

* fix(minimax): stop capping MiniMax-M3 / M2.7 max_tokens at 8192 (#3141) (#3163)

MiniMax-M3 had no MODEL_SPECS entry and capitalized MiniMax-M2.7 missed
its lowercase spec (case-sensitive lookup) → both fell to the 8192 default
cap. Add the M3 spec (512K output), alias the capitalized ids, and make
getModelSpec lookups case-insensitive.

Co-authored-by: totaltube <totaltube@users.noreply.github.com>

* fix(github-copilot): discover model catalog live from api.githubcopilot.com (#3120, #3121) (#3164)

The github (Copilot) provider had a static hardcoded catalog with no
discovery source, so Import Models never refreshed (#3120) and advertised
non-entitled models that 400 on use (#3121). Add a live /models fetch with
fallback to the static list.

Co-authored-by: gabrielmoreira <gabrielmoreira@users.noreply.github.com>

* fix(combo): invalidate nested-combo cache on edits + log DATA_DIR (#3147) (#3165)

Editing a combo did not invalidate the 10s nested-combo expansion caches
(chat.ts getCombosCachedForChat + chatCore.ts getCombosCached; the exported
clearCombosCache was dead code), so a removed nested target/model could be
served as a phantom for up to 10s. Wire a shared monotonic combos-cache
version in readCache (bumped by invalidateDbCache("combos") on every combo
write); both cache layers treat a version mismatch as a miss.

Also log the resolved DATA_DIR/SQLITE_FILE absolute path at DB init so the
reporter's 'persists across restart + volume wipe' symptom (a multi-replica
Docker volume/DATA_DIR mismatch, not a routing bug) is diagnosable from logs.

Includes consolidated CHANGELOG entries for #3133/#3136/#3007/#3141/#3120/#3121.

Co-authored-by: ViFigueiredo <ViFigueiredo@users.noreply.github.com>

* fix(web-tools): parse bare JSON tool calls (#3157)

Parse bare JSON tool calls for deepseek-web (#2820) + fuzzy tool-name matching. Integrated into release/v3.8.10.

* fix(misc): minor fixes across reasoning cache, account fallback, binary manager (#3177)

Misc: ProviderProfile export, DeepSeek reasoning regex, binary guard. Integrated into release/v3.8.10.

* fix(kiro): minor OAuth social exchange tweaks (#3176)

Kiro social OAuth: optional targetProvider passthrough. Integrated into release/v3.8.10.

* deps: bump hono from 4.12.18 to 4.12.23 (#3179)

Bump hono to 4.12.23. Integrated into release/v3.8.10.

* fix(providerRegistry): update kilocode format and executor (#3166)

kilocode: openai format + default executor (matches kilo-gateway) + registry test. Integrated into release/v3.8.10.

* feat(metrics): cross-request TTFT and gap latency after tool calls (#3173)

Cross-request TTFT + gap-after-tool latency metrics (+test). Integrated into release/v3.8.10.

* feat(dashboard): provider stats API endpoint and dashboard page (#3175)

Provider stats dashboard + API (SQL moved to db module per Hard Rule #5, +test). Integrated into release/v3.8.10.

* fix(usage): sequential+spaced OAuth quota sync, reactive force-refresh, actionable 401 (#3156)

Sequential+spaced OAuth quota sync, reactive force-refresh on 401, actionable 401 in UI. Integrated into release/v3.8.10.

* fix(healthcheck): per-provider proactive-refresh skip list (rescue short-TTL OAuth) (#3159)

Per-provider proactive-refresh skip list (OMNIROUTE_HEALTHCHECK_SKIP_PROVIDERS) to rescue short-TTL OAuth. Integrated into release/v3.8.10.

* feat(quota): show OAuth token expiry on provider cards (small, blue, informative) (#3178)

Show OAuth token expiry on provider cards (small, blue, informative). Integrated into release/v3.8.10.

* fix(providers): empty refresh must not resurface just-cleared synced models (#3181)

Empty refresh must not resurface just-cleared synced models (fixes the release-blocking provider-models-route test). Integrated into release/v3.8.10.

* chore(release): v3.8.10 — 2026-06-04 (finalize CHANGELOG)

---------

Co-authored-by: Wilson <pedbookmed@gmail.com>
Co-authored-by: Xiangzhe <32761048+xz-dev@users.noreply.github.com>
Co-authored-by: Jan Leon <Jan.gaschler@gmail.com>
Co-authored-by: M.M <mr.maatoug@gmail.com>
Co-authored-by: Hernan Javier Ardila Sanchez <hjasgr@gmail.com>
Co-authored-by: Markus Hartung <mail@hartmark.se>
Co-authored-by: KooshaPari <KooshaPari@users.noreply.github.com>
Co-authored-by: tjengbudi <tjengbudi@users.noreply.github.com>
Co-authored-by: minhtran162 <minhtran162@users.noreply.github.com>
Co-authored-by: totaltube <totaltube@users.noreply.github.com>
Co-authored-by: gabrielmoreira <gabrielmoreira@users.noreply.github.com>
Co-authored-by: ViFigueiredo <ViFigueiredo@users.noreply.github.com>
Co-authored-by: PizzaV <103120356+pizzav-xyz@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Nicolas Lorin <androw95220@gmail.com>
2026-06-04 20:05:38 -03:00

153 lines
5.4 KiB
TypeScript

import { describe, it } from "node:test";
import assert from "node:assert";
// Helper functions from batchProcessor.ts
function parseBatchWindowSeconds(window: string | null | undefined): number {
const DEFAULT = 24 * 60 * 60;
if (!window) return DEFAULT;
const match = /^(\d+)([hdm])$/.exec(window);
if (!match) return DEFAULT;
const value = Number.parseInt(match[1], 10);
const unit = match[2];
if (unit === "h") return value * 3600;
if (unit === "d") return value * 86400;
if (unit === "m") return value * 60;
return DEFAULT;
}
describe("Batch Processor - File Expiration", () => {
describe("getBatchOutputExpiresAt logic", () => {
it("should calculate output expiration as 30 days from batch completion", () => {
const completedAt = Math.floor(Date.now() / 1000) - 5 * 24 * 60 * 60; // 5 days ago
const expectedExpiresAt = completedAt + 30 * 24 * 60 * 60;
// Simulate the logic from getBatchOutputExpiresAt
const thirtyDaysInSeconds = 30 * 24 * 60 * 60;
const expiresAt = completedAt + thirtyDaysInSeconds;
assert(expiresAt === expectedExpiresAt);
});
it("should use custom expires_after if provided", () => {
const createdAt = Math.floor(Date.now() / 1000);
const customSeconds = 7 * 24 * 60 * 60; // 7 days
const expiresAt = createdAt + customSeconds;
assert(expiresAt === createdAt + 7 * 24 * 60 * 60);
});
it("should handle failed batch expiration", () => {
const now = Math.floor(Date.now() / 1000);
const failedAt = now - 10 * 24 * 60 * 60; // 10 days ago
const expiresAt = failedAt + 30 * 24 * 60 * 60;
const expectedExpiresAt = now + 20 * 24 * 60 * 60;
assert.strictEqual(expiresAt, expectedExpiresAt);
});
it("should handle cancelled batch expiration", () => {
const cancelledAt = Math.floor(Date.now() / 1000) - 2 * 24 * 60 * 60; // 2 days ago
const expiresAt = cancelledAt + 30 * 24 * 60 * 60;
assert(expiresAt > Math.floor(Date.now() / 1000)); // Should still be in future
});
});
describe("File cleanup expiration logic", () => {
it("should identify expired input files", () => {
const now = Math.floor(Date.now() / 1000);
const completionTime = now - 31 * 24 * 60 * 60; // Completed 31 days ago
const inputExpiresAt = completionTime + 30 * 24 * 60 * 60;
// File should be expired
assert(now > inputExpiresAt, "File should be past expiration");
});
it("should NOT delete input files within 30 days", () => {
const now = Math.floor(Date.now() / 1000);
const completionTime = now - 15 * 24 * 60 * 60; // Completed 15 days ago
const inputExpiresAt = completionTime + 30 * 24 * 60 * 60;
// File should NOT be expired yet
assert(now < inputExpiresAt, "File should not be expired yet");
});
it("should identify expired output files", () => {
const now = Math.floor(Date.now() / 1000);
const completionTime = now - 35 * 24 * 60 * 60; // Completed 35 days ago
const outputExpiresAt = completionTime + 30 * 24 * 60 * 60;
assert(now > outputExpiresAt, "Output file should be expired");
});
it("should NOT delete output files within 30 days of completion", () => {
const now = Math.floor(Date.now() / 1000);
const completionTime = now - 25 * 24 * 60 * 60; // Completed 25 days ago
const outputExpiresAt = completionTime + 30 * 24 * 60 * 60;
assert(now < outputExpiresAt, "Output file should still be valid");
});
});
describe("Completion window parsing", () => {
it("should parse hours format", () => {
const seconds = parseBatchWindowSeconds("24h");
assert(seconds === 24 * 3600);
});
it("should parse days format", () => {
const seconds = parseBatchWindowSeconds("2d");
assert(seconds === 2 * 86400);
});
it("should parse minutes format", () => {
const seconds = parseBatchWindowSeconds("30m");
assert(seconds === 30 * 60);
});
it("should default to 24h for invalid format", () => {
const seconds = parseBatchWindowSeconds("invalid");
assert(seconds === 24 * 60 * 60);
});
it("should default to 24h for null", () => {
const seconds = parseBatchWindowSeconds(null);
assert(seconds === 24 * 60 * 60);
});
it("should default to 24h for undefined", () => {
const seconds = parseBatchWindowSeconds(undefined);
assert(seconds === 24 * 60 * 60);
});
});
describe("Orphan file cleanup", () => {
it("should identify orphan batch files stuck in validating after 48h", () => {
const now = Math.floor(Date.now() / 1000);
const fortyNineHoursAgo = now - 49 * 60 * 60;
const isOrphan = now - fortyNineHoursAgo > 48 * 60 * 60;
assert(isOrphan, "File should be identified as orphan");
});
it("should NOT delete batch files in validating under 48h", () => {
const now = Math.floor(Date.now() / 1000);
const fortyHoursAgo = now - 40 * 60 * 60;
const isOrphan = now - fortyHoursAgo > 48 * 60 * 60;
assert(!isOrphan, "File should not be orphan yet");
});
it("should identify old batch files regardless of status", () => {
const now = Math.floor(Date.now() / 1000);
const createdAt = now - 3 * 24 * 60 * 60;
const threshold = 48 * 60 * 60; // 48 hours
const isOldBatchFile = now - createdAt > threshold;
assert(isOldBatchFile, "File older than 48h should be flagged");
});
});
});