Files
OmniRoute/bin/cli/provider-store.mjs
Diego Rodrigues de Sa e Souza 6248699ce5 Release/v3.8.0 — full changelog with 660+ commits (#2419)
* fix(cli-tools): guard modelId type before calling indexOf

E2E shakedown v3.8.0: cli-tools quebrava com TypeError quando dynamicModels
continha entradas sem .id (objeto retornado diretamente em vez de string).

* fix(offline): avoid SSR/CSR hydration mismatch on navigator.onLine

Replace useState+lazy-initializer with useSyncExternalStore so the server
snapshot (() => false) and client snapshot (() => navigator.onLine) are
declared separately. React hydrates with the server value and switches to
the real online status client-side without a mismatch.

* chore(i18n): add missing en.json keys for translator, cli-tools, memory, onboarding

Adds 58 missing keys identified by the new dashboard audit script:
- cliTools: 18 custom CLI builder keys (CustomCliCard)
- translator: 24 keys covering stream transformer, live monitor, test bench
- memory: 12 health/pagination/dialog keys
- onboarding.tier: 8 keys for the tier tour walkthrough

Also adds scripts/i18n/audit-dashboard-pages.mjs which scans all dashboard
pages, reports t() calls referencing missing en.json keys, and flags
candidate hardcoded JSX/attribute strings.

* chore(i18n): replace hardcoded UI text with t() calls across dashboard (round 1)

Subagents refactored 8 high-impact dashboard pages, replacing 81 of the
407 hardcoded English/PT strings flagged by the audit with proper
useTranslations() lookups. Added 73 corresponding keys to en.json across
the home, apiManager, providers, settings, and usage namespaces.

Pages affected:
- BudgetTab (27 → 0)
- HomePageClient (2 → 0)
- RoutingTab (25 → 7)
- ResilienceTab (38 → 18)
- SystemStorageTab (42 → 21)
- providers/[id] (17 → 15)
- ApiManagerPageClient (14 → 13)
- OneproxyTab (13 → 10)

Also adds two helper scripts:
- scripts/i18n/extract-keys-from-diff.mjs — extracts new keys from git diff
- scripts/i18n/merge-keys.mjs — merges a pending-keys JSON into en.json

Remaining hardcoded strings will be addressed in follow-up rounds.

* chore(i18n): replace hardcoded UI text with t() calls across dashboard (round 2)

Continues round 1 (commit 8d34f4c65). Round-2 subagents refactored
additional dashboard pages, replacing 77 more hardcoded strings with
useTranslations() lookups. Added 79 corresponding keys to en.json
across the a2aDashboard, agents, analytics, apiManager, cliTools,
common, and settings namespaces.

Pages affected:
- a2a/page (new useTranslations + 6 keys)
- agent-skills/page (new useTranslations + 9 keys)
- AutoRoutingAnalyticsTab (new useTranslations + 6 keys)
- AppearanceTab (8 → 6 remaining)
- OneproxyTab (10 → 0)
- ResilienceTab (18 → 0 missing key)
- RoutingTab (7 → 0 missing key)
- VisionBridgeSettingsTab (new useTranslations + 6 keys)
- CopilotToolCard (7 → 0 missing key)
- ApiManagerPageClient (13 → 0 missing key)
- gamification/admin (new useTranslations + 7 keys)

Hardcoded total: 326 → 249. Real missing keys: 0 (the 6 still flagged
are false positives in exampleTemplates.tsx where t is passed as a
parameter — keys exist at translator.templatePayloads.*).

* chore(i18n): replace hardcoded UI text with t() calls across dashboard (round 3)

Round-3 subagents and manual edits refactored 9 more dashboard pages
(plus 2 small extras), replacing ~80 hardcoded strings with
useTranslations() lookups. Added 79 corresponding keys to en.json
across analytics, cloudAgents, combos, common, health, settings, and
usage namespaces.

Pages affected:
- analytics/ComboHealthTab (new useTranslations + 15 keys)
- analytics/CompressionAnalyticsTab (new useTranslations + 11 keys)
- settings/SystemStorageTab (21 → 0 missing key)
- tokens/page (new useTranslations + 13 keys)
- usage/BudgetTab (9 missing fixed)
- health/page (manual: 6 keys)
- cloud-agents/page (manual: 3 keys)
- combos/page (manual: 1 key)

Hardcoded total: 249 → 164. Real missing keys: 0 (6 remaining are
exampleTemplates.tsx false positives).

Also adds scripts/i18n/build-pending-from-missing.mjs which reads
_audit.json and locates English values from HEAD to rebuild
_pending-keys.json after race-condition resets between subagent edits.

* chore(i18n): localize remaining dashboard settings labels

Replace hardcoded labels in compression and resilience settings with
translation lookups to continue the dashboard i18n cleanup.

Add the v3.8.0 dashboard shakedown runbook to document the manual
smoke-test process and known dev environment pitfalls.

* chore(i18n): replace hardcoded UI text with t() calls across dashboard (round 4)

Round-4 subagent + manual key-resolution refactored remaining strings in
3 high-traffic settings/API tabs, plus extracted English values for
keys that were already added as t() calls but lost during the previous
en.json race-condition resets.

Pages affected:
- api-manager/ApiManagerPageClient (7 → 0 missing key)
- settings/CompressionSettingsTab (8 → 0 missing key)
- settings/MemorySkillsTab (8 → 0 missing key)
- settings/ResilienceTab (4 more keys recovered)

Hardcoded total: 164 → 140. Real missing keys: 0 (6 remaining are the
exampleTemplates.tsx false positives — t passed as parameter).

* chore(i18n): replace hardcoded UI text with t() calls across dashboard (round 5)

Round-5 agent began processing the remaining smaller dashboard files.
Added 5 more keys to en.json for providers/[id]/page.tsx OAuth flow
labels and the cross-OS auto-detection hint.

Pages affected:
- providers/[id]/page.tsx (5 keys)

Hardcoded total: 140 → 136. Real missing keys: 0.

* chore(i18n): resolve last 2 missing providers/[id] keys

Adds providerDetailMyClaudeAccountPlaceholder and
providerDetailPathAutoDetected — the final user-visible labels in the
providers/[id] page that the round-5 subagent rewrote to t() calls
without yet adding to en.json.

Real missing keys: 0 (6 remaining are exampleTemplates.tsx false
positives — t is passed as a parameter so the audit cannot resolve the
namespace; keys do exist at translator.templatePayloads.*).

* chore(i18n): replace hardcoded UI text with t() calls across dashboard (round 6 — 10 parallel agents)

Round-6 dispatched 10 parallel subagents covering all 57 remaining
dashboard files. Each agent worked on a disjoint file set to avoid
en.json race conditions. Added ~60 new i18n keys across 9 namespaces
covering small UI labels, table headers, search placeholders, and
empty-state messages.

Major changes:
- analytics: SearchAnalyticsTab, ProviderUtilizationTab, DiversityScoreCard, CompressionAnalyticsTab (new useTranslations + keys)
- batch: BatchDetailModal, BatchListTab, FileDetailModal, FilesListTab (new useTranslations + keys)
- settings: CliproxyapiSettingsTab, PayloadRulesTab, ModelCooldownsCard, AppearanceTab, PricingTab (mostly new useTranslations)
- endpoint: TokenSaverCard, ApiEndpointsTab, EndpointPageClient
- cache: CachePerformance, IdempotencyLayer, ReasoningCacheTab, MediaPageClient, page
- combos: IntelligentComboPanel, page
- playground: ChatPlayground, SearchPlayground
- providers: ProviderCard
- onboarding: TierFlowDiagram
- changelog: ChangelogViewer
- home: ProviderTopology, TierCoverageWidget, BootstrapBanner, BadgeToast
- usage: BudgetTab, BudgetTelemetryCards, QuotaTable
- quotaShare: QuotaSharePageClient
- profile: page
- leaderboard: page
- skills: page

Hardcoded total: 131 → 60. Real missing keys: 0 plus 1 false-positive
for combos.modePack (lookup via prop-passed t).

* chore(i18n): finalize round-6 keys for batch/cache/endpoint/usage

Adds the remaining keys produced by parallel agents A4, A6, A8, A9:
- common: batch-related labels (BatchDetailModal, BatchListTab,
  FileDetailModal, FilesListTab, page) + profile/leaderboard
- cache: hit rate, latency, retry, avg chars
- endpoint: token saver, API endpoints, copy URL, cloud/local labels
- usage: noSpend, activeSessions, quotaAlerts, budget timing
- skills: install/marketplace/filter
- proxyRegistry/quotaShare/mcpDashboard: misc labels

Hardcoded total: 60 → 48. Real missing keys: 0 (modePack remaining is a
false positive — combos.modePack exists but the audit can't resolve it
since IntelligentComboPanel receives t as a prop).

* fix(playground): dedupe filteredModels to avoid duplicate React key warning

The /v1/models endpoint can return the same model id twice (e.g., when a
model is listed by both an alias and its canonical provider), which made
the <Select> emit two <option> elements with the same key — triggering
"Encountered two children with the same key, codex/gpt-5.5".

Replace the chained filter + map with a single pass that skips ids
already added.

* fix(playground): guard against non-string model ids before .split/.startsWith

The /v1/models endpoint can include synthetic entries (combos, locals,
in-progress imports) with a null/undefined id. The playground used to
call m.id.split("/") in the provider-discovery loop, which threw on the
first non-string entry; the surrounding .catch(() => {}) silently
swallowed the error, so the provider/model/account dropdowns ended up
empty even though /v1/models returned thousands of valid entries.

- Skip entries without a string id before split/startsWith.
- Log the rejection in the .catch handler so future regressions are
  visible in DevTools instead of silently emptying the UI.

* fix(playground): guard ChatPlayground filteredModels for non-string ids

Same root cause as commit 49fe356b9: ChatPlayground filtered models
with m.id.startsWith(...) which crashed on null/undefined ids returned
by /v1/models (synthetic combo entries). Apply the same defensive guard
and dedupe used in the parent page.

* fix(claude): drop orphan tool_result after fixToolAdjacency strip (discussion #2410)

Discussion #2410 reports Claude returning 400 for sequences like:
  assistant: tool_use(id=X)
  user: <plain text>           ← breaks adjacency
  user: tool_result(id=X)

The previous round added `fixToolAdjacency` (commit 44d9abac9) which
correctly strips the orphan tool_use from the assistant message. But
that left the now-unmatched tool_result intact, so the upstream
rejected the request with:

  messages.N.content.M: unexpected `tool_use_id` found in `tool_result`
  blocks: X. Each tool_result block must have a corresponding tool_use
  block in the previous message.

Fix: after running `fixToolAdjacency`, re-run `fixToolPairs` to drop
the orphaned tool_result blocks. All three call sites updated:
  - contextManager.purifyHistory (both inside the binary-search loop
    and the final pass)
  - BaseExecutor message-prep (Claude path)
  - claudeCodeCompatible request signer

Also tightens an unrelated dynamic-key access in
readNestedString (claudeCodeCompatible) to satisfy the prototype-
pollution scanner triggered by the post-tool semgrep hook.

* fix(mitm): point runtime manager re-export to js entrypoint

Use the emitted `.js` path for the runtime manager re-export so dynamic
runtime loading resolves correctly outside the Turbopack alias handling.

* docs: add AgentRouter setup guide (#2422)

Integrated into release/v3.8.0 — AgentRouter setup guide docs.

* feat: add new feature on combos - falloverBeforeRetry (#2417)

Integrated into release/v3.8.0 — falloverBeforeRetry for per-model quota skipping in combos.

* feat(batch): implement 10 feature requests harvested  (#2414)

Integrated into release/v3.8.0 — batch of 10 feature requests: llama.cpp local provider, upstream error exposure, Termux detection, providers rotate CLI, t3.chat web skeleton, Zed Docker integration, Kiro multi-account OAuth isolation, auto-combo cost blending, auto-combo context filter, combo provider-level exhaustion tracking (#1731). Conflicts with #2417 (falloverBeforeRetry) resolved.

* fix(gamification): resolve SQL bug, auth gap, pagination, and anomaly scoring (#2421)

Integrated into release/v3.8.0 — 6 critical gamification bug fixes: SQL SELECT in checkActionCountBadges, federation auth enforcement, leaderboard pagination offset, real z-score computation, addXp level calculation, and barrel index.ts

* docs(changelog): add post-release entries for #2414 #2417 #2421 #2422

- feat(batch): T3-Chat-Web executor, exhaustedProviders set (#1731), Zed Docker
- feat(combos): falloverBeforeRetry + setTry loop (#2417 — @hartmark)
- fix(gamification): SQL SELECT bug, federation auth, pagination, z-score (#2421 — @oyi77)
- docs: AgentRouter setup guide (#2422 — @leninejunior)

* fix(security): resolve CodeQL random/password-hash alerts and sync docs & tests

---------

Co-authored-by: diegosouzapw <diego.souza.pw@gmail.com>
Co-authored-by: Lenine Júnior <lenine@engrene.com.br>
Co-authored-by: Markus Hartung <mail@hartmark.se>
Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com>
2026-05-20 02:05:50 -03:00

313 lines
9.4 KiB
JavaScript

import { randomUUID } from "node:crypto";
import { decryptCredential, encryptCredential } from "./encryption.mjs";
const REQUIRED_PROVIDER_COLUMNS = [
["auth_type", "TEXT"],
["name", "TEXT"],
["email", "TEXT"],
["priority", "INTEGER DEFAULT 0"],
["is_active", "INTEGER DEFAULT 1"],
["access_token", "TEXT"],
["refresh_token", "TEXT"],
["expires_at", "TEXT"],
["token_expires_at", "TEXT"],
["scope", "TEXT"],
["project_id", "TEXT"],
["test_status", "TEXT"],
["error_code", "TEXT"],
["last_error", "TEXT"],
["last_error_at", "TEXT"],
["last_error_type", "TEXT"],
["last_error_source", "TEXT"],
["backoff_level", "INTEGER DEFAULT 0"],
["rate_limited_until", "TEXT"],
["health_check_interval", "INTEGER"],
["last_health_check_at", "TEXT"],
["last_tested", "TEXT"],
["api_key", "TEXT"],
["id_token", "TEXT"],
["provider_specific_data", "TEXT"],
["expires_in", "INTEGER"],
["display_name", "TEXT"],
["global_priority", "INTEGER"],
["default_model", "TEXT"],
["token_type", "TEXT"],
["consecutive_use_count", "INTEGER DEFAULT 0"],
["rate_limit_protection", "INTEGER DEFAULT 0"],
["last_used_at", "TEXT"],
['"group"', "TEXT"],
["max_concurrent", "INTEGER"],
["created_at", "TEXT"],
["updated_at", "TEXT"],
];
function ensureProviderColumns(db) {
const existingColumns = new Set(
db
.prepare("PRAGMA table_info(provider_connections)")
.all()
.map((column) => column.name)
);
const missingColumns = REQUIRED_PROVIDER_COLUMNS.filter(([name]) => {
const normalizedName = name.replaceAll('"', "");
return !existingColumns.has(normalizedName);
});
if (missingColumns.length === 0) return;
db.transaction(() => {
for (const [name, type] of missingColumns) {
db.prepare(`ALTER TABLE provider_connections ADD COLUMN ${name} ${type}`).run();
}
})();
}
export function ensureProviderSchema(db) {
db.prepare(
`CREATE TABLE IF NOT EXISTS provider_connections (
id TEXT PRIMARY KEY,
provider TEXT NOT NULL,
auth_type TEXT,
name TEXT,
email TEXT,
priority INTEGER DEFAULT 0,
is_active INTEGER DEFAULT 1,
access_token TEXT,
refresh_token TEXT,
expires_at TEXT,
token_expires_at TEXT,
scope TEXT,
project_id TEXT,
test_status TEXT,
error_code TEXT,
last_error TEXT,
last_error_at TEXT,
last_error_type TEXT,
last_error_source TEXT,
backoff_level INTEGER DEFAULT 0,
rate_limited_until TEXT,
health_check_interval INTEGER,
last_health_check_at TEXT,
last_tested TEXT,
api_key TEXT,
id_token TEXT,
provider_specific_data TEXT,
expires_in INTEGER,
display_name TEXT,
global_priority INTEGER,
default_model TEXT,
token_type TEXT,
consecutive_use_count INTEGER DEFAULT 0,
rate_limit_protection INTEGER DEFAULT 0,
last_used_at TEXT,
"group" TEXT,
max_concurrent INTEGER,
created_at TEXT NOT NULL,
updated_at TEXT NOT NULL
)`
).run();
ensureProviderColumns(db);
db.prepare("CREATE INDEX IF NOT EXISTS idx_pc_provider ON provider_connections(provider)").run();
db.prepare("CREATE INDEX IF NOT EXISTS idx_pc_active ON provider_connections(is_active)").run();
db.prepare(
"CREATE INDEX IF NOT EXISTS idx_pc_priority ON provider_connections(provider, priority)"
).run();
}
function nextPriority(db, provider) {
const row = db
.prepare("SELECT MAX(priority) as max_priority FROM provider_connections WHERE provider = ?")
.get(provider);
return Number(row?.max_priority || 0) + 1;
}
function parseJsonObject(value) {
if (!value || typeof value !== "string") return undefined;
try {
const parsed = JSON.parse(value);
return parsed && typeof parsed === "object" ? parsed : null;
} catch {
return null;
}
}
function rowToConnection(row) {
return {
id: row.id,
provider: row.provider,
authType: row.auth_type || "oauth",
name: row.name || row.display_name || row.email || row.provider,
email: row.email || null,
priority: row.priority || 0,
isActive: row.is_active !== 0,
apiKey: row.api_key || null,
accessToken: row.access_token || null,
refreshToken: row.refresh_token || null,
idToken: row.id_token || null,
providerSpecificData: parseJsonObject(row.provider_specific_data),
testStatus: row.test_status || "unknown",
defaultModel: row.default_model || null,
lastTested: row.last_tested || null,
lastError: row.last_error || null,
updatedAt: row.updated_at || null,
createdAt: row.created_at || null,
};
}
export function listProviderConnections(db) {
ensureProviderSchema(db);
return db
.prepare(
`SELECT * FROM provider_connections
ORDER BY provider ASC, priority ASC, updated_at DESC`
)
.all()
.map(rowToConnection);
}
export function findProviderConnection(db, selector) {
const normalized = String(selector || "")
.trim()
.toLowerCase();
if (!normalized) return null;
const connections = listProviderConnections(db);
return (
connections.find((connection) => connection.id.toLowerCase() === normalized) ||
connections.find((connection) => connection.id.toLowerCase().startsWith(normalized)) ||
connections.find((connection) => String(connection.name || "").toLowerCase() === normalized) ||
connections.find((connection) => connection.provider.toLowerCase() === normalized) ||
null
);
}
export function getProviderApiKey(connection) {
if (connection.authType !== "apikey") {
throw new Error(`Connection ${connection.name} is not an API-key provider.`);
}
if (!connection.apiKey) {
throw new Error(`Connection ${connection.name} has no API key configured.`);
}
return decryptCredential(connection.apiKey);
}
export function upsertApiKeyProviderConnection(db, input) {
ensureProviderSchema(db);
const provider = input.provider;
const name = input.name || provider;
const now = new Date().toISOString();
const existing = db
.prepare(
"SELECT id, priority FROM provider_connections WHERE provider = ? AND auth_type = 'apikey' AND name = ?"
)
.get(provider, name);
const connection = {
id: existing?.id || randomUUID(),
provider,
authType: "apikey",
name,
priority: existing?.priority || nextPriority(db, provider),
isActive: 1,
apiKey: encryptCredential(input.apiKey),
testStatus: input.testStatus || "unknown",
defaultModel: input.defaultModel || null,
providerSpecificData: input.providerSpecificData
? JSON.stringify(input.providerSpecificData)
: null,
createdAt: input.createdAt || now,
updatedAt: now,
};
db.prepare(
`INSERT INTO provider_connections (
id, provider, auth_type, name, priority, is_active, api_key, provider_specific_data,
test_status, default_model, created_at, updated_at
) VALUES (
@id, @provider, @authType, @name, @priority, @isActive, @apiKey, @providerSpecificData,
@testStatus, @defaultModel, @createdAt, @updatedAt
)
ON CONFLICT(id) DO UPDATE SET
api_key = excluded.api_key,
provider_specific_data = excluded.provider_specific_data,
test_status = excluded.test_status,
default_model = excluded.default_model,
is_active = excluded.is_active,
updated_at = excluded.updated_at`
).run(connection);
return connection;
}
export function removeProviderConnectionByProvider(db, provider) {
ensureProviderSchema(db);
const result = db
.prepare(
"DELETE FROM provider_connections WHERE provider = ? AND (auth_type = 'apikey' OR (api_key IS NOT NULL AND api_key != ''))"
)
.run(provider);
return result.changes;
}
/**
* Replace the encrypted API key for a connection and clear any cooldown state.
* `encryptedKey` must already be passed through `encryptCredential()`.
*/
export function updateProviderApiKey(db, connectionId, encryptedKey) {
ensureProviderSchema(db);
const now = new Date().toISOString();
const result = db
.prepare(
`UPDATE provider_connections
SET api_key = @apiKey,
test_status = 'unknown',
last_error = NULL,
last_error_at = NULL,
last_error_type = NULL,
last_error_source = NULL,
error_code = NULL,
rate_limited_until = NULL,
backoff_level = 0,
updated_at = @updatedAt
WHERE id = @id`
)
.run({ id: connectionId, apiKey: encryptedKey, updatedAt: now });
return result.changes;
}
export function updateProviderTestResult(db, connectionId, result) {
ensureProviderSchema(db);
const now = new Date().toISOString();
const valid = result?.valid === true;
db.prepare(
`UPDATE provider_connections SET
test_status = @testStatus,
last_error = @lastError,
last_error_at = @lastErrorAt,
last_error_type = @lastErrorType,
last_error_source = @lastErrorSource,
error_code = @errorCode,
last_tested = @lastTested,
updated_at = @updatedAt
WHERE id = @id`
).run({
id: connectionId,
testStatus: valid ? "active" : "error",
lastError: valid ? null : result?.error || "Provider test failed",
lastErrorAt: valid ? null : now,
lastErrorType: valid ? null : "connection_test_failed",
lastErrorSource: valid ? null : "upstream",
errorCode: valid ? null : result?.statusCode || null,
lastTested: now,
updatedAt: now,
});
return {
...result,
testedAt: now,
};
}