Commit Graph

240 Commits

Author SHA1 Message Date
Diego Rodrigues de Sa e Souza
eb83eaf25f refactor(dashboard): nav, providers, endpoint, runtime, quota, pricing, budget redesign + quota sharing preview (#2384)
* refactor(dashboard): sidebar subtitles, providers UX, monaco self-host

Sidebar:
- Add subtitleKey to all ~50 menu items so every entry shows a short
  description line (previously only 7 had subtitles).
- Inject 50 new sidebar.*Subtitle keys across all 42 i18n locales
  (en/pt-BR translated; remaining locales fall back to English).
- Fix DATA_÷IC glitch: replace invalid Material Symbols icon
  "data_compression" with "compress" on analytics-compression.
- Rename "Compression Combos" -> "Engine Combos" to avoid truncation
  and disambiguate from the OmniProxy Combos item.

Auto-routing banner:
- Move AutoRoutingBanner from DashboardLayout (rendered on every page)
  to /home only, so it no longer follows the user across the dashboard.

Monaco editor:
- Add shared MonacoEditor wrapper that calls loader.config({ monaco })
  to load Monaco from the bundled monaco-editor package instead of the
  jsdelivr CDN (blocked by CSP script-src 'self'), fixing the
  "Monaco initialization: error" runtime error.
- Migrate the 5 direct dynamic imports of @monaco-editor/react to the
  wrapper (playground, search-tools, translator).

Providers page UX:
- Replace the static legend + 4-stat divider + duplicate filter chips
  with a single row of clickable category pills with embedded counters
  (All, Free, OAuth, API Key, IDE, Compatible, Web Cookie, Search,
  Audio, Local, Cloud Agent).
- Remove redundant per-section Free only / Configured only toggles and
  the Zed Import button from the OAuth section header.
- Introduce a dedicated "IDE Providers" section (Cursor, Zed, Trae)
  rendered under OAuth Providers; exclude IDE_PROVIDER_IDS from OAuth
  to avoid duplication.
- Add zed and trae providers, plus IDE_PROVIDER_IDS set.
- Move the Zed keychain import to /dashboard/providers/zed as a
  contextual Card, instead of cluttering every OAuth section header.
- Extend test-batch route and validation schema with mode: "ide".

* feat(dashboard): add token saver controls to endpoint and context pages

Expose the Token Saver master settings from the endpoint page and
surface its disabled state across the Caveman and RTK context pages.

Update default compression behavior to start disabled with lighter
intensity presets, and add Caveman input compression controls so users
can configure input and output modes separately.

Tighten provider page section rendering by gating compatible, free,
oauth, and api key blocks behind their visibility checks and simplify
several summary labels.

* feat(dashboard): add runtime page and rename limits to quota

Introduce a dedicated runtime observability page for circuit
breakers, cooldowns, lockouts, sessions, and quota alerts.

Split provider quota out of the old limits route, add a redirect from
`/dashboard/limits` to `/dashboard/quota`, and update sidebar/header
labels and i18n keys to match the new navigation.

Enhance provider quota filtering state and remove the tier coverage
widget from the dashboard home view.

* feat(dashboard): redesign budget page and add quota sharing preview

Budget (/dashboard/costs/budget) gets a full rewrite:
- Hero with 6 KPIs (today, month, projected EOM, blocked, at-risk, active)
- Status pills with counts (blocked/alerting/warning/safe/no-limit)
- Templates row (localStorage) with bulk-apply to selected keys
- Multi-key table with checkbox selection and colored progress bar
- Expandable rows with projection card and per-provider cost breakdown
  (last 30d via /api/usage/analytics?apiKeyIds=) plus inline edit form

Quota sharing (/dashboard/costs/quota-share) is new and ships as a beta
UI preview backed by localStorage. Pool persistence in the DB and
request-pipeline enforcement are intentionally deferred to a follow-up.
The page lets operators:
- Create pools from a provider connection + quota window
- Edit allocations per API key with % split and equal-split helper
- Toggle hard/soft/burst policy intent
Donut chart rendered with inline SVG; allocation editor in a modal.

Sidebar gets the new "Quota Sharing" entry under Costs Parameters; i18n
keys propagated across all 41 locales with PT-BR translation.

---------

Co-authored-by: diegosouzapw <diego.souza.pw@gmail.com>
2026-05-18 18:53:00 -03:00
diegosouzapw
5ed96f5072 fix(routing): implement embedding combos, local provider validation bypass, and resolve migration collisions 2026-05-18 14:33:56 -03:00
diegosouzapw
b17fd87470 fix(rate-limiter): Redis is now opt-in via REDIS_URL (#2357)
Docker images launched without a sibling Redis container used to spam
'[REDIS] Error: connect ECONNREFUSED 127.0.0.1:6379' for every
rate-limit and API-key-auth cache lookup. The root cause was a default
of process.env.REDIS_URL || 'redis://localhost:6379' that turned the
opt-in cache into a hard dependency.

Three coordinated changes:

1. src/shared/utils/rateLimiter.ts — gate Redis on REDIS_URL being
   explicitly set. getRedisClient() returns null when disabled; the
   single connection-error handler dedupes via a redisErrorLogged latch
   so a sustained outage produces one warn instead of per-request flood.
   checkRateLimit() routes to the existing in-memory store on both the
   'disabled' and 'test' paths.

2. src/lib/db/apiKeys.ts — short-circuit Redis-backed auth cache reads
   and writes when getRedisClient() returns null. SQLite remains
   authoritative; the cache is purely an optimization.

3. Same file — replace the wildcard scope matcher's dynamic RegExp
   compilation with a deterministic segment walker. Eliminates the
   ReDoS surface on operator-supplied scope patterns and silences the
   Semgrep js/regex-injection advisory that previously blocked edits to
   this file.

Single-instance deployments now work silently out of the box;
multi-instance setups continue to use Redis when REDIS_URL is set.
2026-05-18 10:57:23 -03:00
Paijo
193e7a6417 feat(routing): LGKP remembers last good account per provider (#2338)
Integrated into release/v3.8.0 — added unit tests for connectionId-aware getLKGP/setLKGP
2026-05-17 19:54:32 -03:00
diegosouzapw
72afecffeb fix(migrations): resolve version collisions and add batch deletion API (#2294)
- Rename 056_provider_connection_quota_window_thresholds.sql to 057
- Add LEGACY_VERSION_SLOT_MIGRATIONS entries for backward compatibility
- Add deleteBatch/deleteCompletedBatches to batches.ts
- Add DELETE routes for batches (single + bulk)
- Add batch deletion buttons to dashboard
- Broaden dashboard session auth to all client API routes
- Add quota_window_thresholds_json column repair

Authored-by: Markus Hartung <hartmark@users.noreply.github.com>
2026-05-16 00:27:20 -03:00
diegosouzapw
0cc6fec85e Merge PR #2280: feat(cli): CLI v4 — Commander.js, 50+ commands, TUI, i18n, plugins (Phases 0-9)
Complete rewrite of the OmniRoute CLI:
- Commander.js-based modular architecture (50+ command files)
- Full i18n support (en + pt-BR, 1222 keys each)
- TUI interactive interface (OAuthFlow, EvalWatch, ProvidersTestAll)
- Plugin system (omniroute-cmd-*)
- OpenAPI codegen (omniroute api <tag> <op>)
- Commands: serve, combo, compression, keys, tunnel, backup, test-provider,
  health, memory, MCP, A2A, oauth, skills, webhooks, usage, cost, eval,
  context-eng, dashboard, doctor, env, files, logs, models, nodes, oneproxy,
  open, openapi, plugin, policy, pricing, providers, quota, registry, repl,
  reset-encrypted-columns, resilience, restart, runtime, sessions, setup,
  simulate, status, stop, stream, sync, tags, telemetry, translator, tray, update
- Code review fixes: C1-C3, I1-I5, M1-M4 applied

# Conflicts:
#	bin/cli/commands/config.mjs
#	bin/omniroute.mjs
#	package-lock.json
#	package.json
2026-05-15 10:50:54 -03:00
diegosouzapw
151528735b Merge remote-tracking branch 'origin/feat/v3.8.0-features' into release/v3.8.0
# Conflicts:
#	CHANGELOG.md
#	bin/omniroute.mjs
#	docs/reference/ENVIRONMENT.md
#	src/server/authz/policies/management.ts
2026-05-15 03:44:51 -03:00
diegosouzapw
54be51a664 chore(docs): remove all competitor references from branch
Remove every reference to the competing open-source project from docs,
comparisons, i18n mirrors, comments, and source files so the branch
history does not expose competitive intelligence.
2026-05-15 02:14:58 -03:00
diegosouzapw
f79ab2c3d1 fix(settings): default debugMode to true on fresh installations
The Debug sidebar section (Translator, Playground, Search Tools) was
hidden on new installs because debugMode was not in the settings
defaults object. This made data?.debugMode === true evaluate to false,
while the toggle in System & Storage appeared active — an inconsistency.

Changes:
- Add debugMode: true to getSettings() defaults in settings.ts
- Align SystemStorageTab useState initial value to true
- Update CHANGELOG with fix entry
2026-05-15 01:57:17 -03:00
diegosouzapw
8f915b18b0 feat(runtime): dynamic SQLite runtime installer with 5-step fallback chain
Adds bin/cli/runtime/sqliteRuntime.mjs that resolves better-sqlite3 from:
(1) bundled optionalDependency, (2) ~/.omniroute/runtime/ install,
(3) lazy npm install into runtime dir, (4) node:sqlite stdlib (Node >=22.5),
(5) bundled sql.js WASM. Each native binary is validated against expected
platform magic bytes (ELF/Mach-O/PE) before load.

Adds bin/cli/runtime/magicBytes.mjs with validateBinaryMagic() helper
(9 tests). Adds bin/cli/runtime/index.mjs as warmUpRuntimes() orchestrator.

Adds scripts/postinstall.mjs warm-up hook (non-fatal, skipped in CI).
Integrates it as the last step of scripts/build/postinstall.mjs.

Extends src/lib/db/core.ts with ensureDbInitialized() (async, idempotent)
and getDriverInfo() so the startup orchestrator can await the resolver
before any DB access, enabling graceful degradation without crashing the
process on missing better-sqlite3.

Solves Windows EBUSY error on 'npm install -g omniroute@latest' while the
previous version is still running, and works in environments without C++
build tools or with unreachable npm registry.

Documents OMNIROUTE_SKIP_POSTINSTALL in .env.example and ENVIRONMENT.md.

Ref: 9router/cli/hooks/sqliteRuntime.js (pattern origin).
2026-05-15 00:05:49 -03:00
diegosouzapw
ab911265ed feat(cli): banir SQLite direto — withRuntime + src/lib/db/* modules (Fase 1.5) 2026-05-14 23:41:02 -03:00
diegosouzapw
e7a4ea8c7f feat(mcp): add MCP accessibility-tree smart filter engine
Adds compression engine that collapses repeated sibling lines (≥30 items
with same indent + role prefix) into head + summary + tail, preserves
[ref=eXX] anchors required by Playwright/computer-use MCPs, and
hard-truncates oversized text with a navigation hint footer.

Reduces token usage 60-80% on browser snapshots/accessibility trees from
external MCP servers (playwright-mcp, chrome-mcp). Configurable via
settings.compression.mcpAccessibility namespace.

Changes:
- open-sse/services/compression/engines/mcpAccessibility/: new engine
  (constants.ts, collapseRepeated.ts, index.ts with smartFilterText)
- open-sse/services/compression/types.ts: re-exports McpAccessibilityConfig
- src/lib/db/compression.ts: getMcpAccessibilityConfig/setMcpAccessibilityConfig
- src/lib/db/migrations/056_mcp_accessibility_compression.sql: default settings
- open-sse/mcp-server/server.ts: apply filter to all tool result text blocks
- tests/unit/compression/mcpAccessibility.test.ts: 4 unit tests
- tests/unit/mcp/serverSmartFilter.test.ts: 4 integration tests (DB getter/setter)

Ref: 9router/src/lib/mcp/stdioSseBridge.js:14-90 (algorithm origin).
2026-05-14 21:24:05 -03:00
payne
aa0e312d8a feat(limits): per-window quota cutoffs across all providers with usage data (#2267)
feat(limits): per-window quota cutoffs across all providers with usage data (#2267 — thanks @payne0420)
2026-05-14 20:19:55 -03:00
墨林ObsidianGrove
83f242fa4d fix: clear synced provider models on delete all
Ensure provider-level delete all removes synced available model lists so imported models do not reappear after clearing managed models.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-15 01:39:31 +08:00
Dohyun Jung
fc620514a9 feat(providers): add Command Code provider (#2199)
Integrated into release/v3.8.0 after syncing the contributor branch, removing unrelated workflow/package-lock changes, and validating Command Code provider, auth, validation, and Responses coverage locally.
2026-05-12 19:57:35 -03:00
Dohyun Jung
dcb32a6ba0 feat(api): aggregate combo model metadata in catalog (#2166)
Integrated into release/v3.8.0 — adds target-based metadata aggregation for combo entries in /v1/models using least-common-denominator approach (context_length, max_output_tokens, capabilities, modalities).
2026-05-11 21:14:25 -03:00
diegosouzapw
bbecbccb0a fix(cli): harden setup, doctor, and backup workflows
Hide admin password entry during setup, make doctor degrade to warnings
when source-only runtime checks are unavailable, and improve stop
behavior by attempting graceful shutdown before force killing ports.

Also use SQLite's backup API for safer snapshots under WAL, align CLI
key writes with the current provider_connections schema, and include
follow-on compatibility fixes for GLM provider detection, stream error
sanitization, and auth-aware test coverage.
2026-05-11 09:13:49 -03:00
diegosouzapw
fa1295d3cf Merge remote-tracking branch 'origin/release/v3.8.0' into bugs/2120_docker
# Conflicts:
#	open-sse/executors/antigravity.ts
#	open-sse/services/accountFallback.ts
#	open-sse/services/usage.ts
#	open-sse/translator/helpers/geminiHelper.ts
#	open-sse/utils/error.ts
#	src/lib/db/apiKeys.ts
2026-05-10 21:22:21 -03:00
diegosouzapw
40bd60959e refactor(core): strengthen typing and normalize auth and model flows
Tighten executor, usage, model-resolution, and state-management
code with explicit types and safer record handling to reduce runtime
edge cases across providers.

Also normalize management-token failures to 403 responses, require API
keys consistently on cloud agent task routes with CORS-safe errors,
refresh stale Gemini CLI project IDs, prioritize Gemini search tools
correctly, add new provider/model registry entries, and serialize
integration tests for more reliable CI.
2026-05-10 20:48:03 -03:00
Markus Hartung
bff9a0c4a6 refactor: improve type safety and add cloud agent providers
- Update types in several files to reduce usage of `any`
- Fix `fetch` body type error in `AntigravityExecutor` by returning `ReadableStream`
- Add `CLOUD_AGENT_PROVIDERS` constants

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-11 00:41:36 +02:00
diegosouzapw
ec6456ba73 chore(release): align migration compatibility and packaged CLI runtime
Skip the superseded 041 session_account_affinity migration when
the canonical 050 file is present, and remap legacy migration
markers so upgraded databases do not replay the duplicate slot.

Also include the CLI entrypoints in packaged artifacts and extend
management-auth coverage across admin memory, pricing, routing,
provider validation, and usage endpoints to keep release bundles
runnable and sensitive operations protected.
2026-05-10 18:27:41 -03:00
diegosouzapw
12b254097b security: fix code scanning alerts — sanitize error messages and suppress false-positive hash warnings
- Sanitize error messages in errorResponse() and cursor buildErrorResponse() to strip stack traces before sending to client (fixes js/stack-trace-exposure)
- Add explicit CodeQL suppression comments for intentional SHA-256 usage in API key hashing (fast O(1) lookup, not password storage) and deterministic UUID generation (fixes js/insufficient-password-hash false positives)
2026-05-10 10:41:16 -03:00
diegosouzapw
73bda23c60 chore(release): finalize v3.8.0 stabilization and fix typescript regressions
- Fix stream readiness loop and upstream error code propagation in chatCore.ts

- Resolve Headers iterator TypeScript errors

- Fix type mismatches and missing props in BuilderIntelligentStep, Card, and providers page

- Fix providerLimits typecasts and resolve implicit any errors

- Ensure green build and strict type compliance for production
2026-05-10 09:10:43 -03:00
diegosouzapw
5731541bad chore(security): apply CodeQL fixes to release branch 2026-05-10 01:37:17 -03:00
smartenok-ops
fa29e19863 feat(auth): per-session sticky routing for codex (#1887)
Integrated into release/v3.8.0
2026-05-10 00:58:07 -03:00
Raxxoor
a8106bbadd fix(glm): add dedicated coding transport (#2087)
Integrated into release/v3.8.0
2026-05-10 00:52:00 -03:00
backryun
09733e4906 Refresh providers, model catalogs, and docs for v3.8.0 (#2088)
Merged automatically
2026-05-10 00:00:11 -03:00
Yoviar Pauzi
bfb5ab0f58 fix(api): usage and keys (#2092)
Integrated into release/v3.8.0
2026-05-09 22:04:07 -03:00
Paijo
cdd71ab211 feat(providers): batch delete provider connections via checkbox multi-select (#2094)
Integrated into release/v3.8.0
2026-05-09 21:43:10 -03:00
Gleb Peregud
043d345647 feat(api): allow configuration via API calls - open management routes to Bearer keys with manage scope - (#2103)
Integrated into release/v3.8.0
2026-05-09 21:35:51 -03:00
diegosouzapw
276e5da137 Merge PR #2019 and resolve conflicts 2026-05-08 17:54:35 -03:00
diegosouzapw
aacd43bb45 fix: clean up proxy page redundancy and fix 1proxy sync empty body error (#2052) 2026-05-08 17:43:41 -03:00
diegosouzapw
e26f79f052 fix(db): resolve migration conflict by renumbering 051 to 052 and 053 2026-05-08 17:37:46 -03:00
Paijo
13ce9d69cb feat(multi): manifest-aware tier routing — W1-W4 complete (#2014)
Integrated into release/v3.8.0
2026-05-08 17:35:49 -03:00
Raxxoor
831829dbc3 fix(compression): support Responses input and expand Spanish rules (#2028)
Integrated into release/v3.8.0
2026-05-08 17:35:43 -03:00
Raxxoor
deb2180c9b fix(db): reduce hot-path persistence overhead (#2039)
Integrated into release/v3.8.0
2026-05-08 17:35:36 -03:00
Paijo
60bb00be41 fix(db): add missing migration renumbering entries for compression migrations (#2041)
Integrated into release/v3.8.0
2026-05-08 17:35:31 -03:00
Markus Hartung
a47bb90388 fix: Follow OpenAI specification, handle throttling in batch and fix UI (#2045)
Integrated into release/v3.8.0
2026-05-08 17:35:06 -03:00
Dohyun Jung
39ae0314b6 feat(combo): add context_length input field to combo edit form (#2047)
Integrated into release/v3.8.0
2026-05-08 17:34:56 -03:00
diegosouzapw
171081dbbb fix(core): harden input handling and compression cleanup
Replace regex-based compression artifact cleanup with linear helpers to
avoid pathological backtracking and normalize whitespace safely.
Tighten request and response parsing in assess, Gemini translation, and
executor telemetry to avoid unsafe property access and invalid category
filtering.

Also add managed database backup support for legacy encrypted
connection migration, improve SQLite load error handling, and cover the
regressions with unit tests.
2026-05-06 02:29:25 -03:00
Diego Rodrigues de Sa e Souza
7665ad3950 Release v3.7.9 (continued development) (#1982)
* chore: add GPT-5.5 Instant and support Node 26 (#1977)

chore: add GPT-5.5 Instant model to Codex registry + Node 26 support with CI + improved native SQLite error handling. Integrated into release/v3.7.9

* feat: enhance cost formatting and add Codex GPT-5.5 pricing support

* fix formatting

---------

Co-authored-by: backryun <bakryun0718@proton.me>
Co-authored-by: Jan Leon <jan.gaschler@gmail.com>
Co-authored-by: 05dunski <05dunski-kredo@icloud.com>
2026-05-06 01:21:31 -03:00
diegosouzapw
c63c5d5008 fix: resolve MCP endpoint auth bypass (#1970) and finalize DB settings 2026-05-05 09:59:43 -03:00
Sergey Morozov
8077e9b62b feat(settings): add request body limit setting (#1968)
Integrated into release/v3.7.9
2026-05-05 09:12:35 -03:00
diegosouzapw
afe4b19588 fix: resolve analytics tracking issues, provider alias mapping, and fallback calculation 2026-05-05 01:17:52 -03:00
diegosouzapw
bc7226ae95 fix(auth): implement session affinity sticky routing logic 2026-05-04 21:02:41 -03:00
Paijo
6a45ea2c97 feat(db): consolidate all database settings into SystemStorageTab (closes #1935) (#1947)
Integrated into release/v3.7.9
2026-05-04 19:25:41 -03:00
diegosouzapw
8f3d9e2ec7 fix: active db migration for legacy encrypted tokens (#1941)
Closes #1941 by forcing healthCheck.ts to scan and re-encrypt all
provider connections that were previously encrypted with the dynamic salt
fallback. This permanently upgrades legacy tokens to static-salt without
relying on organic updates.
2026-05-04 19:15:27 -03:00
diegosouzapw
baeaaee0f7 fix(auth): implement extractSessionAffinityKey stub for codex tests 2026-05-04 16:48:49 -03:00
diegosouzapw
0024d20e28 fix(settings): include usage and budget records in json backups
Export and restore usage history, domain cost history, and domain
budget data so analytics and budget state survive settings transfers.

Also adjust cost overview fallbacks to rank by request volume when
cost data is unavailable, count conversationState entries in chat
request logging, and align e2e coverage with the proxy settings route.
2026-05-04 16:28:47 -03:00
diegosouzapw
3e3ba607b5 test: fix ambiguous model resolution test and migration conflicts 2026-05-04 14:03:48 -03:00