Commit Graph

1982 Commits

Author SHA1 Message Date
oyi77
8053ebe798 feat(compression): Phase 4 — ultra mode with heuristic token pruning and SLM stub 2026-04-29 01:28:36 +07:00
oyi77
4f7a0c265d fix(compression): address PR #1717 review feedback
- chatCore: remove shadowed const, update estimatedTokens after compression
- aggressive: fix techniquesUsed overwrite (.push), use estimateTokens() for savings
- toolResultCompressor: add estimateTokens helper, convert all saved: to token math
- progressiveAging: add estimateTokens helper, convert all saved += to token math
2026-04-28 20:54:54 +07:00
oyi77
6bf7b9601d feat(compression): Phase 3 — aggressive mode with summarization, tool compression, and progressive aging
Implements the aggressive compression pipeline (issue #1588) with three
core stages: tool-result compression, progressive aging, and rule-based
summarization. Includes downgrade chain to caveman/lite when savings are
insufficient.

Core modules:
- summarizer.ts: RuleBasedSummarizer with intent/file/error/decision
  extraction, code fence trimming, skip-already-compressed guard
- toolResultCompressor.ts: 5 auto-detected strategies (fileContent,
  grepSearch, shellOutput, json, errorMessage) with toggle support
- progressiveAging.ts: 4-tier degradation (verbatim→light→moderate→
  fullSummary) with [COMPRESSED:aging:<tier>] markers
- aggressive.ts: Orchestrator with 3-step pipeline and downgrade chain
  (aggressive→caveman→lite→as-is)

Integration:
- strategySelector.ts: applyCompression() now dispatches mode='aggressive'
- compression.ts: aggressiveConfig CRUD with deep merge of nested objects
- API route: Zod schema for aggressiveConfig thresholds/strategies
- CompressionSettingsTab: aggressive mode card, thresholds, toggles, i18n
- Migration 031: SELECT 1 no-op (config stored as kv key)

Tests: 109 across 8 files (types, summarizer, toolResultCompressor,
progressiveAging, aggressive, integration, golden eval, caveman regression)
All pass. Typecheck clean. Lint clean (0 errors). Build succeeds.
2026-04-28 16:58:17 +07:00
oyi77
819c0762b9 fix(compression): address PR review — multi-part msg safety, preservation $& fix, rule name sync, no-op rule removal
4 fixes from Gemini Code Assist PR #1689 review:

1. HIGH: Multi-part message content duplication — skip array-content
   messages instead of joining+replacing all text parts with compressed
   result, which caused content duplication (e.g., [A,B] → [comp(A+B), comp(A+B)])

2. HIGH: String.prototype.replace $& vulnerability — use arrow function
   callback instead of string arg in restorePreservedBlocks() to prevent
   special replacement patterns ($&, , etc.) from corrupting restored
   content containing code, URLs, or file paths

3. HIGH: UI/backend rule name mismatch — ALL_CAVEMAN_RULES in
   CompressionSettingsTab.tsx now uses actual backend rule names
   (polite_framing, hedging, verbose_instructions, etc.) instead of
   fabricated names (hedging_disclaimer, redundant_please, etc.)
   that would break the skip-rules feature

4. MEDIUM: Remove no-op turn_marker rule — pattern /^$/g matches only
   empty strings and replaces with empty string, achieving nothing.
   Removed from CAVEMAN_RULES; total count now 29 (was 30).

Tests: 72/72 pass, typecheck: 0 errors, lint: 0 errors
2026-04-28 04:20:46 +07:00
oyi77
4b475df5b2 test(compression): add API schema validation tests for compression settings 2026-04-28 00:57:58 +07:00
oyi77
c0d92f3569 feat(ui): add compression settings tab, compression log viewer, and settings API route
- CompressionSettingsTab.tsx: full UI for compression config (enable/mode/caveman)
- CompressionLogTab.tsx: compression stats viewer with rulesApplied display
- /api/settings/compression: GET/PUT API route with Zod validation
- Settings page: wire CompressionSettingsTab under AI tab
- i18n: 28 compression keys added to all 33 locale files
2026-04-28 00:55:30 +07:00
oyi77
88dbefa141 feat(compression): reconcile Phase 2 with Phase 1 API surface
- Use 'standard' mode (not 'caveman') in CompressionMode type
- Align CompressionConfig with Phase 1 shape (enabled, defaultMode,
  autoTriggerTokens, cacheMinutes, preserveSystemPrompt, comboOverrides)
- Extend CompressionStats with techniquesUsed + rulesApplied + durationMs
- Make CompressionResult.stats nullable (Phase 1 compat)
- Add Phase 1 functions: estimateCompressionTokens, createCompressionStats,
  trackCompressionStats, selectCompressionStrategy, applyCompression,
  checkComboOverride, shouldAutoTrigger, getEffectiveMode
- Add lite.ts stub for Phase 1 'lite' compression mode
- Add index.ts barrel file for full module export
- Fix DB compression.ts to return Phase 1 CompressionConfig shape
- Fix chatCore.ts to use unified compression pipeline
  (selectCompressionStrategy + applyCompression)
- Add backwards-compatible estimateTokensForStats alias
- Renumber migration 028 → 030 (Phase 1 uses 028)
- Update all tests for reconciled API (67/67 pass)
2026-04-28 00:25:45 +07:00
oyi77
b1e13668f2 feat(compression): wave 2+3 — tests, golden eval, rule fixes, migration
- Fix question_to_directive rule: trim trailing whitespace before lookup
- Fix DB import path: correct relative path from src/lib/db to open-sse
- Add test DB cleanup beforeEach for isolation
- Add 4 unit test files: caveman-db, hedging, dedup, structural (28 tests)
- Add golden set quality test (4 tests, 99.3% key phrase preservation)
- Add golden set savings test (3 tests, performance + savings verification)
- Add golden set data (20 verbose coding prompts with key phrases)
- Add migration 028 for new test suite acknowledgment

67 tests pass across 9 files. typecheck:core clean.
2026-04-27 20:00:08 +07:00
oyi77
b5f6bea880 feat(compression): implement caveman compression engine — Wave 1 complete
- CavemanConfig types and interfaces (types.ts)
- 30 compression rules across 4 categories (cavemanRules.ts)
- Core 5-step compression pipeline (caveman.ts)
- Code block / URL / path preservation (preservation.ts)
- Strategy selector with caveman dispatch (strategySelector.ts)
- Stats tracking module (stats.ts)
- DB settings module (compression.ts)
- Unit tests: 36 tests, 0 failures
- Typecheck: 0 errors, Lint: 0 errors

Implements: GitHub issue #1587 (Phase 2)
2026-04-27 18:31:46 +07:00
oyi77
763d353f5c fix(encryption): return null on decryption failure to prevent sending encrypted tokens to providers
- When decrypt() encounters a malformed encrypted value (invalid format), return null instead of the ciphertext
- When decrypt() fails due to decryption error (wrong key, auth tag mismatch), return null instead of the ciphertext
- This prevents encrypted tokens from being sent to upstream APIs
- Fixes [400]: Improperly formed request errors when routing to Kiro and other providers with unavailable credentials
- Updated test expectations to match the new correct behavior: decrypt returns null on any failure
2026-04-21 03:24:35 +07:00
diegosouzapw
08d0e9f8b4 fix(security): resolve CodeQL alert 164 ReDoS in extraction and preserve release branch workflow 2026-04-19 20:28:39 -03:00
Diego Rodrigues de Sa e Souza
3432dfd280 Release v3.6.9 (#1404)
* test: resolve typescript strictness complaints in unit tests

* Update Claude Code obfuscation to version 2.1.114 (#1403)

* fix(cloud-code): scope thinking stripping to executor boundaries (#1401)

* fix(cloud-code): scope thinking stripping to executors

* fix(cloud-code): guard antigravity normalized body

* Update Claude Code obfuscation to version 2.1.114

- Update Claude Code version from 2.1.87 to 2.1.114
- Update X-Stainless-Package-Version from 0.80.0 to 0.81.0
- Add new beta flags: redact-thinking-2026-02-12, advisor-tool-2026-03-01, advanced-tool-use-2025-11-20
- Add missing headers: anthropic-version, anthropic-dangerous-direct-browser-access, x-app, X-Stainless-Timeout
- Add all X-Stainless-* headers (Arch, Lang, OS, Runtime, Runtime-Version, Retry-Count)
- Fix accept-encoding header: identity -> gzip, deflate, br, zstd
- Add connection: keep-alive header
- Update tool name mapping: add lsp, apply_patch, websearch

These changes ensure that requests from OpenCode through Omniroute are indistinguishable from genuine Claude Code 2.1.114 requests, allowing proper authentication with Anthropic's API without triggering extra credits errors.

* fix: resolve CodeQL password hash alert and TruffleHog CI failure

---------

Co-authored-by: Randi <55005611+rdself@users.noreply.github.com>
Co-authored-by: Diego Rodrigues de Sa e Souza <8016841+diegosouzapw@users.noreply.github.com>
Co-authored-by: Nikolay Popov <ekklesio.dev@gmail.com>
Co-authored-by: diegosouzapw <diegosouzapw@users.noreply.github.com>

* fix(claude-code): scope obfuscation to cli clients and fix tests

* docs(workflows): enforce PR merge instead of manual close

* docs(changelog): update 3.6.9 notes with missing PR 1403 and fixes

* docs(workflows): update generate-release to use full changelog for PR body

* fix(tsc): silence baseUrl deprecation warnings for TS 5.5+

* fix(chatcore): apply proactive compression before provider translation (#1406)

Integrated into release/v3.6.9

* docs(changelog): add PR 1406

* Makes text visible in dark-mode (#1409)

Integrated into release/v3.6.9

* docs(changelog): add PR 1409

* chore: save local work

* chore(release): sync version references to 3.6.9

* fix(codex): prevent proactive token refresh consumption and strip background parameter

* ci: shard long-running suites and relax timeouts

* ci: allow manual CI dispatch for release branches

* feat(skills): provider-aware marketplace UX, scored AUTO injection, and memory pipeline hardening (#1411)

* fix/400 for GeminiCLI(add "ref" in GEMINI_UNSUPPORTED_SCHEMA_KEYS)

* feat(cc-compatible): align request shape with Claude CLI

* fix(cc-compatible): add Claude CLI system skeleton for OpenAI input

* preserve reasoning when translating chat to responses (#1414)

Integrated into release/v3.6.9

* fix(skills): optimize AUTO scoring and include Responses input context (#1418)

Integrated into release/v3.6.9

* chore: fix TS errors and update review-prs workflow

* fix(api): stop sending unsupported Gemini and Codex parameters

Prevent Gemini request translation from injecting default
thoughtSignature values that the upstream API strictly validates and
rejects. Only preserve real signatures resolved from prior upstream
responses, and strip additionalProperties from Gemini function schemas
to avoid 400 "Unknown name" errors.

Also remove fallback-injected session_id and conversation_id fields
before sending Codex requests, and restore compatibility with the
legacy OUTBOUND_SSRF_GUARD_ENABLED flag when determining whether
private provider URLs are allowed.

Updates the Gemini translator and regression tests for issue #1410
and related 400 error cases.

* fix(core): stabilization fixes for token refresh, usage translation, and testing

- Update Codex token refresh detection logic
- Mark provider connections invalid on unrecoverable refresh error
- Fix Claude usage translation under-reporting cached tokens
- Update test expectations
- Update CHANGELOG.md for v3.6.9

* fix(auth): reload fresh token state and unify expiry persistence

Refresh checks now re-read the latest stored provider connection before
attempting rotation so they do not use stale refresh tokens captured by
an earlier sweep.

Token updates also persist both expiresAt and tokenExpiresAt across the
health check, usage-limit refresh path, and SSE refresh flow. This keeps
known token expiry metadata in sync and avoids interval-based refreshes
for connections whose tokens are still valid well into the future.

* fix: resolve SSRF environment static evaluation bug (#1427)

Fix import aliases and strict TS typings for tests and ACP agents.

* test: resolve remaining strict type errors in test files

* test: fix provider service assertion for anthropic-compatible header

* fix(codex): respect openaiStoreEnabled setting during native passthrough (#1432)

* fix(codex): fix token refresh unrecoverable detection for expired tokens

* fix(ci): restore release v3.6.9 build and flaky tests

* fix(cc-compatible): trim default OpenAI system skeleton (#1433)

Integrated into release/v3.6.9

* fix: prevent masked API keys from being written to CLI tool configs (#1435)

* feat: mark Qwen provider as deprecated and add deprecation warning to CLI tool (#1437)

* docs(changelog): comprehensive v3.6.9 update with all 59 commits since v3.6.8

* test(ci): align qwen guide settings assertions

* fix(security): resolve CodeQL alert 163 for incomplete URL sanitization in Qwen CLI settings

---------

Co-authored-by: diegosouzapw <diegosouzapw@users.noreply.github.com>
Co-authored-by: Nikolay Popov <74762779+nikolay-popov-ideogram@users.noreply.github.com>
Co-authored-by: Randi <55005611+rdself@users.noreply.github.com>
Co-authored-by: Nikolay Popov <ekklesio.dev@gmail.com>
Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com>
Co-authored-by: Tim Massey <tim-massey@users.noreply.github.com>
Co-authored-by: Paijo <oyi77@users.noreply.github.com>
Co-authored-by: dail45 <dail45@yandex.ru>
Co-authored-by: R.D. <rogerproself@gmail.com>
v3.6.9
2026-04-19 19:50:30 -03:00
Randi
5be86907d7 preserve reasoning when translating chat to responses (#1414)
Integrated into release/v3.6.9
2026-04-19 06:46:54 -03:00
Diego Rodrigues de Sa e Souza
b191842d98 Merge pull request #1392 from diegosouzapw/release/v3.6.9
chore(release): v3.6.9 — Bug Fixes and PR Integrations
2026-04-18 17:16:31 -03:00
Randi
293290e12a fix(cloud-code): scope thinking stripping to executor boundaries (#1401)
* fix(cloud-code): scope thinking stripping to executors

* fix(cloud-code): guard antigravity normalized body
2026-04-18 17:15:59 -03:00
diegosouzapw
bb1e70acab test: align codex passthrough assertion with explicit store retention policy 2026-04-18 17:08:15 -03:00
diegosouzapw
97fe1a1b57 chore: enforce contributor credit rule in review-prs workflow 2026-04-18 16:53:33 -03:00
diegosouzapw
860d596c3b fix: resolve combo-routing-engine test regression and TS errors 2026-04-18 16:53:26 -03:00
diegosouzapw
b909013058 fix: resolve MITM not working when connecting Antigravity (#1399) 2026-04-18 16:53:20 -03:00
diegosouzapw
f979c606fe test: fix store assertion for codex responses 2026-04-18 15:46:25 -03:00
diegosouzapw
4a50b2eb6a chore(release): v3.6.9 — finalize PR integrations and test fixes 2026-04-18 15:35:21 -03:00
Benson K B
f3ae67473b fix(combo): fallback to next model on all-accounts-rate-limited 503 (#1398)
Integrated into release/v3.6.9
2026-04-18 15:35:21 -03:00
Gi99lin
9d32b65a82 fix(codex): cache system prompts for Chat Completions path via convertSystemToDeveloperRole (#1400)
Integrated into release/v3.6.9
2026-04-18 15:10:18 -03:00
Gi99lin
e57126af4f fix(codex): strip server-generated IDs from response items in input to prevent 404 errors (#1397)
Integrated into release/v3.6.9
2026-04-18 15:10:15 -03:00
diegosouzapw
8d1c30ad17 chore: merge main (CodeQL fixes) into release/v3.6.9 2026-04-18 12:02:07 -03:00
diegosouzapw
ecab0edad1 fix(security): Resolve CodeQL alerts (#151, #154, #155-#159)
- Fix insecure randomness in usage service
- Add CodeQL suppression for intentional SHA-512 checksum in callLogArtifacts
- Replace URL string prefix matching with strict hostname validation in tests
- Remove scratch scripts with sensitive data logging
2026-04-18 11:51:24 -03:00
diegosouzapw
d42842ba25 chore: fix CodeQL alerts and missing docker postinstall 2026-04-18 11:44:20 -03:00
diegosouzapw
c1659a1c5e docs(changelog): update v3.6.9 notes with PRs 1393 and 1394 2026-04-18 11:08:50 -03:00
Benson K B
4a560c0b1c feat(cli): add direct config save for Qwen Code (#1394)
Integrated into release/v3.6.9
2026-04-18 10:59:11 -03:00
Benson K B
891189bbf3 feat(cli): derive Claude CLI model defaults from provider registry dynamically (#1393)
Integrated into release/v3.6.9
2026-04-18 10:49:34 -03:00
diegosouzapw
01ae037205 test(cli): resolve strict null checks in Qoder unit tests 2026-04-18 10:29:30 -03:00
diegosouzapw
f53caa93b6 fix: Qoder PAT validation treats 500 error as bypass to avoid false negatives (#1391)
fix: proxy context correctly inherited during token refresh to avoid expiration loops (#1390)
2026-04-18 10:18:36 -03:00
diegosouzapw
c8679b0c79 chore(release): v3.6.9 — changelog, docs, version sync 2026-04-18 09:16:27 -03:00
diegosouzapw
7bc4ac1833 fix: Type error in Header electronAPI 2026-04-18 04:59:17 -03:00
diegosouzapw
c03a5a4443 fix: resolve CodeQL security alerts (#151, #152, #154, #155-#159)
- #155-#159 (Incomplete URL substring sanitization):
  Replaced partial `startsWith()` matching on URLs in test assertions and mocks with strict `new URL(url).hostname` parsing.
- #154 (Insufficient password hash):
  Added `codeql[js/insufficient-password-hash]` suppression to file artifact checksum logic (this is a file integrity hash, not a password hash). Switched back to sha256 to avoid unnecessary sha512 overhead.
- #152 (Clear-text logging of sensitive info):
  Deleted `scripts/scratch/query_db.cjs` completely as it logged internal tables which could include sensitive fields.
- #151 (Insecure randomness):
  Switched `globalThis.crypto.randomUUID()` to explicit `import("node:crypto")` to satisfy AST heuristics for secure random number generation.
2026-04-18 04:58:15 -03:00
diegosouzapw
7e1e0e362e feat: implement #1350 #1367 #1369 — persistent API key, backup pruning, GPU optimization
#1350 — Persist API-Key via Docker volume:
- isValidApiKey() now checks OMNIROUTE_API_KEY/ROUTER_API_KEY env vars
  before querying SQLite, making keys survive container restarts/restores
- Env-var keys bypass DB entirely — no regeneration needed

#1367 — Limit Database Backup Count:
- Already implemented: UI controls (keepLatest, retentionDays) in
  SystemStorageTab + backend cleanupDbBackups() with DB_BACKUP_MAX_FILES
- Closed as already resolved

#1369 — Reduce GPU usage:
- Removed backdrop-blur-xl from Sidebar.tsx and Header.tsx
- Made --color-sidebar CSS vars fully opaque (eliminates GPU compositing)
- Added data memoization to RequestLoggerV2/ProxyLogger via
  logsSignatureRef — skips setLogs when data unchanged (~80% fewer re-renders)

Tests: 36/36 pass, typecheck:core pass
2026-04-18 04:54:59 -03:00
diegosouzapw
4a930e7966 fix: Claude passthrough (#1359), kimi-k2 reasoning (#1360), thinking leak (#1361), Ollama redirect (#1381)
- Eliminate lossy Claude→OpenAI→Claude round-trip for Claude-format providers
- Expand isReasoner to include kimi-k2 and opencode-go provider models
- Block thinking param leak to non-Claude antigravity models (gemini, gpt-oss)
- Allow redirects for Ollama Cloud /v1/models endpoint (301)
2026-04-18 04:34:11 -03:00
Diego Rodrigues de Sa e Souza
0307950dc6 Merge pull request #1383 from uwuclxdy/copilot/fix-workflow-issue-1382
fix(docker): copy postinstallSupport.mjs before npm ci in Dockerfile
2026-04-18 04:33:06 -03:00
copilot-swe-agent[bot]
6d9ba007e5 fix(docker): copy postinstallSupport.mjs before npm ci in Dockerfile
Agent-Logs-Url: https://github.com/uwuclxdy/OmniRoute/sessions/cb9cd4a9-4f1e-4201-8327-a26c0f2c87d0

Co-authored-by: uwuclxdy <37777261+uwuclxdy@users.noreply.github.com>
2026-04-18 07:19:58 +00:00
diegosouzapw
15abfe61ec chore: fix CodeQL alerts and missing docker postinstall 2026-04-18 04:15:33 -03:00
Diego Rodrigues de Sa e Souza
4734d53322 Merge pull request #1352 from diegosouzapw/release/v3.6.8
chore(release): v3.6.8 — Integration & Stability Update
2026-04-18 02:59:02 -03:00
diegosouzapw
71b256aad5 docs(i18n): remove incorrectly translated internal source and reporting folders v3.6.8 2026-04-18 02:57:53 -03:00
diegosouzapw
e5c4e450c0 docs(i18n): sync documentation updates to 32 languages 2026-04-18 02:51:32 -03:00
diegosouzapw
857b692aac test: avoid cooldown retry flake in chat integration 2026-04-18 02:18:23 -03:00
diegosouzapw
738353a0e7 test: stabilize cooldown-aware retry unit 2026-04-18 02:06:13 -03:00
diegosouzapw
4a6e915ebd test: stabilize settings toggles e2e 2026-04-18 01:43:51 -03:00
diegosouzapw
004ed83689 test: fix integration tests resolving limits from CI environments 2026-04-18 00:06:10 -03:00
diegosouzapw
4ea123a2c0 build(next): tighten standalone tracing and ignore runtime fs lookups
Trim standalone output by excluding repository-only directories from Next
file tracing and mark runtime path resolution with turbopackIgnore so
build analysis does not treat host-specific files as bundled assets.

Align the proxy debug toggle with the current change handler signature to
avoid incorrect state transitions during settings updates.
2026-04-17 23:48:37 -03:00
diegosouzapw
c8828b8a42 fix(build): unblock release build and settings state updates
Add targeted TypeScript annotations and module declarations to reduce
type errors in open-sse services, executors, and shared utilities while
temporarily disabling checking in legacy files that still need migration.

Reset stale `.next/standalone` output before isolated builds so release
artifacts are generated from a clean state.

Update the dashboard proxy settings UI to bypass cached settings reads
and immediately roll back debug mode when the PATCH request fails, which
prevents stale data and inconsistent toggle state.
2026-04-17 23:21:02 -03:00
diegosouzapw
3ae6938d1f chore: update CHANGELOG.md with recent fixes 2026-04-17 21:04:30 -03:00