Exports SHARED_BOUNDARIES constant (ported from 9router cavemanPrompts.js)
that instructs the model to write normally for security warnings,
irreversible confirmations, and multi-step sequences, then resume terse
style. Appended to all 6 languages x 3 intensity levels. Polished full/ultra
English prompts with article-drop and short-synonym guidance.
Fixes alreadyApplied check order so SHARED_BOUNDARIES keywords in the
injected system prompt don't trigger a false-positive bypass on re-injection.
Adds compression engine that collapses repeated sibling lines (≥30 items
with same indent + role prefix) into head + summary + tail, preserves
[ref=eXX] anchors required by Playwright/computer-use MCPs, and
hard-truncates oversized text with a navigation hint footer.
Reduces token usage 60-80% on browser snapshots/accessibility trees from
external MCP servers (playwright-mcp, chrome-mcp). Configurable via
settings.compression.mcpAccessibility namespace.
Changes:
- open-sse/services/compression/engines/mcpAccessibility/: new engine
(constants.ts, collapseRepeated.ts, index.ts with smartFilterText)
- open-sse/services/compression/types.ts: re-exports McpAccessibilityConfig
- src/lib/db/compression.ts: getMcpAccessibilityConfig/setMcpAccessibilityConfig
- src/lib/db/migrations/056_mcp_accessibility_compression.sql: default settings
- open-sse/mcp-server/server.ts: apply filter to all tool result text blocks
- tests/unit/compression/mcpAccessibility.test.ts: 4 unit tests
- tests/unit/mcp/serverSmartFilter.test.ts: 4 integration tests (DB getter/setter)
Ref: 9router/src/lib/mcp/stdioSseBridge.js:14-90 (algorithm origin).
Replace regex-based compression artifact cleanup with linear helpers to
avoid pathological backtracking and normalize whitespace safely.
Tighten request and response parsing in assess, Gemini translation, and
executor telemetry to avoid unsafe property access and invalid category
filtering.
Also add managed database backup support for legacy encrypted
connection migration, improve SQLite load error handling, and cover the
regressions with unit tests.
Update the seeded default compression combo to use the RTK then
Caveman pipeline in both fresh installs and upgraded databases.
Add a targeted migration and runtime guard that only rewrites the
legacy seeded record when its original metadata and single-step
pipeline still match, preserving user-customized default combos.
Refresh docs and tests to reflect the stacked default and expanded
RTK filter catalog.
Only apply saved default compression combos when they contain a stacked
pipeline so seeded Caveman-only defaults do not replace the builtin
stacked behavior.
Also require management auth for compression language pack and rules
metadata endpoints, and defer usage receipt attachment until compression
analytics writes have completed to keep analytics records consistent.
Block preview requests unless they come from a valid management session
token so protected settings cannot be probed through the preview API.
Add unit coverage for unauthenticated requests, invalid bearer tokens,
and successful authenticated preview execution.
Centralize compression config schemas across settings, preview, RTK,
and combo APIs to enforce consistent validation for stacked pipelines
and engine-specific options.
Expand caveman and stacked compression behavior by applying default
combos at runtime, surfacing validation and fallback metadata, and
exposing aggressive and ultra adapter schemas for configuration UI and
tests.
Persist MCP description compression snapshots into analytics without
counting them as provider usage, and extend the dashboard with the new
RTK controls and localized labels.
Compress MCP registry and list metadata descriptions for tools, prompts,
resources, and resource templates while keeping tool-response bodies
unchanged. Expose those savings in compression status as
`mcp_metadata_estimate` metadata rather than provider usage.
Add Caveman rule-pack support for custom regex flags and match-specific
replacement maps, update English rules for upstream parity, and tighten
article and pleasantry handling. Also process RTK multipart text blocks
independently so mixed media content compresses safely without
duplicating output.
* chore(rtk): initialize compression roadmap branch
* feat(compression): add RTK engine and compression combos
Introduce RTK command-aware tool-output compression alongside
stacked RTK -> Caveman pipelines for mixed prompt contexts.
Add engine registration, declarative RTK filter packs, language-aware
Caveman rule loading, compression combo persistence and assignments,
analytics grouped by engine/combo, and new MCP/API endpoints for
configuration, previews, filters, and combo management.
Expose the new capabilities in the dashboard with dedicated Context &
Cache pages for Caveman, RTK, and compression combos, and update docs,
i18n strings, migrations, and tests to cover the expanded compression
surface.
* feat(compression): expand RTK DSL, filter catalog, and recovery APIs
Add RTK parity features across the compression pipeline, dashboard,
and management APIs. This expands the built-in filter catalog, adds
trust-gated custom filter loading, inline filter verification, code
stripping, smarter detection, and optional redacted raw-output
retention for authenticated recovery.
Also extend Caveman with file-based multilingual rule packs, localized
output-mode instructions, stricter preview/config schemas, engine
registry metadata, analytics fields, and broad unit test coverage for
RTK, rule loading, and stacked compression behavior.
* fix(auth): protect oauth routes and health reset operations
Require authenticated dashboard access for OAuth endpoints that can
create or import provider connections when login enforcement is
enabled.
Move `/api/monitoring/health` to the readonly public route list so
safe methods remain public while DELETE now returns 401 for anonymous
requests.
Also update Next.js native `.node` handling to avoid webpack parse
failures from external packages such as ngrok and keytar, and add
coverage for the new auth behavior.
* build(compression): ship RTK rule and filter assets with app bundles
Include compression JSON assets in Next output tracing, prepublish copies,
and pack artifact policy checks so standalone and packaged builds can
load RTK filters and caveman rule packs at runtime.
Also harden compression runtime behavior by resolving alternate asset
directories, scoping rule cache entries by source path, carrying RTK raw
output pointers through stacked runs, degrading oversized preview diffs,
and applying combo language/output mode defaults during chat routing.
Add coverage for packaging rules, provider-scoped model parsing, smart
truncate edge cases, raw output retention, and combo-driven compression
behavior.
* docs(workflows): update local repo paths to OmniRoute
Replace outdated `/home/diegosouzapw/dev/proxys/9router` references
with the current `OmniRoute` directory across deploy, release, and
version bump workflow guides so local command examples match the
renamed repository layout
* feat(compression): complete RTK parity coverage
* test(build): align next config assertions
---------
Co-authored-by: diegosouzapw <diego.souza.pw@gmail.com>
Add estimated USD savings to compression analytics so saved tokens can
be reported in cost terms alongside existing token metrics.
Expose caveman rule intensity metadata for settings consumers and add a
settings API route alias for rule lookup. Also preserve system prompts
when aggressive compression falls back to lite mode.
Add caveman intensity levels, output mode instructions, validation, and
preview diffs across the compression pipeline.
Extend MCP and dashboard settings to support auto-trigger mode, system
prompt preservation, MCP description compression, and caveman rule
metadata. Record richer compression analytics with receipt fields,
validation fallbacks, output mode data, and add the related database
migration.
Improve preservation handling for code, URLs, markdown, math, and other
protected content while adding broad unit, integration, and golden-set
coverage for caveman parity and compression behavior.
Stop usage analytics reads from backfilling missing API key attribution
into historical rows so legacy records remain unchanged and surface as
unknown instead of guessed ownership.
Also require management authentication on admin concurrency and
compression analytics endpoints, and preserve image payloads during lite
compression unless a model is explicitly marked as non-vision.
- Add compressionModeUltra, compressionModeUltraDesc, compressionAnalyticsTitle,
compressionAnalyticsDescription keys to all 32 locale files
- Fix missing trailing comma after comboHealthDescription in all non-en locales
- Add compressionAnalytics unit tests (10/10 passing) with beforeEach isolation
4 fixes from Gemini Code Assist PR #1689 review:
1. HIGH: Multi-part message content duplication — skip array-content
messages instead of joining+replacing all text parts with compressed
result, which caused content duplication (e.g., [A,B] → [comp(A+B), comp(A+B)])
2. HIGH: String.prototype.replace $& vulnerability — use arrow function
callback instead of string arg in restorePreservedBlocks() to prevent
special replacement patterns ($&, , etc.) from corrupting restored
content containing code, URLs, or file paths
3. HIGH: UI/backend rule name mismatch — ALL_CAVEMAN_RULES in
CompressionSettingsTab.tsx now uses actual backend rule names
(polite_framing, hedging, verbose_instructions, etc.) instead of
fabricated names (hedging_disclaimer, redundant_please, etc.)
that would break the skip-rules feature
4. MEDIUM: Remove no-op turn_marker rule — pattern /^$/g matches only
empty strings and replaces with empty string, achieving nothing.
Removed from CAVEMAN_RULES; total count now 29 (was 30).
Tests: 72/72 pass, typecheck: 0 errors, lint: 0 errors
- Fix question_to_directive rule: trim trailing whitespace before lookup
- Fix DB import path: correct relative path from src/lib/db to open-sse
- Add test DB cleanup beforeEach for isolation
- Add 4 unit test files: caveman-db, hedging, dedup, structural (28 tests)
- Add golden set quality test (4 tests, 99.3% key phrase preservation)
- Add golden set savings test (3 tests, performance + savings verification)
- Add golden set data (20 verbose coding prompts with key phrases)
- Add migration 028 for new test suite acknowledgment
67 tests pass across 9 files. typecheck:core clean.
Add unit tests for strategy selector (17), lite compression (20), stats module (11), and DB module (7). Add integration tests for full compression pipeline (6). All 61 tests pass. Remove broken integration test files from previous WIP.
Ultraworked with [Sisyphus](https://github.com/code-yeongyu/oh-my-opencode)
Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
