Commit Graph

7 Commits

Author SHA1 Message Date
oyi77
ce3e4ba618 feat(i18n): add compression analytics + ultra mode keys to all 32 locales
- Add compressionModeUltra, compressionModeUltraDesc, compressionAnalyticsTitle,
  compressionAnalyticsDescription keys to all 32 locale files
- Fix missing trailing comma after comboHealthDescription in all non-en locales
- Add compressionAnalytics unit tests (10/10 passing) with beforeEach isolation
2026-04-29 12:01:22 +07:00
oyi77
8053ebe798 feat(compression): Phase 4 — ultra mode with heuristic token pruning and SLM stub 2026-04-29 01:28:36 +07:00
oyi77
6bf7b9601d feat(compression): Phase 3 — aggressive mode with summarization, tool compression, and progressive aging
Implements the aggressive compression pipeline (issue #1588) with three
core stages: tool-result compression, progressive aging, and rule-based
summarization. Includes downgrade chain to caveman/lite when savings are
insufficient.

Core modules:
- summarizer.ts: RuleBasedSummarizer with intent/file/error/decision
  extraction, code fence trimming, skip-already-compressed guard
- toolResultCompressor.ts: 5 auto-detected strategies (fileContent,
  grepSearch, shellOutput, json, errorMessage) with toggle support
- progressiveAging.ts: 4-tier degradation (verbatim→light→moderate→
  fullSummary) with [COMPRESSED:aging:<tier>] markers
- aggressive.ts: Orchestrator with 3-step pipeline and downgrade chain
  (aggressive→caveman→lite→as-is)

Integration:
- strategySelector.ts: applyCompression() now dispatches mode='aggressive'
- compression.ts: aggressiveConfig CRUD with deep merge of nested objects
- API route: Zod schema for aggressiveConfig thresholds/strategies
- CompressionSettingsTab: aggressive mode card, thresholds, toggles, i18n
- Migration 031: SELECT 1 no-op (config stored as kv key)

Tests: 109 across 8 files (types, summarizer, toolResultCompressor,
progressiveAging, aggressive, integration, golden eval, caveman regression)
All pass. Typecheck clean. Lint clean (0 errors). Build succeeds.
2026-04-28 16:58:17 +07:00
oyi77
819c0762b9 fix(compression): address PR review — multi-part msg safety, preservation $& fix, rule name sync, no-op rule removal
4 fixes from Gemini Code Assist PR #1689 review:

1. HIGH: Multi-part message content duplication — skip array-content
   messages instead of joining+replacing all text parts with compressed
   result, which caused content duplication (e.g., [A,B] → [comp(A+B), comp(A+B)])

2. HIGH: String.prototype.replace $& vulnerability — use arrow function
   callback instead of string arg in restorePreservedBlocks() to prevent
   special replacement patterns ($&, , etc.) from corrupting restored
   content containing code, URLs, or file paths

3. HIGH: UI/backend rule name mismatch — ALL_CAVEMAN_RULES in
   CompressionSettingsTab.tsx now uses actual backend rule names
   (polite_framing, hedging, verbose_instructions, etc.) instead of
   fabricated names (hedging_disclaimer, redundant_please, etc.)
   that would break the skip-rules feature

4. MEDIUM: Remove no-op turn_marker rule — pattern /^$/g matches only
   empty strings and replaces with empty string, achieving nothing.
   Removed from CAVEMAN_RULES; total count now 29 (was 30).

Tests: 72/72 pass, typecheck: 0 errors, lint: 0 errors
2026-04-28 04:20:46 +07:00
oyi77
88dbefa141 feat(compression): reconcile Phase 2 with Phase 1 API surface
- Use 'standard' mode (not 'caveman') in CompressionMode type
- Align CompressionConfig with Phase 1 shape (enabled, defaultMode,
  autoTriggerTokens, cacheMinutes, preserveSystemPrompt, comboOverrides)
- Extend CompressionStats with techniquesUsed + rulesApplied + durationMs
- Make CompressionResult.stats nullable (Phase 1 compat)
- Add Phase 1 functions: estimateCompressionTokens, createCompressionStats,
  trackCompressionStats, selectCompressionStrategy, applyCompression,
  checkComboOverride, shouldAutoTrigger, getEffectiveMode
- Add lite.ts stub for Phase 1 'lite' compression mode
- Add index.ts barrel file for full module export
- Fix DB compression.ts to return Phase 1 CompressionConfig shape
- Fix chatCore.ts to use unified compression pipeline
  (selectCompressionStrategy + applyCompression)
- Add backwards-compatible estimateTokensForStats alias
- Renumber migration 028 → 030 (Phase 1 uses 028)
- Update all tests for reconciled API (67/67 pass)
2026-04-28 00:25:45 +07:00
oyi77
b1e13668f2 feat(compression): wave 2+3 — tests, golden eval, rule fixes, migration
- Fix question_to_directive rule: trim trailing whitespace before lookup
- Fix DB import path: correct relative path from src/lib/db to open-sse
- Add test DB cleanup beforeEach for isolation
- Add 4 unit test files: caveman-db, hedging, dedup, structural (28 tests)
- Add golden set quality test (4 tests, 99.3% key phrase preservation)
- Add golden set savings test (3 tests, performance + savings verification)
- Add golden set data (20 verbose coding prompts with key phrases)
- Add migration 028 for new test suite acknowledgment

67 tests pass across 9 files. typecheck:core clean.
2026-04-27 20:00:08 +07:00
oyi77
b5f6bea880 feat(compression): implement caveman compression engine — Wave 1 complete
- CavemanConfig types and interfaces (types.ts)
- 30 compression rules across 4 categories (cavemanRules.ts)
- Core 5-step compression pipeline (caveman.ts)
- Code block / URL / path preservation (preservation.ts)
- Strategy selector with caveman dispatch (strategySelector.ts)
- Stats tracking module (stats.ts)
- DB settings module (compression.ts)
- Unit tests: 36 tests, 0 failures
- Typecheck: 0 errors, Lint: 0 errors

Implements: GitHub issue #1587 (Phase 2)
2026-04-27 18:31:46 +07:00