Diego Rodrigues de Sa e Souza 21c1f540b3 feat(compression): relevance extractive engine — roadmap #7 (#5289) ...

* test(compression): failing tests for relevance engine scorer + apply

* feat(compression): relevance extractive engine — scores sentences against last user query

* test(compression): regression tests for relevance engine review fixes (threshold/multimodal/force-preserve/whitespace/query)

* fix(compression): relevance engine hardening from core review

- overlapThreshold was dead config (|| kept<budget made it unreachable) → real threshold gate
- multimodal: only compress when exactly one text block (was stamping joined text into every block)
- force-preserve sentences are now 'free' (don't consume budget) so they can't starve top-relevance
- preserve inter-sentence whitespace (\n\n survives) instead of flattening to single spaces
- ROOT-CAUSE: stop gating preserve on ultraHeuristic FORCE_PRESERVE_RE — it matches the period
  ending every sentence, so it force-preserved everything (no-op). New SENTENCE_PRESERVE_RE anchors
  on real signals (digits/URL/Error:/code/at-frame/path/key=value), mirroring #17's UNIT_PRESERVE_RE
- core-review suggestion to skip the query message: rejected (self-overlap already protects it;
  skipping would no-op the single-message RAG case) — documented + test updated

* docs(changelog): restore relevance engine bullet (#7, eaten by rebase)

2026-06-29 01:25:41 -03:00

..

fixtures

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

active-combo-dispatch.test.ts

Release v3.8.33 (#4515)

2026-06-22 03:17:02 -03:00

active-combo-integration.test.ts

Release v3.8.33 (#4515)

2026-06-22 03:17:02 -03:00

adaptive-chatcore-source-guard.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

adaptive-compute-target.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

adaptive-panel-target.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

adaptive-resolve-plan.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

adaptive-select-plan-wiring.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

aggressive-fidelity.test.ts

Release v3.8.30 (#4267)

2026-06-20 07:09:43 -03:00

aggressive.test.ts

feat(compression): Phase 3 — aggressive mode with summarization, tool compression, and progressive aging

2026-04-28 16:58:17 +07:00

applycompression-bailout-optin.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

bailout.test.ts

feat(compression): compression engines + async pipeline + Compression Studios (#3848)

2026-06-14 10:45:22 -03:00

benchmark.test.ts

Release v3.8.25 (#3866)

2026-06-15 03:32:11 -03:00

body-adapter.test.ts

fix(compression): support Responses input and expand Spanish rules (#2028)

2026-05-08 17:35:43 -03:00

cachingAware.test.ts

Release v3.8.30 (#4267)

2026-06-20 07:09:43 -03:00

caveman-db.test.ts

Merge release/v3.7.7 into compression phase 2

2026-04-30 17:07:39 -03:00

caveman-dedup.test.ts

feat(compression): wave 2+3 — tests, golden eval, rule fixes, migration

2026-04-27 20:00:08 +07:00

caveman-engine.test.ts

Release v3.8.19 (#3526)

2026-06-09 22:57:12 -03:00

caveman-hedging.test.ts

feat(compression): wave 2+3 — tests, golden eval, rule fixes, migration

2026-04-27 20:00:08 +07:00

caveman-preservation.test.ts

fix: harden security scan findings

2026-05-02 04:51:38 -03:00

caveman-rules.test.ts

fix(compression): address PR review — multi-part msg safety, preservation $& fix, rule name sync, no-op rule removal

2026-04-28 04:20:46 +07:00

caveman-structural.test.ts

feat(compression): wave 2+3 — tests, golden eval, rule fixes, migration

2026-04-27 20:00:08 +07:00

caveman-v379.test.ts

feat(compression): expand caveman parity and MCP metadata compression

2026-05-03 09:14:20 -03:00

cavemanSharedBoundaries.test.ts

feat(compression): add SHARED_BOUNDARIES to caveman output mode prompts

2026-05-14 23:46:57 -03:00

ccr-cross-tenant.test.ts

fix(security): CCR cross-tenant IDOR — scope store per-principal + bound memory (#3859)

2026-06-14 18:02:36 -03:00

ccr-marker-retrieve.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

ccrQuery.test.ts

Release v3.8.39 (#5164)

2026-06-28 06:58:29 -03:00

ccrRanged.test.ts

Release v3.8.39 (#5164)

2026-06-28 06:58:29 -03:00

combos-engine-ui-schema-parity-4955.test.ts

Release v3.8.37 (#5053)

2026-06-26 02:51:06 -03:00

compareRoute.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

compression-aggressive.test.ts

feat(compression): expose rule intensities and track usd savings

2026-05-02 12:57:37 -03:00

compression-benchmark-cli.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

compression-budget-gate.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

compression-combos-db.test.ts

fix(compression): align seeded standard savings combo with stacked default

2026-05-03 15:34:15 -03:00

compression-engines-map-migration.test.ts

Release v3.8.32 (#4418)

2026-06-21 08:56:51 -03:00

compression-header-dispatch.test.ts

Release v3.8.34 (#4614)

2026-06-23 03:08:29 -03:00

compression-preview-api.test.ts

feat(compression): unify config validation and persist MCP savings

2026-05-03 12:38:21 -03:00

compression-preview-auth.test.ts

fix(compression): preserve stacked defaults and secure metadata routes

2026-05-03 14:06:37 -03:00

compression-registry-clear.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

compression-step-streaming.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

compression-tool-cardinality-env.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

compressionAnalytics.test.ts

fix(compression): record no-op compression runs so Stacked is visible in analytics (#4268) (#5277)

2026-06-28 21:53:48 -03:00

compressionAnnotation.test.ts

feat(compression): inline transparency annotation — roadmap #18 (#5284)

2026-06-29 00:24:23 -03:00

compressionChannel.test.ts

feat(compression): compression engines + async pipeline + Compression Studios (#3848)

2026-06-14 10:45:22 -03:00

compressionMcpTools.test.ts

feat(compression): unify config validation and persist MCP savings

2026-05-03 12:38:21 -03:00

context-compression-api.test.ts

feat(compression): unify config validation and persist MCP savings

2026-05-03 12:38:21 -03:00

context-editing-telemetry.test.ts

Release v3.8.28 (#4053)

2026-06-17 19:26:32 -03:00

context-editing.test.ts

Release v3.8.27 (#3968)

2026-06-17 02:43:21 -03:00

db.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

derive-default-plan.test.ts

Release v3.8.32 (#4418)

2026-06-21 08:56:51 -03:00

derived-pipeline-integration.test.ts

Release v3.8.32 (#4418)

2026-06-21 08:56:51 -03:00

diffHelper.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

encoderComparison.test.ts

Release v3.8.39 (#5164)

2026-06-28 06:58:29 -03:00

engine-breakdown-synthesis.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

engine-catalog.test.ts

Release v3.8.32 (#4418)

2026-06-21 08:56:51 -03:00

engine-enabled-toggle.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

engine-registry.test.ts

Release v3.8.27 (#3968)

2026-06-17 02:43:21 -03:00

eval-aggregate.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

eval-corpus.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

eval-cost-meter.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

eval-grader.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

eval-judge.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

eval-report.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

eval-runner.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

eval-savings.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

eval-seed-corpus.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

eval-selftest.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

fidelityCheck.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

fidelityGate.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

fidelityGateStacked.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

fidelityGateTypes.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

fuzzyDedup.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

gcf-benchmark.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

gcf-inline-array-quote.test.ts

Release v3.8.30 (#4267)

2026-06-20 07:09:43 -03:00

golden-eval.test.ts

feat(compression): Phase 3 — aggressive mode with summarization, tool compression, and progressive aging

2026-04-28 16:58:17 +07:00

hard-budget.test.ts

feat(compression): hard-budget mode (compress to ≤ N tokens) — roadmap #17 (#5288)

2026-06-29 01:24:38 -03:00

harness.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

headroom-smartcrusher.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

heatmap-build.test.ts

feat(compression): saliency heatmap in the compression studio — roadmap #13 (#5285)

2026-06-29 00:21:13 -03:00

ionizerEngine.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

ionizerGateSkip.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

ionizerSample.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

language-detect-select.test.ts

Release v3.8.30 (#4267)

2026-06-20 07:09:43 -03:00

language-packs.test.ts

feat(compression): add Indonesian caveman rules and language pack (#3975)

2026-06-16 09:12:35 -03:00

lite.test.ts

Release v3.8.14 (#3340)

2026-06-07 07:20:02 -03:00

llmlingua-failopen.test.ts

Release v3.8.27 (#3968)

2026-06-17 02:43:21 -03:00

llmlingua-model-store.test.ts

Release v3.8.27 (#3968)

2026-06-17 02:43:21 -03:00

llmlingua-ultra-entry.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

llmlingua-worker-resolution.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

llmlingua-worker.test.ts

Release v3.8.27 (#3968)

2026-06-17 02:43:21 -03:00

mcp-accessibility-config.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

mcp-description-compressor.test.ts

feat(compression): expand caveman parity and MCP metadata compression

2026-05-03 09:14:20 -03:00

mcpAccessibility-anchors.test.ts

Release v3.8.30 (#4267)

2026-06-20 07:09:43 -03:00

mcpAccessibility-clamp.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

mcpAccessibility-config-bounds.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

mcpAccessibility.test.ts

feat(mcp): add MCP accessibility-tree smart filter engine

2026-05-14 21:24:05 -03:00

mode-and-pipeline.test.ts

Release v3.8.30 (#4267)

2026-06-20 07:09:43 -03:00

output-styles-apply.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

output-styles-backcompat.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

output-styles-catalog.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

output-styles-config.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

output-styles-wiring.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

outputMode.test.ts

Release v3.8.18 (#3482)

2026-06-09 15:56:24 -03:00

pipeline-integration.test.ts

feat(compression): expand caveman parity and MCP metadata compression

2026-05-03 09:14:20 -03:00

preservation-redos-4795.test.ts

Release v3.8.36 (#4854)

2026-06-25 13:17:40 -03:00

previewRouteBreakdown.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

previewRouteFidelity.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

previewRouteFuzzy.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

previewRouteIonizer.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

previewRoutePipeline.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

previewRouteTokens.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

previewRouteToon.test.ts

Release v3.8.39 (#5164)

2026-06-28 06:58:29 -03:00

progressiveAging.test.ts

feat(compression): Phase 3 — aggressive mode with summarization, tool compression, and progressive aging

2026-04-28 16:58:17 +07:00

quantumLockDetect.test.ts

feat(compression): QuantumLock cache-prefix stabilization (opt-in, default off) (#5260)

2026-06-28 21:59:46 -03:00

quantumLockIntegration.test.ts

feat(compression): QuantumLock cache-prefix stabilization (opt-in, default off) (#5260)

2026-06-28 21:59:46 -03:00

quantumLockStep.test.ts

feat(compression): QuantumLock cache-prefix stabilization (opt-in, default off) (#5260)

2026-06-28 21:59:46 -03:00

relevance-engine.test.ts

feat(compression): relevance extractive engine — roadmap #7 (#5289)

2026-06-29 01:25:41 -03:00

relevance-scorer.test.ts

feat(compression): relevance extractive engine — roadmap #7 (#5289)

2026-06-29 01:25:41 -03:00

resolve-compression-plan.test.ts

Release v3.8.32 (#4418)

2026-06-21 08:56:51 -03:00

result-memo.test.ts

feat(compression): result memoization for deterministic engines (opt-in) — roadmap #21 (#5286)

2026-06-29 00:28:52 -03:00

retrieveRoute.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

retrieveRouteRanged.test.ts

Release v3.8.39 (#5164)

2026-06-28 06:58:29 -03:00

riskGateDetect.test.ts

feat(compression): risk-gate pre-pass — shield sensitive spans from lossy compression (#5243)

2026-06-28 15:26:45 -03:00

riskGateIntegration.test.ts

feat(compression): risk-gate pre-pass — shield sensitive spans from lossy compression (#5243)

2026-06-28 15:26:45 -03:00

riskGateStep.test.ts

feat(compression): risk-gate pre-pass — shield sensitive spans from lossy compression (#5243)

2026-06-28 15:26:45 -03:00

rtk-anthropic-tool-result.test.ts

Release v3.8.32 (#4418)

2026-06-21 08:56:51 -03:00

rtk-cache-control-preserve.test.ts

Release v3.8.33 (#4515)

2026-06-22 03:17:02 -03:00

rtk-code-stripper.test.ts

fix(compression): support Responses input and expand Spanish rules (#2028)

2026-05-08 17:35:43 -03:00

rtk-command-detector.test.ts

feat(compression): composite-command splitter for RTK detection — roadmap #16 (#5283)

2026-06-29 00:16:14 -03:00

rtk-command-samples.test.ts

Release v3.8.28 (#4053)

2026-06-17 19:26:32 -03:00

rtk-comments.test.ts

feat(compression): compression engines + async pipeline + Compression Studios (#3848)

2026-06-14 10:45:22 -03:00

rtk-custom-filters.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

rtk-deduplicator.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

rtk-discover-redos.test.ts

feat(compression): compression engines + async pipeline + Compression Studios (#3848)

2026-06-14 10:45:22 -03:00

rtk-dsl-pipeline.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

rtk-engine.test.ts

feat(compression): expand caveman parity and MCP metadata compression

2026-05-03 09:14:20 -03:00

rtk-file-read-no-truncate-4559.test.ts

Release v3.8.36 (#4854)

2026-06-25 13:17:40 -03:00

rtk-filter-catalog.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

rtk-filter-deduplicate.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

rtk-filter-loader-resilience.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

rtk-filter-redos-guard.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

rtk-grouping-config.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

rtk-grouping.test.ts

feat(compression): compression engines + async pipeline + Compression Studios (#3848)

2026-06-14 10:45:22 -03:00

rtk-intensity.test.ts

Release v3.8.30 (#4267)

2026-06-20 07:09:43 -03:00

rtk-learn.test.ts

feat(compression): compression engines + async pipeline + Compression Studios (#3848)

2026-06-14 10:45:22 -03:00

rtk-line-filter.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

rtk-loader-dir-resolution-5089.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

rtk-raw-output-route.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

rtk-raw-output.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

rtk-render-gitdiff.test.ts

feat(compression): RTK semantic command-output renderers (opt-in) — roadmap #10 (#5268)

2026-06-28 21:58:02 -03:00

rtk-render-table.test.ts

feat(compression): RTK semantic command-output renderers (opt-in) — roadmap #10 (#5268)

2026-06-28 21:58:02 -03:00

rtk-render-terraform.test.ts

feat(compression): RTK semantic command-output renderers (opt-in) — roadmap #10 (#5268)

2026-06-28 21:58:02 -03:00

rtk-render-testgreen.test.ts

feat(compression): RTK semantic command-output renderers (opt-in) — roadmap #10 (#5268)

2026-06-28 21:58:02 -03:00

rtk-renderers-integration.test.ts

feat(compression): RTK semantic command-output renderers (opt-in) — roadmap #10 (#5268)

2026-06-28 21:58:02 -03:00

rtk-smart-truncate.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

rtk-strip-comments.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

rtk-truncate-preserve.test.ts

feat(compression): compression engines + async pipeline + Compression Studios (#3848)

2026-06-14 10:45:22 -03:00

rtk-verify.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

rule-loader.test.ts

feat(compression): expand caveman parity and MCP metadata compression

2026-05-03 09:14:20 -03:00

session-dedup.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

sessionDedupFuzzy.test.ts

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

smartcrusherToon.test.ts

Release v3.8.39 (#5164)

2026-06-28 06:58:29 -03:00

splitCompositeCommand.test.ts

feat(compression): composite-command splitter for RTK detection — roadmap #16 (#5283)

2026-06-29 00:16:14 -03:00

stacked-async.test.ts

feat(compression): compression engines + async pipeline + Compression Studios (#3848)

2026-06-14 10:45:22 -03:00

stats.test.ts

test(compression): add unit and integration tests (61 tests)

2026-04-27 03:53:05 +07:00

strategySelector-cache-aware.test.ts

Release v3.8.30 (#4267)

2026-06-20 07:09:43 -03:00

strategySelector.test.ts

Release v3.8.32 (#4418)

2026-06-21 08:56:51 -03:00

summarizer.test.ts

feat(compression): Phase 3 — aggressive mode with summarization, tool compression, and progressive aging

2026-04-28 16:58:17 +07:00

toolResultCompressor.test.ts

feat(compression): Phase 3 — aggressive mode with summarization, tool compression, and progressive aging

2026-04-28 16:58:17 +07:00

toon.test.ts

Release v3.8.39 (#5164)

2026-06-28 06:58:29 -03:00

types.test.ts

feat(compression): RTK compression roadmap (#1889)

2026-05-03 00:37:08 -03:00

ultra-code-preservation.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

ultra-slm-tier.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

ultra.test.ts

Release v3.8.29 (#4126)

2026-06-19 06:49:01 -03:00

validation.test.ts

fix(core): harden input handling and compression cleanup

2026-05-06 02:29:25 -03:00