Markus Hartung f133704267 test(integration): add general live-test tool for the real "default" combo ...

Temporary WIP commit on this deferred branch — lands in its own separate
PR once the bug-fix extraction batch is done (never bundled into a
bug-fix PR). Unlike liveGeminiShared.ts (provisions its own narrow
2-model Gemini-only combo), this reads the REAL "default" combo
currently configured on the target instance directly from the DB and
exercises every provider/model step in it directly, bypassing combo
routing, so live-test coverage always matches whatever is actually
configured instead of a hardcoded snapshot.

Live-verified against omniroute-beta (seeded with the real 18-model,
5-provider default combo): 14/18 models pass consistently across
non-streaming + streaming Chat Completions and streaming Responses API.
The 4 consistent failures are real external state (cerebras
credits_exhausted, one deprecated openrouter free-tier model), not code
regressions.

(cherry picked from commit c40b13a48fd897259c56f5122e9e57a3dc7654ba)

2026-08-09 01:37:13 -03:00

..

combo-live

Release v3.8.38 (#5078)

2026-06-27 09:07:12 -03:00

combo-matrix

fix(memory): register the sqlite backend on the /api/memory/[id] route — every handler 500'd (#9737) (#9785)

2026-08-08 11:23:45 -03:00

services

Release v3.8.44 (#5925)

2026-07-04 13:00:30 -03:00

_chatPipelineCallLogs.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

_chatPipelineHarness.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

_comboRoutingHarness.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

active-request-completion.test.ts

Release v3.8.43 (#5609)

2026-07-02 10:47:13 -03:00

agent-bridge-bypass-flow.test.ts

test(api): integration tests for agent-bridge routes (F5)

2026-05-28 00:24:48 -03:00

agent-bridge-cert-flow.test.ts

test(api): integration tests for agent-bridge routes (F5)

2026-05-28 00:24:48 -03:00

agent-bridge-mappings.test.ts

test(api): integration tests for agent-bridge routes (F5)

2026-05-28 00:24:48 -03:00

agent-bridge-routes.test.ts

feat(radar): flag-gated signed free-model catalog overlay (#9515)

2026-08-06 05:58:58 -03:00

agent-skills-content.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

agent-skills-discovery.test.ts

Add cliproxy provider exposure controls and manifest injection (#7329)

2026-07-17 03:04:00 -03:00

aihorde-load-test.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

all-statuses-route.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

antigravity-projectid-discovery-persist-8491.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

api-keys.test.ts

Release v3.8.47 (#6569)

2026-07-13 09:12:40 -03:00

api-routes-critical.test.ts

Release v3.8.25 (#3866)

2026-06-15 03:32:11 -03:00

audit-log-level-filter.test.ts

test(compliance): fix audit-log level-filter integration test

2026-06-02 18:38:31 -03:00

batch-e2e-rate-limit.test.ts

Release v3.8.43 (#5609)

2026-07-02 10:47:13 -03:00

batch-processor-escaping.test.ts

Release v3.8.0 (#2073)

2026-05-10 00:55:06 -03:00

chat-pipeline.test.ts

fix(quality): 2 production bugs + 24 unit base-reds + measured gate ceilings (#9529)

2026-08-05 22:52:50 -03:00

chatcore-compression-integration.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

chatcore-context-window-boundary.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

cli-settings-codewhale.test.ts

Release v3.8.44 (#5925)

2026-07-04 13:00:30 -03:00

cli-settings-deepseek-tui.test.ts

feat(cli-tools): add settings handlers for new "custom" configType tools (plan 14 F3)

2026-05-27 22:13:59 -03:00

cli-settings-forge.test.ts

feat(cli-tools): add settings handlers for new "custom" configType tools (plan 14 F3)

2026-05-27 22:13:59 -03:00

cli-settings-grok-build.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

cli-settings-jcode.test.ts

feat(cli-tools): add settings handlers for new "custom" configType tools (plan 14 F3)

2026-05-27 22:13:59 -03:00

cli-settings-letta.test.ts

Release v3.8.47 (#6569)

2026-07-13 09:12:40 -03:00

cli-settings-omp.test.ts

Release v3.8.47 (#6569)

2026-07-13 09:12:40 -03:00

cli-settings-pi.test.ts

feat(cli-tools): add settings handlers for new "custom" configType tools (plan 14 F3)

2026-05-27 22:13:59 -03:00

cli-settings-smelt.test.ts

feat(cli-tools): add settings handlers for new "custom" configType tools (plan 14 F3)

2026-05-27 22:13:59 -03:00

codex-chat-reasoning-http-e2e.test.ts

[v3.8.50] fix(sse): stop fabricating encrypted Codex reasoning summary text (#8807)

2026-08-06 05:23:53 -03:00

combo-failover-e2e.test.ts

Release v3.8.24 (#3747)

2026-06-13 17:27:40 -03:00

combo-provider-exhaustion.test.ts

Release v3.8.24 (#3747)

2026-06-13 17:27:40 -03:00

combo-routing-e2e.test.ts

Release v3.8.33 (#4515)

2026-06-22 03:17:02 -03:00

compression-pipeline.test.ts

fix(analytics): avoid persisting inferred API key ownership

2026-04-30 20:31:00 -03:00

cursor-e2e.test.ts

feat(cursor): vision (image_url) input + tool-commit/output-constraint enhancements (#3104)

2026-06-03 18:24:41 -03:00

files-api.test.ts

Release v3.8.0 (#2073)

2026-05-10 00:55:06 -03:00

fingerprint-expansion.test.ts

Release v3.8.46

2026-07-07 13:14:06 -03:00

free-models-benchmark.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

free-models-tpm-stress.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

freeModelBenchmarkShared.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

gemini-combo-cooldown-wait.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

gemini-large-context-tpm.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

gemini-live-429-classification.test.ts

Release v3.8.23

2026-06-12 23:49:22 -03:00

gemini-malformed-function-call-stream.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

gemini-rate-limit-classification.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

gemini-tool-call-escaping.test.ts

Release v3.8.47 (#6569)

2026-07-13 09:12:40 -03:00

heap-growth.test.ts

Fase 8 · Bloco C — resiliência runtime (chaos + heap-growth + k6 soak) (#3854)

2026-06-14 18:02:08 -03:00

historical-tool-call-leak.test.ts

Release v3.8.43 (#5609)

2026-07-02 10:47:13 -03:00

integration-wiring.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

live-default-combo-workload.test.ts

test(integration): add general live-test tool for the real "default" combo

2026-08-09 01:37:13 -03:00

live-gemini-agentic-loop.test.ts

fix(sse): use brand-neutral keepalive placeholders (#8888)

2026-08-05 23:52:27 -03:00

live-gemini-nonstream.test.ts

Release v3.8.43 (#5609)

2026-07-02 10:47:13 -03:00

live-gemini-workload.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

live-gemini.test.ts

Release v3.8.43 (#5609)

2026-07-02 10:47:13 -03:00

live-ws-startup.test.ts

Release v3.8.28 (#4053)

2026-06-17 19:26:32 -03:00

liveDefaultComboShared.ts

test(integration): add general live-test tool for the real "default" combo

2026-08-09 01:37:13 -03:00

liveGeminiShared.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

llama-cpp-provider.test.ts

Release v3.8.33 (#4515)

2026-06-22 03:17:02 -03:00

manifest-routing.test.ts

Release v3.8.0 (#2073)

2026-05-10 00:55:06 -03:00

memory-embedding-providers.test.ts

feat(memory): add F6 backend REST routes for memory engine redesign (plan 21)

2026-05-28 10:53:55 -03:00

memory-engine-status.test.ts

feat(memory): add F6 backend REST routes for memory engine redesign (plan 21)

2026-05-28 10:53:55 -03:00

memory-pipeline.test.ts

Release v3.8.34 (#4614)

2026-06-23 03:08:29 -03:00

memory-reindex.test.ts

feat(memory): add F6 backend REST routes for memory engine redesign (plan 21)

2026-05-28 10:53:55 -03:00

memory-retrieve-preview.test.ts

feat(memory): add F6 backend REST routes for memory engine redesign (plan 21)

2026-05-28 10:53:55 -03:00

memory-route-put.test.ts

feat(memory): add F6 backend REST routes for memory engine redesign (plan 21)

2026-05-28 10:53:55 -03:00

memory-summarize.test.ts

feat(memory): add F6 backend REST routes for memory engine redesign (plan 21)

2026-05-28 10:53:55 -03:00

mimocode-proxy.integration.test.ts

feat(mimocode): per-account proxy support for multi-account round-robin (#3837)

2026-06-14 21:30:02 -03:00

modelsDevSync.test.ts

chore(release): v3.6.6 — Stabilization (#1241)

2026-04-16 05:26:17 -03:00

monitoring-health-cache.test.ts

feat(api): wire shared admission across LLM routes

2026-08-05 08:44:59 -03:00

newly-enabled-providers.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

obsidian-plugin-e2e.test.ts

fix(ci): hasStandaloneAppBundle dist/->app/ fallback + gate obsidian-plugin e2e

2026-06-03 22:48:24 -03:00

opencode-config-startup.test.ts

fix(opencode): complete generated model limits (#8869)

2026-08-07 20:51:59 -03:00

performance-regression.test.ts

fix(i18n): restore missing UI translations and sync locales (#2767)

2026-05-27 01:54:50 -03:00

pipeline-combo.test.ts

Release v3.8.2 (#2503)

2026-05-23 01:46:59 -03:00

playground-improve-prompt.test.ts

test(playground): integration tests for improve-prompt and presets

2026-05-27 23:08:09 -03:00

playground-presets-crud.test.ts

test(playground): integration tests for improve-prompt and presets

2026-05-27 23:08:09 -03:00

playground-presets-zod.test.ts

test(playground): integration tests for improve-prompt and presets

2026-05-27 23:08:09 -03:00

plugins-lifecycle.test.ts

feat(plugins): plugins framework + per-API-key disable-non-public-models (#3041)

2026-06-01 15:43:55 -03:00

presets-dashboard-auth.test.ts

Release v3.8.47 (#6569)

2026-07-13 09:12:40 -03:00

provider-journey.contract.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

proxy-context-passthrough.test.ts

Release v3.8.23

2026-06-12 23:49:22 -03:00

proxy-pipeline.test.ts

Release v3.8.35 (#4743)

2026-06-23 17:06:18 -03:00

proxy-registry-flow.test.ts

test: fix pre-existing CI failures (flaky quota, proxy bridge, e2e)

2026-06-02 20:29:41 -03:00

qdrant-routes.test.ts

Release v3.8.43 (#5609)

2026-07-02 10:47:13 -03:00

quota-plans-crud.test.ts

fix(quota,i18n): close B26 audit gap on DELETE plan + pt-BR translation

2026-05-28 16:03:30 -03:00

quota-pool-delete-combo-cleanup.test.ts

fix(quota): clean managed combos when deleting pools (#8906)

2026-08-08 12:45:00 -03:00

quota-pool-usage-provider-resolution.test.ts

Release v3.8.24 (#3747)

2026-06-13 17:27:40 -03:00

quota-pools-crud.test.ts

test(integration): cover quota REST routes + error sanitization (B/F8)

2026-05-28 07:50:03 -03:00

quota-pools-usage.test.ts

test(integration): cover quota REST routes + error sanitization (B/F8)

2026-05-28 07:50:03 -03:00

quota-preview.test.ts

test(integration): cover quota REST routes + error sanitization (B/F8)

2026-05-28 07:50:03 -03:00

quota-routes-error-sanitization.test.ts

test(integration): cover quota REST routes + error sanitization (B/F8)

2026-05-28 07:50:03 -03:00

quota-store-settings.test.ts

test(integration): cover quota REST routes + error sanitization (B/F8)

2026-05-28 07:50:03 -03:00

reasoning-routing-pipeline.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

resilience-chaos.test.ts

Fase 8 · Bloco C — resiliência runtime (chaos + heap-growth + k6 soak) (#3854)

2026-06-14 18:02:08 -03:00

resilience-http-e2e.test.ts

fix(release): green v3.8.36 release CI (pack-artifact + resilience keys) (#5029)

2026-06-25 16:38:44 -03:00

search-providers-catalog.test.ts

Release v3.8.49 (#7076)

2026-07-29 15:18:55 -03:00

security-hardening.test.ts

Release v3.8.43 (#5609)

2026-07-02 10:47:13 -03:00

skills-pipeline.test.ts

chore: apply PR 1495 and update changelog

2026-04-21 21:12:29 -03:00

sse-correctness.test.ts

Fase 8 · Bloco B — suíte de correção (property + golden + SSE-correctness) (#3808)

2026-06-14 18:02:51 -03:00

stream-recovery-wiring.test.ts

Release v3.8.43 (#5609)

2026-07-02 10:47:13 -03:00

test-model-compression-off-6240.test.ts

Release v3.8.47 (#6569)

2026-07-13 09:12:40 -03:00

traffic-inspector-capture-modes.test.ts

test(api): integration tests for traffic-inspector routes (F6)

2026-05-28 01:24:33 -03:00

traffic-inspector-error-sanitization.test.ts

test(api): integration tests for traffic-inspector routes (F6)

2026-05-28 01:24:33 -03:00

traffic-inspector-hosts.test.ts

test(api): integration tests for traffic-inspector routes (F6)

2026-05-28 01:24:33 -03:00

traffic-inspector-internal-ingest.test.ts

test(api): integration tests for traffic-inspector routes (F6)

2026-05-28 01:24:33 -03:00

traffic-inspector-localonly.test.ts

test(api): integration tests for traffic-inspector routes (F6)

2026-05-28 01:24:33 -03:00

traffic-inspector-requests.test.ts

test(api): integration tests for traffic-inspector routes (F6)

2026-05-28 01:24:33 -03:00

traffic-inspector-session-requests.test.ts

feat(inspector): add POST /sessions/[id]/requests to persist live snapshots (R5-5 backend half)

2026-05-28 21:43:24 -03:00

traffic-inspector-sessions.test.ts

test(api): integration tests for traffic-inspector routes (F6)

2026-05-28 01:24:33 -03:00

traffic-inspector-ws.test.ts

test(api): integration tests for traffic-inspector routes (F6)

2026-05-28 01:24:33 -03:00

v1-contracts-behavior.test.ts

Release v3.8.46

2026-07-07 13:14:06 -03:00