Files
OmniRoute/tests
Rafael Dias Zendron a5e5e88092 fix: DDG circuit breaker (#6999) + null content validation (#7000) (#7001)
* feat(6922): register effort-tier aliases for glm-5.2 & mimo-v2.5 on opencode-go

Previously only deepseek-v4-pro had effort-tier aliases on the opencode-go
provider. GLM-5.2 and MiMo-V2.5 only had base model ids, making it impossible
to pin reasoning effort per combo target.

Changes:
- Generalize parseDeepSeekEffortLevel → parseEffortLevel with EFFORT_TIERS table
- deepseek-v4-pro: low/medium/high/max (unchanged)
- glm-5.2: high/max only (OpenAI transport; low/medium not supported)
- mimo-v2.5: high/max only (same reasoning)
- Register alias model ids in opencode-go registry
- Mark base models supportsReasoning: true
- 9 unit tests covering registry + executor + backward compat

Closes #6922

* ci: retrigger CI for Electron Package Smoke flaky test

* ci: retrigger flaky Electron Package Smoke

* test(#6922): rewrite tests to call real parseEffortLevel function

- Export parseEffortLevel from opencode.ts so tests can import it
- Replace grep-on-source-file assertions with real function calls
- 13 tests: 4 deepseek tiers + 2 glm-5.2 tiers + 2 mimo-v2.5 tiers
  + 5 negative cases (unknown model, unsupported tiers, empty, base-only)
- Remove dependency on readFileSync / string matching

* fix: DDG circuit breaker (#6999) + null content validation (#7000)

#6999: Add lightweight circuit breaker to DuckDuckGo executor.
After 5 consecutive failures (429, 5xx, network errors), the breaker
opens for 30s — during that window every request fast-fails with 503
so the combo engine can immediately fail over to the next provider
instead of waiting for timeouts. Half-open probing happens naturally
once the cooldown expires. A single success resets the counter.

#7000: Fix false positive in validateResponseQuality where multimodal
content arrays (empty []) and whitespace-only strings passed as valid.
Now properly validates: arrays must have >=1 non-empty part; strings
must have non-zero trimmed length.

* test: add regression tests for DDG circuit breaker (#6999) and null content validation (#7000)

- Circuit breaker: verifies 400 for empty messages is unaffected by CB state,
  and that CB starts closed (no 503 on first request)
- Null content (#7000): verifies validateResponseQuality correctly flags
  null content, empty array content [] as invalid, and array with text as valid

* fix(ci): add ddg-circuit-breaker test to stryker tap.testFiles for mutation coverage gate

* test(#6999): exercise the DDG circuit breaker state machine directly

The existing "circuit breaker fast-fails with 503 after consecutive
failures" test never actually drives 5 consecutive failures — it makes a
single real network call and only asserts the response isn't 503, which
passes whether or not the breaker logic works at all (confirmed by
disabling the open-threshold check entirely: that test stayed green).

Exports cbIsOpen/cbRecordFailure/cbRecordSuccess/CB_THRESHOLD/
CB_COOLDOWN_MS (previously module-private) plus two test-only helpers
(__setDdgCircuitBreakerStateForTests/__getDdgCircuitBreakerStateForTests,
following the __xxxForTests convention already used in
src/shared/utils/circuitBreaker.ts) so tests can drive the module-level
singleton directly instead of needing a full network mock through
warmSession/seedChallengeChain/acquireAuthHeaders, and without waiting
CB_COOLDOWN_MS=30s in real time for the half-open case.

New tests cover: starts closed; opens on the CB_THRESHOLD-th consecutive
failure (not before); execute() fast-fails with 503 while open without
reaching the network (verified: disabling the cbIsOpen() gate makes the
same test fall through to a real network call, ~1s slower and red);
still open just before cooldown elapses; self-closes once cooldown has
elapsed (half-open); cbRecordSuccess resets the counter.

Red-first proof (both independently green->red->restored-green):
1. `if (false && failures >= CB_THRESHOLD ...)` — neuters the open
   transition. Result: the new "opens after CB_THRESHOLD..." test fails;
   the pre-existing weak test stays green regardless.
2. `if (false && cbIsOpen())` — neuters the execute() gate. Result: the
   new "execute() fast-fails with 503 while open" test fails (and takes
   ~1s longer, falling through to a real network attempt instead of
   short-circuiting).

Co-authored-by: diegosouzapw <8016841+diegosouzapw@users.noreply.github.com>

---------

Co-authored-by: diegosouzapw <8016841+diegosouzapw@users.noreply.github.com>
2026-07-18 15:17:57 -03:00
..
2026-05-23 01:46:59 -03:00
2026-07-13 09:12:40 -03:00
2026-07-02 10:47:13 -03:00
2026-07-06 02:25:17 -03:00
2026-07-13 09:12:40 -03:00
2026-06-13 17:27:40 -03:00