Files
OmniRoute/tests/unit/wafRateLimit.test.ts
Praveen K Palaniswamy 65e81158ab fix(ollama): route models by advertised capability (#11088)
Landed with the design call resolved per the owner's pick — **option 1**: the synced store is now endpoint-agnostic (persistDiscoveredModels and managedModelImport no longer drop non-chat models at write time), and chat selectability moved to read time (auto-pool expansion in autoStrategy applies filterChatSelectableModels; the models-route projection already had its chatOnly filter). Your discovery test now passes end-to-end (3/3): /api/show capabilities persist per connection and image/embedding requests route through the advertising host.

Reconciliation notes: conflicted areas merged onto the current tip (adobe discovery import, requestedModel preflight signature, resolvedProvider fast-path coexists with the synced-route override — explicit resolution wins); carried base-red drains (#10055 memoization, #11071 test variants) dropped as already-landed; the managed-model-import exclusion test was propagated to the new contract (image/video models persist; the read filter still hides them from chat pickers — pinned by a new assertion). Full battery: 205/206 focused (the one red is a confirmed periodic-timer timing flake on the loaded devbox — 20/20 isolated), autoCombo vitest 30/30, combo suites 46/46, gates + typecheck clean.

Thank you @yourspraveen — the capability probe + routing design was right; it just needed the store contract opened up. Fixes #11087.
2026-08-23 11:45:01 -03:00

73 lines
2.9 KiB
TypeScript

import test from "node:test";
import assert from "node:assert/strict";
import {
gateOutboundRequest,
configureWafRateLimit,
getWafRateLimitConfig,
resetWafRateLimit,
} from "../../open-sse/services/wafRateLimit.ts";
// #FIX: agentrouter.org's WAF is burst-sensitive. The gate must serialize
// outbound calls per bucket and hold for at least `minGapMs` between calls.
test("first call is immediate (no previous timestamp)", async () => {
resetWafRateLimit();
configureWafRateLimit({ minGapMs: 100 });
const t0 = Date.now();
await gateOutboundRequest("agentrouter:https://example.com/v1/messages");
const elapsed = Date.now() - t0;
assert.ok(elapsed < 50, `first call should be near-instant, was ${elapsed}ms`);
});
test("second call within minGapMs is throttled", async () => {
resetWafRateLimit();
configureWafRateLimit({ minGapMs: 300 });
await gateOutboundRequest("agentrouter:https://example.com/v1/messages");
const t0 = Date.now();
await gateOutboundRequest("agentrouter:https://example.com/v1/messages");
const elapsed = Date.now() - t0;
assert.ok(elapsed >= 250, `second call should wait at least minGapMs, was ${elapsed}ms`);
assert.ok(elapsed < 600, `second call should not wait much longer than minGapMs, was ${elapsed}ms`);
});
test("third call after the gate has been satisfied is not throttled", async () => {
resetWafRateLimit();
configureWafRateLimit({ minGapMs: 100 });
await gateOutboundRequest("agentrouter:https://example.com/v1/messages");
await new Promise((resolve) => setTimeout(resolve, 150));
const t0 = Date.now();
await gateOutboundRequest("agentrouter:https://example.com/v1/messages");
const elapsed = Date.now() - t0;
assert.ok(elapsed < 50, `third call after cooldown should be near-instant, was ${elapsed}ms`);
});
test("buckets are independent", async () => {
resetWafRateLimit();
configureWafRateLimit({ minGapMs: 500 });
await gateOutboundRequest("agentrouter:https://a.example.com/v1/messages");
const t0 = Date.now();
// Different bucket key → independent state → should not be throttled
await gateOutboundRequest("agentrouter:https://b.example.com/v1/messages");
const elapsed = Date.now() - t0;
assert.ok(elapsed < 50, `independent bucket should not be throttled, was ${elapsed}ms`);
});
test("configureWafRateLimit overrides defaults", () => {
resetWafRateLimit();
configureWafRateLimit({ minGapMs: 42 });
const cfg = getWafRateLimitConfig();
assert.equal(cfg.minGapMs, 42);
});
test("resetWafRateLimit clears all bucket state", async () => {
configureWafRateLimit({ minGapMs: 500 });
await gateOutboundRequest("agentrouter:https://example.com/v1/messages");
resetWafRateLimit();
// After reset, the next call should be near-instant
const t0 = Date.now();
await gateOutboundRequest("agentrouter:https://example.com/v1/messages");
const elapsed = Date.now() - t0;
assert.ok(elapsed < 50, `after reset, first call should be immediate, was ${elapsed}ms`);
});