Diego Rodrigues de Sa e Souza
0ecc380928
feat(sse): add nvidia NIM local RPM budget + concurrency cap ( #6846 ) ( #7726 )
...
Phase 1 of client-side quota tracking for NVIDIA NIM (no rate-limit
headers, no usage API):
- Register nvidia in PROVIDER_DEFAULT_RATE_LIMITS (40 RPM sliding
window, matching the documented free-tier note), operator-overridable
via a new ResilienceSettings.providerQuotaOverrides map.
- Per-connection concurrency cap (default 6) via a new
nvidiaConcurrencyGate leaf module wrapping rateLimitSemaphore,
wired into DefaultExecutor.execute().
- Per-model 429 lockout: confirmed already satisfied by #6773 's
passthroughModels flag on the nvidia registry entry (no new code
needed) — added as a regression-guard test instead.
Phase 2 (AIMD adaptive ceiling learning) and Phase 3 (dashboard quota
card + combo-routing headroom preference) are explicitly deferred to
follow-up issues, per the plan's own scope note.
2026-07-19 14:37:18 -03:00
..
2026-07-18 21:19:20 -03:00
2026-07-18 21:19:42 -03:00
2026-07-13 09:12:40 -03:00
2026-07-13 09:12:40 -03:00
2026-07-16 14:13:03 -03:00
2026-07-04 13:00:30 -03:00
2026-07-04 13:00:30 -03:00
2026-07-19 14:37:18 -03:00
2026-07-04 13:00:30 -03:00
2026-07-04 13:00:30 -03:00
2026-07-04 13:00:30 -03:00
2026-07-04 13:00:30 -03:00
2026-07-13 09:12:40 -03:00
2026-07-04 13:00:30 -03:00
2026-07-04 13:00:30 -03:00
2026-06-29 08:40:06 -03:00
2026-07-18 21:19:20 -03:00
2026-06-05 14:20:05 -03:00
2026-07-18 11:33:57 -03:00
2026-07-17 11:32:25 -03:00
2026-06-27 09:07:12 -03:00
2026-07-18 21:19:50 -03:00
2026-06-17 02:43:21 -03:00
2026-06-29 08:40:06 -03:00
2026-07-17 06:12:15 -03:00
2026-06-17 19:26:32 -03:00
2026-07-04 13:00:30 -03:00
2026-06-29 08:40:06 -03:00
2026-05-15 12:51:07 -03:00
2026-07-19 02:31:26 -03:00
2026-07-13 09:12:40 -03:00
2026-07-04 13:00:30 -03:00
2026-07-13 09:12:40 -03:00
2026-06-27 09:07:12 -03:00
2026-07-18 21:18:06 -03:00
2026-07-13 09:12:40 -03:00
2026-07-07 13:14:06 -03:00
2026-07-06 02:25:17 -03:00
2026-07-07 13:14:06 -03:00
2026-06-29 08:40:06 -03:00
2026-07-13 09:12:40 -03:00
2026-07-13 09:12:40 -03:00
2026-07-04 13:00:30 -03:00
2026-07-13 09:12:40 -03:00
2026-07-19 14:37:18 -03:00
2026-05-11 21:49:32 -03:00
2026-07-07 13:14:06 -03:00
2026-07-18 15:17:57 -03:00
2026-07-17 11:32:25 -03:00
2026-07-17 11:31:54 -03:00
2026-07-04 13:00:30 -03:00
2026-07-02 10:47:13 -03:00
2026-06-29 08:40:06 -03:00
2026-07-19 09:39:02 -03:00
2026-07-17 10:40:09 -03:00
2026-07-07 13:14:06 -03:00
2026-07-04 13:00:30 -03:00
2026-07-17 06:55:41 -03:00
2026-07-19 02:34:49 -03:00
2026-07-04 13:00:30 -03:00
2026-07-18 03:16:58 -03:00
2026-07-04 13:00:30 -03:00
2026-07-18 21:19:42 -03:00
2026-06-29 08:40:06 -03:00
2026-05-24 18:05:58 -03:00
2026-05-07 00:01:54 +07:00
2026-07-18 21:19:42 -03:00
2026-07-18 21:19:42 -03:00
2026-07-13 09:12:40 -03:00
2026-06-27 09:07:12 -03:00
2026-07-13 09:12:40 -03:00
2026-07-17 12:09:12 -03:00
2026-07-14 21:13:45 -03:00
2026-07-18 21:19:42 -03:00
2026-07-13 09:12:40 -03:00
2026-05-26 23:51:47 -03:00
2026-04-24 07:00:21 -03:00
2026-07-19 04:26:26 -03:00
2026-07-18 15:14:37 -03:00
2026-07-04 13:00:30 -03:00
2026-06-29 08:40:06 -03:00
2026-06-25 13:17:40 -03:00
2026-03-22 20:29:06 -03:00
2026-07-04 13:00:30 -03:00
2026-07-13 09:12:40 -03:00
2026-07-02 10:47:13 -03:00
2026-05-24 18:05:58 -03:00
2026-07-18 15:13:13 -03:00
2026-07-07 13:14:06 -03:00
2026-07-13 09:12:40 -03:00
2026-07-13 09:12:40 -03:00
2026-06-29 08:40:06 -03:00
2026-06-29 08:40:06 -03:00
2026-06-16 01:00:40 -03:00
2026-06-16 01:00:40 -03:00
2026-05-26 23:51:47 -03:00
2026-07-18 21:18:53 -03:00
2026-07-14 15:40:09 -03:00
2026-07-13 09:12:40 -03:00
2026-07-07 13:14:06 -03:00
2026-06-27 09:07:12 -03:00