Commit Graph

39 Commits

Author SHA1 Message Date
Diego Rodrigues de Sa e Souza
c922b21102 fix(quota): cota exclusiva lista qtSd/ no /v1/models (#4806) + limite EPSILON não bloqueia (#4830)
Integrated into release/v3.8.36 — quota-exclusive qtSd/ listing (#4806) + EPSILON placeholder no longer blocks; rebuilt from stale base (3 defining commits cherry-picked clean over release tip)
2026-06-23 20:17:09 -03:00
Diego Rodrigues de Sa e Souza
76a07cf7a5 Release v3.8.24 (#3747)
Release v3.8.24 — see CHANGELOG.md [3.8.24] for the full notes and the PR description for the contributors hall. Integration of release/v3.8.24 into main.
2026-06-13 17:27:40 -03:00
diegosouzapw
5bebf0e53c fix(quota,sse): clear SonarCloud new-reliability findings on the v3.8.12 diff
- chipotle/grokTls: explicit null checks instead of a Promise in a boolean
  conditional (behavior-preserving; clears the 2 MAJOR reliability bugs)
- sqliteQuotaStore.poolUsage: drop the unreachable dimMap scan loops (dimMap
  was never populated) — the lightweight snapshot already returns no
  dimensions; poolUsageWithDimensions() is the plan-aware path
- BudgetTab: presentation role + keyboard handler on the checkbox wrapper
2026-06-06 06:49:46 -03:00
Paijo
1c8f3bee97 fix(quota): resolve poolUsage dead code, burn rate, saturation signals, webhooks, and embeddings enforcement (#3280)
Integrated into release/v3.8.12. Quota Sharing Engine fixes: poolUsageWithDimensions promoted to the QuotaStore interface, single-snapshot burn rate, zero-weight normalization, Anthropic saturation signals, quota.exceeded webhook on block, and embeddings enforcement. Validated: 10/10 PR tests + 34 quota/embedding regression files green, typecheck + lint clean. Dropped the committed .omo/ agent-tooling artifacts.
2026-06-06 03:41:03 -03:00
diegosouzapw
512e980a9e feat(quota): xiaomi monthly cap + deepseek USD preset; researched plan tiers
- xiaomi-mimo: token plan is MONTHLY (per platform.xiaomimimo.com/token-plan), so
  the seed is now tokens/monthly/4.1B (was weekly).
- deepseek: prepaid in USD — its balance API is already wired (deepseekQuotaFetcher)
  and the fair-share engine supports the usd unit (COUNTABLE_UNITS). Seeded a
  usd/monthly preset so the limit is set by dollar value.
- minimax: documented the real M3 tiers (Plus ~1.633B/Max ~5.053B/Ultra ~9.796B)
  in-comment; EPSILON keeps it manual until tier-aware presets land.
- planRegistry already seeds codex/claude/glm/minimax/kimi/kimi-coding/xiaomi-mimo/
  deepseek/bailian/alibaba; PoolWizard 'Limite' step stays editable.

Researched plan structures + the tier-aware-preset follow-up are in the redesign plan.
2026-06-02 05:17:20 -03:00
diegosouzapw
f8c1213722 feat(quota): seed claude plan preset (percent 5h+weekly) in planRegistry
Claude Code (Pro/Max) is a percentage-of-plan quota (5h rolling + weekly cap,
shared Claude+Code); exact token caps are unpublished/task-variable so percent is
the practical unit. Unblocks the PoolWizard 'Limite' pre-fill for claude pools.
Researched plan structures (codex/claude/glm/kimi/minimax/xiaomi) captured in the
quota-share redesign plan.
2026-06-02 05:06:34 -03:00
diegosouzapw
831f82858f feat(quota-share): beta banner, Responses + codex-WS endpoints in card, plan presets
- Beta banner scoped to the Quota Share page (functional-but-bugs-expected) with a
  pre-filled "open an issue" link (labels quota-share,beta). Page-only.
- Endpoints card now also surfaces POST /v1/responses (codex/github) and the
  codex-only WS /v1/responses line (the Responses-over-WebSocket proxy), each gated
  on the in-scope provider slug.
- planRegistry: seed xiaomi-mimo (4.1B-token weekly "lite" cap) and kimi-coding so the
  PoolWizard "Limite" step pre-fills a fair-share limit for these no-balance-API
  providers (fair-share enforces from the proxy's own token count, not an upstream
  balance — set the real cap manually in step 2).
- docs(API_REFERENCE): document the codex Responses-over-WebSocket endpoint.
- i18n en/pt-BR for all new keys.

Tracked in _tasks/features-v3.8.8/quota-share-key-redesign.plan.md (codex-WS config
toggle + per-provider balance fetchers + %-quota attribution are planned follow-ups).
2026-06-02 05:02:52 -03:00
diegosouzapw
e9cc53b17f feat(quota): key scope + /v1/models expand to the whole group (real group)
- `getPoolsByGroup(groupId)` in quotaPools.ts: SELECT all pools for a group,
  exposed as public API and re-exported from localDb.ts.
- `resolveQuotaKeyScope`: pool → group → all pools in group expansion.
  The returned `poolSlugs` field now holds GROUP slugs (quotaGroupSlug of the
  group name) instead of individual pool-name slugs, one per distinct group.
  Group slug included only when the group has ≥1 valid connection (group-level
  anyValidConnection gate). Deduplication: a key in 2 pools of the same group
  expands once.
- `filterModelsToQuotaPools` (quotaCombos.ts): already matches by
  `parsed.groupSlug` ∈ poolSlugs — no logic change needed, just test alignment.
- quota-key-resolve.test.ts: updated 4 tests that asserted pool-name slugs
  (testpoola2, poolmix, etc.) to assert the group slug ("groupdemo") — this is
  alignment to the B5 group semantics, not masking; the assertions were correct
  for the old pool-slug behavior and are now correct for the new group-slug
  behavior.
- quota-catalog-filter.test.ts: updated fixtures from old quotaShared-* format
  to qtSd/<groupSlug>/... (naming changed in B3, test was already broken before B5).
2026-05-31 19:15:16 -03:00
diegosouzapw
fc6692925e feat(quota): group-aware quotaShared combos (qtSd/<group>/...) with provider-scoped prune
- resolvePoolForSync now resolves groupName via getGroupName(pool.groupId),
  falling back to pool.name when the group record is missing.
- Both quotaModelName calls in syncQuotaCombos use groupName instead of
  pool.name, so combos are named qtSd/<groupSlug>/<provider>/<model>.
- Prune is now scoped to group+provider: syncing pool A (openrouter) never
  deletes pool B (baidu) combos that share the same group.
- removeQuotaCombosForPool likewise scoped to group+provider.
- Updated quota-combos-sync, quota-combo-balancing, quota-combo-cli-providers
  tests for the new group-slug naming.
- New tests/unit/quota-combo-groups.test.ts: G1–G4 cover two-pool same-group
  naming, provider-scoped prune isolation, default-group fallback, and stale
  prune within the same group+provider.
2026-05-31 19:02:32 -03:00
diegosouzapw
cb1a18fa1a feat(quota): qtSd/<group>/<provider>/<model> model naming
Replace the old quotaShared-<poolSlug>-<provider>/<model> format with
qtSd/<groupSlug>/<provider>/<model>. Adds quotaGroupSlug() as the canonical
helper; keeps quotaPoolSlug() as a delegating alias so existing callers
(quotaKey.ts, quotaCombos.ts) compile without changes. parseQuotaModelName
now returns { groupSlug, provider, model }. Updates quotaCombos.ts,
apiKeyPolicy.ts, and all tests that referenced the old field name or the
old hardcoded prefix literal.
2026-05-31 18:48:41 -03:00
diegosouzapw
ddd129f3f9 fix(quota): block per-key overage for countable units (real pool-total consumed)
Replace the saturation-signal approximation (globalUsedPercent × effectiveLimit,
which is always 0 for requests/tokens/usd) with store.poolConsumedTotal() so
the pool actually saturates and enforceQuotaShare returns "block" when the pool
total hits the effective limit for countable dimensions.

"percent" dimensions continue to use the upstream saturation signal, which is
the authoritative measure for provider-reported utilisation windows.
2026-05-31 18:15:11 -03:00
diegosouzapw
abb77879db feat(quota): QuotaStore.poolConsumedTotal — pool aggregate per dimension
Add poolConsumedTotal(poolId, dim) to the QuotaStore interface and implement
it in both SqliteQuotaStore and RedisQuotaStore so the enforce path can read
the real pool-wide consumption (sum across all keys) rather than the per-key
saturation signal, which is 0 for countable units and therefore never blocks.

- db/quotaConsumption.ts: add sumPoolDimension() — single SQL COALESCE(SUM)
  for curr and prev buckets across all api_key_id rows for a dimensionKey.
- localDb.ts: re-export sumPoolDimension.
- quota/types.ts: add poolConsumedTotal to QuotaStore interface (with JSDoc).
- sqliteQuotaStore.ts: implement using sumPoolDimension + existing
  slidingWindowEffective helper — one consistent sliding-window read.
- redisQuotaStore.ts: implement by fetching pool allocations from SQLite (F2),
  then issuing a single MGET for all (key, curr-bucket) and (key, prev-bucket)
  Redis keys, summing raw values, and applying the sliding-window formula once.
- tests/unit/quota-store-pool-total.test.ts: 4 tests (sum, pool isolation,
  unit isolation, peek-no-regression) all passing.
2026-05-31 17:57:02 -03:00
diegosouzapw
be77a03aa0 fix(quota): await getQuotaStore() in enforce — quota never enforced/recorded (fail-open)
getQuotaStore() is async; enforce.ts used it without await, so store was a Promise
and store.peek/store.consume threw 'not a function' → enforceQuotaShare failed open
on every request and recordConsumption never wrote. Production quota was a silent
no-op (unit tests passed because they inject a sync mock store). Await it + guard.
2026-05-31 17:20:10 -03:00
diegosouzapw
5acf6bd9cd feat(quota): default to equal split when allocation weights are unset (runtime + UI)
Runtime (enforce.ts): compute effectiveWeight = 100/N for each key when the
pool's total weight is 0, so pools with all-zero weights (newly created via
UI) are usable immediately without a re-save. Original non-zero weights are
unchanged.

UI (PoolWizard, EditAllocationsModal): addKey now recomputes all weights to
an equal split after adding a key, so saved pools store equal weights and
never persist all-zero allocations.

Tests: tests/unit/quota-equal-split.test.ts (7 scenarios).
2026-05-31 15:16:55 -03:00
diegosouzapw
99f615c7e0 fix(quota): generate quotaShared-* combos for CLI/OAuth providers (use REGISTRY not PROVIDER_MODELS)
getProviderModelIds read PROVIDER_MODELS, which is empty for CLI/OAuth providers
(codex, kimi, claude, …) — so pools built from those providers produced ZERO
quotaShared-* combos and their quota keys saw no models. Read the provider REGISTRY
instead (the same source /v1/models uses), which covers all providers.
2026-05-31 13:03:44 -03:00
diegosouzapw
d490a30b58 feat(quota): pool budget = per-account limit × account count (summed balde)
A pool with N same-type connections now has an effective budget of
perAccountLimit × N per dimension. Only the limit fed to fair-share
scales — consumption (pool-keyed shared bucket) is unchanged.
2026-05-31 11:09:25 -03:00
diegosouzapw
4157fbe7a9 feat(quota): balance + failover across same-provider accounts (N-step fill-first combo)
Replace the (connId × modelId) upsert loop in syncQuotaCombos with a
model-grouped build: one combo per model with ALL connections as steps
and strategy "fill-first", fixing the collision where a second same-provider
connection overwrote the first (last upsert won, only one account ever used).
2026-05-31 11:02:18 -03:00
diegosouzapw
d07d3dcdaf fix(quota): orphan pool (no valid connection) must not contribute its slug to key scope
D2 moved poolSlug collection outside the connection loop, so a pool whose only
connection was deleted still leaked its slug into resolveQuotaKeyScope — that
slug has no quotaShared-* models behind it. Gate the slug on >=1 valid member
connection (restores Phase-A2 behavior for multi-connection pools).
2026-05-31 01:36:53 -03:00
diegosouzapw
e5a624d0ec feat(quota): propagate N pool connections through scope, combos, enforce (Phase D2)
- quotaKey.ts (resolveQuotaKeyScope): iterate pool.connectionIds (fall back to
  [connectionId] for un-backfilled rows); each connection contributes its own
  connId + provider to the scope. poolSlugs logic unchanged (one slug per pool).
- quotaCombos.ts (syncQuotaCombos): replace single-connection resolvePoolProvider
  with resolvePoolForSync that returns all connectionIds; iterate each connId to
  build the desiredNames union across all providers; upsert combos pinned to the
  CORRECT per-connection connId; prune against the full union so only truly stale
  combos (no longer produced by any current connection) are deleted.
- enforce.ts (enforceQuotaShare + recordConsumption): both pool-matching loops
  changed from equality (p.connectionId === input.connectionId) to membership
  (p.connectionIds.includes) with fallback for un-backfilled rows. Fail-open
  (B16) and pool-level dimension key semantics are preserved unchanged.
- quotaPools.ts: no logic change needed — connectionIds already flows through
  getPool (D1); syncQuotaCombosGuarded passes poolId and syncQuotaCombos
  resolves the full QuotaPool internally.
- tests/unit/quota-multiprovider.test.ts: 6 new tests covering D2 (scope,
  enforce primary/secondary membership, combos 2-provider create + prune).
  All 22 tests pass (14 new + 8 existing enforce + pool-connections suites).
2026-05-30 22:44:50 -03:00
diegosouzapw
6a14c31280 feat(quota): reconcile key allowedQuotas when pool allocations saved as exclusive (Phase C3) 2026-05-30 21:56:05 -03:00
diegosouzapw
3742afcd64 feat(quota): /v1/models lists only quotaShared-* models for quota-exclusive keys (Phase B3) 2026-05-30 21:41:13 -03:00
diegosouzapw
78c5a30cf9 feat(quota): restrict quota-exclusive keys to their quotaShared-* models (Phase B4) 2026-05-30 21:35:41 -03:00
diegosouzapw
49f6092099 feat(quota): auto-sync quotaShared-* combos on pool allocation changes (Phase B2)
Mints one combo per model of the pool's provider when a quota pool is
created/updated/reallocated, and prunes stale quota combos on deletion.
2026-05-30 21:23:08 -03:00
diegosouzapw
6214ea6768 feat(quota): add quotaShared-* virtual model naming helpers (Phase B1) 2026-05-30 21:12:30 -03:00
diegosouzapw
a921300a53 feat(quota): force quota-exclusive keys onto pool connection in account selection (Phase A4) 2026-05-30 21:00:36 -03:00
diegosouzapw
c29d6ed7a4 feat(quota): add resolveQuotaKeyScope helper (Phase A2)
Introduces src/lib/quota/quotaKey.ts with resolveQuotaKeyScope(), a
pure async helper that maps an API key's allowedQuotas pool-ID list to
the concrete connectionIds and provider slugs it is permitted to use.
Covers empty/null/undefined input, missing pools, orphaned connectionIds,
and multi-pool deduplication. No behaviour change to existing code paths.
2026-05-30 20:40:33 -03:00
diegosouzapw
5b56704538 fix(quota): audit-discovered stale eslint-disable in planResolver + sidebar-costs-section test drift (B/F10) 2026-05-28 10:42:12 -03:00
diegosouzapw
0181348cee feat(quota): add spendRecorder fire-and-forget wrapper (B/F7)
scheduleRecordConsumption() wraps recordConsumption() in setImmediate so it
never adds latency to the client response path. Errors are caught and logged
via pino warn but NEVER propagated to the caller (B29 fail-open contract).
2026-05-27 22:17:16 -03:00
diegosouzapw
d80e1b63eb feat(quota): add enforce.ts (enforceQuotaShare + recordConsumption) (B/F7)
Implements the quota share enforcement gate and consumption recorder:
- enforceQuotaShare(): PRE-request check that returns allow/block/deprioritize
  based on fair-share algorithm, saturation signals, and pool allocations.
- recordConsumption(): POST-response tracker that increments per-key counters
  for each active plan dimension.
Both functions fail-open per B16/B29: any infra error → allow + warn log.
2026-05-27 22:17:10 -03:00
diegosouzapw
4d825ad482 feat(quota): add saturationSignals reader with 30s cache and fail-open (B/F6) 2026-05-27 20:38:41 -03:00
diegosouzapw
23f5b6f8b8 feat(quota): add planResolver (DB override > known catalog > empty) (B/F6) 2026-05-27 20:38:33 -03:00
diegosouzapw
c3c0817c3b feat(quota): add burnRate EMA estimator and time-to-exhaustion (B/F6) 2026-05-27 20:38:25 -03:00
diegosouzapw
9905d92244 feat(quota): add fairShare work-conserving algorithm (multi-dimension, generous/strict modes, cap-absolute) (B/F6) 2026-05-27 20:38:18 -03:00
diegosouzapw
67548034be feat(quota): add storeFactory with setting/env-driven driver selection (B/F6) 2026-05-27 20:38:11 -03:00
diegosouzapw
4bb44b10d3 feat(quota): add redisQuotaStore (optional driver, gated by ioredis availability) (B/F6) 2026-05-27 20:38:02 -03:00
diegosouzapw
ca85652bab feat(quota): add sqliteQuotaStore with sliding window counter and per-key mutex (B/F6) 2026-05-27 20:37:51 -03:00
diegosouzapw
8a10b3ecd8 feat(quota): add QuotaStore facade and types re-export (B/F6) 2026-05-27 20:37:44 -03:00
diegosouzapw
7a5166621d feat(quota): add provider plan registry with known plans 2026-05-27 19:05:02 -03:00
diegosouzapw
70b9cc7831 feat(quota): add canonical dimensions, types and Zod schemas 2026-05-27 19:04:55 -03:00