Commit Graph

8 Commits

Author SHA1 Message Date
Markus Hartung
a47bb90388 fix: Follow OpenAI specification, handle throttling in batch and fix UI (#2045)
Integrated into release/v3.8.0
2026-05-08 17:35:06 -03:00
Cong Vu Chi
15b4a54454 fix(claude): preserve tool_result adjacency (#1555)
* fix(claude): preserve tool_result adjacency in native and CC-compatible paths

* feat(providers): add Petals and Nous Research provider support

Register Nous Research as an OpenAI-compatible gateway with remote
model discovery and validation against chat completions.

Add Petals provider metadata, default config, validation, and a
specialized executor that maps OpenAI-style requests to the public
generate endpoint. Also allow optional API keys and configurable base
URLs for Petals in the dashboard and provider schemas.

Expand provider model and catalog tests to cover both integrations.

* fix(resilience): sync queue updates and clear stale discovery caches

Await runtime request queue updates so limiter settings and auto-enabled
API key protections are recomputed when resilience settings change.

Preserve cancelled batch state for in-flight work by marking input files
processed without generating output artifacts, and replace cached synced
models with an empty set when remote discovery returns no models so the
providers route falls back to the local catalog instead of stale cache.

---------

Co-authored-by: congvc <congvc-dev@gmail.com>
Co-authored-by: diegosouzapw <diegosouzapw@users.noreply.github.com>
2026-04-24 09:22:46 -03:00
diegosouzapw
16b0499192 fix(api): harden batch and file endpoints for auth and recovery
Reject invalid API keys even when authentication is optional and add
OPTIONS handlers for batch and file routes to support CORS preflights.

Also recover orphaned batches stuck in finalizing after restarts,
include finalizing in pending batch queries, preserve multipart upload
content handling, and fetch remote vision images as data URIs for
Anthropic requests.
2026-04-22 17:10:47 -03:00
diegosouzapw
128f242808 Feature/OpenAI batching gui (#1500)
* Added GUI for OpenAI batching
* Support downloading files via API
* Set stream: false for chat completions in batchProcessor
2026-04-22 12:26:21 -03:00
diegosouzapw
a7b6dfb06e chore: apply PR 1495 and update changelog 2026-04-21 21:12:29 -03:00
Markus Hartung
098639e146 fix: add batch item dispatching to specific handlers based on URL (#1495)
Integrated into release/v3.7.0
2026-04-21 21:10:38 -03:00
Markus Hartung
2e36599d40 fix: resolve code rebase issues 2026-04-21 22:53:19 +02:00
Markus Hartung
03769eb0ea feat: add support for OpenAI batch processing 2026-04-21 15:12:12 +02:00