From b0819404c70fe4db0edaa260f91d93259c2c60be Mon Sep 17 00:00:00 2001 From: diegosouzapw Date: Thu, 5 Mar 2026 20:04:41 -0300 Subject: [PATCH] =?UTF-8?q?feat(release):=20v2.0.1=20=E2=80=94=20endpoint-?= =?UTF-8?q?aware=20models,=203=20bug=20fixes=20(#212,=20#213,=20#200),=203?= =?UTF-8?q?=20features=20(#204,=20#205,=20#206)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- CHANGELOG.md | 44 ++++++++++++++++++++++++++++++++++++++++---- README.ar.md | 7 ++++--- README.bg.md | 7 ++++--- README.da.md | 6 ++++-- README.de.md | 5 +++-- README.es.md | 1 + README.fi.md | 1 + README.fr.md | 1 + README.he.md | 17 +++++++++-------- README.hu.md | 1 + README.id.md | 1 + README.in.md | 17 +++++++++-------- README.it.md | 1 + README.ja.md | 3 +++ README.ko.md | 17 +++++++++-------- README.md | 33 +++++++++++++++++---------------- README.ms.md | 17 +++++++++-------- README.nl.md | 17 +++++++++-------- README.no.md | 1 + README.phi.md | 3 ++- README.pl.md | 17 +++++++++-------- README.pt-BR.md | 5 +++-- README.pt.md | 1 + README.ro.md | 2 ++ README.ru.md | 1 + README.sk.md | 1 + README.sv.md | 1 + README.th.md | 1 + README.uk-UA.md | 1 + README.vi.md | 1 + README.zh-CN.md | 19 ++++++++++--------- package.json | 2 +- 32 files changed, 161 insertions(+), 91 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 7f4409dd8b..ad2f83b14b 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -7,6 +7,42 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 --- +## [2.0.1] — 2026-03-05 + +> ### 🐛 Bug Fixes & ✨ Endpoint-Aware Model Management + +### 🐛 Bug Fixes + +- **#212 — API Key creation crash** — Auto-generate `API_KEY_SECRET` at startup (like `JWT_SECRET`) to prevent HMAC crashes +- **#213 — Circuit breaker scope** — Changed circuit breaker key from provider-level to model-level; a 429 on one account no longer blocks all accounts for the same provider +- **#200 — Custom provider connection check** — Added connectivity fallback for OpenAI-compatible providers (Ollama, LM Studio); if `/models` and `/chat/completions` fail, a simple HTTP ping to the base URL marks the provider as connected + +### ✨ New Features + +- **#204 — API Format selector** — Custom models can now specify `apiFormat`: `chat-completions` (default) or `responses` (for the Responses API) +- **#205 — Combo endpoint support** — Combos now accept an `endpoint` field in the schema (`chat` | `embeddings` | `images`), enabling fallback/rotation combos for non-chat endpoints +- **#206 — Supported Endpoints mapping** — When adding custom models, users can check which endpoints the model supports (💬 Chat, 📐 Embeddings, 🖼️ Images, 🔊 Audio). Models tagged for embeddings appear in `/v1/embeddings` and models tagged for images appear in `/v1/images/generations` +- **Visual badges** — Model rows now display colored badges for non-default API formats and endpoint types +- **Model catalog metadata** — `/v1/models` response includes `api_format`, `type`, and `supported_endpoints` for custom models + +### 📁 Files Changed + +| File | Change | +| ------------------------------------------------------- | ------------------------------------------------ | +| `src/instrumentation.ts` | Auto-generate `API_KEY_SECRET` | +| `open-sse/services/combo.ts` | Circuit breaker keyed per-model | +| `src/lib/providers/validation.ts` | Connectivity fallback ping | +| `src/lib/db/models.ts` | `apiFormat` + `supportedEndpoints` fields | +| `src/shared/schemas/validation.ts` | `endpoint` in `comboSchema` | +| `src/shared/validation/schemas.ts` | Extended `providerModelMutationSchema` | +| `src/app/api/provider-models/route.ts` | Pass new fields through API | +| `src/app/(dashboard)/dashboard/providers/[id]/page.tsx` | API format dropdown, endpoint checkboxes, badges | +| `src/app/api/v1/models/catalog.ts` | Custom model metadata enrichment | +| `src/app/api/v1/embeddings/route.ts` | Include custom embedding models | +| `src/app/api/v1/images/generations/route.ts` | Include custom image models | + +--- + ## [2.0.0] — 2026-03-05 > ### 🚀 Major Release — MCP Multi-Transport, A2A Protocol, Auto-Combo Engine & Full Type Safety Overhaul @@ -131,13 +167,13 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 | `src/lib/a2a/skills/` | `smartRouting.ts`, `quotaManagement.ts` | | `src/app/a2a/` | `route.ts` (JSON-RPC 2.0 dispatch handler) | | `src/app/api/mcp/sse/` | `route.ts` (SSE transport endpoint) | -| `src/app/api/mcp/stream/` | `route.ts` (Streamable HTTP transport endpoint) | +| `src/app/api/mcp/stream/` | `route.ts` (Streamable HTTP transport endpoint) | | `open-sse/services/autoCombo/` | `scoring.ts`, `taskFitness.ts`, `engine.ts`, `selfHealing.ts`, `modePacks.ts`, `persistence.ts`, `index.ts` | | `src/shared/contracts/` | `quota.ts` (shared API contracts) | | `src/shared/constants/` | `mcpScopes.ts` | | `src/shared/validation/` | `settingsSchemas.ts` (extracted settings Zod schema) | | `src/lib/db/migrations/` | `002_mcp_a2a_tables.sql` | -| `src/app/(dashboard)/` | `dashboard/mcp/page.tsx`, `dashboard/a2a/page.tsx`, `dashboard/auto-combo/page.tsx`, `dashboard/endpoint/ApiEndpointsTab.tsx` | +| `src/app/(dashboard)/` | `dashboard/mcp/page.tsx`, `dashboard/a2a/page.tsx`, `dashboard/auto-combo/page.tsx`, `dashboard/endpoint/ApiEndpointsTab.tsx` | | `vscode-extension/src/services/` | `mcpClient.ts`, `a2aClient.ts`, `policyEngine.ts`, `preflightDialog.ts`, `budgetGuard.ts`, `healthMonitor.ts`, `modePackSelector.ts`, `humanCheckpoint.ts` | | `scripts/` | `check-cycles.mjs`, `check-docs-sync.mjs`, `check-route-validation.mjs`, `check-t11-any-budget.mjs`, `run-playwright-tests.mjs`, `runtime-env.mjs` | | `tests/` | `t06-schema-hardening.test.mjs`, `t07-no-log-key-config.test.mjs`, `t08-mcp-scope-enforcement.test.mjs`, `ecosystem.test.ts` | @@ -158,12 +194,12 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 | `889e2ba` | 2026-03-04 | feat: add error pages, harden DB layer and compliance module | | `cbd0b1c` | 2026-03-04 | refactor: harden open-sse services, eliminate any casts, add dashboard pages | | `b33a853` | 2026-03-04 | feat: Introduce A2A lifecycle management, add type safety to ComfyUI and stream handling | -| `a1a2610` | 2026-03-04 | feat: v2.0.0 - MCP server, A2A agent, proxy improvements and docs update | +| `a1a2610` | 2026-03-04 | feat: v2.0.0 - MCP server, A2A agent, proxy improvements and docs update | | `d615ca5` | 2026-03-05 | feat: configurable tool name prefix (#199) and custom rpm/tpm rate limits (#198) | | `6d8868b` | 2026-03-05 | fix: extract validation helpers to fix webpack barrel-file resolution bug | | `bc2e60c` | 2026-03-05 | feat: Introduce new A2A and MCP API routes, enhance dashboard UI, E2E tests | | `79c23df` | 2026-03-05 | feat: Add i18n for media/themes, enhance combos with strategy guides, E2E tests | -| `2490ba5` | 2026-03-05 | feat: Introduce combo readiness checks and strategy recommendations | +| `2490ba5` | 2026-03-05 | feat: Introduce combo readiness checks and strategy recommendations | | `48dda26` | 2026-03-05 | fix: CORS headers on early-return error responses + auto-combo validation (#208, #209) | | `078a42b` | 2026-03-05 | feat: consolidate Endpoint, MCP, A2A into tabbed Endpoints page | | `6f1e6a0` | 2026-03-05 | feat: add MCP/A2A enable/disable toggle switches on Endpoints page | diff --git a/README.ar.md b/README.ar.md index f4dd3d89b6..ae768b3029 100644 --- a/README.ar.md +++ b/README.ar.md @@ -287,6 +287,7 @@ Result: Never stop coding, minimal cost - **مكافحة الرعد القطيع** — Mutex + حماية الإشارة ضد عواصف إعادة المحاولة المتزامنة - **السلاسل الاحتياطية المجمعة** — إذا فشل الموفر الأساسي، فسيتم دخوله تلقائيًا عبر السلسلة دون أي تدخل - **Combo Circuit Breaker** — التعطيل التلقائي لمقدمي الخدمات الفاشلين ضمن سلسلة التحرير والسرد + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **لوحة معلومات الصحة** — مراقبة وقت التشغيل، وحالات قاطع الدائرة، وعمليات التأمين، وإحصائيات ذاكرة التخزين المؤقت، ووقت الاستجابة p50/p95/p99 @@ -874,10 +875,10 @@ npm run electron:build:linux # Linux (.AppImage) ### 🤖 عمليات الوكيل والبروتوكول (الإصدار 2.0)| ميزة | ماذا يفعل | | ------------------------------------ | -------------------------------------------------------------------------------- | -| 🔧 **خادم MCP (16 أداة)** | تتحكم أدوات IDE/agent في التوجيه والصحة والمجموعات والحدود والعمليات | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) +| 🔧 **خادم MCP (16 أداة)** | تتحكم أدوات IDE/agent في التوجيه والصحة والمجموعات والحدود والعمليات | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) | 🤝 **خادم A2A (JSON-RPC + SSE)** | تنفيذ المهام من وكيل إلى وكيل مع تدفقات المزامنة والتدفق | -| 🧭 **Consolidated Endpoints Page** | Tabbed management page with Endpoint Proxy, MCP, A2A, and API Endpoints tabs | -| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | +| 🧭 **Consolidated Endpoints Page** | Tabbed management page with Endpoint Proxy, MCP, A2A, and API Endpoints tabs | +| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | | 🛰️ **نبضات وقت تشغيل MCP** | حالة العملية الحقيقية (معرف المنتج، وقت التشغيل، عمر نبضات القلب، النقل، وضع النطاق) | | 📋 **مسار تدقيق MCP** | سجلات التدقيق القابلة للتصفية مع النجاح/الفشل والإسناد الرئيسي | | 🔐 **تنفيذ نطاق MCP** | 9 أذونات نطاق تفصيلية للوصول إلى الأدوات الخاضعة للرقابة | diff --git a/README.bg.md b/README.bg.md index 8b54331cce..ef256d959c 100644 --- a/README.bg.md +++ b/README.bg.md @@ -287,6 +287,7 @@ OpenAI използва един формат, Claude (Anthropic) използв - **Anti-Thundering Herd** — Mutex + семафорна защита срещу едновременни повторни бури - **Combo Fallback Chains** — Ако основният доставчик се провали, автоматично преминава през веригата без намеса - **Combo Circuit Breaker** — Автоматично деактивира неизправните доставчици в рамките на комбинирана верига + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Health Dashboard** — Мониторинг на времето на работа, състояния на прекъсвачи, блокировки, статистика на кеша, латентност на p50/p95/p99 @@ -875,10 +876,10 @@ OmniRoute v2.0 е създаден като операционна платфо ### 🤖 Операции на агент и протокол (v2.0)| Характеристика | Какво прави | | ------------------------------------ | -------------------------------------------------------------------------------- | -| 🔧 **MCP сървър (16 инструмента)** | Инструментите за IDE/агент контролират маршрутизиране, здраве, комбинации, ограничения и операции | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) +| 🔧 **MCP сървър (16 инструмента)** | Инструментите за IDE/агент контролират маршрутизиране, здраве, комбинации, ограничения и операции | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) | 🤝 **A2A сървър (JSON-RPC + SSE)** | Изпълнение на задачи от агент към агент със синхронизиране и поточно предаване | -| 🧭 **Consolidated Endpoints Page** | Tabbed management page with Endpoint Proxy, MCP, A2A, and API Endpoints tabs | -| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | +| 🧭 **Consolidated Endpoints Page** | Tabbed management page with Endpoint Proxy, MCP, A2A, and API Endpoints tabs | +| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | | 🛰️ **MCP Runtime Heartbeat** | Реално състояние на процеса (pid, време на работа, възраст на сърдечния ритъм, транспорт, режим на обхвата) | | 📋 **MCP одитна пътека** | Филтрируеми журнали за одит с успех/неуспех и ключово приписване | | 🔐 **Прилагане на обхват на MCP** | 9 подробни разрешения за обхват за контролиран достъп до инструменти | diff --git a/README.da.md b/README.da.md index c71d0ad72c..596d696a23 100644 --- a/README.da.md +++ b/README.da.md @@ -283,10 +283,12 @@ Når en AI-gateway eksponeres for netværket (LAN, VPS, Docker), kan enhver med **Sådan løser OmniRoute det:** - **Circuit Breaker pr. udbyder** — Automatisk åbning/lukning med konfigurerbare tærskler og nedkøling (lukket/åbent/halvt åbent) + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Eksponentiel backoff** — Progressive forsinkelser af genforsøg - **Anti-tordenbesætning** — Mutex + semaforbeskyttelse mod samtidige genforsøgsstorme - **Combo Fallback Chains** — Hvis den primære udbyder fejler, falder den automatisk gennem kæden uden indgriben - **Combo Circuit Breaker** - Deaktiverer automatisk fejlende udbydere i en kombinationskæde + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Health Dashboard** — Oppetidsovervågning, strømafbrydertilstande, lockouts, cachestatistik, p50/p95/p99 latency @@ -875,10 +877,10 @@ OmniRoute v2.0 er bygget som en operationel platform, ikke kun en relæ-proxy. ### 🤖 Agent- og protokoloperationer (v2.0)| Funktion | Hvad det gør | | ------------------------------------ | ---------------------------------------------------------------------------------- | -| 🔧 **MCP-server (16 værktøjer)** | IDE/agent-værktøjer kontrollerer routing, sundhed, kombinationer, grænser og operationer | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) +| 🔧 **MCP-server (16 værktøjer)** | IDE/agent-værktøjer kontrollerer routing, sundhed, kombinationer, grænser og operationer | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) | 🤝 **A2A-server (JSON-RPC + SSE)** | Agent-til-agent opgaveudførelse med synkronisering og streaming flows | | 🧭 **Consolidated Endpoints Page** | Dedikerede administrationssider (`/dashboard/mcp`, `/dashboard/a2a`) | -| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | +| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | | 🛰️ **MCP Runtime Heartbeat** | Reel processtatus (pid, oppetid, hjerteslagsalder, transport, omfangstilstand) | | 📋 **MCP Audit Trail** | Filtrerbare revisionslogfiler med succes/fejl og nøgletilskrivning | | 🔐 **MCP Scope Enforcement** | 9 granulære omfangstilladelser til kontrolleret værktøjsadgang | diff --git a/README.de.md b/README.de.md index 4d52cab98e..f96ccd48d8 100644 --- a/README.de.md +++ b/README.de.md @@ -287,6 +287,7 @@ Wenn ein KI-Gateway dem Netzwerk (LAN, VPS, Docker) zugänglich gemacht wird, ka - **Anti-Thundering Herd** – Mutex + Semaphor-Schutz gegen gleichzeitige Wiederholungsstürme - **Combo-Fallback-Ketten** – Wenn der primäre Anbieter ausfällt, fällt er automatisch durch die Kette, ohne dass ein Eingreifen erforderlich ist - **Combo Circuit Breaker** – Deaktiviert automatisch ausgefallene Anbieter innerhalb einer Combo-Kette + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Gesundheits-Dashboard** – Betriebszeitüberwachung, Leistungsschalterzustände, Sperren, Cache-Statistiken, p50/p95/p99-Latenz @@ -881,10 +882,10 @@ OmniRoute v2.0 ist als Betriebsplattform konzipiert und nicht nur als Relay-Prox ### 🤖 Agenten- und Protokolloperationen (v2.0)| Funktion | Was es tut | | ------------------------------------ | -------------------------------------------------------------------------------- | -| 🔧 **MCP-Server (16 Tools)** | IDE-/Agent-Tools steuern Routing, Zustand, Kombinationen, Grenzwerte und Vorgänge | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) +| 🔧 **MCP-Server (16 Tools)** | IDE-/Agent-Tools steuern Routing, Zustand, Kombinationen, Grenzwerte und Vorgänge | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) | 🤝 **A2A-Server (JSON-RPC + SSE)** | Ausführung von Agent-zu-Agent-Aufgaben mit Synchronisierungs- und Streaming-Flows | | 🧭 **Consolidated Endpoints Page** | Dedizierte Verwaltungsseiten (`/dashboard/mcp`, `/dashboard/a2a`) | -| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | +| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | | 🛰️ **MCP Runtime Heartbeat** | Echter Prozessstatus (PID, Betriebszeit, Heartbeat-Alter, Transport, Scope-Modus) | | 📋 **MCP Audit Trail** | Filterbare Audit-Protokolle mit Erfolg/Misserfolg und Schlüsselzuordnung | | 🔐 **Durchsetzung des MCP-Geltungsbereichs** | 9 granulare Umfangsberechtigungen für kontrollierten Werkzeugzugriff | diff --git a/README.es.md b/README.es.md index c609dbf37b..3dbb4dd0c7 100644 --- a/README.es.md +++ b/README.es.md @@ -868,6 +868,7 @@ npm run electron:build:linux # Linux (.AppImage) | Característica | Qué Hace | | ---------------------------------- | ---------------------------------------------------------------------------- | | 🔌 **Circuit Breaker** | Auto-apertura/cierre por proveedor con umbrales configurables | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **Anti-Thundering Herd** | Mutex + semáforo rate-limit para proveedores con API key | | 🧠 **Caché Semántico** | Caché de dos niveles (firma + semántico) reduce costo y latencia | | ⚡ **Idempotencia de Solicitud** | Ventana de dedup de 5s para solicitudes duplicadas | diff --git a/README.fi.md b/README.fi.md index 3730a5f6f4..34342b4a52 100644 --- a/README.fi.md +++ b/README.fi.md @@ -294,6 +294,7 @@ Tekoälypalveluntarjoajat voivat muuttua epävakaiksi, palauttaa 5xx-virheitä t - **Anti-Thundering Herd** — Mutex + semaforisuoja samanaikaisia myrskyjä vastaan - **Yhdistelmävaraketjut** – Jos ensisijainen toimittaja epäonnistuu, putoaa automaattisesti ketjun läpi ilman väliintuloa - **Combo Circuit Breaker** — Poistaa automaattisesti käytöstä vialliset palveluntarjoajat yhdistelmäketjussa + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Health Dashboard** — käytettävyyden valvonta, katkaisijoiden tilat, lukitukset, välimuistitilastot, p50/p95/p99-viive diff --git a/README.fr.md b/README.fr.md index 538d2854bf..d5833087ad 100644 --- a/README.fr.md +++ b/README.fr.md @@ -866,6 +866,7 @@ npm run electron:build:linux # Linux (.AppImage) | Fonctionnalité | Ce qu'elle fait | | ------------------------------- | ---------------------------------------------------------------------------- | | 🔌 **Circuit Breaker** | Ouverture/fermeture auto par fournisseur avec seuils configurables | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **Anti-Thundering Herd** | Mutex + sémaphore de rate-limit pour les fournisseurs avec clé API | | 🧠 **Cache sémantique** | Cache à deux niveaux (signature + sémantique) réduit coût et latence | | ⚡ **Idempotence des requêtes** | Fenêtre de dédup 5s pour les requêtes dupliquées | diff --git a/README.he.md b/README.he.md index cf9cb67c7a..20a0d9b0f0 100644 --- a/README.he.md +++ b/README.he.md @@ -1495,14 +1495,15 @@ Se não quiser criar credenciais próprias agora, ainda é possível usar o flux ל-OmniRoute יש **210+ תכונות מתוכננות** לאורך שלבי פיתוח מרובים. להלן תחומי המפתח: -| קטגוריה | תכונות מתוכננות | הבהרה | -| --------------------- | --------------- | ---------------------------------------------------------------------------------------- | -| 🧠 **ניתוב ומודיעין** | 25+ | ניתוב עם זמן האחזור הנמוך ביותר, ניתוב מבוסס תגים, בדיקה מוקדמת של מכסה, בחירת חשבון P2C | -| 🔒 **אבטחה ותאימות** | 20+ | הקשחת SSRF, הסוואה של אישורים, הגבלת קצב לכל נקודת קצה, היקף מפתח ניהול | -| 📊 **צפיות** | 15+ | אינטגרציה של OpenTelemetry, ניטור מכסות בזמן אמת, מעקב עלויות לכל דגם | -| 🔄 **שילובי ספקים** | 20+ | רישום מודלים דינמיים, צינון ספקים, Codex מרובה חשבונות, ניתוח מכסת Copilot | -| ⚡ **ביצועים** | 15+ | שכבת מטמון כפולה, מטמון הנחיה, מטמון תגובה, סטרימינג Keepalive, API אצווה | -| 🌐 **מערכת אקולוגית** | 10+ | WebSocket API, טעינה חוזרת של תצורה, חנות תצורה מבוזרת, מצב מסחרי | +| קטגוריה | תכונות מתוכננות | הבהרה | +| ---------------------------- | ------------------------------------------------------ | ---------------------------------------------------------------------------------------- | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | +| 🧠 **ניתוב ומודיעין** | 25+ | ניתוב עם זמן האחזור הנמוך ביותר, ניתוב מבוסס תגים, בדיקה מוקדמת של מכסה, בחירת חשבון P2C | +| 🔒 **אבטחה ותאימות** | 20+ | הקשחת SSRF, הסוואה של אישורים, הגבלת קצב לכל נקודת קצה, היקף מפתח ניהול | +| 📊 **צפיות** | 15+ | אינטגרציה של OpenTelemetry, ניטור מכסות בזמן אמת, מעקב עלויות לכל דגם | +| 🔄 **שילובי ספקים** | 20+ | רישום מודלים דינמיים, צינון ספקים, Codex מרובה חשבונות, ניתוח מכסת Copilot | +| ⚡ **ביצועים** | 15+ | שכבת מטמון כפולה, מטמון הנחיה, מטמון תגובה, סטרימינג Keepalive, API אצווה | +| 🌐 **מערכת אקולוגית** | 10+ | WebSocket API, טעינה חוזרת של תצורה, חנות תצורה מבוזרת, מצב מסחרי | ### 🔜 בקרוב diff --git a/README.hu.md b/README.hu.md index b21da026cc..f94b51472d 100644 --- a/README.hu.md +++ b/README.hu.md @@ -294,6 +294,7 @@ Az AI-szolgáltatók instabillá válhatnak, 5xx-es hibákat adnak vissza, vagy - **Mennydörgés elleni csorda** - Mutex + szemafor védelem az egyidejű újrapróbálkozási viharok ellen - **Kombinált tartalék láncok** – Ha az elsődleges szolgáltató meghibásodik, automatikusan, beavatkozás nélkül átesik a láncon - **Combo Circuit Breaker** – Automatikusan letiltja a hibás szolgáltatókat a kombinált láncon belül + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Egészségügyi irányítópult** — Üzemidő-figyelés, áramkör-megszakító állapotok, zárolások, gyorsítótár-statisztika, p50/p95/p99 késleltetés diff --git a/README.id.md b/README.id.md index cdecb4c739..a73c55a6ed 100644 --- a/README.id.md +++ b/README.id.md @@ -294,6 +294,7 @@ Penyedia AI bisa menjadi tidak stabil, menampilkan kesalahan 5xx, atau mencapai - **Kawanan Anti-Guntur** — Perlindungan mutex + semaphore terhadap badai percobaan ulang secara bersamaan - **Combo Fallback Chains** — Jika penyedia utama gagal, otomatis gagal dalam rantai tanpa intervensi - **Combo Circuit Breaker** — Menonaktifkan secara otomatis penyedia yang gagal dalam rantai kombo + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Dasbor Kesehatan** — Pemantauan waktu aktif, status pemutus sirkuit, penguncian, statistik cache, latensi p50/p95/p99 diff --git a/README.in.md b/README.in.md index 969e9453e7..628cdd555d 100644 --- a/README.in.md +++ b/README.in.md @@ -1138,14 +1138,15 @@ Cost: $0 forever! ओम्निरूट ने कई विकास चरणों में **210+ सुविधाओं की योजना बनाई है**। यहां प्रमुख क्षेत्र हैं: -| श्रेणी | नियोजित विशेषताएं | हाइलाइट्स | -| --------------------------- | ----------------- | ------------------------------------------------------------------------------------------- | -| 🧠 **रूटिंग और इंटेलिजेंस** | 25+ | न्यूनतम-विलंबता रूटिंग, टैग-आधारित रूटिंग, कोटा प्रीफ़्लाइट, पी2सी खाता चयन | -| 🔒 **सुरक्षा एवं अनुपालन** | 20+ | एसएसआरएफ हार्डनिंग, क्रेडेंशियल क्लोकिंग, प्रति समापन बिंदु दर-सीमा, प्रबंधन कुंजी स्कोपिंग | -| 📊 **अवलोकनशीलता** | 15+ | ओपन टेलीमेट्री एकीकरण, वास्तविक समय कोटा निगरानी, ​​प्रति मॉडल लागत ट्रैकिंग | -| 🔄 **प्रदाता एकीकरण** | 20+ | डायनेमिक मॉडल रजिस्ट्री, प्रदाता कूलडाउन, मल्टी-अकाउंट कोडेक्स, कोपायलट कोटा पार्सिंग | -| ⚡ **प्रदर्शन** | 15+ | दोहरी कैश परत, शीघ्र कैश, प्रतिक्रिया कैश, स्ट्रीमिंग कीपलाइव, बैच एपीआई | -| 🌐 **पारिस्थितिकी तंत्र** | 10+ | वेबसॉकेट एपीआई, कॉन्फिग हॉट-रीलोड, वितरित कॉन्फिग स्टोर, वाणिज्यिक मोड | +| श्रेणी | नियोजित विशेषताएं | हाइलाइट्स | +| ---------------------------- | ------------------------------------------------------ | ------------------------------------------------------------------------------------------- | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | +| 🧠 **रूटिंग और इंटेलिजेंस** | 25+ | न्यूनतम-विलंबता रूटिंग, टैग-आधारित रूटिंग, कोटा प्रीफ़्लाइट, पी2सी खाता चयन | +| 🔒 **सुरक्षा एवं अनुपालन** | 20+ | एसएसआरएफ हार्डनिंग, क्रेडेंशियल क्लोकिंग, प्रति समापन बिंदु दर-सीमा, प्रबंधन कुंजी स्कोपिंग | +| 📊 **अवलोकनशीलता** | 15+ | ओपन टेलीमेट्री एकीकरण, वास्तविक समय कोटा निगरानी, ​​प्रति मॉडल लागत ट्रैकिंग | +| 🔄 **प्रदाता एकीकरण** | 20+ | डायनेमिक मॉडल रजिस्ट्री, प्रदाता कूलडाउन, मल्टी-अकाउंट कोडेक्स, कोपायलट कोटा पार्सिंग | +| ⚡ **प्रदर्शन** | 15+ | दोहरी कैश परत, शीघ्र कैश, प्रतिक्रिया कैश, स्ट्रीमिंग कीपलाइव, बैच एपीआई | +| 🌐 **पारिस्थितिकी तंत्र** | 10+ | वेबसॉकेट एपीआई, कॉन्फिग हॉट-रीलोड, वितरित कॉन्फिग स्टोर, वाणिज्यिक मोड | ### 🔜 जल्द आ रहा है diff --git a/README.it.md b/README.it.md index 0efcca8906..50da8f06fe 100644 --- a/README.it.md +++ b/README.it.md @@ -865,6 +865,7 @@ npm run electron:build:linux # Linux (.AppImage) | Funzionalità | Cosa Fa | | ------------------------------- | ---------------------------------------------------------------------------- | | 🔌 **Circuit Breaker** | Apertura/chiusura auto per provider con soglie configurabili | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **Anti-Thundering Herd** | Mutex + semaforo rate-limit per provider con API key | | 🧠 **Cache semantica** | Cache a due livelli (firma + semantica) riduce costi e latenza | | ⚡ **Idempotenza richieste** | Finestra dedup 5s per richieste duplicate | diff --git a/README.ja.md b/README.ja.md index 2def3bafd7..39ba2772aa 100644 --- a/README.ja.md +++ b/README.ja.md @@ -532,6 +532,7 @@ AIは単なるチャット補完ではありません。開発者は、画像の - MCP ダッシュボードからコンボのアクティブ化を直接切り替えます - 事前定義されたポリシーパックから復元プロファイルを適用 - 同じ操作パネルからサーキットブレーカーの状態をリセット + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | @@ -864,6 +865,7 @@ npm run electron:build:linux # Linux (.AppImage) | 特集 | 何をするのか | | -------------------------------- | ---------------------------------------------------------------------------- | | 🔌 **サーキットブレーカー** | 設定可能なしきい値によるプロバイダーごとの自動開閉 | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **対雷鳴の群れ** | API キープロバイダーのミューテックス + セマフォのレート制限 | | 🧠 **セマンティック キャッシュ** | 2 層キャッシュ (シグネチャ + セマンティック) によりコストと遅延が削減 | | ⚡ **冪等性のリクエスト** | 重複リクエストに対する 5 秒の重複除去ウィンドウ | @@ -964,6 +966,7 @@ Combo: "my-coding-stack" - システムステータス (稼働時間、バージョン、メモリ使用量) - プロバイダーごとのサーキットブレーカーの状態 (クローズ/オープン/ハーフオープン) + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - レート制限ステータスとアクティブなロックアウト - 署名キャッシュ統計 - レイテンシ テレメトリ (p50/p95/p99) + プロンプト キャッシュ diff --git a/README.ko.md b/README.ko.md index 62029ccc6c..0a0a9e2bd3 100644 --- a/README.ko.md +++ b/README.ko.md @@ -1495,14 +1495,15 @@ Se não quiser criar credenciais próprias agora, ainda é possível usar o flux OmniRoute에는 여러 개발 단계에 걸쳐 **210개 이상의 기능이 계획되어 있습니다**. 주요 영역은 다음과 같습니다. -| 카테고리 | 계획된 기능 | 하이라이트 | -| --------------------------- | ----------- | ------------------------------------------------------------------------------ | -| 🧠 **라우팅 및 인텔리전스** | 25세 이상 | 최저 대기 시간 라우팅, 태그 기반 라우팅, 실행 전 할당량, P2C 계정 선택 | -| 🔒 **보안 및 규정 준수** | 20세 이상 | SSRF 강화, 자격 증명 클로킹, 엔드포인트당 속도 제한, 관리 키 범위 지정 | -| 📊 **관측성** | 15세 이상 | OpenTelemetry 통합, 실시간 할당량 모니터링, 모델별 비용 추적 | -| 🔄 **공급자 통합** | 20세 이상 | 동적 모델 레지스트리, 공급자 쿨다운, 다중 계정 Codex, Copilot 할당량 구문 분석 | -| ⚡ **성능** | 15세 이상 | 듀얼 캐시 레이어, 프롬프트 캐시, 응답 캐시, 스트리밍 Keepalive, 배치 API | -| 🌐 **생태계** | 10세 이상 | WebSocket API, 구성 핫 리로드, 분산 구성 저장소, 상용 모드 | +| 카테고리 | 계획된 기능 | 하이라이트 | +| ---------------------------- | ------------------------------------------------------ | ------------------------------------------------------------------------------ | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | +| 🧠 **라우팅 및 인텔리전스** | 25세 이상 | 최저 대기 시간 라우팅, 태그 기반 라우팅, 실행 전 할당량, P2C 계정 선택 | +| 🔒 **보안 및 규정 준수** | 20세 이상 | SSRF 강화, 자격 증명 클로킹, 엔드포인트당 속도 제한, 관리 키 범위 지정 | +| 📊 **관측성** | 15세 이상 | OpenTelemetry 통합, 실시간 할당량 모니터링, 모델별 비용 추적 | +| 🔄 **공급자 통합** | 20세 이상 | 동적 모델 레지스트리, 공급자 쿨다운, 다중 계정 Codex, Copilot 할당량 구문 분석 | +| ⚡ **성능** | 15세 이상 | 듀얼 캐시 레이어, 프롬프트 캐시, 응답 캐시, 스트리밍 Keepalive, 배치 API | +| 🌐 **생태계** | 10세 이상 | WebSocket API, 구성 핫 리로드, 분산 구성 저장소, 상용 모드 | ### 🔜 출시 예정 diff --git a/README.md b/README.md index 489ae37ad3..45e5266c17 100644 --- a/README.md +++ b/README.md @@ -47,7 +47,7 @@ _Your universal API proxy — one endpoint, 36+ providers, zero downtime. Now wi | **Settings** | ![Settings](docs/screenshots/06-settings.png) | | **CLI Tools** | ![CLI Tools](docs/screenshots/07-cli-tools.png) | | **Usage Logs** | ![Usage](docs/screenshots/08-usage.png) | -| **Endpoints** | ![Endpoints](docs/screenshots/09-endpoint.png) | +| **Endpoints** | ![Endpoints](docs/screenshots/09-endpoint.png) | @@ -289,7 +289,7 @@ AI providers can become unstable, return 5xx errors, or hit temporary rate limit **How OmniRoute solves it:** -- **Circuit Breaker per-provider** — Auto-open/close with configurable thresholds and cooldown (Closed/Open/Half-Open) +- **Circuit Breaker per-model** — Auto-open/close with configurable thresholds and cooldown (Closed/Open/Half-Open), scoped per-model to avoid cascading blocks - **Exponential Backoff** — Progressive retry delays - **Anti-Thundering Herd** — Mutex + semaphore protection against concurrent retry storms - **Combo Fallback Chains** — If the primary provider fails, automatically falls through the chain with no intervention @@ -890,19 +890,19 @@ OmniRoute v2.0 is built as an operational platform, not just a relay proxy. ### 🤖 Agent & Protocol Operations (v2.0) -| Feature | What It Does | -| ------------------------------------ | -------------------------------------------------------------------------------- | -| 🔧 **MCP Server (16 tools)** | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) | -| 🤝 **A2A Server (JSON-RPC + SSE)** | Agent-to-agent task execution with sync and streaming flows | -| 🧭 **Consolidated Endpoints Page** | Tabbed management page with Endpoint Proxy, MCP, A2A, and API Endpoints tabs | -| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | -| 🛰️ **MCP Runtime Heartbeat** | Real process status (pid, uptime, heartbeat age, transport, scope mode) | -| 📋 **MCP Audit Trail** | Filterable audit logs with success/failure and key attribution | -| 🔐 **MCP Scope Enforcement** | 9 granular scope permissions for controlled tool access | -| 📡 **A2A Task Lifecycle Management** | List/filter tasks, inspect events/artifacts, cancel running tasks | -| 📋 **Agent Card Discovery** | `/.well-known/agent.json` for client auto-discovery | -| 🧪 **Protocol E2E Test Harness** | Real MCP SDK + A2A client flows in `test:protocols:e2e` | -| ⚙️ **Operational Controls** | Switch combo, apply resilience profiles, reset breakers from one control surface | +| Feature | What It Does | +| ------------------------------------- | -------------------------------------------------------------------------------------------------- | +| 🔧 **MCP Server (16 tools)** | IDE/agent tools via 3 transports: stdio, SSE (`/api/mcp/sse`), Streamable HTTP (`/api/mcp/stream`) | +| 🤝 **A2A Server (JSON-RPC + SSE)** | Agent-to-agent task execution with sync and streaming flows | +| 🧭 **Consolidated Endpoints Page** | Tabbed management page with Endpoint Proxy, MCP, A2A, and API Endpoints tabs | +| 🎚️ **Service Enable/Disable Toggles** | ON/OFF switches for MCP and A2A with settings persistence (default: OFF) | +| 🛰️ **MCP Runtime Heartbeat** | Real process status (pid, uptime, heartbeat age, transport, scope mode) | +| 📋 **MCP Audit Trail** | Filterable audit logs with success/failure and key attribution | +| 🔐 **MCP Scope Enforcement** | 9 granular scope permissions for controlled tool access | +| 📡 **A2A Task Lifecycle Management** | List/filter tasks, inspect events/artifacts, cancel running tasks | +| 📋 **Agent Card Discovery** | `/.well-known/agent.json` for client auto-discovery | +| 🧪 **Protocol E2E Test Harness** | Real MCP SDK + A2A client flows in `test:protocols:e2e` | +| ⚙️ **Operational Controls** | Switch combo, apply resilience profiles, reset breakers from one control surface | ### 🧠 Routing & Intelligence @@ -938,7 +938,8 @@ OmniRoute v2.0 is built as an operational platform, not just a relay proxy. | Feature | What It Does | | ----------------------------------- | ---------------------------------------------------------- | -| 🔌 **Circuit Breakers** | Provider-level trip/recover with threshold controls | +| 🔌 **Circuit Breakers** | Per-model trip/recover with threshold controls | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **Anti-Thundering Herd** | Mutex + semaphore protections on retry/rate events | | 🧠 **Semantic + Signature Cache** | Cost/latency reduction with two cache layers | | ⚡ **Request Idempotency** | Duplicate protection window | diff --git a/README.ms.md b/README.ms.md index e0b6fe1d05..1408df102a 100644 --- a/README.ms.md +++ b/README.ms.md @@ -1495,14 +1495,15 @@ Jika anda ingin mendapatkan credenciais próprias agora, ada kemungkinan penggun OmniRoute mempunyai **210+ ciri yang dirancang** merentas berbilang fasa pembangunan. Berikut adalah bidang utama: -| Kategori | Ciri Terancang | Sorotan | -| ------------------------------ | -------------- | ---------------------------------------------------------------------------------------------------- | -| 🧠 **Penghalaan & Perisikan** | 25+ | Penghalaan kependaman terendah, penghalaan berasaskan teg, kuota prapenerbangan, pemilihan akaun P2C | -| 🔒 **Keselamatan & Pematuhan** | 20+ | Pengerasan SSRF, penyelubungan kelayakan, had kadar setiap titik akhir, skop kunci pengurusan | -| 📊 **Kebolehlihatan** | 15+ | Penyepaduan OpenTelemetry, pemantauan kuota masa nyata, penjejakan kos setiap model | -| 🔄 **Integrasi Pembekal** | 20+ | Pendaftaran model dinamik, penyejukan pembekal, Codex berbilang akaun, penghuraian kuota Copilot | -| ⚡ **Prestasi** | 15+ | Lapisan cache dwi, ​​cache gesaan, cache respons, penstriman keepalive, API kelompok | -| 🌐 **Ekosistem** | 10+ | API WebSocket, konfigurasi hot-reload, kedai konfigurasi teragih, mod komersial | +| Kategori | Ciri Terancang | Sorotan | +| ------------------------------ | ------------------------------------------------------ | ---------------------------------------------------------------------------------------------------- | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | +| 🧠 **Penghalaan & Perisikan** | 25+ | Penghalaan kependaman terendah, penghalaan berasaskan teg, kuota prapenerbangan, pemilihan akaun P2C | +| 🔒 **Keselamatan & Pematuhan** | 20+ | Pengerasan SSRF, penyelubungan kelayakan, had kadar setiap titik akhir, skop kunci pengurusan | +| 📊 **Kebolehlihatan** | 15+ | Penyepaduan OpenTelemetry, pemantauan kuota masa nyata, penjejakan kos setiap model | +| 🔄 **Integrasi Pembekal** | 20+ | Pendaftaran model dinamik, penyejukan pembekal, Codex berbilang akaun, penghuraian kuota Copilot | +| ⚡ **Prestasi** | 15+ | Lapisan cache dwi, ​​cache gesaan, cache respons, penstriman keepalive, API kelompok | +| 🌐 **Ekosistem** | 10+ | API WebSocket, konfigurasi hot-reload, kedai konfigurasi teragih, mod komersial | ### 🔜 Akan Datang diff --git a/README.nl.md b/README.nl.md index 2ba9618477..aed201bf3a 100644 --- a/README.nl.md +++ b/README.nl.md @@ -1495,14 +1495,15 @@ Als u geen geloofwaardige geloofwaardigheid meer heeft, is het mogelijk om de st OmniRoute heeft **210+ functies gepland** over meerdere ontwikkelingsfasen. Dit zijn de belangrijkste gebieden: -| Categorie | Geplande functies | Hoogtepunten | -| ------------------------------- | ----------------- | --------------------------------------------------------------------------------------------------------- | -| 🧠 **Routing en intelligentie** | 25+ | Routering met de laagste latentie, op tags gebaseerde routering, quota-preflight, P2C-accountselectie | -| 🔒 **Beveiliging en naleving** | 20+ | SSRF-verharding, cloaking van inloggegevens, snelheidslimiet per eindpunt, scoping van beheersleutels | -| 📊 **Waarneembaarheid** | 15+ | OpenTelemetry-integratie, realtime quotabewaking, kostenregistratie per model | -| 🔄 **Provider-integraties** | 20+ | Dynamisch modelregister, cooldowns van providers, Codex met meerdere accounts, parseren van Copilot-quota | -| ⚡ **Prestaties** | 15+ | Dubbele cachelaag, promptcache, responscache, streaming keepalive, batch-API | -| 🌐 **Ecosysteem** | 10+ | WebSocket API, configuratie hot-reload, gedistribueerde configuratieopslag, commerciële modus | +| Categorie | Geplande functies | Hoogtepunten | +| ------------------------------- | ------------------------------------------------------ | --------------------------------------------------------------------------------------------------------- | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | +| 🧠 **Routing en intelligentie** | 25+ | Routering met de laagste latentie, op tags gebaseerde routering, quota-preflight, P2C-accountselectie | +| 🔒 **Beveiliging en naleving** | 20+ | SSRF-verharding, cloaking van inloggegevens, snelheidslimiet per eindpunt, scoping van beheersleutels | +| 📊 **Waarneembaarheid** | 15+ | OpenTelemetry-integratie, realtime quotabewaking, kostenregistratie per model | +| 🔄 **Provider-integraties** | 20+ | Dynamisch modelregister, cooldowns van providers, Codex met meerdere accounts, parseren van Copilot-quota | +| ⚡ **Prestaties** | 15+ | Dubbele cachelaag, promptcache, responscache, streaming keepalive, batch-API | +| 🌐 **Ecosysteem** | 10+ | WebSocket API, configuratie hot-reload, gedistribueerde configuratieopslag, commerciële modus | ### 🔜 Binnenkort beschikbaar diff --git a/README.no.md b/README.no.md index 2f50731d9e..6d1e1129ab 100644 --- a/README.no.md +++ b/README.no.md @@ -864,6 +864,7 @@ npm run electron:build:linux # Linux (.AppImage) | Funksjon | Hva det gjør | | --------------------------------- | ----------------------------------------------------------------------------- | | 🔌 **Circuit Breaker** | Automatisk åpning/lukking per leverandør med konfigurerbare terskler | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **Anti-tordenflokk** | Mutex + semaforhastighetsgrense for API-nøkkelleverandører | | 🧠 **Semantisk cache** | To-lags cache (signatur + semantisk) reduserer kostnader og ventetid | | ⚡ **Be om idempotens** | 5s dedup-vindu for dupliserte forespørsler | diff --git a/README.phi.md b/README.phi.md index c672523a29..23f772ad9b 100644 --- a/README.phi.md +++ b/README.phi.md @@ -289,7 +289,7 @@ Ang mga tagapagbigay ng AI ay maaaring maging hindi matatag, magbalik ng 5xx na **Paano ito niresolba ng OmniRoute:** -- **Circuit Breaker per-provider** — Awtomatikong buksan/sarado na may mga na-configure na threshold at cooldown (Sarado/Bukas/Kalahating Bukas) +- **Circuit Breaker per-model** — Awtomatikong buksan/sarado na may mga na-configure na threshold at cooldown (Sarado/Bukas/Kalahating Bukas) - **Exponential Backoff** — Progressive retry delays - **Anti-Thundering Herd** — Mutex + semaphore na proteksyon laban sa kasabay na muling pagsubok na mga bagyo - **Combo Fallback Chains** — Kung nabigo ang pangunahing provider, awtomatikong mahuhulog sa chain nang walang interbensyon @@ -864,6 +864,7 @@ npm run electron:build:linux # Linux (.AppImage) | Tampok | Ano ang Ginagawa Nito | | ----------------------------------------- | ------------------------------------------------------------------------------------- | | 🔌 **Circuit Breaker** | Awtomatikong buksan/isara ang bawat provider na may mga na-configure na threshold | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **Anti-Thundering Herd** | Mutex + semaphore rate-limit para sa mga API key provider | | 🧠 **Semantic Cache** | Binabawasan ng two-tier na cache (pirma + semantiko) ang gastos at latency | | ⚡ **Humiling ng Idempotency** | 5s dedup window para sa mga duplicate na kahilingan | diff --git a/README.pl.md b/README.pl.md index 29fa1f1ab1..4a1d24f966 100644 --- a/README.pl.md +++ b/README.pl.md @@ -1495,14 +1495,15 @@ Jeśli chcesz uzyskać dostęp do **podręcznika URL**: OmniRoute ma **ponad 210 funkcji zaplanowanych** w wielu fazach rozwoju. Oto kluczowe obszary: -| Kategoria | Planowane funkcje | Najważniejsze | -| -------------------------------- | ----------------- | -------------------------------------------------------------------------------------------------------------------------------------------------- | -| 🧠 **Routing i inteligencja** | 25+ | Routing z najmniejszym opóźnieniem, routing oparty na tagach, wstępna inspekcja przydziału, wybór konta P2C | -| 🔒 **Bezpieczeństwo i zgodność** | 20+ | Wzmocnienie SSRF, maskowanie poświadczeń, limit szybkości na punkt końcowy, zakres kluczy zarządzania | -| 📊 **Obserwowalność** | 15+ | Integracja OpenTelemetry, monitorowanie kwot w czasie rzeczywistym, śledzenie kosztów według modelu | -| 🔄 **Integracja dostawców** | 20+ | Rejestr modeli dynamicznych, czasy odnowienia dostawcy, Kodeks dla wielu kont, analiza przydziału Copilot | -| ⚡ **Wydajność** | 15+ | Podwójna warstwa pamięci podręcznej, pamięć podręczna podpowiedzi, pamięć podręczna odpowiedzi, utrzymywanie transmisji strumieniowej, wsadowe API | -| 🌐 **Ekosystem** | 10+ | WebSocket API, ładowanie konfiguracji na gorąco, rozproszony magazyn konfiguracji, tryb komercyjny | +| Kategoria | Planowane funkcje | Najważniejsze | +| -------------------------------- | ------------------------------------------------------ | -------------------------------------------------------------------------------------------------------------------------------------------------- | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | +| 🧠 **Routing i inteligencja** | 25+ | Routing z najmniejszym opóźnieniem, routing oparty na tagach, wstępna inspekcja przydziału, wybór konta P2C | +| 🔒 **Bezpieczeństwo i zgodność** | 20+ | Wzmocnienie SSRF, maskowanie poświadczeń, limit szybkości na punkt końcowy, zakres kluczy zarządzania | +| 📊 **Obserwowalność** | 15+ | Integracja OpenTelemetry, monitorowanie kwot w czasie rzeczywistym, śledzenie kosztów według modelu | +| 🔄 **Integracja dostawców** | 20+ | Rejestr modeli dynamicznych, czasy odnowienia dostawcy, Kodeks dla wielu kont, analiza przydziału Copilot | +| ⚡ **Wydajność** | 15+ | Podwójna warstwa pamięci podręcznej, pamięć podręczna podpowiedzi, pamięć podręczna odpowiedzi, utrzymywanie transmisji strumieniowej, wsadowe API | +| 🌐 **Ekosystem** | 10+ | WebSocket API, ładowanie konfiguracji na gorąco, rozproszony magazyn konfiguracji, tryb komercyjny | ### 🔜 Już wkrótce diff --git a/README.pt-BR.md b/README.pt-BR.md index b9c4973a98..7fc609240d 100644 --- a/README.pt-BR.md +++ b/README.pt-BR.md @@ -289,7 +289,7 @@ Provedores de IA podem ficar instáveis, retornar erro 5xx ou atingir limites te **Como o OmniRoute resolve isso:** -- **Circuit Breaker por provedor** — Abre/fecha automaticamente com limiares e cooldown configuráveis (Closed/Open/Half-Open) +- **Circuit Breaker por modelo** — Abre/fecha automaticamente com limiares e cooldown configuráveis (Closed/Open/Half-Open) - **Exponential Backoff** — Atrasos progressivos de retry - **Anti-Thundering Herd** — Proteção com mutex + semáforo contra tempestade de retries concorrentes - **Cadeias de Fallback em Combo** — Se o primário falhar, avança automaticamente na cadeia sem intervenção @@ -871,7 +871,8 @@ Por que isso é relevante: | Funcionalidade | O que Faz | | ----------------------------------- | ----------------------------------------------------------------------------- | -| 🔌 **Circuit Breaker** | Auto-abertura/fechamento por provedor com limites configuráveis | +| 🔌 **Circuit Breaker** | Trip/recover por modelo com limites configuráveis | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **Anti-Thundering Herd** | Mutex + semáforo rate-limit para provedores com API key | | 🧠 **Cache Semântico** | Cache de duas camadas (assinatura + semântico) reduz custo e latência | | ⚡ **Idempotência de Requisição** | Janela de dedup de 5s para requisições duplicadas | diff --git a/README.pt.md b/README.pt.md index 12f34a6cd8..5f4d516476 100644 --- a/README.pt.md +++ b/README.pt.md @@ -294,6 +294,7 @@ Os provedores de IA podem ficar instáveis, retornar erros 5xx ou atingir limite - **Rebanho Anti-Trovão** — Proteção Mutex + semáforo contra tempestades de novas tentativas simultâneas - **Combo Fallback Chains** — Se o provedor primário falhar, ele cairá automaticamente na cadeia sem intervenção - **Combo Circuit Breaker** — Desativa automaticamente provedores com falha em uma cadeia de combinação + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Health Dashboard** — Monitoramento de tempo de atividade, estados de disjuntores, bloqueios, estatísticas de cache, latência p50/p95/p99 diff --git a/README.ro.md b/README.ro.md index 98501387ca..bb9ebd9577 100644 --- a/README.ro.md +++ b/README.ro.md @@ -290,10 +290,12 @@ Furnizorii de AI pot deveni instabili, pot returna erori 5xx sau pot atinge limi **Cum o rezolvă OmniRoute:** - **Circuit Breaker per furnizor** - Deschidere/închidere automată cu praguri configurabile și răcire (Închis/Deschis/Pe jumătate deschis) + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Backoff exponențial** — Întârzieri progresive ale reîncercării - **Anti-Thundering Herd** — Mutex + protecție semafor împotriva furtunilor concurente de reîncercare - **Combo Fallback Chains** — Dacă furnizorul principal eșuează, trece automat prin lanț fără nicio intervenție - **Combo Circuit Breaker** — Dezactivează automat furnizorii care eșuează dintr-un lanț combinat + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Tabloul de bord pentru sănătate** — Monitorizare timp de funcționare, stări întrerupătoare de circuit, blocări, statistici cache, latență p50/p95/p99 diff --git a/README.ru.md b/README.ru.md index 5cc92eb8cc..c2167bff29 100644 --- a/README.ru.md +++ b/README.ru.md @@ -864,6 +864,7 @@ npm run electron:build:linux # Linux (.AppImage) | Функция | Что делает | | -------------------------------- | ---------------------------------------------------------------------------- | | 🔌 **Circuit Breaker** | Авто-открытие/закрытие по провайдеру с настраиваемыми порогами | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **Anti-Thundering Herd** | Mutex + семафор для API key провайдеров | | 🧠 **Семантический кеш** | Двухуровневый кеш (сигнатура + семантика) снижает стоимость | | ⚡ **Идемпотентность запросов** | 5с окно дедупликации для дублирующихся запросов | diff --git a/README.sk.md b/README.sk.md index c1a620c1ce..217f71e608 100644 --- a/README.sk.md +++ b/README.sk.md @@ -295,6 +295,7 @@ Poskytovatelia AI sa môžu stať nestabilnými, vrátiť chyby 5xx alebo dosiah - **Anti-Thundering Herd** - ochrana Mutex + semafor proti súbežným opakovaným búrkam - **Combo Fallback Chains** – Ak primárny poskytovateľ zlyhá, automaticky prepadne reťazcom bez akéhokoľvek zásahu - **Combo Circuit Breaker** – Automaticky deaktivuje zlyhávajúcich poskytovateľov v rámci kombinovaného reťazca + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | – **Health Dashboard** – Monitorovanie dostupnosti, stavy ističov, blokovania, štatistiky vyrovnávacej pamäte, latencia p50/p95/p99 diff --git a/README.sv.md b/README.sv.md index b831e714ba..1787571299 100644 --- a/README.sv.md +++ b/README.sv.md @@ -864,6 +864,7 @@ npm run electron:build:linux # Linux (.AppImage) | Funktion | Vad det gör | | -------------------------------------- | --------------------------------------------------------------------------------- | | 🔌 **Circuit Breaker** | Autoöppna/stäng per leverantör med konfigurerbara trösklar | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | | 🛡️ **Anti-ånflock** | Mutex + semaforhastighetsgräns för API-nyckelleverantörer | | 🧠 **Semantisk cache** | Tvåskiktscache (signatur + semantisk) minskar kostnaden och fördröjningen | | ⚡ **Begär idempotens** | 5s dedup-fönster för dubblettförfrågningar | diff --git a/README.th.md b/README.th.md index 6a98249287..9f238d0fa3 100644 --- a/README.th.md +++ b/README.th.md @@ -294,6 +294,7 @@ OpenAI ใช้รูปแบบหนึ่ง Claude (Anthropic) ใช้ - **Anti-Thundering Herd** — Mutex + การป้องกันเซมาฟอร์จากพายุที่ลองใหม่พร้อมกัน - **Combo Fallback Chains** — หากผู้ให้บริการหลักล้มเหลว จะตกผ่านห่วงโซ่โดยอัตโนมัติโดยไม่มีการแทรกแซง - **Combo Circuit Breaker** — ปิดการใช้งานผู้ให้บริการที่ล้มเหลวภายในคอมโบเชนโดยอัตโนมัติ + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **แดชบอร์ดสุขภาพ** — การตรวจสอบสถานะการออนไลน์ สถานะของเซอร์กิตเบรกเกอร์ การล็อก สถิติแคช เวลาแฝง p50/p95/p99 diff --git a/README.uk-UA.md b/README.uk-UA.md index c58c88cafc..d987c41d5d 100644 --- a/README.uk-UA.md +++ b/README.uk-UA.md @@ -294,6 +294,7 @@ OpenAI використовує один формат, Claude (Anthropic) вик - **Anti-Thundering Herd** — Mutex + захист семафора від одночасних повторних штормів - **Комбіновані запасні ланцюги** — якщо основний постачальник виходить з ладу, автоматично проходить через ланцюжок без втручання. - **Combo Circuit Breaker** — автоматично вимикає несправні постачальники в комбінованому ланцюжку + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Health Dashboard** — Моніторинг безвідмовної роботи, стани автоматичного вимикача, блокування, статистика кешу, затримка p50/p95/p99 diff --git a/README.vi.md b/README.vi.md index 25c998e6d7..78b88a9a82 100644 --- a/README.vi.md +++ b/README.vi.md @@ -294,6 +294,7 @@ Các nhà cung cấp AI có thể trở nên không ổn định, trả về l - **Bầy chống sấm sét** — Mutex + bảo vệ semaphore chống lại các cơn bão thử lại đồng thời - **Chuỗi dự phòng kết hợp** — Nếu nhà cung cấp chính không thành công, nó sẽ tự động rơi qua chuỗi mà không cần can thiệp - **Combo Circuit Breaker** — Tự động vô hiệu hóa các nhà cung cấp bị lỗi trong chuỗi kết hợp + | 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | - **Bảng thông tin sức khỏe** — Giám sát thời gian hoạt động, trạng thái ngắt mạch, khóa, số liệu thống kê bộ nhớ đệm, độ trễ p50/p95/p99 diff --git a/README.zh-CN.md b/README.zh-CN.md index cef605e003..7d0cd811ef 100644 --- a/README.zh-CN.md +++ b/README.zh-CN.md @@ -1348,15 +1348,16 @@ codex "your prompt" ## 📖 文档 -| 文档 | 描述 | -| ----------------------------------- | ---------------------------- | -| [用户指南](docs/USER_GUIDE.md) | 提供商、组合、CLI 集成、部署 | -| [API 参考](docs/API_REFERENCE.md) | 所有端点及示例 | -| [故障排除](docs/TROUBLESHOOTING.md) | 常见问题和解决方案 | -| [架构](docs/ARCHITECTURE.md) | 系统架构和内部机制 | -| [贡献指南](CONTRIBUTING.md) | 开发设置和指南 | -| [OpenAPI 规范](docs/openapi.yaml) | OpenAPI 3.0 规范 | -| [安全策略](SECURITY.md) | 漏洞报告和安全实践 | +| 文档 | 描述 | +| ----------------------------------- | ------------------------------------------------------ | +| 🎯 **Endpoint-Aware Models** | Custom models declare supported endpoints + API format | +| [用户指南](docs/USER_GUIDE.md) | 提供商、组合、CLI 集成、部署 | +| [API 参考](docs/API_REFERENCE.md) | 所有端点及示例 | +| [故障排除](docs/TROUBLESHOOTING.md) | 常见问题和解决方案 | +| [架构](docs/ARCHITECTURE.md) | 系统架构和内部机制 | +| [贡献指南](CONTRIBUTING.md) | 开发设置和指南 | +| [OpenAPI 规范](docs/openapi.yaml) | OpenAPI 3.0 规范 | +| [安全策略](SECURITY.md) | 漏洞报告和安全实践 | --- diff --git a/package.json b/package.json index dab4b4d9c0..f0978ed31b 100644 --- a/package.json +++ b/package.json @@ -1,6 +1,6 @@ { "name": "omniroute", - "version": "2.0.0", + "version": "2.0.1", "description": "Smart AI Router with auto fallback — route to FREE & cheap models, zero downtime. Works with Cursor, Cline, Claude Desktop, Codex, and any OpenAI-compatible tool.", "type": "module", "bin": {