diff --git a/AGENTS.md b/AGENTS.md index 4472c2fa5e..2168ae70b9 100644 --- a/AGENTS.md +++ b/AGENTS.md @@ -46,7 +46,7 @@ Repository map and Reference Documentation sections below. ## Project at a Glance -**OmniRoute** โ€” unified AI proxy/router. One endpoint, 342 LLM providers, auto-fallback. +**OmniRoute** โ€” unified AI proxy/router. One endpoint, 343 LLM providers, auto-fallback. | Layer | Location | Purpose | | ------------- | ----------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | diff --git a/README.md b/README.md index fd13437fc9..43341e9895 100644 --- a/README.md +++ b/README.md @@ -7,7 +7,7 @@ # ๐Ÿš€ OmniRoute โ€” The Free AI Gateway -OmniRoute โ€” Never stop coding. Every AI tool โ†’ 342 providers โ€” 90+ free โ€” through one endpoint. Claude Code, Codex, Cursor, Cline, Copilot & Antigravity into FREE Claude / GPT / Gemini with auto-fallback. RTK + Caveman stacked compression saves 15โ€“95% tokens (~89% avg) โ€” never hit limits. 342 AI providers ยท 90+ free tiers ยท ~1.51B free tokens/mo ยท 19 routing strategies ยท $0 to start. +OmniRoute โ€” Never stop coding. Every AI tool โ†’ 343 providers โ€” 90+ free โ€” through one endpoint. Claude Code, Codex, Cursor, Cline, Copilot & Antigravity into FREE Claude / GPT / Gemini with auto-fallback. RTK + Caveman stacked compression saves 15โ€“95% tokens (~89% avg) โ€” never hit limits. 343 AI providers ยท 90+ free tiers ยท ~1.51B free tokens/mo ยท 19 routing strategies ยท $0 to start. @@ -101,7 +101,7 @@ โš™๏ธ Features ๐ŸŽฏ Combos - ๐ŸŒ Providers + ๐ŸŒ Providers ๐Ÿ”Œ CLI & MCP @@ -210,7 +210,7 @@ curl http://localhost:20128/v1/chat/completions \ -The Promise โ€” One endpoint. 342 providers. Never stop building โ€” OmniRoute picks the cheapest one that works. Six pillars: Never hit limits (auto-fallback across 342 providers in milliseconds, zero downtime) ยท Save up to 95% tokens (RTK + Caveman stacked compression cuts 15โ€“95%, ~89% avg on tool-heavy sessions) ยท $0 to start (90+ free tiers, 56 free forever โ€” no card needed) ยท Every tool works (33 coding agents through one config) ยท One endpoint (OpenAI โ†” Claude โ†” Gemini โ†” Responses API at /v1) ยท Production-grade (circuit breakers, TLS stealth, MCP 109 tools, A2A, memory, guardrails, evals โ€” 25,000+ tests). +The Promise โ€” One endpoint. 343 providers. Never stop building โ€” OmniRoute picks the cheapest one that works. Six pillars: Never hit limits (auto-fallback across 343 providers in milliseconds, zero downtime) ยท Save up to 95% tokens (RTK + Caveman stacked compression cuts 15โ€“95%, ~89% avg on tool-heavy sessions) ยท $0 to start (90+ free tiers, 56 free forever โ€” no card needed) ยท Every tool works (33 coding agents through one config) ยท One endpoint (OpenAI โ†” Claude โ†” Gemini โ†” Responses API at /v1) ยท Production-grade (circuit breakers, TLS stealth, MCP 109 tools, A2A, memory, guardrails, evals โ€” 25,000+ tests).

@@ -461,7 +461,7 @@ All **19** strategies โ€” mix & match per combo step: -What sets OmniRoute apart โ€” comparison table vs 9router, OpenRouter, CLIProxyAPI and LiteLLM across 13 capabilities. OmniRoute: 342 providers, 90+ free providers built-in, 19 routing strategies, 12-engine token compression, built-in MCP server with 109 tools, A2A agent protocol, persistent memory, guardrails, cloud agents, TLS fingerprint stealth, Desktop/Termux/PWA, 43 i18n UI locales, 100% MIT self-hosted. OmniRoute is the only one with the full set; competitors show a mix of checks, partials and crosses. Verified from each project's docs. +What sets OmniRoute apart โ€” comparison table vs 9router, OpenRouter, CLIProxyAPI and LiteLLM across 13 capabilities. OmniRoute: 343 providers, 90+ free providers built-in, 19 routing strategies, 12-engine token compression, built-in MCP server with 109 tools, A2A agent protocol, persistent memory, guardrails, cloud agents, TLS fingerprint stealth, Desktop/Termux/PWA, 43 i18n UI locales, 100% MIT self-hosted. OmniRoute is the only one with the full set; competitors show a mix of checks, partials and crosses. Verified from each project's docs. ๐Ÿ“Š Full methodology & per-feature detail vs 9router, OpenRouter, CLIProxyAPI & LiteLLM โ†’ [`docs/comparison/OMNIROUTE_VS_ALTERNATIVES.md`](docs/comparison/OMNIROUTE_VS_ALTERNATIVES.md) @@ -559,7 +559,7 @@ the current catalog at **[radar.omniroute.online/planos](https://radar.omniroute - **๐Ÿ–ผ๏ธ New endpoints** โ€” `/v1/ocr` (Mistral OCR) and `/v1/audio/translations` (Whisper-style) round out the media surface. โ†’ [API Reference](docs/reference/API_REFERENCE.md) - **๐ŸŽจ Image / video / audio generation** โ€” one API for media: xAI Grok Imagine & Novita AI video, ComfyUI, Freepik, Adobe Firefly, Microsoft Designer, Segmind, EdgeTTS. โ†’ [API Reference](docs/reference/API_REFERENCE.md) - **๐ŸŒ Deployment & ops** โ€” reverse-proxy `basePath`, browser-language auto-detect, per-key device tracking, root-less MITM trust, zh-TW localization. โ†’ [Environment](docs/reference/ENVIRONMENT.md) -- **๐Ÿค More providers & agents** โ€” Cursor Cloud Agent, Grok Build (xAI) with browser + OAuth login, Ollama first-class card, Claude Opus 5 & Sonnet 5, Kimi official partnership (Code/Web/Moonshot), Zed, Requesty, SenseNova, Yuanbao, Agnes AIโ€ฆ and a refreshed **342-provider catalog**. โ†’ [Providers](docs/reference/PROVIDER_REFERENCE.md) +- **๐Ÿค More providers & agents** โ€” Cursor Cloud Agent, Grok Build (xAI) with browser + OAuth login, Ollama first-class card, Claude Opus 5 & Sonnet 5, Kimi official partnership (Code/Web/Moonshot), Zed, Requesty, SenseNova, Yuanbao, Agnes AIโ€ฆ and a refreshed **343-provider catalog**. โ†’ [Providers](docs/reference/PROVIDER_REFERENCE.md) - **๐Ÿ“ก Routing transparency** โ€” every response carries an `X-OmniRoute-Decision` header naming the strategy/provider/latency that served it, a new `cache-optimized` combo strategy + Auto-Combo `cacheAffinity` factor route repeat requests back to the connection holding the cached prefix, and a read-only `/v1/auto-combo/{channel}/candidates` endpoint exposes an `auto/*` channel's live candidate pool. โ†’ [Auto-Combo](docs/routing/AUTO-COMBO.md) - **โšก Local performance & infra** โ€” one-click local Redis, Cloudflare Workers / Deno Deploy relay deployers, Bifrost & Mux as supervised embedded services. โ†’ [Embedded Services](docs/frameworks/EMBEDDED-SERVICES.md) @@ -642,11 +642,11 @@ of your shell history. โ†’ [CLI Integrations](docs/guides/CLI-INTEGRATIONS.md)
-## ๐ŸŒ 342 AI Providers โ€” 90+ Free +## ๐ŸŒ 343 AI Providers โ€” 90+ Free
-> The most complete catalog of any open-source router: **342 providers**, **90+ with a free tier**, **56 free forever**. +> The most complete catalog of any open-source router: **343 providers**, **90+ with a free tier**, **56 free forever**.
diff --git a/docs/diagrams/cli-terminal.svg b/docs/diagrams/cli-terminal.svg index a18765a9c7..507e8ac54c 100644 --- a/docs/diagrams/cli-terminal.svg +++ b/docs/diagrams/cli-terminal.svg @@ -1,4 +1,4 @@ - + Compact animated terminal cycling three real OmniRoute CLI commands with a typewriter effect and a scrolling subcommand ticker; the first frame shows the completed providers-list screen. diff --git a/docs/diagrams/comparison-table.svg b/docs/diagrams/comparison-table.svg index 744dbb7d00..e69c2d0c2c 100644 --- a/docs/diagrams/comparison-table.svg +++ b/docs/diagrams/comparison-table.svg @@ -1,4 +1,4 @@ - + Static-header comparison table where each capability row fades in top to bottom; the OmniRoute column is highlighted and shows a check or a leading value in every row, while competitors show a mix of checks, partials and crosses. diff --git a/docs/diagrams/promise-pillars.svg b/docs/diagrams/promise-pillars.svg index 5b692896e9..c73ef5e0d7 100644 --- a/docs/diagrams/promise-pillars.svg +++ b/docs/diagrams/promise-pillars.svg @@ -1,4 +1,4 @@ - + Animated promise card: six pillar tiles fade in in reading order, then a soft colored border highlight sweeps from tile to tile in a continuous cycle. @@ -21,7 +21,7 @@ - One endpoint. 342 providers. Never stop building โ€” OmniRoute picks the cheapest one that works. + One endpoint. 343 providers. Never stop building โ€” OmniRoute picks the cheapest one that works. @@ -38,7 +38,7 @@ Never hit limits - Auto-fallback across 342 providers in + Auto-fallback across 343 providers in milliseconds. Quota out? The next provider takes over โ€” zero downtime. diff --git a/docs/diagrams/readme-hero.svg b/docs/diagrams/readme-hero.svg index 6e13fac6b4..e5ad1f9971 100644 --- a/docs/diagrams/readme-hero.svg +++ b/docs/diagrams/readme-hero.svg @@ -1,4 +1,4 @@ - + Animated hero card: a pulse travels the divider line and a compression bar demo repeatedly shrinks a prompt by up to 95 percent; all headline content is static and readable on the first frame. @@ -28,7 +28,7 @@ Never stop coding. - Every AI tool โ†’ 342 providers โ€” 90+ free โ€” through one endpoint. + Every AI tool โ†’ 343 providers โ€” 90+ free โ€” through one endpoint. Claude Code ยท Codex ยท Cursor ยท Cline ยท Copilot ยท Antigravity  โ†’  FREE Claude / GPT / Gemini ยท auto-fallback diff --git a/docs/reference/PROVIDER_REFERENCE.md b/docs/reference/PROVIDER_REFERENCE.md index 64dc00960d..440088ed3d 100644 --- a/docs/reference/PROVIDER_REFERENCE.md +++ b/docs/reference/PROVIDER_REFERENCE.md @@ -1,16 +1,16 @@ --- title: "Provider Reference" version: 3.8.50 -lastUpdated: 2026-08-19 +lastUpdated: 2026-08-20 --- # Provider Reference > **Auto-generated** from `src/shared/constants/providers.ts` โ€” do not edit by hand. > Regenerate with: `npm run gen:provider-reference` -> **Last generated:** 2026-08-19 +> **Last generated:** 2026-08-20 -Total providers: **342**. See category breakdown below. +Total providers: **343**. See category breakdown below. ## Categories @@ -120,7 +120,7 @@ Use the dashboard at `/dashboard/providers` to enable, configure, and test each | `zai-web` | `zw` | Z.ai Web | Web cookie | [link](https://chat.z.ai) | Copy the "token" value from chat.z.ai โ†’ DevTools โ†’ Application โ†’ Local Storage. Do not copy cookies; OmniRoute handles the per-request CAPTCHA through its browser transport. | โ€” | | `zenmux-free` | `zmf` | ZenMux Free (Web) | Web cookie | [link](https://zenmux.ai) | Login at zenmux.ai, then export all cookies using EditThisCookie or Cookie-Editor and paste the full Cookie header string here. Refresh every ~30 days. | โ€” | -## API Key Providers (paid / paid-with-free-credits) (229) +## API Key Providers (paid / paid-with-free-credits) (230) | ID | Alias | Name | Tags | Website | Notes | |----|-------|------|------|---------|-------| @@ -323,9 +323,9 @@ Use the dashboard at `/dashboard/providers` to enable, configure, and test each | `thebai` | `thebai` | TheB.AI | API key, aggregator | [link](https://theb.ai) | Bearer API key for the TheB.AI OpenAI-compatible gateway. | | `tinyfish` | `tf` | TinyFish Fetch | API key | [link](https://docs.tinyfish.ai/fetch-api) | X-API-Key from agent.tinyfish.ai/api-keys | | `together` | `together` | Together AI | API key, video | [link](https://www.together.ai) | โ€” | +| `token-kiosk` | `tk` | Token Kiosk | API key | [link](https://agent-router.gaib.ai) | Use your Token Kiosk API key in Authorization: Bearer . Fully OpenAI-compatible gateway. API base URL: https://agent-router.gaib.ai/v1. | | `tokenreply` | `tokenreply` | TokenReply | API key, aggregator | [link](https://www.tokenreply.com) | Free-tagged models have model- and campaign-specific daily limits; no fixed global free quota is published. | -| `tokenrouter` | `trk` | TokenRouter | API key | [link](https://tokenrouter.com) | Use your TokenRouter API key in Authorization: Bearer *** Fully OpenAI-compatible. API base URL: https://api.tokenrouter.com/v1. | -| `token-kiosk` | `tk` | Token Kiosk | API key | [link](https://agent-router.gaib.ai) | Use your Token Kiosk API key in Authorization: Bearer *** Fully OpenAI-compatible. API base URL: https://agent-router.gaib.ai/v1. | +| `tokenrouter` | `trk` | TokenRouter | API key | [link](https://tokenrouter.com) | Use your TokenRouter API key in Authorization: Bearer . Fully OpenAI-compatible. API base URL: https://api.tokenrouter.com/v1. | | `topaz` | `topaz` | Topaz | API key, image | [link](https://topazlabs.com) | โ€” | | `typhoon` | `typhoon` | Typhoon | API key | [link](https://docs.opentyphoon.ai) | Free API key with a 5 req/s and 200 req/m rate limit. | | `udio` | `udio` | Udio | API key | [link](https://udio.com) | Paste session cookie from udio.com (Supabase auth) | diff --git a/llm.txt b/llm.txt index cc2d9d5aba..c80df65ca7 100644 --- a/llm.txt +++ b/llm.txt @@ -1,6 +1,6 @@ # OmniRoute -> OmniRoute is a free, open-source AI Gateway that acts as a universal API proxy for multi-provider LLMs. It provides smart routing, automatic fallback, load balancing, and format translation across 342 AI providers โ€” all through a single OpenAI-compatible endpoint. Includes a built-in MCP Server (109 tools), A2A v0.3 protocol, Memory/Skills systems, Cloud Agents (codex, cursor, devin, jules), Guardrails framework, and an Electron desktop app. +> OmniRoute is a free, open-source AI Gateway that acts as a universal API proxy for multi-provider LLMs. It provides smart routing, automatic fallback, load balancing, and format translation across 343 AI providers โ€” all through a single OpenAI-compatible endpoint. Includes a built-in MCP Server (109 tools), A2A v0.3 protocol, Memory/Skills systems, Cloud Agents (codex, cursor, devin, jules), Guardrails framework, and an Electron desktop app. ## Overview @@ -165,7 +165,7 @@ OmniRoute solves the problem of managing multiple AI provider subscriptions, quo โ”‚ โ”‚ โ””โ”€โ”€ manager.ts # MITM proxy manager โ”‚ โ”œโ”€โ”€ shared/ # Shared utilities, components, and constants โ”‚ โ”‚ โ”œโ”€โ”€ components/ # Reusable UI components (Card, Badge, Button, Modal, Sidebar, ProviderIcon, etc.) -โ”‚ โ”‚ โ”œโ”€โ”€ constants/ # Provider definitions (342), model lists, pricing, routing strategies, MCP scopes +โ”‚ โ”‚ โ”œโ”€โ”€ constants/ # Provider definitions (343), model lists, pricing, routing strategies, MCP scopes โ”‚ โ”‚ โ”œโ”€โ”€ contracts/ # Shared API contracts โ”‚ โ”‚ โ”œโ”€โ”€ hooks/ # React hooks โ”‚ โ”‚ โ”œโ”€โ”€ middleware/ # Shared middleware utilities @@ -277,7 +277,7 @@ OmniRoute solves the problem of managing multiple AI provider subscriptions, quo ## Key Features (v3.8.50) ### Core Proxy -- **342 AI providers** with automatic format translation +- **343 AI providers** with automatic format translation - **Provider categories**: Free (90+ free tiers), OAuth, API Key, Self-Hosted, Custom (OpenAI/Anthropic-compatible) - **18 routing strategies**: priority, weighted, round-robin, fill-first, p2c, random, least-used, cost-optimized, reset-aware, reset-window, headroom, strict-random, auto, lkgp, context-optimized, context-relay, fusion, pipeline - **4-tier fallback**: Subscription โ†’ API Key โ†’ Cheap โ†’ Free @@ -475,7 +475,7 @@ diagnostics) plus **memory**, **skill**, **agentSkill**, **githubSkill**, **pool ## v3.8.x Highlights -- **342-provider catalog** with 90+ free tiers, one-click account imports, and bulk key add +- **343-provider catalog** with 90+ free tiers, one-click account imports, and bulk key add - **19 routing strategies** โ€” including `fusion` (parallel panel + judge synthesis), `pipeline`, `reset-aware`, `reset-window`, `headroom`, and `context-relay` - **14-factor Auto-Combo scoring** with bandit exploration and progressive cooldown - **MCP server expanded to 109 tools / 33 scopes** (canonical + memory/skill/agentSkill/githubSkill/pool/notion/obsidian/localCorpus/gamification/plugin modules) diff --git a/package.json b/package.json index 5a235fec3b..a199504707 100644 --- a/package.json +++ b/package.json @@ -1,7 +1,7 @@ { "name": "omniroute", "version": "3.8.50", - "description": "Unified AI router with 342 providers, RTK+Caveman compression, auto fallback, MCP/A2A, desktop, PWA, and OpenAI-compatible APIs.", + "description": "Unified AI router with 343 providers, RTK+Caveman compression, auto fallback, MCP/A2A, desktop, PWA, and OpenAI-compatible APIs.", "type": "module", "bin": { "omniroute": "bin/omniroute.mjs",