- 🚫 Never hit limits
Auto-fallback across 236 providers in milliseconds. Quota out? Next provider takes over — zero downtime. |
+ 🚫 Never hit limits
Auto-fallback across 237 providers in milliseconds. Quota out? Next provider takes over — zero downtime. |
💸 Save up to 95% tokens
RTK + Caveman stacked compression cuts 15–95% of eligible tokens (~89% avg on tool-heavy sessions). |
🆓 $0 to start
90+ providers with a free tier, 11 free forever (Kiro, Qoder, Pollinations, LongCat…). No card needed. |
@@ -308,7 +308,7 @@ Result: 4 layers of fallback = zero downtime
| Feature | OmniRoute | Other routers |
| -------------------------------------- | ------------------------------------------------------------------- | ------------- |
-| 🌐 Providers | **236** | 20–100 |
+| 🌐 Providers | **237** | 20–100 |
| 🆓 Free providers | **90+ (11 free forever)** | 1–5 |
| 🔀 Routing strategies | **17** (priority, weighted, cost-optimized, context-relay, fusion…) | 1–3 |
| 🗜️ Token compression | **RTK + Caveman stacked (15–95%)** | None / 20–40% |
@@ -344,7 +344,7 @@ Result: 4 layers of fallback = zero downtime
- **💸 Cost telemetry everywhere** — `X-OmniRoute-*` cost/usage headers on every endpoint (including media), a non-token cost engine, a cache-HIT `X-OmniRoute-Cost-Saved` header, and per-key USD spend quotas. → [API Reference](docs/reference/API_REFERENCE.md)
- **🧠 Memory you control** — opt-in int8 vector quantization (Qdrant + sqlite-vec), memory off by default, and a per-request `x-omniroute-no-memory` header. → [Memory](docs/frameworks/MEMORY.md)
- **🛡️ Security** — a prompt-injection guard across every LLM route (backed by a red-team suite), plus a free DuckDuckGo last-resort web search. → [Guardrails](docs/security/GUARDRAILS.md)
-- **🤝 More providers & agents** — Cursor Cloud Agent (a 4th cloud agent), CodeBuddy CN (`copilot.tencent.com`), a Google Flow video-generation provider, new gateways **DGrid** and **Pioneer AI** (Fastino Labs), inbound **xAI Grok** translators plus **Grok Build (xAI)** with an OAuth import-token flow, GPT-4 / GPT-4o-mini on the GitHub Copilot provider, multi-model **Factory Droid**, **ZenMux Free** (session-cookie free tier), **Alibaba DashScope** text-to-video (`wan2.7-t2v`), a refreshed 236-provider catalog (OrcaRouter, Wafer AI, OpenAdapter, dit.ai, TokenRouter, …), Vertex AI media generation (speech / transcription / music / video), and one-click account import from CLIProxyAPI (`~/.cli-proxy-api/`). → [Providers](docs/reference/PROVIDER_REFERENCE.md)
+- **🤝 More providers & agents** — Cursor Cloud Agent (a 4th cloud agent), CodeBuddy CN (`copilot.tencent.com`), a Google Flow video-generation provider, new gateways **DGrid** and **Pioneer AI** (Fastino Labs), inbound **xAI Grok** translators plus **Grok Build (xAI)** with an OAuth import-token flow, GPT-4 / GPT-4o-mini on the GitHub Copilot provider, multi-model **Factory Droid**, **ZenMux Free** (session-cookie free tier), **Alibaba DashScope** text-to-video (`wan2.7-t2v`), a refreshed 237-provider catalog (OrcaRouter, Wafer AI, OpenAdapter, dit.ai, TokenRouter, …), Vertex AI media generation (speech / transcription / music / video), and one-click account import from CLIProxyAPI (`~/.cli-proxy-api/`). → [Providers](docs/reference/PROVIDER_REFERENCE.md)
- **⚡ Local performance & infra** — a one-click local Redis launcher (`omniroute redis up`, plus a dashboard Redis panel), one-click **Cloudflare Workers** and **Deno Deploy** relay deployers wired into the proxy pool, and an optional Bifrost Go sidecar that offloads the hottest relay path (`BIFROST_BASE_URL`, with automatic fallback to the TypeScript path on timeout) — now with a relay-backend selector (`OMNIROUTE_RELAY_BACKEND=ts|bifrost|auto`) so the `/v1/relay` endpoint stays the stable surface while choosing the fastest backend internally. → [Environment](docs/reference/ENVIRONMENT.md)
@@ -387,11 +387,11 @@ Result: 4 layers of fallback = zero downtime
-# 🌐 236 AI Providers — 90+ Free
+# 🌐 237 AI Providers — 90+ Free
-> The most complete catalog of any open-source router: **236 providers**, **90+ with a free tier**, **11 free forever**.
+> The most complete catalog of any open-source router: **237 providers**, **90+ with a free tier**, **11 free forever**.
@@ -899,7 +899,7 @@ Compression: aggressive (~50%) → double your free quota · Cost: $0/mo
**Will I be charged by OmniRoute?** No — it's free, open-source software on your machine. You only pay paid providers directly. OmniRoute has no billing system.
**Are FREE providers really unlimited?** Mostly — Qoder, Pollinations, LongCat, and Cloudflare are free with no per-account credit cap. Kiro is free too but capped at ~50 credits/month per account. Stack multiple free providers in a combo and auto-fallback keeps you serving for $0.
**Will compression hurt quality?** No — it only compresses the **input**; code, URLs, JSON are always protected.
-**Does it work where AI is blocked?** Yes — 3-level proxy + 1proxy marketplace reach all 236 providers.
+**Does it work where AI is blocked?** Yes — 3-level proxy + 1proxy marketplace reach all 237 providers.
📖 [User Guide](docs/guides/USER_GUIDE.md) · [API Reference](docs/reference/API_REFERENCE.md) · [Environment Config](docs/reference/ENVIRONMENT.md)
diff --git a/docs/reference/PROVIDER_REFERENCE.md b/docs/reference/PROVIDER_REFERENCE.md
index dbdee596c2..f313db9895 100644
--- a/docs/reference/PROVIDER_REFERENCE.md
+++ b/docs/reference/PROVIDER_REFERENCE.md
@@ -10,7 +10,7 @@ lastUpdated: 2026-06-30
> Regenerate with: `npm run gen:provider-reference`
> **Last generated:** 2026-06-30
-Total providers: **236**. See category breakdown below.
+Total providers: **237**. See category breakdown below.
## Categories
@@ -247,7 +247,7 @@ Use the dashboard at `/dashboard/providers` to enable, configure, and test each
| `zai` | `zai` | Z.AI | API key | [link](https://open.bigmodel.cn) | — |
| `zenmux` | `zm` | ZenMux | API key | [link](https://zenmux.ai) | Use your ZenMux API key in Authorization: Bearer . ZenMux is fully OpenAI-compatible. Base URL: https://zenmux.ai/api/v1. |
-## Local Providers (11)
+## Local Providers (12)
| ID | Alias | Name | Tags | Website | Notes |
|----|-------|------|------|---------|-------|
@@ -257,6 +257,7 @@ Use the dashboard at `/dashboard/providers` to enable, configure, and test each
| `llama-cpp` | `llamacpp` | llama.cpp | Local, self-hosted | [link](https://github.com/ggml-org/llama.cpp) | API key optional (use any value, e.g. sk-no-key-required). Configure the llama-server OpenAI-compatible base URL (default: http://127.0.0.1:8080/v1). Note: if Llamafile is also installed, both default to port 8080 — run only one at a time or override the port. |
| `llamafile` | `llamafile` | Llamafile | Local, self-hosted | [link](https://github.com/Mozilla-Ocho/llamafile) | API key optional. Configure the local Llamafile OpenAI-compatible base URL (default: http://127.0.0.1:8080/v1). |
| `lm-studio` | `lmstudio` | LM Studio | Local, self-hosted | [link](https://lmstudio.ai) | API key optional. Configure the local LM Studio OpenAI-compatible base URL (default: http://localhost:1234/v1). |
+| `ollama-local` | `ollama` | Ollama | Local, self-hosted | [link](https://ollama.com) | No API key required. Ollama runs locally — configure its OpenAI-compatible base URL (default: http://localhost:11434/v1) and make sure Ollama is running before connecting. |
| `oobabooga` | `ooba` | oobabooga | Local, self-hosted | [link](https://github.com/oobabooga/text-generation-webui) | API key optional. Configure the local oobabooga OpenAI-compatible base URL (default: http://localhost:5000/v1). |
| `sdwebui` | `sdwebui` | SD WebUI | Local | [link](https://github.com/AUTOMATIC1111/stable-diffusion-webui) | No API key required. Configure the local WebUI base URL (default: http://localhost:7860). |
| `triton` | `triton` | NVIDIA Triton | Local, self-hosted | [link](https://developer.nvidia.com/triton-inference-server) | API key optional. Configure the Triton OpenAI-compatible base URL (default: http://localhost:8000/v1). |
diff --git a/open-sse/executors/default.ts b/open-sse/executors/default.ts
index db15963796..eac8d95603 100644
--- a/open-sse/executors/default.ts
+++ b/open-sse/executors/default.ts
@@ -271,6 +271,7 @@ export class DefaultExecutor extends BaseExecutor {
const baseUrl = credentials?.providerSpecificData?.baseUrl || this.config.baseUrl;
return normalizeOpenAIChatUrl(baseUrl);
}
+ case "ollama-local":
case "llama-cpp":
case "lm-studio":
case "modal":
diff --git a/src/shared/constants/providers.ts b/src/shared/constants/providers.ts
index dbb61b205c..38a7bfeae5 100644
--- a/src/shared/constants/providers.ts
+++ b/src/shared/constants/providers.ts
@@ -151,6 +151,7 @@ export function isLocalProvider(providerId: unknown): boolean {
}
export const SELF_HOSTED_CHAT_PROVIDER_IDS = new Set([
+ "ollama-local",
"lm-studio",
"vllm",
"lemonade",
diff --git a/src/shared/constants/providers/local.ts b/src/shared/constants/providers/local.ts
index 1d32bac27e..a16939fbb9 100644
--- a/src/shared/constants/providers/local.ts
+++ b/src/shared/constants/providers/local.ts
@@ -3,6 +3,19 @@
* Pure data literal; re-exported by the providers.ts barrel. No behavior change.
*/
export const LOCAL_PROVIDERS = {
+ "ollama-local": {
+ id: "ollama-local",
+ alias: "ollama",
+ name: "Ollama",
+ icon: "pets",
+ color: "#58A6FF",
+ textIcon: "OL",
+ website: "https://ollama.com",
+ authHint:
+ "No API key required. Ollama runs locally — configure its OpenAI-compatible base URL (default: http://localhost:11434/v1) and make sure Ollama is running before connecting.",
+ localDefault: "http://localhost:11434/v1",
+ passthroughModels: true,
+ },
"lm-studio": {
id: "lm-studio",
alias: "lmstudio",
diff --git a/tests/unit/ollama-local-provider.test.ts b/tests/unit/ollama-local-provider.test.ts
new file mode 100644
index 0000000000..70a6489514
--- /dev/null
+++ b/tests/unit/ollama-local-provider.test.ts
@@ -0,0 +1,50 @@
+import { test } from "node:test";
+import assert from "node:assert/strict";
+
+import {
+ LOCAL_PROVIDERS,
+ isLocalProvider,
+ isSelfHostedChatProvider,
+} from "@/shared/constants/providers";
+import { DefaultExecutor } from "@omniroute/open-sse/executors/default.ts";
+
+// #5578: Ollama is the most popular local runtime, yet OmniRoute only shipped
+// `ollama-cloud` (api-key, cloud) and `ollama-search` (web search). There was no
+// first-class card for the local Ollama runtime (localhost:11434). This adds
+// `ollama-local` to the local catalog so users get a dedicated card instead of
+// falling back to the generic `openai-compatible-*` provider.
+
+test("ollama-local is a first-class entry in the local catalog", () => {
+ const entry = LOCAL_PROVIDERS["ollama-local"];
+ assert.ok(entry, "ollama-local must be defined in LOCAL_PROVIDERS");
+ assert.equal(entry.id, "ollama-local");
+ assert.equal(entry.name, "Ollama");
+ // Ollama exposes an OpenAI-compatible surface at /v1 on its default port.
+ assert.equal(entry.localDefault, "http://localhost:11434/v1");
+ // Models are listed via the OpenAI-compatible /v1/models passthrough.
+ assert.equal(entry.passthroughModels, true);
+});
+
+test("ollama-local is classified as a local, self-hosted chat provider", () => {
+ assert.equal(isLocalProvider("ollama-local"), true);
+ assert.equal(isSelfHostedChatProvider("ollama-local"), true);
+});
+
+test("ollama-local buildUrl routes to the configured local baseUrl, not OpenAI", () => {
+ const executor = new DefaultExecutor("ollama-local");
+ const url = executor.buildUrl("llama3.2", true, 0, {
+ providerSpecificData: { baseUrl: "http://127.0.0.1:11434/v1" },
+ });
+
+ assert.equal(url, "http://127.0.0.1:11434/v1/chat/completions");
+ assert.equal(new URL(url).hostname, "127.0.0.1", `expected local host, got ${url}`);
+});
+
+test("ollama-local buildUrl falls back to localhost:11434, never OpenAI, when no baseUrl is set", () => {
+ const executor = new DefaultExecutor("ollama-local");
+ const url = executor.buildUrl("llama3.2", true, 0, {});
+
+ assert.equal(url, "http://localhost:11434/v1/chat/completions");
+ assert.equal(new URL(url).hostname, "localhost", `expected local default host, got ${url}`);
+ assert.notEqual(new URL(url).hostname, "api.openai.com");
+});