Files
OmniRoute/examples/quickstart/python_requests.py
Praveen K Palaniswamy 65e81158ab fix(ollama): route models by advertised capability (#11088)
Landed with the design call resolved per the owner's pick — **option 1**: the synced store is now endpoint-agnostic (persistDiscoveredModels and managedModelImport no longer drop non-chat models at write time), and chat selectability moved to read time (auto-pool expansion in autoStrategy applies filterChatSelectableModels; the models-route projection already had its chatOnly filter). Your discovery test now passes end-to-end (3/3): /api/show capabilities persist per connection and image/embedding requests route through the advertising host.

Reconciliation notes: conflicted areas merged onto the current tip (adobe discovery import, requestedModel preflight signature, resolvedProvider fast-path coexists with the synced-route override — explicit resolution wins); carried base-red drains (#10055 memoization, #11071 test variants) dropped as already-landed; the managed-model-import exclusion test was propagated to the new contract (image/video models persist; the read filter still hides them from chat pickers — pinned by a new assertion). Full battery: 205/206 focused (the one red is a confirmed periodic-timer timing flake on the loaded devbox — 20/20 isolated), autoCombo vitest 30/30, combo suites 46/46, gates + typecheck clean.

Thank you @yourspraveen — the capability probe + routing design was right; it just needed the store contract opened up. Fixes #11087.
2026-08-23 11:45:01 -03:00

34 lines
1.0 KiB
Python

"""
OmniRoute Quickstart — Python (requests library)
================================================
Run: pip install requests (if not already installed)
python python_requests.py
"""
import requests
# Your local OmniRoute server — started with: npx omniroute
API_URL = "http://localhost:20128/v1/chat/completions"
headers = {
"Content-Type": "application/json",
"Authorization": "Bearer dummy-key", # Any string works for free/keyless providers
}
data = {
"model": "felo/auto", # Keyless, works out of the box — no sign-up needed
"stream": False,
"messages": [
{"role": "user", "content": "Hello! What can you do?"}
],
}
response = requests.post(API_URL, headers=headers, json=data)
response.raise_for_status()
print(response.json()["choices"][0]["message"]["content"])
# Fresh install, zero credentials — `auto` already works:
# curl http://localhost:20128/v1/chat/completions \
# -H "Content-Type: application/json" \
# -d '{"model":"auto","messages":[{"role":"user","content":"Hello!"}]}'