mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-08-25 16:42:16 +03:00
fix(ollama): route models by advertised capability (#11088)
Landed with the design call resolved per the owner's pick — **option 1**: the synced store is now endpoint-agnostic (persistDiscoveredModels and managedModelImport no longer drop non-chat models at write time), and chat selectability moved to read time (auto-pool expansion in autoStrategy applies filterChatSelectableModels; the models-route projection already had its chatOnly filter). Your discovery test now passes end-to-end (3/3): /api/show capabilities persist per connection and image/embedding requests route through the advertising host. Reconciliation notes: conflicted areas merged onto the current tip (adobe discovery import, requestedModel preflight signature, resolvedProvider fast-path coexists with the synced-route override — explicit resolution wins); carried base-red drains (#10055 memoization, #11071 test variants) dropped as already-landed; the managed-model-import exclusion test was propagated to the new contract (image/video models persist; the read filter still hides them from chat pickers — pinned by a new assertion). Full battery: 205/206 focused (the one red is a confirmed periodic-timer timing flake on the loaded devbox — 20/20 isolated), autoCombo vitest 30/30, combo suites 46/46, gates + typecheck clean. Thank you @yourspraveen — the capability probe + routing design was right; it just needed the store contract opened up. Fixes #11087.
This commit is contained in:
committed by
GitHub
parent
c68cda7dfb
commit
65e81158ab
33
examples/quickstart/python_requests.py
Normal file
33
examples/quickstart/python_requests.py
Normal file
@@ -0,0 +1,33 @@
|
||||
"""
|
||||
OmniRoute Quickstart — Python (requests library)
|
||||
================================================
|
||||
Run: pip install requests (if not already installed)
|
||||
python python_requests.py
|
||||
"""
|
||||
|
||||
import requests
|
||||
|
||||
# Your local OmniRoute server — started with: npx omniroute
|
||||
API_URL = "http://localhost:20128/v1/chat/completions"
|
||||
|
||||
headers = {
|
||||
"Content-Type": "application/json",
|
||||
"Authorization": "Bearer dummy-key", # Any string works for free/keyless providers
|
||||
}
|
||||
|
||||
data = {
|
||||
"model": "felo/auto", # Keyless, works out of the box — no sign-up needed
|
||||
"stream": False,
|
||||
"messages": [
|
||||
{"role": "user", "content": "Hello! What can you do?"}
|
||||
],
|
||||
}
|
||||
|
||||
response = requests.post(API_URL, headers=headers, json=data)
|
||||
response.raise_for_status()
|
||||
print(response.json()["choices"][0]["message"]["content"])
|
||||
|
||||
# Fresh install, zero credentials — `auto` already works:
|
||||
# curl http://localhost:20128/v1/chat/completions \
|
||||
# -H "Content-Type: application/json" \
|
||||
# -d '{"model":"auto","messages":[{"role":"user","content":"Hello!"}]}'
|
||||
Reference in New Issue
Block a user