mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-07-26 09:52:11 +03:00
* chore(release): open v3.8.10 development cycle Bump 3.8.9 → 3.8.10 across package.json, lockfile, electron, open-sse, and docs/reference/openapi.yaml; add the [3.8.10] CHANGELOG section (root + 41 i18n mirrors) as the integration target for the cycle. Entries land here as work merges into release/v3.8.10; finalized by the release flow. * fix(providers): resolve web provider alias collisions Assign unique aliases to HuggingChat, Kimi Web, and Qwen Web so they no longer shadow primary providers or trigger startup warnings. Add a unit test to enforce provider alias uniqueness and prevent future collisions. Also expand local ignore and VS Code exclude rules for agent, build, and worktree artifacts. * fix(responses): normalize image_url parts across input paths (#3150) Normalize image_url parts across all Responses input paths. Integrated into release/v3.8.10. * fix(api-manager): preserve API key expiration local time (#3146) Preserve API key expiration local time + clear button. Integrated into release/v3.8.10. * Strip previous_response_id for stateless Responses upstreams (#3143) Strip previous_response_id for stateless Responses upstreams (auto/strip/preserve). Integrated into release/v3.8.10. * fix(opencode-plugin): map thinking cap to interleaved in model+combo (#3138) Map caps.thinking to ModelV2.capabilities.interleaved for opencode-plugin. Integrated into release/v3.8.10. * fix(providers): use synced models as fallback for all providers (#3148) Use synced models as authoritative local catalog for all providers (+regression test). Integrated into release/v3.8.10. * fix(qoder): bifurcate validation by token type — PAT→Cosy, regular API key→dashscope (#3149) Bifurcate Qoder validation by token type (PAT→Cosy, regular→dashscope) +regression test. Integrated into release/v3.8.10. * fix(antigravity): dynamic model resolution via MITM alias table (#3144) Dynamic antigravity MITM model resolution in the executor (+bug fix +regression test; DB import dropped from client-reachable config). Integrated into release/v3.8.10. * Feature/batch allow big (#3128) Podman deployment options + larger upload body-size limits (+CONTAINER_HOST docs). Integrated into release/v3.8.10. * fix(fireworks): preserve fully-qualified router/model IDs (#3133) (#3160) Fireworks router IDs (accounts/fireworks/routers/...) were double-prefixed with accounts/fireworks/models/ → upstream 404. Add optional acceptedModelIdPrefixes to the registry entry and skip the prepend when the model already starts with an accepted prefix. Co-authored-by: KooshaPari <KooshaPari@users.noreply.github.com> * fix(llama-cpp): route to configured local baseUrl instead of OpenAI (#3136) (#3161) llama-cpp was missing from the local-provider group in buildUrl(), so it fell through to the OpenAI baseUrl and returned an OpenAI 401. Add the case to resolve the connection's providerSpecificData.baseUrl. Co-authored-by: tjengbudi <tjengbudi@users.noreply.github.com> * fix(t3-chat-web): parse cookies + convexSessionId from stored credential (#3007) (#3162) The executor read credentials.cookies/convexSessionId, but the pipeline only stores the pasted string under apiKey → t3.chat always 400'd. Parse both values from apiKey (fallback accessToken), mirroring validation.ts. Co-authored-by: minhtran162 <minhtran162@users.noreply.github.com> * fix(minimax): stop capping MiniMax-M3 / M2.7 max_tokens at 8192 (#3141) (#3163) MiniMax-M3 had no MODEL_SPECS entry and capitalized MiniMax-M2.7 missed its lowercase spec (case-sensitive lookup) → both fell to the 8192 default cap. Add the M3 spec (512K output), alias the capitalized ids, and make getModelSpec lookups case-insensitive. Co-authored-by: totaltube <totaltube@users.noreply.github.com> * fix(github-copilot): discover model catalog live from api.githubcopilot.com (#3120, #3121) (#3164) The github (Copilot) provider had a static hardcoded catalog with no discovery source, so Import Models never refreshed (#3120) and advertised non-entitled models that 400 on use (#3121). Add a live /models fetch with fallback to the static list. Co-authored-by: gabrielmoreira <gabrielmoreira@users.noreply.github.com> * fix(combo): invalidate nested-combo cache on edits + log DATA_DIR (#3147) (#3165) Editing a combo did not invalidate the 10s nested-combo expansion caches (chat.ts getCombosCachedForChat + chatCore.ts getCombosCached; the exported clearCombosCache was dead code), so a removed nested target/model could be served as a phantom for up to 10s. Wire a shared monotonic combos-cache version in readCache (bumped by invalidateDbCache("combos") on every combo write); both cache layers treat a version mismatch as a miss. Also log the resolved DATA_DIR/SQLITE_FILE absolute path at DB init so the reporter's 'persists across restart + volume wipe' symptom (a multi-replica Docker volume/DATA_DIR mismatch, not a routing bug) is diagnosable from logs. Includes consolidated CHANGELOG entries for #3133/#3136/#3007/#3141/#3120/#3121. Co-authored-by: ViFigueiredo <ViFigueiredo@users.noreply.github.com> * fix(web-tools): parse bare JSON tool calls (#3157) Parse bare JSON tool calls for deepseek-web (#2820) + fuzzy tool-name matching. Integrated into release/v3.8.10. * fix(misc): minor fixes across reasoning cache, account fallback, binary manager (#3177) Misc: ProviderProfile export, DeepSeek reasoning regex, binary guard. Integrated into release/v3.8.10. * fix(kiro): minor OAuth social exchange tweaks (#3176) Kiro social OAuth: optional targetProvider passthrough. Integrated into release/v3.8.10. * deps: bump hono from 4.12.18 to 4.12.23 (#3179) Bump hono to 4.12.23. Integrated into release/v3.8.10. * fix(providerRegistry): update kilocode format and executor (#3166) kilocode: openai format + default executor (matches kilo-gateway) + registry test. Integrated into release/v3.8.10. * feat(metrics): cross-request TTFT and gap latency after tool calls (#3173) Cross-request TTFT + gap-after-tool latency metrics (+test). Integrated into release/v3.8.10. * feat(dashboard): provider stats API endpoint and dashboard page (#3175) Provider stats dashboard + API (SQL moved to db module per Hard Rule #5, +test). Integrated into release/v3.8.10. * fix(usage): sequential+spaced OAuth quota sync, reactive force-refresh, actionable 401 (#3156) Sequential+spaced OAuth quota sync, reactive force-refresh on 401, actionable 401 in UI. Integrated into release/v3.8.10. * fix(healthcheck): per-provider proactive-refresh skip list (rescue short-TTL OAuth) (#3159) Per-provider proactive-refresh skip list (OMNIROUTE_HEALTHCHECK_SKIP_PROVIDERS) to rescue short-TTL OAuth. Integrated into release/v3.8.10. * feat(quota): show OAuth token expiry on provider cards (small, blue, informative) (#3178) Show OAuth token expiry on provider cards (small, blue, informative). Integrated into release/v3.8.10. * fix(providers): empty refresh must not resurface just-cleared synced models (#3181) Empty refresh must not resurface just-cleared synced models (fixes the release-blocking provider-models-route test). Integrated into release/v3.8.10. * chore(release): v3.8.10 — 2026-06-04 (finalize CHANGELOG) --------- Co-authored-by: Wilson <pedbookmed@gmail.com> Co-authored-by: Xiangzhe <32761048+xz-dev@users.noreply.github.com> Co-authored-by: Jan Leon <Jan.gaschler@gmail.com> Co-authored-by: M.M <mr.maatoug@gmail.com> Co-authored-by: Hernan Javier Ardila Sanchez <hjasgr@gmail.com> Co-authored-by: Markus Hartung <mail@hartmark.se> Co-authored-by: KooshaPari <KooshaPari@users.noreply.github.com> Co-authored-by: tjengbudi <tjengbudi@users.noreply.github.com> Co-authored-by: minhtran162 <minhtran162@users.noreply.github.com> Co-authored-by: totaltube <totaltube@users.noreply.github.com> Co-authored-by: gabrielmoreira <gabrielmoreira@users.noreply.github.com> Co-authored-by: ViFigueiredo <ViFigueiredo@users.noreply.github.com> Co-authored-by: PizzaV <103120356+pizzav-xyz@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Nicolas Lorin <androw95220@gmail.com>
140 lines
5.9 KiB
TypeScript
140 lines
5.9 KiB
TypeScript
// #2820 — tool-call translation for web-cookie providers (deepseek-web first).
|
|
// The web UIs accept only a plain prompt string and reply with tool invocations as
|
|
// raw text. These pure helpers (a) serialize the OpenAI `tools` array into a
|
|
// system-prompt contract, and (b) parse the upstream `<tool>{...}</tool>` text back
|
|
// into OpenAI `tool_calls`.
|
|
import test from "node:test";
|
|
import assert from "node:assert/strict";
|
|
|
|
const { serializeToolsToPrompt, parseToolCallsFromText } = await import(
|
|
"../../open-sse/translator/webTools.ts"
|
|
);
|
|
|
|
const TOOLS = [
|
|
{
|
|
type: "function",
|
|
function: {
|
|
name: "get_weather",
|
|
description: "Get the current weather for a city",
|
|
parameters: {
|
|
type: "object",
|
|
properties: { city: { type: "string" } },
|
|
required: ["city"],
|
|
},
|
|
},
|
|
},
|
|
];
|
|
|
|
test("serializeToolsToPrompt lists the tool and the <tool> invocation contract", () => {
|
|
const prompt = serializeToolsToPrompt(TOOLS);
|
|
assert.ok(prompt.includes("get_weather"), "tool name present");
|
|
assert.ok(prompt.includes("Get the current weather"), "tool description present");
|
|
assert.ok(prompt.includes("<tool>"), "invocation contract mentions the <tool> tag");
|
|
});
|
|
|
|
test("serializeToolsToPrompt returns empty string for no tools", () => {
|
|
assert.equal(serializeToolsToPrompt([]), "");
|
|
assert.equal(serializeToolsToPrompt(undefined), "");
|
|
});
|
|
|
|
test("parseToolCallsFromText extracts a single tool call and strips it from content", () => {
|
|
const text =
|
|
'Sure, let me check.\n<tool>{"name": "get_weather", "arguments": {"city": "Paris"}}</tool>';
|
|
const { content, toolCalls } = parseToolCallsFromText(text);
|
|
assert.ok(toolCalls && toolCalls.length === 1, "one tool call parsed");
|
|
assert.equal(toolCalls[0].type, "function");
|
|
assert.equal(toolCalls[0].function.name, "get_weather");
|
|
// OpenAI tool_calls arguments is a JSON *string*.
|
|
assert.equal(typeof toolCalls[0].function.arguments, "string");
|
|
assert.deepEqual(JSON.parse(toolCalls[0].function.arguments), { city: "Paris" });
|
|
assert.ok(toolCalls[0].id, "tool call has an id");
|
|
assert.ok(!content.includes("<tool>"), "the raw block is stripped from content");
|
|
assert.ok(content.includes("Sure, let me check."), "surrounding text preserved");
|
|
});
|
|
|
|
test("parseToolCallsFromText returns null toolCalls when there is no tool block", () => {
|
|
const { content, toolCalls } = parseToolCallsFromText("just a normal answer");
|
|
assert.equal(toolCalls, null);
|
|
assert.equal(content, "just a normal answer");
|
|
});
|
|
|
|
test("parseToolCallsFromText detects bare JSON tool calls when requested tools are present", () => {
|
|
const text = '{"name":"get_weather","arguments":{"city":"Paris"}}';
|
|
const { content, toolCalls } = parseToolCallsFromText(text, "call", TOOLS);
|
|
|
|
assert.equal(content, "");
|
|
assert.equal(toolCalls?.length, 1);
|
|
assert.equal(toolCalls?.[0].function.name, "get_weather");
|
|
assert.deepEqual(JSON.parse(toolCalls?.[0].function.arguments || "{}"), { city: "Paris" });
|
|
});
|
|
|
|
test("parseToolCallsFromText does not parse bare JSON without requested tools", () => {
|
|
const text = '{"name":"get_weather","arguments":{"city":"Paris"}}';
|
|
const { content, toolCalls } = parseToolCallsFromText(text);
|
|
|
|
assert.equal(toolCalls, null);
|
|
assert.equal(content, text);
|
|
});
|
|
|
|
test("parseToolCallsFromText tolerates Python-dict-ish bare tool JSON", () => {
|
|
const text = "{'command': 'get_weather', 'arguments': {'city': 'Paris', 'units': 'metric', 'fresh': True}}";
|
|
const { toolCalls } = parseToolCallsFromText(text, "call", TOOLS);
|
|
|
|
assert.equal(toolCalls?.length, 1);
|
|
assert.equal(toolCalls?.[0].function.name, "get_weather");
|
|
assert.deepEqual(JSON.parse(toolCalls?.[0].function.arguments || "{}"), {
|
|
city: "Paris",
|
|
units: "metric",
|
|
fresh: true,
|
|
});
|
|
});
|
|
|
|
test("parseToolCallsFromText escapes double quotes inside single-quoted strings", () => {
|
|
const text = "{'command': 'get_weather', 'arguments': {'city': 'Paris \"City\"'}}";
|
|
const { toolCalls } = parseToolCallsFromText(text, "call", TOOLS);
|
|
|
|
assert.equal(toolCalls?.length, 1);
|
|
assert.deepEqual(JSON.parse(toolCalls?.[0].function.arguments || "{}"), { city: 'Paris "City"' });
|
|
});
|
|
|
|
test("parseToolCallsFromText fuzzy-matches emitted tool names to requested tools", () => {
|
|
const text = '{"name":"getWeather","arguments":{"city":"Paris"}}';
|
|
const { toolCalls } = parseToolCallsFromText(text, "call", TOOLS);
|
|
|
|
assert.equal(toolCalls?.length, 1);
|
|
assert.equal(toolCalls?.[0].function.name, "get_weather");
|
|
});
|
|
|
|
test("parseToolCallsFromText strips bare JSON while preserving surrounding text", () => {
|
|
const text = 'I will check now.\n{"name":"get_weather","arguments":"{\\"city\\":\\"Paris\\"}"}\nDone.';
|
|
const { content, toolCalls } = parseToolCallsFromText(text, "call", TOOLS);
|
|
|
|
assert.equal(toolCalls?.length, 1);
|
|
assert.deepEqual(JSON.parse(toolCalls?.[0].function.arguments || "{}"), { city: "Paris" });
|
|
assert.equal(content, "I will check now.\nDone.");
|
|
});
|
|
|
|
test("parseToolCallsFromText ignores bare JSON whose tool is not requested", () => {
|
|
const text = '{"name":"delete_everything","arguments":{"force":true}}';
|
|
const { content, toolCalls } = parseToolCallsFromText(text, "call", TOOLS);
|
|
|
|
assert.equal(toolCalls, null);
|
|
assert.equal(content, text);
|
|
});
|
|
|
|
test("parseToolCallsFromText parses multiple tool calls", () => {
|
|
const text =
|
|
'<tool>{"name": "a", "arguments": {"x": 1}}</tool>\n<tool>{"name": "b", "arguments": {}}</tool>';
|
|
const { toolCalls } = parseToolCallsFromText(text);
|
|
assert.equal(toolCalls?.length, 2);
|
|
assert.equal(toolCalls[0].function.name, "a");
|
|
assert.equal(toolCalls[1].function.name, "b");
|
|
});
|
|
|
|
test("parseToolCallsFromText tolerates a tool block with no arguments", () => {
|
|
const { toolCalls } = parseToolCallsFromText('<tool>{"name": "ping"}</tool>');
|
|
assert.equal(toolCalls?.length, 1);
|
|
assert.equal(toolCalls[0].function.name, "ping");
|
|
assert.equal(toolCalls[0].function.arguments, "{}");
|
|
});
|