mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-09-07 15:32:10 +03:00
Rebased onto the current release/v3.8.51 tip as part of a combined provider-retirement/provenance merge batch (Designer Web, Felo Web, Runtime, GPL-derived removal, Qwen Web already landed). Large conflict set (this is the biggest PR in the batch — the common ChatGPT Web provider touches chat, images, count-tokens, session leases, and combos). Conflicts resolved: - `open-sse/config/providers/registry/chatgpt-web/*`, `open-sse/executors/chatgpt-web*`, `open-sse/handlers/imageGeneration/providers/chatgptWeb.ts`, and their tests: kept deleted, matching the PR's stated scope. - `open-sse/config/providers/registry/minimax/web/index.ts`, `open-sse/handlers/imageGeneration/providers/geminiWeb.ts`, `open-sse/executors/gemini-web.ts`'s stale image-mode branch: base-drift collisions against already-merged sibling retirements (#11691, #11708) — kept deleted / dropped the dead code, since this PR's own branch forked before those merged. - `src/shared/constants/reservedProviderPrefixes.ts`, `open-sse/executors/index.ts`, `executorProxy.ts`, `virtualFactory.ts`, `autoStrategy.ts`, `src/lib/db/providers.ts`, `src/sse/handlers/chat.ts`: combined the Designer + Runtime (Felo/Qwen) + common-ChatGPT-Web retirement guard calls at each shared chokepoint — compute-once-then-OR pattern, consistent with prior combinations in this batch. - `src/sse/services/model.ts` / `src/sse/handlers/chatHelpers.ts`: adopted this PR's new `getModelInfoOrRetirementResponse()` central wrapper (a real improvement over ad-hoc try/catch), and extended it to also catch the Designer + Runtime retirement errors it didn't originally cover, so the consolidation doesn't regress the other two mechanisms. - `src/app/api/v1/images/edits/route.ts`: this PR moved the retirement check earlier (before `enforceApiKeyPolicy`) but left the old later call+catch block in place from base drift — removed the now-redundant duplicate `resolveImageRouteModel()` call and merged the Designer catch into the earlier one. - `open-sse/config/imageRegistry.ts`, `tests/snapshots/executors/executor-map.json` (`keyCount` recomputed to 133), `tests/snapshots/provider/translate-path.json`: same "both sides inserted a different retired provider at the same slot" pattern — resolved by dropping both. - `tests/unit/chatcore-executor-proxy.test.ts`, `provider-node-reserved-prefix.test.ts`, `combo-auto-candidate-expansion.test.ts`, `messages-count-tokens-route.test.ts`, `virtual-auto-combo.test.ts`: split into independent per-mechanism test blocks (established pattern); `virtual-auto-combo.test.ts`'s old "includes cookie web-session providers" positive-inclusion test (which used chatgpt-web as its example) was retired along with the provider and replaced by this PR's negative-exclusion test for the same slot. - `docs/architecture/ARCHITECTURE.md`, `CODEBASE_DOCUMENTATION.md` (+ 4 i18n mirrors), `README.md`, `FREE-TIERS-GUIDE.md`, `docs/diagrams/free-tier-budget.svg`, `docs/screenshots/free-tier-budget-card.svg`, `docs/reference/PROVIDER_REFERENCE.md`: recomputed every stale count from the real merged state — 104 executors (`countFiles` gate logic), 351 providers (regenerated via `gen:provider-reference`), 152/351 `hasFree` entries, 445/438/7 free-tier catalog rows, 13 ToS-avoid providers, budget-card regenerated via its real generator script. One doc conflict (`oauth/` module list) needed picking HEAD's side specifically — theirs still listed the already-removed `raycast` module instead of the real `openference`. - `config/quality/test-masking-allowlist.json`: additive merge of the PR's 17 `_deletedWithReplacement` entries alongside the batch's existing ones (one real duplicate-key mistake in my first pass, caught and fixed via a `object_pairs_hook` duplicate-key check before finalizing). Also fixed two real, unrelated-to-my-merge issues surfaced by the focused suite: - `tests/unit/resolve-web-provider-host.test.ts`: the PR's own test had a typo — it asserted `perplexity-web`'s resolved host as `"perplexity.ai"`, but the provider's registered `website` is `"https://www.perplexity.ai"` and the resolver returns the URL's `host` verbatim (no www-stripping), so the correct value is `"www.perplexity.ai"` (consistent with the same test's own `url` assertion). - `tests/unit/hard-session-lease-bypass-inventory.test.ts`: this golden call-site inventory was already stale on the pristine post-#11713 tip (confirmed via a throwaway probe worktree) — `src/lib/db/providers.ts`'s 3 connection-fallback sites and a third `src/app/api/providers/route.ts` site were never added to the golden list by the earlier-merged #11698/#11720 PRs. Updated it to the real current inventory (dated inline comments explain each delta and which PR introduced it), plus this PR's own legitimate deltas (image-edits duplicate-call removal, `ChatGptWebExecutor.execute()` site removed). Focused suite green (433/433 across executor-proxy, reserved-prefix, hard-session-lease-bypass-inventory, resolve-web-provider-host, retirement/runtime-block/source-retirement/management-retirement/image-handler-retirement, migration-168, combo-auto-candidate-expansion, virtual-auto-combo, executor-map-golden and siblings), plus `typecheck:core`, `check-file-size`, and `check-changelog-integrity` clean. Thanks for the thorough provenance-hold retirement work — appreciated.
177 lines
6.9 KiB
TypeScript
177 lines
6.9 KiB
TypeScript
/**
|
|
* Tests for open-sse/services/tokenExtractionConfig.ts
|
|
*
|
|
* Validates that all web-cookie provider configs are well-formed,
|
|
* have valid login URLs, and include at least one extraction source.
|
|
*/
|
|
|
|
import { describe, it } from "node:test";
|
|
import assert from "node:assert/strict";
|
|
|
|
const { TOKEN_EXTRACTION_CONFIGS, getExtractionConfig, listExtractionConfigs } =
|
|
await import("../../open-sse/services/tokenExtractionConfig.ts");
|
|
|
|
describe("tokenExtractionConfig", () => {
|
|
it("exports TOKEN_EXTRACTION_CONFIGS as a Map", () => {
|
|
assert.ok(TOKEN_EXTRACTION_CONFIGS instanceof Map);
|
|
});
|
|
|
|
it("has at least 21 registered providers (18 existing + 3 new)", () => {
|
|
assert.ok(TOKEN_EXTRACTION_CONFIGS.size >= 21);
|
|
});
|
|
|
|
it("every config has required fields", () => {
|
|
for (const [providerId, cfg] of TOKEN_EXTRACTION_CONFIGS) {
|
|
assert.ok(typeof cfg.providerId === "string", `${providerId}: missing providerId`);
|
|
assert.ok(cfg.providerId.length > 0, `${providerId}: empty providerId`);
|
|
assert.ok(typeof cfg.displayName === "string", `${providerId}: missing displayName`);
|
|
assert.ok(cfg.displayName.length > 0, `${providerId}: empty displayName`);
|
|
assert.ok(
|
|
cfg.loginUrl.startsWith("http"),
|
|
`${providerId}: loginUrl "${cfg.loginUrl}" must start with http`
|
|
);
|
|
assert.ok(
|
|
cfg.homeUrl.startsWith("http"),
|
|
`${providerId}: homeUrl "${cfg.homeUrl}" must start with http`
|
|
);
|
|
assert.ok(Array.isArray(cfg.tokenSources), `${providerId}: tokenSources must be an array`);
|
|
assert.ok(cfg.tokenSources.length > 0, `${providerId}: must have at least one tokenSource`);
|
|
assert.ok(typeof cfg.instructions === "string", `${providerId}: missing instructions`);
|
|
assert.ok(cfg.instructions.length > 0, `${providerId}: empty instructions`);
|
|
}
|
|
});
|
|
|
|
it("every tokenSource has a valid type", () => {
|
|
const validTypes = ["cookie", "localStorage", "sessionStorage", "header"];
|
|
for (const [providerId, cfg] of TOKEN_EXTRACTION_CONFIGS) {
|
|
for (const src of cfg.tokenSources) {
|
|
assert.ok(
|
|
validTypes.includes(src.type),
|
|
`${providerId}: invalid tokenSource type "${src.type}"`
|
|
);
|
|
if (src.type === "cookie") {
|
|
assert.ok(typeof src.name === "string", `${providerId}: cookie source missing name`);
|
|
assert.ok(src.name.length > 0, `${providerId}: cookie source has empty name`);
|
|
}
|
|
if (src.type === "localStorage" || src.type === "sessionStorage") {
|
|
assert.ok(typeof src.key === "string", `${providerId}: storage source missing key`);
|
|
assert.ok(src.key.length > 0, `${providerId}: storage source has empty key`);
|
|
}
|
|
}
|
|
}
|
|
});
|
|
|
|
it("loginUrl and homeUrl share the same root domain", () => {
|
|
function extractDomain(url: string): string {
|
|
try {
|
|
const u = new URL(url);
|
|
return u.hostname;
|
|
} catch {
|
|
return "";
|
|
}
|
|
}
|
|
for (const [providerId, cfg] of TOKEN_EXTRACTION_CONFIGS) {
|
|
const loginDomain = extractDomain(cfg.loginUrl);
|
|
const homeDomain = extractDomain(cfg.homeUrl);
|
|
// Allow different subdomains but same root
|
|
const loginParts = loginDomain.split(".");
|
|
const homeParts = homeDomain.split(".");
|
|
const loginRoot = loginParts.slice(-2).join(".");
|
|
const homeRoot = homeParts.slice(-2).join(".");
|
|
assert.equal(
|
|
loginRoot,
|
|
homeRoot,
|
|
`${providerId}: loginUrl (${cfg.loginUrl}) and homeUrl (${cfg.homeUrl}) should share the same root domain`
|
|
);
|
|
}
|
|
});
|
|
|
|
it("getExtractionConfig returns undefined for unknown provider", () => {
|
|
const result = getExtractionConfig("nonexistent-provider");
|
|
assert.equal(result, undefined);
|
|
});
|
|
|
|
it("getExtractionConfig returns config for known providers", () => {
|
|
const providers = ["claude-web", "perplexity-web", "gemini-web", "grok-web", "deepseek-web"];
|
|
for (const id of providers) {
|
|
const cfg = getExtractionConfig(id);
|
|
assert.ok(cfg !== undefined, `getExtractionConfig("${id}") returned undefined`);
|
|
assert.equal(cfg?.providerId, id);
|
|
}
|
|
});
|
|
|
|
it("does not expose in-app extraction for retired common ChatGPT Web ids", () => {
|
|
assert.equal(getExtractionConfig("chatgpt-web"), undefined);
|
|
assert.equal(getExtractionConfig("cgpt-web"), undefined);
|
|
});
|
|
|
|
it("captures Copilot's bearer authorization header instead of an unrelated cookie", () => {
|
|
const cfg = getExtractionConfig("copilot-web");
|
|
assert.deepEqual(cfg?.tokenSources, [{ type: "header", name: "Authorization" }]);
|
|
assert.doesNotMatch(cfg?.instructions || "", /RPSCAuth/i);
|
|
});
|
|
|
|
it("extracts zai-web auth from localStorage rather than a cookie", () => {
|
|
const cfg = getExtractionConfig("zai-web");
|
|
assert.deepEqual(cfg?.tokenSources, [{ type: "localStorage", key: "token" }]);
|
|
assert.match(cfg?.instructions ?? "", /CAPTCHA/);
|
|
});
|
|
|
|
it("listExtractionConfigs returns all configs as an array", () => {
|
|
const all = listExtractionConfigs();
|
|
assert.ok(Array.isArray(all));
|
|
assert.equal(all.length, TOKEN_EXTRACTION_CONFIGS.size);
|
|
});
|
|
|
|
it("includes the 3 new missing providers", () => {
|
|
const newProviders = ["chatglm-web", "xiaomimimo-web", "manus-web"];
|
|
for (const id of newProviders) {
|
|
const cfg = getExtractionConfig(id);
|
|
assert.ok(cfg !== undefined, `Missing provider "${id}" not found in config`);
|
|
}
|
|
});
|
|
|
|
it("every provider ID matches the executor naming convention", () => {
|
|
// volcengine-console is exempt: it extracts a console session cookie for
|
|
// provider binding (volcenginePlanBinding), not a chat-web credential, so
|
|
// the "-web" suffix convention does not apply to it.
|
|
const exempt = new Set(["volcengine-console"]);
|
|
for (const providerId of TOKEN_EXTRACTION_CONFIGS.keys()) {
|
|
assert.ok(
|
|
providerId.endsWith("-web") || exempt.has(providerId),
|
|
`Provider ID "${providerId}" should follow the "-web" naming convention`
|
|
);
|
|
}
|
|
});
|
|
|
|
it("each cookie token source has a valid domain when specified", () => {
|
|
for (const [providerId, cfg] of TOKEN_EXTRACTION_CONFIGS) {
|
|
for (const src of cfg.tokenSources) {
|
|
if (src.type === "cookie" && src.domain) {
|
|
assert.ok(
|
|
src.domain.startsWith(".") || src.domain.startsWith("http"),
|
|
`${providerId}: cookie domain "${src.domain}" should start with "." or "http"`
|
|
);
|
|
}
|
|
}
|
|
}
|
|
});
|
|
|
|
it("pollingConfig has valid values", () => {
|
|
for (const [providerId, cfg] of TOKEN_EXTRACTION_CONFIGS) {
|
|
assert.ok(
|
|
cfg.pollingConfig.pollInterval >= 100,
|
|
`${providerId}: pollInterval too low (${cfg.pollingConfig.pollInterval})`
|
|
);
|
|
assert.ok(
|
|
cfg.pollingConfig.timeout >= 10000,
|
|
`${providerId}: timeout too low (${cfg.pollingConfig.timeout})`
|
|
);
|
|
assert.ok(
|
|
cfg.pollingConfig.minLoginTime >= 1000,
|
|
`${providerId}: minLoginTime too low (${cfg.pollingConfig.minLoginTime})`
|
|
);
|
|
}
|
|
});
|
|
});
|