Files
OmniRoute/tests/unit/perplexity-web.test.ts
Diego Rodrigues de Sa e Souza fa367dd99e Release v3.8.27 (#3968)
* chore(release): open v3.8.27 development cycle

* fix(security): polynomial ReDoS in comboAgentMiddleware regex (#3982)

* fix(security): eliminate polynomial ReDoS in comboAgentMiddleware <omniModel> regex (CodeQL js/polynomial-redos)

CACHE_TAG_PATTERN wrapped the tag in an unbounded `(?:\\n|\n|\r)*` prefix/suffix.
On an unanchored `.test()`/`.exec()` that is O(n²) on inputs with many newlines
(CodeQL js/polynomial-redos, alerts #612/#613). The surrounding runs are irrelevant
to detecting/capturing the tag, so the detection pattern now matches only the core
`<omniModel>([^<]+)</omniModel>`; the global strip pattern still consumes the
wrapping newlines (combo.ts streaming, #531) but BOUNDED ({0,16}) so it stays linear.

Behavior preserved: detection, model extraction, multi-tag stripping (#454) and
blank-line cleanup all unchanged (107 related tests green). Adds ReDoS-safety
regression tests (50k-newline inputs complete in <1ms).

* docs(changelog): add #3982 ReDoS fix to [3.8.27]

* ci(security): harden workflows — artipacked persist-credentials + cache-poisoning + SC2086 (#3965)

* Refine provider quota card display (#3969)

Integrated into release/v3.8.27

* feat: add sidebar group separator toggles (#3971)

Integrated into release/v3.8.27

* Gate control-plane proxy direct fallback (#3963)

Integrated into release/v3.8.27

* Capture actual upstream provider requests (#3941)

Integrated into release/v3.8.27

* ci(quality): flip require-tighten + osv + Trivy to blocking (v3.8.27 cycle-end) (#3984)

* fix(resilience): respect connection cooldown stored as numeric epoch (#3954) (#3995)

rate_limited_until is a TEXT column, but setConnectionRateLimitUntil (Antigravity full-quota path) persists a raw epoch number that SQLite coerces to a numeric string ("1781696905131.0"). The selection predicate isAccountUnavailable then did new Date("1781696905131.0") -> NaN, so the cooling connection was never skipped and the router kept dispatching to rate-limited accounts. Normalize numeric-epoch strings (and number/Date/ISO) via a shared cooldownUntilMs() helper in isAccountUnavailable / getEarliestRateLimitedUntil / filterAvailableAccounts / parseFutureDateMs. ISO behavior preserved.

* fix(providers): fetch live /models for LLM7 and BytePlus (#3976) (#3996)

llm7 and byteplus carry a real modelsUrl but were not classified by any live-fetch branch of the model-import route, so their hardcoded 4-entry registry catalog was served (source local_catalog) instead of the upstream catalog. Add both to NAMED_OPENAI_STYLE_PROVIDERS so the route probes <baseUrl>/models and serves the live list, falling back to the local catalog only on fetch failure.

* fix(dashboard): logs auto-refresh reads live visibility, not a stale mount ref (#3972) (#3997)

The auto-refresh interval gated each tick on visibleRef, seeded once at mount and updated only by a visibilitychange event. A tab mounted while document.visibilityState is 'hidden' (background load, bfcache, embedded/proxied webviews) with no later visibilitychange left the ref false forever, so the interval ticked but never fetched — only the manual button worked. Read the live document.visibilityState in the tick instead.

* feat(compression): add Indonesian caveman rules and language pack (#3975)

Integrated into release/v3.8.27

(cherry picked from commit c9b5b1a892)

* fix(combo): shuffle strict-random fallback remainder to spread load (#3959) (#3998)

strict-random shuffled only the deck-selected slot 0 and left the fallback remainder in fixed priority order, so after a failing deck pick the chain always fell through to the same top-priority model — a persistently-failing model was retried on essentially every request and fallback load never spread across peers. Shuffle the remainder too (like the random strategy).

* Add provider auth visibility controls (#3953)

Integrated into release/v3.8.27

* fix(claude): forward client tool-search-tool anthropic-beta on the Claude OAuth path (#3974) (#3999)

The client-negotiated anthropic-beta: tool-search-tool-2025-10-19 was dropped on both Claude code paths (default executor rebuilt from static ANTHROPIC_BETA_CLAUDE_OAUTH; selectBetaFlags only read the client beta to gate thinking/effort), so claude.ai rejected deferred-tool requests with 400 'Tool reference not found'. Add an allowlist-merge (mergeClientAnthropicBeta) that unions the client's allowlisted betas into the outbound set on both paths, preserving #3415 (no forced thinking/effort).

* feat(providers): add model search filter to provider dashboard (#3950)

Integrated into release/v3.8.27

* fix(vision-bridge): force bridge for tokenrouter deepseek models (#3946)

Integrated into release/v3.8.27

* fix(executor): strip stream_options on non-streaming requests (#3884) (#4000)

Clients that send stream_options:{include_usage:true} regardless of stream (e.g. the OpenAI Python SDK) had it passed through on non-streaming calls; NVIDIA NIM rejected it with 400 'Stream options can only be defined when stream=True'. DefaultExecutor.transformRequest only injected/cleared stream_options on the streaming branch and never stripped a client-sent value when stream=false. Add a !stream strip branch; the streaming injection path is unchanged. Global to openai-compat providers.

* fix(qwen-web): cookie validation false-positive - check response body for user object (#3958)

Integrated into release/v3.8.27

* fix(db): persist backup retention days (#3970)

Integrated into release/v3.8.27

* 大量UI显示和i18n优化 (#3973)

Integrated into release/v3.8.27

* deps: bump the npm_and_yarn group across 1 directory with 2 updates (#3943)

Integrated into release/v3.8.27

* deps: bump form-data from 4.0.5 to 4.0.6 (#3944)

Integrated into release/v3.8.27

* deps: bump vite from 8.0.5 to 8.0.16 (#3942)

Integrated into release/v3.8.27

* chore(quality): re-baseline validation.ts 4407->4428 (#3958 qwen body-check)

The qwen-web validation body-check merged in #3958 pushed validation.ts past its
frozen size on the integrated release tip. Bump the baseline with justification;
no logic is separately extractable from the existing qwen-web validation branch.

* deps: bump the production group with 13 updates (#3915)

Integrated into release/v3.8.27 — low-risk group (playwright 1.60→1.61 minor + transitive patches; fumadocs-core 16.9→16.10 minor).

* chore(deps): ignore jscpd major bumps (v5 Rust rewrite breaks the duplication gate)

Our duplication ratchet (scripts/check/check-duplication.mjs) is pinned to jscpd@4
and parses jscpd-report.json against a frozen baseline. jscpd v5 is a native Rust
binary with no Node.js API and a different report/bin, so a major bump would break
the gate. Migrate deliberately, not via dependabot. Closes the noise from #3916.

* fix(perplexity-web): parse schematized diff_block stream so answers aren't empty (#4001)

Integrated into release/v3.8.27 — schematized diff_block parsing follow-up to #3938.

* refactor: modularize providerRegistry.ts into 159 individual provider plugins (#3993)

Modularize provider registry (#3594). Integrated into release/v3.8.27 after rebase + behavior-preservation verification (provider-consistency gate 159/232/0, typecheck, registry tests, build 556/556).

Co-authored-by: diegosouzapw <diegosouza.pw@gmail.com>

* fix(registry): restore byteplus + mimocode dropped by #3993 modularization

The provider-registry modularization (#3993) was cut from a base predating the
byteplus (#3877) and mimocode (#3837) registry entries, so merging it silently
dropped both providers (getRegistryEntry returned undefined → validation reported
'not supported'). Re-add them as registry modules in the new structure; registered
count 159→161, provider-consistency 161/232/0.

Also align the pre-existing qwen-web validator test to #3958: since the validator
now requires a real `user` object in the 200 body, the mock must carry one.

* refactor: modularize schemas (non-stacked) (#3988)

Modularize validation schemas (#3594). Integrated into release/v3.8.27 after rebase (reconciled the merged hiddenSidebarGroupLabels #3971 + intelligenceSyncRequestSchema into the new modules) + behavior verification (typecheck, 195 schema/settings/validation tests, build 556/556).

Co-authored-by: diegosouzapw <diegosouza.pw@gmail.com>

* fix(default-executor): honor custom providerSpecificData.baseUrl for OpenAI-format providers (#4002)

Integrated into release/v3.8.27 — honor custom providerSpecificData.baseUrl in DefaultExecutor (openai-format), tested.

* feat(openai): honor custom base URL in model discovery + complete openai/codex pricing (#4005)

Integrated into release/v3.8.27 — openai model-discovery honors custom base URL (SSRF-guarded) + pricing rows for new openai/codex models. Tested + baselines bumped.

* fix(live-ws): bridge sidecar events to dashboard (#4004)

Integrated into release/v3.8.27 — repair LiveWS sidecar (startup, same-origin /live-ws, main→sidecar compression.completed bridge, early-msg queue). Fixed the cookie-parse regex (\s) + added a focused unit test; baseline bumped for the non-blocking chatCore bridge.

* docs(troubleshooting): note MITM proxy cannot intercept Windows-host apps under WSL (#4003)

Integrated into release/v3.8.27 — MITM/WSL troubleshooting note.

* fix(repo): untrack accidentally-committed root node_modules symlink + gitignore it

A worktree node_modules symlink (-> the main checkout's node_modules) was staged by a
`git add -A` during the #3988 merge and committed into 05213ac6a. The symlink points
at the repo's own node_modules path, so checking it out turns the main checkout's
node_modules into a self-referential symlink (breaking tsx/all node ops). Untrack it and
add a root-anchored /node_modules ignore so the symlink form can't be re-committed (the
existing 'node_modules/' only matches directories).

* fix(quality): allowlist socks dep (declared by #4004, never allowlisted)

socks@^2.8.7 was added to package.json in #4004 (LiveWS sidecar, 02302131f)
as a phantom-dep cleanup but never added to dependency-allowlist.json, so
check:deps has been red on the release tip ever since. socks is the standard
SOCKS proxy client (dep of fetch-socks), legitimate and years old.

* feat(sse): real LLMLingua-2 ONNX compression engine (stable) (#4014)

Integrated into release/v3.8.27.

Adjustments before merge:
- Synced with the current release tip (was 11 commits behind).
- Added the 3 LLMLingua-2 ONNX optional-runtime deps to dependency-allowlist.json
  (@atjsh/llmlingua-2, @tensorflow/tfjs, js-tiktoken) — the only gate that was red.
- socks was allowlisted directly on release (separate fix d7db5c73d; it was declared
  by #4004 but never allowlisted, leaving check:deps red release-wide).

Verified locally: check:deps OK, file-size OK, public-creds OK, provider-consistency
161/232/0, typecheck:core clean, 24/24 LLMLingua tests pass. The only remaining Fast-QG
red is the pre-existing #3972 orphan test (request-logger-autorefresh-visibility-3972.test.tsx),
which is release-wide and unrelated to this PR.

* test(dashboard): rehome #3972 logs auto-refresh test so a runner collects it

tests/unit/request-logger-autorefresh-visibility-3972.test.tsx (added by #3972
via #3997) sat at the top level of tests/unit/ as a .tsx vitest test, which NO
runner collects: the node runner only globs *.test.ts, and test:vitest:ui only
runs tests/unit/ui. So the #3972 regression guard never executed in CI and
check:test-discovery was red release-wide. Move it under tests/unit/ui/ (the
collected vitest:ui path) and fix the relative import depth. Verified: the test
now runs and passes (2/2), and check:test-discovery is green.

* feat(compression): capture per-engine analytics (#3960) + Lite schema fix (#3952) (#4018)

Captures the net-new value from #3960 (per-engine breakdown analytics) and #3952 (Lite engine schema fix) onto release/v3.8.27. Fast QG green; 622/622 compression+analytics tests pass.

* fix(sse): guard model-less registry entries in getUnsupportedParams (mimocode) (#4015)

Real bugfix: guard model-less registry entries (mimocode) in getUnsupportedParams so handleChatCore no longer throws 'entry.models is not iterable' / reports 'All models failed' for unrelated requests. Includes a regression test. Fast QG green.

* feat(ci): Quality Gate v2 — Onda 0 + Onda 1 (gate flips, TIA, SAST, DAST-smoke, mutation infra) (#4016)

* docs(ops): add quality-gate assessment + replication playbook (Fase 9 foundation)

* feat(ci): flip oasdiff breaking-change gate to blocking (ratchet)

* docs(ops): deliver main branch-protection ruleset for owner to apply

* fix(ci): run typecheck:core in PR->release fast-gates (close fast-gates hole, part 1)

* perf(mutation): enable Stryker incremental mode + cache (scales the 60/80 rollout)

* feat(ci): commit CodeQL advanced config (security-extended), replacing default-setup

* feat(ci): version semgrep SAST workflow (owasp/secrets), advisory

* feat(quality): TIA test-impact map builder (import-graph; map built at runtime, gitignored)

* feat(quality): TIA impacted-test selector with run-all fail-safe

* fix(ci): run TIA-impacted unit tests in PR->release fast-gates (build map at runtime, fail-safe full)

* feat(ci): DAST-smoke per-PR (schemathesis subset + promptfoo injection-guard, blocking)

* fix(ci): unbreak Fase 9 PR CI (MDX frontmatter, CodeQL conflict, dast-smoke advisory)

- Add MDX frontmatter to docs/ops/{BRANCH_PROTECTION_MAIN,QUALITY_GATE_PLAYBOOK}.md.
  fumadocs rejects frontmatter-less docs -> 'npm run build' failed -> broke dast-smoke's
  build step (the release fast-gates never runs build, so this only surfaced on the PR).
- codeql.yml: workflow_dispatch-only until the owner switches repo CodeQL Default->Advanced
  (advanced configs cannot be processed while default setup is enabled; documented inline).
- dast-smoke.yml: job-level continue-on-error (advisory) so this brand-new gate matures
  before it blocks (repo convention: advisory -> blocking).

* ci(quality): make TIA unit-test step advisory until release test-debt is cleared

release/v3.8.27 carries ~17 pre-existing failing unit tests (budget #3537, apiKey
#3552, several Zod schemas, Puter/Qwen executors, mimocode entry, etc.) unrelated to
this PR — the new 'run tests on PR->release' gate surfaced them. Per the repo's
advisory->blocking convention, this step enters advisory (it still runs + reports)
so pre-existing debt doesn't block the gate program. typecheck:core stays blocking.
Flip to blocking (remove continue-on-error) once the release suite is green.

* fix(sse): preserve Kiro streaming finish_reason tool_calls (#3980) (#4025)

* fix(guardrails): preserve original image when vision-bridge describe fails (#4012) (#4026)

* feat(api): advertise combo capabilities on import surfaces (#3979) (#4027)

* feat(sse): delegated Anthropic Context Editing for Claude (clear_tool_uses) (#4021)

Opt-in Claude-only delegated compression: injects context_management.clear_tool_uses_20250919 at the Claude pre-serialization chokepoint (composes with clear_thinking, thinking first), threaded via ExecuteInput from handleChatCore. Pure edit-builder + 11 tests (7 unit + 4 e2e fetch-capture). Beta context-management-2025-06-27 already advertised; allowlist done. Telemetry/400-fallback/claude-web coverage deferred.

* fix(opencode): map x-session-affinity to x-opencode-session for custom providers (#4022) (#4028)

* fix(dashboard): Playground Compare tab loading + HTTP method guard (#4024)

randomUUID non-HTTPS fallback + static CompareTab import; raw HTTP TRACE->405 method guard wired into dev + standalone servers. Integrated into release/v3.8.27.

* refactor(dashboard): settings UI layout + API Keys naming (#4020)

Presentation/relabel refactor of the Settings dashboard (API Manager -> API Keys), card relocations, Toggle adoption, present-but-disabled engine steps. Auth-file changes are string/comment-only (no behavior change). Integrated into release/v3.8.27.

* fix: restore unit regressions dropped by lossy schema/registry modularizations (#4030)

Restores schema fields (combo reasoningTokenBuffer, budget-0 #3537, openrouter preset, proxy family #3777, resilience degradation/providerCooldown), qwen-web v2 endpoint+catalog, mimocode models key — all dropped by #3988/#3993 — and aligns 3 tests to #3941/#3993. Verified: 8 failing regression tests on release tip -> 131/131 green on this branch. Integrated into release/v3.8.27.

* fix(api): return 400 (not 500) for malformed JSON on /api/auth/login (#4031)

Wrap request.json() so a malformed/non-JSON login body returns a structured 400 instead of falling through to the 500 catch. Fixes the schemathesis high-risk-endpoint DAST finding (verified: schemathesis step now passes). +TDD test. Integrated into release/v3.8.27.

* feat(dashboard): real circuit-breaker state in the Combo Live cascade (U1b) (#4029)

Overlays real provider circuit-breaker state (GET /api/monitoring/health) onto the Combo Live cascade as a 'CB: OPEN · 41s' badge. Pure enrichRunWithBreakers + fail-soft useProviderBreakerHealth poll; graceful when health is absent. +13 tests. Integrated into release/v3.8.27.

* Fix promptfoo security assertion parsing (#4032)

* chore(deps): dependabot security bumps + drop unused gray-matter (#4036)

Integrated into release/v3.8.27 — dependabot security bumps (form-data/js-yaml/protobufjs/dompurify/hono) + drop unused gray-matter. Unblocks the npm audit:deps gate (Lint) branch-wide.

* fix(ci): scope TIA to node:test unit files only (mirror test:unit glob) (#4035)

Integrated into release/v3.8.27 — scopes the advisory TIA step to the test:unit node:test glob, fixing the 99 false failures. +4 TDD.

* Refine compression settings, storage labels, and sidebar grouping (#4033)

Integrated into release/v3.8.27 — relocate Token Saver into Compression Settings (controlled component), reorder Security/Authz tabs, storage labels + i18n relabel. Thanks @rdself!

* [codex] add per-key local usage command (#4034)

Integrated into release/v3.8.27 — per-key local @@om-usage command (cached quota, no upstream routing). Rebased onto modularized schemas/keys.ts + file-size rebaseline. Thanks @Witroch4!

* chore(release): reconcile v3.8.27 CHANGELOG + i18n mirrors

* ci(quality): unblock v3.8.27 release gates (zizmor pin + test-masking allowlist)

- zizmor ratchet (151→139, no regression): SHA-pin every action ref ADDED this
  cycle — codeql/dast-smoke/semgrep (3 new workflows) + trivy-action (docker-publish)
  + actions/cache (nightly-mutation). Pre-existing tag refs keep the repo convention.
- test-masking: add config/quality/test-masking-allowlist.json + allowlist support in
  check-test-masking.mjs (exempts ONLY the net-assert-reduction signal; tautology/skip/
  deletion still fire). Allowlists 2 verified-legitimate reductions:
  appearance-widget-settings-schema (#4033 removed showTokenSaverOnEndpoint field) and
  dashboard-shell-tabs (#3973 tabs→redirect refactor, asserts replaced). +4 gate tests.

* test(quality): reword test-masking self-test comments to avoid literal masking patterns

The added allowlist-test comments contained the literal strings 'assert.ok(true)' and
'.skip' which the masking detector's own regexes match as text — making the gate flag
its own test file (net +1 tautology/skip/extended-tautology vs main). Reworded to plain
prose ('a new tautology', 'a new skip marker'); test logic unchanged (24/24 pass).

* fix(quality): unblock v3.8.27 release — align 3 stale tests + restore modularized settings-schema parity

Release-PR full CI surfaced 3 deterministic test failures (no live product regression),
all stale vs legitimate cycle changes:

- settings-schema parity (#3988): the modularized updateSettingsSchema barrel
  (schemas/settings.ts) had diverged from the canonical settingsSchemas.ts (45 vs 85
  fields — 40 dropped + 6 extra), a lossy-modularization dead-code copy. Re-export from
  the canonical source so the barrel can never diverge again (runtime already uses
  canonical). Parity test now passes.
- api-manager permissions modal: #4034 added a 4th self-service switch (per-key usage
  allowance); a11y invariant (every switch type="button") still holds. Updated the
  static count 3 -> 4.
- pack-artifact policy: dist/http-method-guard.cjs became a required runtime path;
  added it to the test's expected missing-paths list.

Also documents the gate gap for Fase 9 (QUALITY_GATE_PLAYBOOK Parte 6): G1 run the
deterministic unit layer + test-masking on PR->release (not just PR->main), G2 a
modularization-parity gate (would have caught the #3988 drop at its PR), G3 flake
quarantine. Env flakes (LiveWS startup timeout, integration server-startup cascade)
are pre-existing/CI-env, triaged separately.

---------

Co-authored-by: Randi <55005611+rdself@users.noreply.github.com>
Co-authored-by: Veier04 <118300867+Veier04@users.noreply.github.com>
Co-authored-by: Felipe Sartori <felipesartori.ti@gmail.com>
Co-authored-by: WormAlien <164898390+WormAlien@users.noreply.github.com>
Co-authored-by: thezukiru <121331256+thezukiru@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: NOXX - Commiter <artur1992123@mail.ru>
Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com>
Co-authored-by: Demiurge The Single <megamen932@gmail.com>
Co-authored-by: Witroch4 <witalo_rocha@hotmail.com>
2026-06-17 02:43:21 -03:00

959 lines
30 KiB
TypeScript

// @ts-nocheck
import test from "node:test";
import assert from "node:assert/strict";
// ─── Import the executor and its dependencies ──────────────────────────────
const { PerplexityWebExecutor } = await import("../../open-sse/executors/perplexity-web.ts");
const { getExecutor, hasSpecializedExecutor } = await import("../../open-sse/executors/index.ts");
const { __setTlsFetchOverrideForTesting, TlsClientUnavailableError } =
await import("../../open-sse/services/perplexityTlsClient.ts");
// #2459: the executor now routes through tlsFetchPerplexity (Firefox TLS) instead of
// global fetch. Install one persistent bridge so the tests below can keep stubbing
// globalThis.fetch (returning a Response) and have it surface as a TlsFetchResult.
__setTlsFetchOverrideForTesting(async (url, opts) => {
const res = await (globalThis.fetch as any)(url, opts);
return {
status: res.status,
headers: res.headers,
text: res.status === 200 ? null : await res.text(),
body: res.status === 200 ? res.body : null,
};
});
// ─── Helper: Build a mock SSE stream from Perplexity events ─────────────────
function mockPplxStream(events) {
const encoder = new TextEncoder();
const chunks = [];
for (const evt of events) {
chunks.push(`event: message\r\ndata: ${JSON.stringify(evt)}\r\n\r\n`);
}
chunks.push("event: end_of_stream\r\n\r\n");
const body = chunks.join("");
return new ReadableStream({
start(controller) {
controller.enqueue(encoder.encode(body));
controller.close();
},
});
}
// ─── Helper: stub globalThis.fetch for testing ──────────────────────────────
// The persistent bridge above forwards tlsFetchPerplexity calls to globalThis.fetch,
// so stubbing fetch is still the way to mock Perplexity's upstream response.
function mockFetch(status, streamEvents, bodyText) {
const original = globalThis.fetch;
globalThis.fetch = async () => {
if (status === 200) {
return new Response(mockPplxStream(streamEvents), {
status,
headers: { "Content-Type": "text/event-stream" },
});
}
return new Response(bodyText ?? `{"error":"http ${status}"}`, {
status,
headers: { "Content-Type": "text/html" },
});
};
return () => {
globalThis.fetch = original;
};
}
function mockFetchError(error) {
const original = globalThis.fetch;
globalThis.fetch = async () => {
throw error;
};
return () => {
globalThis.fetch = original;
};
}
// ─── Test: Executor registration ────────────────────────────────────────────
test("PerplexityWebExecutor is registered in executor index", () => {
assert.ok(hasSpecializedExecutor("perplexity-web"));
assert.ok(hasSpecializedExecutor("pplx-web"));
const executor = getExecutor("perplexity-web");
assert.ok(executor instanceof PerplexityWebExecutor);
});
test("PerplexityWebExecutor alias resolves to same type", () => {
const a = getExecutor("perplexity-web");
const b = getExecutor("pplx-web");
assert.ok(a instanceof PerplexityWebExecutor);
assert.ok(b instanceof PerplexityWebExecutor);
});
// ─── Test: Constructor ──────────────────────────────────────────────────────
test("PerplexityWebExecutor sets correct provider name", () => {
const executor = new PerplexityWebExecutor();
assert.equal(executor.getProvider(), "perplexity-web");
});
// ─── Test: Non-streaming response ───────────────────────────────────────────
test("Non-streaming: simple text response", async () => {
const pplxEvents = [
{
backend_uuid: "test-uuid-123",
blocks: [
{
intended_usage: "markdown",
markdown_block: {
chunks: ["Hello, world!"],
progress: "DONE",
},
},
],
status: "COMPLETED",
},
];
const restore = mockFetch(200, pplxEvents);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "hi" }], stream: false },
stream: false,
credentials: { apiKey: "test-cookie-value" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 200);
const json = (await result.response.json()) as any;
assert.equal(json.object, "chat.completion");
assert.equal(json.choices[0].message.role, "assistant");
assert.equal(json.choices[0].message.content, "Hello, world!");
assert.equal(json.choices[0].finish_reason, "stop");
assert.ok(json.id.startsWith("chatcmpl-pplx-"));
assert.ok(json.usage.total_tokens > 0);
} finally {
restore();
}
});
test("Non-streaming: strips citations from response", async () => {
const pplxEvents = [
{
blocks: [
{
intended_usage: "markdown",
markdown_block: {
chunks: ["The answer is 42[1] according to sources[2][3]."],
progress: "DONE",
},
},
],
status: "COMPLETED",
},
];
const restore = mockFetch(200, pplxEvents);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-gpt",
body: { messages: [{ role: "user", content: "meaning of life" }], stream: false },
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
const json = (await result.response.json()) as any;
assert.ok(!json.choices[0].message.content.includes("[1]"));
assert.ok(!json.choices[0].message.content.includes("[2]"));
assert.ok(!json.choices[0].message.content.includes("[3]"));
assert.ok(json.choices[0].message.content.includes("The answer is 42"));
} finally {
restore();
}
});
// ─── Test: Streaming response ───────────────────────────────────────────────
test("Streaming: produces valid SSE chunks", async () => {
const pplxEvents = [
{
backend_uuid: "stream-uuid-456",
blocks: [
{
intended_usage: "markdown",
markdown_block: { chunks: ["Hello "], progress: "IN_PROGRESS" },
},
],
},
{
blocks: [
{
intended_usage: "markdown",
markdown_block: { chunks: ["Hello world!"], progress: "DONE" },
},
],
status: "COMPLETED",
},
];
const restore = mockFetch(200, pplxEvents);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-sonnet",
body: { messages: [{ role: "user", content: "hello" }], stream: true },
stream: true,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 200);
assert.equal(result.response.headers.get("Content-Type"), "text/event-stream");
// Read all SSE chunks
const text = await result.response.text();
const lines = text.split("\n").filter((l) => l.startsWith("data: "));
assert.ok(lines.length >= 3, `Expected at least 3 SSE data lines, got ${lines.length}`);
// First chunk should have role
const first = JSON.parse(lines[0].slice(6));
assert.equal(first.object, "chat.completion.chunk");
assert.equal(first.choices[0].delta.role, "assistant");
// Last data line should be [DONE]
const lastLine = text.trim().split("\n").filter(Boolean).pop();
assert.equal(lastLine, "data: [DONE]");
// Second-to-last should have finish_reason: stop
const stopLine = lines[lines.length - 1];
if (stopLine !== "data: [DONE]") {
const stop = JSON.parse(stopLine.slice(6));
assert.equal(stop.choices[0].finish_reason, "stop");
}
} finally {
restore();
}
});
// ─── Test: Schematized diff_block streaming (use_schematized_api) ───────────
test("Schematized API: diff_block chunks reconstruct answer (non-streaming)", async () => {
// Mirrors the live www.perplexity.ai schematized API: the answer streams as
// RFC-6902 JSON-patch frames against markdown_block, a `final:true` flag
// arrives on a still-PENDING frame, then a COMPLETED frame materializes the
// full markdown_block. The parser must NOT stop on `final` and must apply
// the diff patches.
const pplxEvents = [
{
backend_uuid: "diff-uuid-1",
status: "PENDING",
blocks: [
{
intended_usage: "ask_text_0_markdown",
diff_block: {
field: "markdown_block",
patches: [
{ op: "replace", path: "", value: { progress: "IN_PROGRESS", chunks: ["The "] } },
],
},
},
],
},
{
status: "PENDING",
blocks: [
{
intended_usage: "ask_text_0_markdown",
diff_block: { field: "markdown_block", patches: [{ op: "add", path: "/chunks/1", value: "answer " }] },
},
],
},
{
status: "PENDING",
final: true,
blocks: [
{
intended_usage: "ask_text_0_markdown",
diff_block: { field: "markdown_block", patches: [{ op: "add", path: "/chunks/2", value: "is 42." }] },
},
],
},
{
status: "COMPLETED",
final: true,
blocks: [
{
intended_usage: "ask_text_0_markdown",
markdown_block: { progress: "DONE", chunks: ["The answer is 42."], answer: "The answer is 42." },
},
],
},
];
const restore = mockFetch(200, pplxEvents);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "what is the answer?" }], stream: false },
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 200);
const json = JSON.parse(await result.response.text());
assert.equal(json.choices[0].message.content, "The answer is 42.");
} finally {
restore();
}
});
test("Schematized API: diff_block streams incremental deltas", async () => {
const pplxEvents = [
{
backend_uuid: "diff-uuid-2",
status: "PENDING",
blocks: [
{
intended_usage: "ask_text_0_markdown",
diff_block: { field: "markdown_block", patches: [{ op: "replace", path: "", value: { progress: "IN_PROGRESS", chunks: ["one, "] } }] },
},
],
},
{
status: "PENDING",
blocks: [
{
intended_usage: "ask_text_0_markdown",
diff_block: { field: "markdown_block", patches: [{ op: "add", path: "/chunks/1", value: "two, " }] },
},
],
},
{
status: "COMPLETED",
final: true,
blocks: [
{
intended_usage: "ask_text_0_markdown",
markdown_block: { progress: "DONE", chunks: ["one, two, three"], answer: "one, two, three" },
},
],
},
];
const restore = mockFetch(200, pplxEvents);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "count" }], stream: true },
stream: true,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 200);
const text = await result.response.text();
let assembled = "";
for (const line of text.split("\n")) {
if (!line.startsWith("data: ")) continue;
const d = line.slice(6).trim();
if (d === "[DONE]") continue;
const o = JSON.parse(d);
const c = o.choices?.[0]?.delta?.content;
if (c) assembled += c;
}
assert.equal(assembled, "one, two, three");
} finally {
restore();
}
});
// ─── Test: Thinking/reasoning content ───────────────────────────────────────
test("Streaming: thinking content emitted as reasoning_content", async () => {
const pplxEvents = [
{
blocks: [
{
intended_usage: "pro_search_steps",
plan_block: {
steps: [
{
step_type: "SEARCH_WEB",
search_web_content: { queries: [{ query: "test query" }] },
},
],
},
},
],
},
{
blocks: [
{
intended_usage: "markdown",
markdown_block: { chunks: ["The answer."], progress: "DONE" },
},
],
status: "COMPLETED",
},
];
const restore = mockFetch(200, pplxEvents);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-sonnet",
body: { messages: [{ role: "user", content: "search test" }], stream: true },
stream: true,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
const text = await result.response.text();
const dataLines = text
.split("\n")
.filter((l) => l.startsWith("data: ") && l !== "data: [DONE]");
// Should have a reasoning_content delta
const hasReasoning = dataLines.some((l) => {
const json = JSON.parse(l.slice(6));
return json.choices?.[0]?.delta?.reasoning_content != null;
});
assert.ok(hasReasoning, "Should have reasoning_content delta for thinking steps");
} finally {
restore();
}
});
// ─── Test: Error handling ───────────────────────────────────────────────────
test("Error: 401 returns auth error message", async () => {
const restore = mockFetch(401, []);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "hi" }] },
stream: false,
credentials: { apiKey: "expired-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 401);
const json = (await result.response.json()) as any;
assert.ok(json.error.message.includes("auth failed"));
assert.ok(json.error.message.includes("session-token"));
} finally {
restore();
}
});
test("Error: 429 returns rate limit message", async () => {
const restore = mockFetch(429, []);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-gpt",
body: { messages: [{ role: "user", content: "hi" }] },
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 429);
const json = (await result.response.json()) as any;
assert.ok(json.error.message.includes("rate limited"));
} finally {
restore();
}
});
test("Error: fetch failure returns 502", async () => {
const restore = mockFetchError(new Error("ECONNREFUSED"));
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "hi" }] },
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 502);
const json = (await result.response.json()) as any;
assert.ok(json.error.message.includes("ECONNREFUSED"));
} finally {
restore();
}
});
test("Error: empty messages returns 400", async () => {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [] },
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 400);
const json = (await result.response.json()) as any;
assert.ok(json.error.message.includes("Missing or empty messages"));
});
test("Error: missing messages returns 400", async () => {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: {},
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 400);
});
// ─── Test: Perplexity SSE error in stream ───────────────────────────────────
test("Non-streaming: Perplexity stream error returns 502", async () => {
const pplxEvents = [{ error_code: "RATE_LIMIT", error_message: "Too many requests" }];
const restore = mockFetch(200, pplxEvents);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "test" }], stream: false },
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 502);
const json = (await result.response.json()) as any;
assert.ok(json.error.message.includes("Too many requests"));
} finally {
restore();
}
});
// ─── Test: Message parsing ──────────────────────────────────────────────────
test("Message parsing: system + user + assistant history", async () => {
let capturedBody = null;
const original = globalThis.fetch;
globalThis.fetch = async (url, opts) => {
capturedBody = JSON.parse(opts.body);
return new Response(
mockPplxStream([
{
blocks: [
{
intended_usage: "markdown",
markdown_block: { chunks: ["response"], progress: "DONE" },
},
],
status: "COMPLETED",
},
]),
{ status: 200, headers: { "Content-Type": "text/event-stream" } }
);
};
try {
const executor = new PerplexityWebExecutor();
await executor.execute({
model: "pplx-auto",
body: {
messages: [
{ role: "system", content: "You are helpful" },
{ role: "user", content: "First question" },
{ role: "assistant", content: "First answer" },
{ role: "user", content: "Follow up" },
],
stream: false,
},
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
// The query should contain the current message
const query = capturedBody.query_str;
assert.ok(query.includes("Follow up"), "Query should contain current user message");
assert.ok(query.includes("You are helpful"), "Query should contain system message");
assert.equal(capturedBody.params.search_focus, "internet");
assert.equal(capturedBody.params.use_schematized_api, true);
} finally {
globalThis.fetch = original;
}
});
test("Message parsing: developer role treated as system", async () => {
let capturedBody = null;
const original = globalThis.fetch;
globalThis.fetch = async (url, opts) => {
capturedBody = JSON.parse(opts.body);
return new Response(
mockPplxStream([
{
blocks: [
{
intended_usage: "markdown",
markdown_block: { chunks: ["ok"], progress: "DONE" },
},
],
status: "COMPLETED",
},
]),
{ status: 200, headers: { "Content-Type": "text/event-stream" } }
);
};
try {
const executor = new PerplexityWebExecutor();
await executor.execute({
model: "pplx-sonnet",
body: {
messages: [
{ role: "developer", content: "Be concise" },
{ role: "user", content: "hello" },
],
stream: false,
},
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
const query = capturedBody.query_str;
assert.ok(query.includes("Be concise"), "Developer message should be treated as system");
} finally {
globalThis.fetch = original;
}
});
// ─── Test: Auth header construction ─────────────────────────────────────────
test("Auth: cookie-based auth sends Cookie header", async () => {
let capturedHeaders = null;
const original = globalThis.fetch;
globalThis.fetch = async (url, opts) => {
capturedHeaders = opts.headers;
return new Response(
mockPplxStream([
{
blocks: [
{
intended_usage: "markdown",
markdown_block: { chunks: ["ok"], progress: "DONE" },
},
],
status: "COMPLETED",
},
]),
{ status: 200, headers: { "Content-Type": "text/event-stream" } }
);
};
try {
const executor = new PerplexityWebExecutor();
await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "test" }], stream: false },
stream: false,
credentials: { apiKey: "my-session-token-value" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(
capturedHeaders["Cookie"],
"__Secure-next-auth.session-token=my-session-token-value"
);
assert.ok(
!capturedHeaders["Authorization"],
"Should not have Authorization header for cookie auth"
);
} finally {
globalThis.fetch = original;
}
});
test("Auth: JWT auth sends Authorization Bearer header", async () => {
let capturedHeaders = null;
const original = globalThis.fetch;
globalThis.fetch = async (url, opts) => {
capturedHeaders = opts.headers;
return new Response(
mockPplxStream([
{
blocks: [
{
intended_usage: "markdown",
markdown_block: { chunks: ["ok"], progress: "DONE" },
},
],
status: "COMPLETED",
},
]),
{ status: 200, headers: { "Content-Type": "text/event-stream" } }
);
};
try {
const executor = new PerplexityWebExecutor();
await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "test" }], stream: false },
stream: false,
credentials: { accessToken: "jwt-token-value" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(capturedHeaders["Authorization"], "Bearer jwt-token-value");
assert.ok(!capturedHeaders["Cookie"], "Should not have Cookie header for JWT auth");
} finally {
globalThis.fetch = original;
}
});
// ─── Test: Model mapping ────────────────────────────────────────────────────
test("Model mapping: pplx-gpt sends correct internal preference", async () => {
let capturedBody = null;
const original = globalThis.fetch;
globalThis.fetch = async (url, opts) => {
capturedBody = JSON.parse(opts.body);
return new Response(
mockPplxStream([
{
blocks: [
{
intended_usage: "markdown",
markdown_block: { chunks: ["ok"], progress: "DONE" },
},
],
status: "COMPLETED",
},
]),
{ status: 200, headers: { "Content-Type": "text/event-stream" } }
);
};
try {
const executor = new PerplexityWebExecutor();
await executor.execute({
model: "pplx-gpt",
body: { messages: [{ role: "user", content: "test" }], stream: false },
stream: false,
credentials: { apiKey: "test" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(capturedBody.params.model_preference, "gpt54");
assert.equal(capturedBody.params.mode, "copilot");
} finally {
globalThis.fetch = original;
}
});
test("Model mapping: thinking mode uses thinking variant", async () => {
let capturedBody = null;
const original = globalThis.fetch;
globalThis.fetch = async (url, opts) => {
capturedBody = JSON.parse(opts.body);
return new Response(
mockPplxStream([
{
blocks: [
{
intended_usage: "markdown",
markdown_block: { chunks: ["ok"], progress: "DONE" },
},
],
status: "COMPLETED",
},
]),
{ status: 200, headers: { "Content-Type": "text/event-stream" } }
);
};
try {
const executor = new PerplexityWebExecutor();
await executor.execute({
model: "pplx-sonnet",
body: {
messages: [{ role: "user", content: "test" }],
stream: false,
thinking: true,
},
stream: false,
credentials: { apiKey: "test" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(capturedBody.params.model_preference, "claude46sonnetthinking");
} finally {
globalThis.fetch = original;
}
});
// ─── Test: Provider registry ────────────────────────────────────────────────
test("Provider registry: perplexity-web is registered with correct models", async () => {
const { PROVIDER_MODELS } = await import("../../open-sse/config/providerModels.ts");
const models = PROVIDER_MODELS["pplx-web"];
assert.ok(models, "pplx-web should be in PROVIDER_MODELS");
assert.ok(models.length === 8, `Expected 8 models, got ${models.length}`);
const modelIds = models.map((m) => m.id);
assert.ok(modelIds.includes("pplx-auto"));
assert.ok(modelIds.includes("pplx-gpt"));
assert.ok(modelIds.includes("pplx-sonnet"));
assert.ok(modelIds.includes("pplx-opus"));
assert.ok(modelIds.includes("pplx-gemini"));
assert.ok(modelIds.includes("pplx-nemotron"));
assert.ok(modelIds.includes("pplx-sonar"));
assert.ok(modelIds.includes("pplx-kimi"));
});
// ─── Test: Fallback text field ──────────────────────────────────────────────
test("Non-streaming: falls back to text field when no blocks", async () => {
const pplxEvents = [{ text: "Fallback answer text", status: "COMPLETED", final: true }];
const restore = mockFetch(200, pplxEvents);
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "test" }], stream: false },
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
const json = (await result.response.json()) as any;
assert.ok(json.choices[0].message.content.includes("Fallback answer text"));
} finally {
restore();
}
});
// ─── Test: Request URL and headers ──────────────────────────────────────────
test("Request: posts to correct Perplexity SSE endpoint", async () => {
let capturedUrl = null;
let capturedHeaders = null;
const original = globalThis.fetch;
globalThis.fetch = async (url, opts) => {
capturedUrl = url;
capturedHeaders = opts.headers;
return new Response(
mockPplxStream([
{
blocks: [
{ intended_usage: "markdown", markdown_block: { chunks: ["ok"], progress: "DONE" } },
],
status: "COMPLETED",
},
]),
{ status: 200, headers: { "Content-Type": "text/event-stream" } }
);
};
try {
const executor = new PerplexityWebExecutor();
await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "test" }], stream: false },
stream: false,
credentials: { apiKey: "test" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(capturedUrl, "https://www.perplexity.ai/rest/sse/perplexity_ask");
assert.equal(capturedHeaders["Origin"], "https://www.perplexity.ai");
assert.equal(capturedHeaders["x-perplexity-request-endpoint"], "https://www.perplexity.ai/rest/sse/perplexity_ask");
assert.equal(capturedHeaders["x-perplexity-request-reason"], "ask-query-state-provider");
assert.ok(capturedHeaders["x-request-id"], "x-request-id header should be set");
assert.equal(capturedHeaders["Accept"], "text/event-stream");
} finally {
globalThis.fetch = original;
}
});
// ─── #2459: Cloudflare challenge vs genuine auth failure ─────────────────────
test("Error: Cloudflare 403 challenge returns a distinct (non-cookie) error", async () => {
const restore = mockFetch(403, [], "<html><title>Just a moment...</title></html>");
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "hi" }] },
stream: false,
credentials: { apiKey: "valid-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 403);
const json = (await result.response.json()) as any;
assert.match(json.error.message, /Cloudflare/i);
assert.ok(!/session-token/i.test(json.error.message), "must not blame the cookie");
} finally {
restore();
}
});
test("Error: TlsClientUnavailableError returns 502 with install hint", async () => {
const restore = mockFetchError(new TlsClientUnavailableError("native binary missing"));
try {
const executor = new PerplexityWebExecutor();
const result = await executor.execute({
model: "pplx-auto",
body: { messages: [{ role: "user", content: "hi" }] },
stream: false,
credentials: { apiKey: "test-cookie" },
signal: AbortSignal.timeout(10000),
log: null,
});
assert.equal(result.response.status, 502);
const json = (await result.response.json()) as any;
assert.match(json.error.message, /TLS client unavailable/i);
} finally {
restore();
}
});