mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-08-26 17:12:27 +03:00
c97d2a6ae2
* feat(homolog): scaffolding da suíte de homologação E2E (deps + npm run homolog) * feat(homolog): L0 avaliador de paridade de deploy (TDD) * feat(homolog): L1a ciclo de vida de API key efêmera (login admin -> create -> revoke) * feat(homolog): L1b suite httpYac de API (models, chat, auth de management, health) * feat(homolog): L1c checker SSE de streaming real (TDD no parser) * feat(homolog): L2 smoke de providers reais via promptfoo gerado do catálogo * feat(homolog): L4a Playwright homolog config + login storageState * feat(homolog): L4b smoke de todas as rotas do dashboard (descoberta via fs) * feat(homolog): L4c fluxo criar/revogar API key pela UI * fix(homolog): resiliencia real-environment — stream:false no smoke promptfoo, retry de socket keep-alive, key efemera com sufixo unico * feat(homolog): L5 orquestrador npm run homolog + relatorio CTRF unificado * docs(homolog): guia de operacao da suite + fragment de changelog + allowlist env-doc-sync * fix(homolog): paraleliza o sweep de rotas do dashboard (fullyParallel + 8 workers) * fix(homolog): isola outputs crus em homolog-report/raw para nao quebrar o ctrf merge * fix(homolog): outputDir absoluto do reporter CTRF da UI (path relativo escapava do worktree) * chore(quality): allowlist the 5 homolog-suite devDependencies (ctrf-io trio, httpyac, promptfoo) after registry verification * chore(quality): register the homolog Playwright suite as a test-discovery collector (run.mjs -> tests/homolog/ui)
19 lines
697 B
TypeScript
19 lines
697 B
TypeScript
import { test } from "node:test";
|
|
import assert from "node:assert/strict";
|
|
import { promptfooToCtrf } from "../../scripts/homolog/lib/promptfooToCtrf.mjs";
|
|
|
|
test("mapeia resultados do promptfoo para tests CTRF", () => {
|
|
const ctrf = promptfooToCtrf({
|
|
results: {
|
|
results: [
|
|
{ provider: { label: "openai" }, success: true, latencyMs: 812 },
|
|
{ provider: { label: "grok" }, success: false, latencyMs: 30000, error: "timeout" },
|
|
],
|
|
},
|
|
});
|
|
assert.equal(ctrf.results.summary.tests, 2);
|
|
assert.equal(ctrf.results.summary.passed, 1);
|
|
assert.equal(ctrf.results.tests[1].status, "failed");
|
|
assert.equal(ctrf.results.tests[1].name, "provider-smoke: grok");
|
|
});
|