mirror of
https://github.com/diegosouzapw/OmniRoute.git
synced 2026-08-06 23:32:12 +03:00
* docs: move superpowers/research artifacts to isolated _tasks repo + docs tree cleanup
- Move docs/superpowers/{plans,specs} and docs/research/* into the gitignored,
separately-versioned _tasks/ repo; untrack the two tracked research design docs.
- Add CLAUDE.md "Planning & Research Artifacts" section overriding the superpowers
default save paths (docs/... -> _tasks/...); align REPOSITORY_MAP and
DOCUMENTATION_OVERHAUL_PLAN with the new convention.
- Drop 4 now-obsolete /api/discovery/* entries from check-docs-symbols allowlist
(stale-enforcement) and refresh code/spec path comments to _tasks/...
- Sweeps in concurrent docs-tree restructuring (root-level provider/guide docs,
compression spec cleanup, .mcp.json.example removal).
* docs: reorganize docs/ tree + fix stale facts across ~26 docs
Phase A — reorganization:
- Move 7 orphan root docs into subfolders (providers/ created; TIERS+USAGE_QUOTA→guides/;
plugins+PLUGIN_SDK→frameworks/); delete 8 obsolete/redundant docs (SUBMIT_PR superseded
by CONTRIBUTING; DOCUMENTATION_OVERHAUL_PLAN; INCIDENT_RESPONSE/PERF_BUDGETS/THREAT_MODEL;
3 ops snapshots). Rebuild README index (was missing ~40 files) + per-folder meta.json nav.
- Clean 14 dangling doc-path references in bin/ ops scripts, scripts/, workflow, tests;
fix the dockerignore-docs-coverage required-docs path (PROVIDERS→providers/CLAUDE_WEB).
Phase B — content accuracy (verified against code, not the audit summary):
- Functional: ENVIRONMENT flag defaults (INPUT_SANITIZER/MCP_ENFORCE_SCOPES=true,
COMPRESS_DESCRIPTIONS=false, dynamic heap); MCP-SERVER notion tool names (omniroute_*→
notion_*) + counts 87→94; coverage gate 75/70→60/60/60/60 (RELEASE_CHECKLIST, COVERAGE_PLAN,
ERROR_SANITIZATION, CONTRIBUTING); pre-push hook description; regenerate PROVIDER_REFERENCE (237).
- Count drift: providers 237, executors 70, migrations 106, db modules 94, oauth 19,
strategies 17, MCP 94, flags 38, TS 6.0, open-sse ~900/services 294 across architecture/
frameworks/ops docs; AUTO-COMBO 9→12 factors w/ correct DEFAULT_WEIGHTS; REASONING +2
patterns; STEALTH UA defaults; AGENT_PROTOCOLS +cursor-cloud/list-capabilities;
LANGUAGE_PACKS +id pack.
- Kept Node 20 (runtime guard accepts 20.20.2+; only engines is stricter) and MCP scopes=13
(mcpScopes.ts) — both were correct in the docs; corrected only the attribution.
* docs: finish content refresh — compression engines, CLI_TOKEN merge, metadata sweep
- Compression: document the additional built-in engines (CCR, headroom, ionizer,
session-dedup) in COMPRESSION_ENGINES; clarify LLMLingua-2 is the ultra-mode SLM
backend + cross-ref the extra engines in EXTENDING_COMPRESSION; add the id
(Indonesian) language pack to LANGUAGE_PACKS.
- AUTO-COMBO: replace the orphan 'How tiers fit' weight table (stale weights) with a
pointer to the canonical 12-factor DEFAULT_WEIGHTS table.
- Security: merge CLI_TOKEN_AUTH.md (legacy 32-char SHA-256 format) into CLI_TOKEN.md
as a 'Legacy format — still accepted' section (server accepts both HMAC + legacy),
delete CLI_TOKEN_AUTH.md, drop it from the index + security nav.
- Metadata: bump stale frontmatter (version/lastUpdated) to 3.8.40/2026-06-28 across the
doc set audited this pass, and normalize the in-body 'Last updated' header lines to match.
* fix(runtime): drop Node 20 from supported range + align all docs/diagrams/counts
- Node minimum is now 22 (aligned with package.json engines). SUPPORTED_NODE_RANGE in
src/shared/utils/nodeRuntimeSupport.ts (and the bin/ mirror) drops the 20.x line →
'>=22.22.2 <23 || >=24.0.0 <27'; getNodeRuntimeSupport now rejects Node 20 as
unsupported-major. Test updated (TDD): node-runtime-support.test.ts asserts Node 20
rejected. Docs aligned (TROUBLESHOOTING ×2, TERMUX, RELEASE_CHECKLIST, CODEBASE,
CLI-TOOLS, README, llm.txt + 42 i18n llm.txt mirrors, skills/cli-serve).
- Diagrams regenerated: mcp-tools-87 -> mcp-tools-94 (34 base + pool 6 = 94) and
auto-combo-9factor -> auto-combo-12factor (correct DEFAULT_WEIGHTS); SVGs re-rendered
via mermaid-cli; doc refs + diagrams/README updated; fixed a pre-existing broken
resilience-3layers image path.
- CLAUDE.md + AGENTS.md aligned to real counts (237 providers, 94 MCP tools / 34 base,
106 migrations, 94 db modules, 12-factor auto-combo, 17 strategies); README provider
count 231 -> 237; executor count corrected to 68 (provider executors, excl base/index)
and OAuth to 18 across architecture docs. check:docs-all now passes (0 strict drift,
0 broken links); removed dead .mcp.json.example doc link.
* fix(services): update installer Node hint to >=22.22.2 (aligned with dropped Node 20)
* docs: realign counts to current release tip after rebase
The release tip advanced while this work was in flight (Gemini CLI provider/executor
removed by #5246, plus other PRs). Re-counted against the current code and updated:
providers 237->236, executors 68->67, OAuth modules 18->17, open-sse services 294->298;
regenerated PROVIDER_REFERENCE.md (236). check:docs-all passes (0 strict drift).
* docs(changelog) + i18n: record Node 20 drop + fix nodeIncompatibleHint
- CHANGELOG: add [3.8.40] entries for the Node 20.x removal (runtime) and the docs
reorganization/accuracy audit.
- i18n: nodeIncompatibleHint across all 42 locales no longer lists Node 20.x as
supported (ASCII + CJK full-width variants), aligned with the dropped Node 20.
* fix(docs): repair CI breakages from the doc moves
- test: cli-plugin-system asserted docs/dev/plugins.md exists; the file moved to
docs/frameworks/PLUGINS.md — point the test at the new path (Unit fast-path 2/2 fix).
- frontmatter: PLUGINS.md and PLUGIN_SDK.md moved into the fumadocs-indexed
docs/frameworks/ which requires a 'title' frontmatter; the missing frontmatter
failed the Next.js MDX build (dast-smoke 'invalid frontmatter'). Added frontmatter
to both, plus the providers/ docs (consistency; that folder is not indexed).
228 lines
10 KiB
JavaScript
228 lines
10 KiB
JavaScript
#!/usr/bin/env node
|
||
// scripts/check/check-docs-symbols.mjs
|
||
// Gate anti-alucinação (docs → código): toda referência a uma rota `/api/...` dentro de
|
||
// docs/**/*.md deve resolver para um `route.ts` real em src/app/api/. Pega endpoint
|
||
// INVENTADO/obsoleto que a IA escreve em docs/PRs descrevendo uma rota que não existe —
|
||
// o padrão recorrente das PRs de docs (ex.: oyi77) que fabricam endpoints/APIs.
|
||
//
|
||
// Complementa os outros gates anti-alucinação:
|
||
// - check-fetch-targets.mjs : fetch("/api/...") na UI → route.ts (código → código)
|
||
// - check-openapi-routes.mjs : path da openapi.yaml → route.ts (spec → código)
|
||
// - este gate : /api/... na prosa/markdown → route.ts (docs → código)
|
||
//
|
||
// LOW-NOISE por design: escopo APENAS a paths de rota `/api/...` (sinal mais alto).
|
||
// Tudo que é ruído conhecido (superfície proxy OpenAI-compat, refs a arquivos-fonte,
|
||
// APIs upstream de terceiros, placeholders) vai para IGNORE com justificativa, NÃO para
|
||
// a allowlist. A allowlist congela só drift REAL pré-existente de docs.
|
||
// Stale-enforcement (6A.3): entrada em KNOWN_STALE_DOC_REFS que não suprime nenhum miss
|
||
// real → gate falha com instrução de remoção (evita furo de regressão silencioso).
|
||
import fs from "node:fs";
|
||
import path from "node:path";
|
||
import { pathToFileURL } from "node:url";
|
||
import { assertNoStale } from "./lib/allowlist.mjs";
|
||
|
||
const ROOT = process.cwd();
|
||
const DOCS = path.join(ROOT, "docs");
|
||
const API = path.join(ROOT, "src/app/api");
|
||
|
||
// Padrões que NÃO são rotas internas do OmniRoute (ruído estrutural, não drift).
|
||
// Adicione aqui (com justificativa) em vez da allowlist quando uma categoria gera
|
||
// falsos positivos — a allowlist é só para endpoints stale REAIS.
|
||
const IGNORE = [
|
||
/^\/api\/v1\//, // superfície OpenAI-compat (proxy), não rota interna
|
||
/^\/api\/v1beta\//, // superfície Gemini-compat (proxy)
|
||
/^\/api\/v0\//, // APIs upstream de terceiros citadas em docs de pesquisa
|
||
/^\/api\/v2\//, // idem (deployments etc.)
|
||
/^\/api\/(organizations|map-image|graphql|gql)\b/, // APIs de provedores externos documentadas
|
||
/your-/i, // placeholder de exemplo
|
||
/example/i, // placeholder de exemplo
|
||
/\.{3}/, // placeholder "..."
|
||
/\{\}/, // placeholder de param vazio
|
||
/_(POST|GET|PUT|DELETE|PATCH)$/, // refs estilo trace de rede (gql_POST)
|
||
];
|
||
|
||
// Refs a ARQUIVOS-FONTE, não a URLs (ex.: src/app/api/.../route.ts citado em prosa).
|
||
// O gate só valida URLs de rota, não caminhos de arquivo.
|
||
function isFileRef(p) {
|
||
return /\.(ts|tsx|js|mjs|jsx)$/.test(p) || /\/route$/.test(p);
|
||
}
|
||
|
||
// Refs a `/api/...` que NÃO resolvem para rota real, congeladas para triagem
|
||
// (catraca: bloqueia QUALQUER nova ref inventada em docs). Estas são achados REAIS de
|
||
// drift/alucinação em docs pré-existentes — cada uma precisa de: criar a rota, corrigir
|
||
// o path na doc, ou remover a menção. NÃO adicione novas aqui sem justificativa — esse
|
||
// é o ponto do gate. Issues de tracking devem ser abertas para cada cluster.
|
||
export const KNOWN_STALE_DOC_REFS = new Set([
|
||
// docs/reference/API_REFERENCE.md — guardrails/shadow doc-fiction RESOLVED in #3496:
|
||
// GET /api/guardrails + POST /api/guardrails/test are now REAL routes (wrapping the
|
||
// existing guardrailRegistry); the fictional enable/disable/logs rows and the entire
|
||
// shadow table were removed from the doc (shadow A-B comparison is combo-config +
|
||
// /api/combos/metrics). No allowlist entries needed for these anymore.
|
||
// (DISCOVERY_TOOL_DESIGN.md saiu de docs/research/ para o repo isolado _tasks/research/
|
||
// — gitignored, fora do escopo deste gate. As 4 entradas /api/discovery/* viraram
|
||
// obsoletas e foram removidas para satisfazer o stale-enforcement da allowlist.)
|
||
// docs/reference/ENVIRONMENT.md — endpoint UPSTREAM do provedor Blackbox Web,
|
||
// citado na descrição de env var (não é rota do OmniRoute):
|
||
"/api/chat",
|
||
// docs/ops/TUNNELS_GUIDE.md — a doc afirma EXPLICITAMENTE que este endpoint NÃO
|
||
// existe ("There is no central /api/settings/tunnels endpoint"); menção pedagógica:
|
||
"/api/settings/tunnels",
|
||
]);
|
||
|
||
function walk(dir, filter, acc = []) {
|
||
if (!fs.existsSync(dir)) return acc;
|
||
for (const e of fs.readdirSync(dir, { withFileTypes: true })) {
|
||
const p = path.join(dir, e.name);
|
||
if (e.isDirectory()) walk(p, filter, acc);
|
||
else if (filter(e.name)) acc.push(p);
|
||
}
|
||
return acc;
|
||
}
|
||
|
||
export function collectRouteFiles() {
|
||
return new Set(
|
||
walk(API, (n) => /^route\.tsx?$/.test(n)).map((p) => path.relative(ROOT, p).replace(/\\/g, "/"))
|
||
);
|
||
}
|
||
|
||
/** Normaliza um segmento dinâmico ({param} / [param] / [...param] / :param) para wildcard. */
|
||
function normSeg(seg) {
|
||
if (/^\[\[?\.{3}.+\]\]?$/.test(seg)) return ""; // catch-all [...x] / [[...x]]
|
||
if (/^\{[^}]+\}$/.test(seg) || /^\[[^\]]+\]$/.test(seg) || /^:[^/]+$/.test(seg)) return " ";
|
||
return seg;
|
||
}
|
||
|
||
// /api/providers/{id}/models → src/app/api/providers/[id]/models/route.ts
|
||
// Casa por contagem de segmentos OU por prefixo (uma doc pode citar só o prefixo de
|
||
// uma rota mais profunda, ex.: /api/auth descrevendo a família /api/auth/login). Qualquer
|
||
// segmento dinâmico ([..]/{..}/:..) casa com um segmento dinâmico real.
|
||
export function resolveApiDocPathToRoute(apiPath, routeFiles) {
|
||
const segs = apiPath
|
||
.replace(/^\//, "")
|
||
.replace(/[?#].*$/, "")
|
||
.split("/")
|
||
.map(normSeg);
|
||
for (const rf of routeFiles) {
|
||
const rsegs = rf
|
||
.replace(/^src\/app\//, "")
|
||
.replace(/\/route\.tsx?$/, "")
|
||
.split("/");
|
||
const rnorm = rsegs.map((rs) => {
|
||
if (/^\[\[?\.{3}.+\]\]?$/.test(rs)) return ""; // catch-all
|
||
if (/^\[[^\]]+\]$/.test(rs)) return " "; // [param]
|
||
return rs;
|
||
});
|
||
const catchAll = rnorm.includes("");
|
||
const effLen = catchAll ? rnorm.indexOf("") : rnorm.length;
|
||
if (!catchAll && segs.length > rnorm.length) continue; // doc mais profunda que a rota
|
||
if (catchAll && segs.length < effLen) continue;
|
||
const cmpLen = Math.min(segs.length, effLen || rnorm.length);
|
||
let match = true;
|
||
for (let i = 0; i < cmpLen; i++) {
|
||
const rs = rnorm[i];
|
||
if (rs === "") break; // catch-all absorve o resto
|
||
if (!(rs === segs[i] || rs === " " || segs[i] === " ")) {
|
||
match = false;
|
||
break;
|
||
}
|
||
}
|
||
if (match) return true;
|
||
}
|
||
return false;
|
||
}
|
||
|
||
/** Limpa o path capturado: remove pontuação/ênfase de prosa, fecha brackets pendentes. */
|
||
function cleanCapturedPath(raw) {
|
||
let p = raw.replace(/[.,:;_)>]+$/, "");
|
||
const ob = (p.match(/\[/g) || []).length;
|
||
const cb = (p.match(/\]/g) || []).length;
|
||
const oc = (p.match(/\{/g) || []).length;
|
||
const cc = (p.match(/\}/g) || []).length;
|
||
if (ob !== cb || oc !== cc) {
|
||
// segmento final truncado pelo regex (bracket aberto sem fechar na prosa) → descarta
|
||
p = p.replace(/\/[^/]*[[{][^/]*$/, "");
|
||
}
|
||
return p.replace(/\/$/, ""); // remove barra final (forma de prefixo)
|
||
}
|
||
|
||
// /api/... só conta como URL quando NÃO é a cauda de um caminho de arquivo-fonte
|
||
// (src/lib/api/, @/app/api/, app/api/). O grupo 2 é o path.
|
||
const API_PATH_RE = /(^|[^A-Za-z0-9_/])(\/api\/[A-Za-z0-9_\-/{}\[\].:]+)/g;
|
||
|
||
/** Extrai os paths /api/... distintos de um arquivo markdown (forma URL, não arquivo). */
|
||
export function extractDocApiPaths(src) {
|
||
const out = new Set();
|
||
let m;
|
||
API_PATH_RE.lastIndex = 0;
|
||
while ((m = API_PATH_RE.exec(src))) {
|
||
const p = cleanCapturedPath(m[2]);
|
||
if (p && p !== "/api") out.add(p);
|
||
}
|
||
return [...out];
|
||
}
|
||
|
||
/**
|
||
* Núcleo puro/testável.
|
||
* @param {{file: string, paths: string[]}[]} docPathsByFile
|
||
* @param {Set<string>} routeFiles conjunto de "src/app/api/.../route.ts"
|
||
* @param {Set<string>} allowlist paths stale congelados
|
||
* @returns {string[]} misses no formato "file → /api/path"
|
||
*/
|
||
export function findStaleDocApiRefs(docPathsByFile, routeFiles, allowlist) {
|
||
const misses = [];
|
||
for (const { file, paths } of docPathsByFile) {
|
||
for (const p of paths) {
|
||
if (IGNORE.some((rx) => rx.test(p))) continue;
|
||
if (isFileRef(p)) continue;
|
||
if (allowlist.has(p)) continue;
|
||
if (!resolveApiDocPathToRoute(p, routeFiles)) {
|
||
misses.push(`${file} → ${p}`);
|
||
}
|
||
}
|
||
}
|
||
return misses;
|
||
}
|
||
|
||
function main() {
|
||
const routeFiles = collectRouteFiles();
|
||
// docs/i18n/** são espelhos auto-gerados das docs canônicas — validar só o canônico
|
||
// evita 40× de ruído duplicado (e os mirrors herdam qualquer fix do canônico).
|
||
// docs/superpowers/** são planos internos de implementação (snapshots históricos
|
||
// de intenção — podem citar rotas planejadas/abandonadas), não claims sobre o
|
||
// código atual; fora do escopo do gate (drift surgiu no ciclo v3.8.18).
|
||
const docFiles = walk(DOCS, (n) => /\.md$/.test(n)).filter((f) => {
|
||
const rel = path.relative(ROOT, f).replace(/\\/g, "/");
|
||
return !rel.startsWith("docs/i18n/") && !rel.startsWith("docs/superpowers/");
|
||
});
|
||
const docPathsByFile = docFiles.map((f) => ({
|
||
file: path.relative(ROOT, f).replace(/\\/g, "/"),
|
||
paths: extractDocApiPaths(fs.readFileSync(f, "utf8")),
|
||
}));
|
||
|
||
// Live misses BEFORE allowlist filtering — used for stale-enforcement.
|
||
// The paths (not "file → path" strings) are the unit that the allowlist keys on.
|
||
const allMisses = findStaleDocApiRefs(docPathsByFile, routeFiles, new Set());
|
||
const liveMissPaths = allMisses.map((m) => m.split(" → ")[1]);
|
||
assertNoStale(KNOWN_STALE_DOC_REFS, liveMissPaths, "check-docs-symbols");
|
||
|
||
const misses = findStaleDocApiRefs(docPathsByFile, routeFiles, KNOWN_STALE_DOC_REFS);
|
||
if (misses.length) {
|
||
console.error(
|
||
`[check-docs-symbols] ${misses.length} ref(s) /api em docs sem rota real:\n` +
|
||
misses.map((m) => " ✗ " + m).join("\n") +
|
||
`\n → crie o route.ts, corrija o path na doc, ou (se for upstream/placeholder)` +
|
||
` adicione um padrão a IGNORE com justificativa. NÃO adicione à allowlist sem` +
|
||
` confirmar que é drift pré-existente real.`
|
||
);
|
||
process.exitCode = 1;
|
||
}
|
||
if (!process.exitCode) {
|
||
console.log(
|
||
`[check-docs-symbols] OK — ${docFiles.length} docs canônicas, ` +
|
||
`${routeFiles.size} rotas conhecidas, ${KNOWN_STALE_DOC_REFS.size} stale congeladas`
|
||
);
|
||
}
|
||
}
|
||
|
||
if (import.meta.url === pathToFileURL(process.argv[1] || "").href) main();
|