Files
OmniRoute/tests/unit/dockerignore-docs-coverage.test.ts
Diego Rodrigues de Sa e Souza 5ac4637816 docs: reorganize docs/ + accuracy audit + drop Node 20 (rebased onto current release tip) (#5262)
* docs: move superpowers/research artifacts to isolated _tasks repo + docs tree cleanup

- Move docs/superpowers/{plans,specs} and docs/research/* into the gitignored,
  separately-versioned _tasks/ repo; untrack the two tracked research design docs.
- Add CLAUDE.md "Planning & Research Artifacts" section overriding the superpowers
  default save paths (docs/... -> _tasks/...); align REPOSITORY_MAP and
  DOCUMENTATION_OVERHAUL_PLAN with the new convention.
- Drop 4 now-obsolete /api/discovery/* entries from check-docs-symbols allowlist
  (stale-enforcement) and refresh code/spec path comments to _tasks/...
- Sweeps in concurrent docs-tree restructuring (root-level provider/guide docs,
  compression spec cleanup, .mcp.json.example removal).

* docs: reorganize docs/ tree + fix stale facts across ~26 docs

Phase A — reorganization:
- Move 7 orphan root docs into subfolders (providers/ created; TIERS+USAGE_QUOTA→guides/;
  plugins+PLUGIN_SDK→frameworks/); delete 8 obsolete/redundant docs (SUBMIT_PR superseded
  by CONTRIBUTING; DOCUMENTATION_OVERHAUL_PLAN; INCIDENT_RESPONSE/PERF_BUDGETS/THREAT_MODEL;
  3 ops snapshots). Rebuild README index (was missing ~40 files) + per-folder meta.json nav.
- Clean 14 dangling doc-path references in bin/ ops scripts, scripts/, workflow, tests;
  fix the dockerignore-docs-coverage required-docs path (PROVIDERS→providers/CLAUDE_WEB).

Phase B — content accuracy (verified against code, not the audit summary):
- Functional: ENVIRONMENT flag defaults (INPUT_SANITIZER/MCP_ENFORCE_SCOPES=true,
  COMPRESS_DESCRIPTIONS=false, dynamic heap); MCP-SERVER notion tool names (omniroute_*→
  notion_*) + counts 87→94; coverage gate 75/70→60/60/60/60 (RELEASE_CHECKLIST, COVERAGE_PLAN,
  ERROR_SANITIZATION, CONTRIBUTING); pre-push hook description; regenerate PROVIDER_REFERENCE (237).
- Count drift: providers 237, executors 70, migrations 106, db modules 94, oauth 19,
  strategies 17, MCP 94, flags 38, TS 6.0, open-sse ~900/services 294 across architecture/
  frameworks/ops docs; AUTO-COMBO 9→12 factors w/ correct DEFAULT_WEIGHTS; REASONING +2
  patterns; STEALTH UA defaults; AGENT_PROTOCOLS +cursor-cloud/list-capabilities;
  LANGUAGE_PACKS +id pack.
- Kept Node 20 (runtime guard accepts 20.20.2+; only engines is stricter) and MCP scopes=13
  (mcpScopes.ts) — both were correct in the docs; corrected only the attribution.

* docs: finish content refresh — compression engines, CLI_TOKEN merge, metadata sweep

- Compression: document the additional built-in engines (CCR, headroom, ionizer,
  session-dedup) in COMPRESSION_ENGINES; clarify LLMLingua-2 is the ultra-mode SLM
  backend + cross-ref the extra engines in EXTENDING_COMPRESSION; add the id
  (Indonesian) language pack to LANGUAGE_PACKS.
- AUTO-COMBO: replace the orphan 'How tiers fit' weight table (stale weights) with a
  pointer to the canonical 12-factor DEFAULT_WEIGHTS table.
- Security: merge CLI_TOKEN_AUTH.md (legacy 32-char SHA-256 format) into CLI_TOKEN.md
  as a 'Legacy format — still accepted' section (server accepts both HMAC + legacy),
  delete CLI_TOKEN_AUTH.md, drop it from the index + security nav.
- Metadata: bump stale frontmatter (version/lastUpdated) to 3.8.40/2026-06-28 across the
  doc set audited this pass, and normalize the in-body 'Last updated' header lines to match.

* fix(runtime): drop Node 20 from supported range + align all docs/diagrams/counts

- Node minimum is now 22 (aligned with package.json engines). SUPPORTED_NODE_RANGE in
  src/shared/utils/nodeRuntimeSupport.ts (and the bin/ mirror) drops the 20.x line →
  '>=22.22.2 <23 || >=24.0.0 <27'; getNodeRuntimeSupport now rejects Node 20 as
  unsupported-major. Test updated (TDD): node-runtime-support.test.ts asserts Node 20
  rejected. Docs aligned (TROUBLESHOOTING ×2, TERMUX, RELEASE_CHECKLIST, CODEBASE,
  CLI-TOOLS, README, llm.txt + 42 i18n llm.txt mirrors, skills/cli-serve).
- Diagrams regenerated: mcp-tools-87 -> mcp-tools-94 (34 base + pool 6 = 94) and
  auto-combo-9factor -> auto-combo-12factor (correct DEFAULT_WEIGHTS); SVGs re-rendered
  via mermaid-cli; doc refs + diagrams/README updated; fixed a pre-existing broken
  resilience-3layers image path.
- CLAUDE.md + AGENTS.md aligned to real counts (237 providers, 94 MCP tools / 34 base,
  106 migrations, 94 db modules, 12-factor auto-combo, 17 strategies); README provider
  count 231 -> 237; executor count corrected to 68 (provider executors, excl base/index)
  and OAuth to 18 across architecture docs. check:docs-all now passes (0 strict drift,
  0 broken links); removed dead .mcp.json.example doc link.

* fix(services): update installer Node hint to >=22.22.2 (aligned with dropped Node 20)

* docs: realign counts to current release tip after rebase

The release tip advanced while this work was in flight (Gemini CLI provider/executor
removed by #5246, plus other PRs). Re-counted against the current code and updated:
providers 237->236, executors 68->67, OAuth modules 18->17, open-sse services 294->298;
regenerated PROVIDER_REFERENCE.md (236). check:docs-all passes (0 strict drift).

* docs(changelog) + i18n: record Node 20 drop + fix nodeIncompatibleHint

- CHANGELOG: add [3.8.40] entries for the Node 20.x removal (runtime) and the docs
  reorganization/accuracy audit.
- i18n: nodeIncompatibleHint across all 42 locales no longer lists Node 20.x as
  supported (ASCII + CJK full-width variants), aligned with the dropped Node 20.

* fix(docs): repair CI breakages from the doc moves

- test: cli-plugin-system asserted docs/dev/plugins.md exists; the file moved to
  docs/frameworks/PLUGINS.md — point the test at the new path (Unit fast-path 2/2 fix).
- frontmatter: PLUGINS.md and PLUGIN_SDK.md moved into the fumadocs-indexed
  docs/frameworks/ which requires a 'title' frontmatter; the missing frontmatter
  failed the Next.js MDX build (dast-smoke 'invalid frontmatter'). Added frontmatter
  to both, plus the providers/ docs (consistency; that folder is not indexed).
2026-06-28 22:07:18 -03:00

163 lines
5.7 KiB
TypeScript

/**
* Issue #2348 — Regression guard for the Docker image documentation bundle.
*
* The Dashboard Docs viewer at `src/app/docs/[slug]/page.tsx` reads markdown
* from `process.cwd()/docs/<file>` at runtime. The previous `.dockerignore`
* shipped only `docs/openapi.yaml` to the container, so every help screen
* threw ENOENT.
*
* This test parses `.dockerignore`, applies it against the working tree,
* and asserts that the critical English markdown files are still in the
* Docker build context.
*/
import test from "node:test";
import assert from "node:assert/strict";
import fs from "node:fs";
import path from "node:path";
import { fileURLToPath } from "node:url";
const __dirname = path.dirname(fileURLToPath(import.meta.url));
const REPO_ROOT = path.resolve(__dirname, "../..");
const DOCKERIGNORE = path.resolve(REPO_ROOT, ".dockerignore");
// Subset of the docs viewer's catalog that MUST survive the docker filter.
// Sourced from src/app/docs/lib/docs-auto-generated.ts.
const REQUIRED_DOCS = [
"docs/README.md",
"docs/providers/CLAUDE_WEB.md",
"docs/routing/AUTO-COMBO.md",
"docs/guides/SETUP_GUIDE.md",
"docs/guides/TROUBLESHOOTING.md",
"docs/reference/API_REFERENCE.md",
"docs/reference/PROVIDER_REFERENCE.md",
"docs/reference/ENVIRONMENT.md",
];
// Referenced from docs/**/*.md — fumadocs-mdx webpack build fails if missing.
const REQUIRED_DOC_DIAGRAMS = [
"docs/diagrams/exported/request-pipeline.svg",
"docs/diagrams/exported/resilience-3layers.svg",
"docs/diagrams/exported/authz-pipeline.svg",
"docs/diagrams/exported/db-schema-overview.svg",
];
const REQUIRED_DOC_SCREENSHOTS = [
"docs/screenshots/01-providers.png",
"docs/screenshots/05-translator.png",
];
// Compile .dockerignore patterns into a simple matcher.
// We only need to support the directives we actually use: glob `**`, plain
// path prefixes, and negations starting with `!`.
function parseDockerignore(text: string): { excludes: string[]; includes: string[] } {
const excludes: string[] = [];
const includes: string[] = [];
for (const raw of text.split(/\r?\n/)) {
const line = raw.trim();
if (!line || line.startsWith("#")) continue;
if (line.startsWith("!")) {
includes.push(line.slice(1));
} else {
excludes.push(line);
}
}
return { excludes, includes };
}
/**
* Match a Docker glob pattern against a file path without building a dynamic
* RegExp (avoid ReDoS risk on patterns sourced from .dockerignore). We walk
* the pattern token-by-token. Supported syntax (the subset our .dockerignore
* actually uses): literal segments, `*` (no slash), `**` (any depth incl. 0),
* and trailing `**`.
*/
function patternMatches(pattern: string, file: string): boolean {
const pSegs = pattern.split("/");
const fSegs = file.split("/");
return matchSegments(pSegs, 0, fSegs, 0);
}
function matchSegments(p: string[], pi: number, f: string[], fi: number): boolean {
while (pi < p.length) {
const seg = p[pi];
if (seg === "**") {
// Try consuming 0..N file segments.
if (pi === p.length - 1) return true; // trailing ** consumes everything
for (let k = fi; k <= f.length; k++) {
if (matchSegments(p, pi + 1, f, k)) return true;
}
return false;
}
if (fi >= f.length) return false;
if (!segmentMatches(seg, f[fi])) return false;
pi++;
fi++;
}
return fi === f.length;
}
function segmentMatches(pattern: string, segment: string): boolean {
if (pattern === "*") return true;
if (!pattern.includes("*")) return pattern === segment;
// Single-segment glob with one or more `*` wildcards. Walk literal chunks.
const parts = pattern.split("*");
let cursor = 0;
// Anchor first chunk to start.
const first = parts[0];
if (first && !segment.startsWith(first)) return false;
cursor = first.length;
// Anchor last chunk to end.
const last = parts[parts.length - 1];
if (last && !segment.endsWith(last)) return false;
// Each middle chunk must appear in order between cursor and end-last.
const endLimit = segment.length - last.length;
for (let i = 1; i < parts.length - 1; i++) {
const idx = segment.indexOf(parts[i], cursor);
if (idx === -1 || idx + parts[i].length > endLimit) return false;
cursor = idx + parts[i].length;
}
return true;
}
function isIgnored(file: string, parsed: { excludes: string[]; includes: string[] }): boolean {
let ignored = false;
for (const ex of parsed.excludes) if (patternMatches(ex, file)) ignored = true;
if (ignored) {
for (const inc of parsed.includes) if (patternMatches(inc, file)) ignored = false;
}
return ignored;
}
test("#2348 .dockerignore keeps every doc the in-product viewer needs", () => {
const parsed = parseDockerignore(fs.readFileSync(DOCKERIGNORE, "utf8"));
const missing: string[] = [];
const ignored: string[] = [];
for (const docPath of [...REQUIRED_DOCS, ...REQUIRED_DOC_DIAGRAMS, ...REQUIRED_DOC_SCREENSHOTS]) {
const absPath = path.resolve(REPO_ROOT, docPath);
if (!fs.existsSync(absPath)) {
missing.push(docPath);
continue;
}
if (isIgnored(docPath, parsed)) {
ignored.push(docPath);
}
}
assert.deepEqual(missing, [], `Required docs missing from repo: ${missing.join(", ")}`);
assert.deepEqual(
ignored,
[],
`Files excluded from Docker context — Dashboard Docs viewer will 404 on these:\n ${ignored.join("\n ")}`
);
});
test("#2348 .dockerignore still excludes the heavy i18n tree", () => {
const parsed = parseDockerignore(fs.readFileSync(DOCKERIGNORE, "utf8"));
const heavy = "docs/i18n/pt-BR/docs/routing/AUTO-COMBO.md";
assert.ok(
isIgnored(heavy, parsed),
`${heavy} should be excluded from Docker context but is not — image size will balloon`
);
});