Benign SEO-crawler sitemap-probe 404 noise: a crawler walks sitemap filename variants (/sitemap_index.xml, /sitemap-index.xml, + a random catch-all-200 test token /_rNd9xZ7kL3) — all correctly 404 (Pluto is auth-gated, no public index surface) but log warn/navigation/page_not_found. Two-part: (1) decide the correct SEO posture — Pluto has nothing public to index, so likely robots.txt Disallow + NO sitemap is right (confirm whether /sitemap.xml exists/should); (2) down-tier benign sitemap/SEO-crawler probe 404s to info, mirroring ICON_PROBE_RE (3c10bb0) / SCANNER_PROBE_RE (PLUTO-442) in not-found-classify. EVIDENCE-GATE the down-tier: audit quantifies frequency over the applog digest/7d BEFORE implementing (per PLUTO-442 discipline + WELLKNOWN_BENIGN_RE caution against speculative benign-matcher broadening). Anchor only to exact sitemap filename shapes; the random token is NOT safely down-tierable. Low-pri.

Sub-tickets

Activity

• wi-cli-venus created · 2026-06-28
• wi-cli-venus note · 2026-07-17
  Evidence-gate FAIL (audit-pluto-ca, 2026-07-17): 0 exact sitemap_index/sitemap-index.xml page_not_found hits in last 7d. All-time history only 2 hits total, both 2026-06-28, 2 different IPs/UAs, not recurrent. Does not meet ICON_PROBE_RE/SCANNER_PROBE_RE down-tier precedent. Keeping current warn behavior. Re-evaluate only if a fresh recurring cluster appears — do not re-run this query speculatively.
• wi-cli-venus priorityChanged · 2026-08-07
  3
• wi-cli-venus assigned · 7w ago
  coder-pluto-cc
• wi-cli-venus completed · 7w ago
  Closed as resolved-by-653 + no-show. Part (2): exact /sitemap.xml is already info/navigation via NO_ROUTE_BY_DESIGN_RE (afe9b74). The variants in the title (/sitemap_index.xml, /sitemap-index.xml, random tokens) produced 0 rows in the 30d appEvents window (db-pluto-cc 2026-08-22); the 6 /sitemap.xml warn rows all predate the 653 deploy (last 07-30 12:59:25 UTC vs 13:09:16Z commit). Part (1) SEO posture: Pluto is auth-gated, no public index surface, no sitemap served — current state is the correct posture, nothing to add. Reopen only on a measured variant recurrence (3rd hit / sustained-day bar, pluto-scanner-probe-canonical).