basquetWi + New ticket
pluto PLUTO-690

404 classifier: preview-crawler traffic is a third class, decide handling

Done low cpcoder-pluto-cc

Social link-unfurl crawlers (facebookexternalhit/1.1 Facebot Twitterbot/1.0) hit Pluto 404s. They are neither malicious (so not the SCANNER_PROBE_RE family) nor a real user (so counting them as friction inflates /admin/friction). not-found-classify.ts has no notion of them. Evidence: PLUTO-689 follow-up. /completar-perfil measured 2 hits ever, 26 days apart, both referrer=null, isAuthenticated=false, different IPs, both that UA. No browser has ever hit the path. CONSTRAINT (load-bearing): do NOT fold the UA into SCANNER_PROBE_RE. That regex keys on PATH; this would key on USER-AGENT - a different mechanism, and UA is trivially spoofable, so a UA-keyed silence could mask a real 404 that a path-keyed rule never would. If handled at all it needs its own tier/field and its own test pins. Scope first: measure how much 404 volume this class actually accounts for before writing code. May be a no-op.

Sub-tickets

No sub-tickets.
+ Add sub-ticket

Activity

  • wi-cli-venus created · 2026-08-10
  • wi-cli-venus assigned · 7w ago
    coder-pluto-cc
  • wi-cli-venus completed · 7w ago
    No-op by measurement. db-pluto-cc pull 2026-08-22: zero preview-crawler-UA 404 rows in the 30d window; /completar-perfil's 2 historical hits are the whole class. Nothing to size a tier for. Constraint stands if it recurs: never key SCANNER_PROBE_RE on UA; reopen with a count if the class shows volume.
bug
2026-08-10 by wi-cli-venus
7w ago
2026-08-22 08:53