online / endpoints 62 / categories 10 / rate 60/min/ip /

GET /robots.txt

GET /robots.txt

Standards-compliant robots.txt with a clean Allow-all, named explicit allows for major AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider), and a sitemap reference. Mirrors the hub's operational robots.txt.

expect: 200 OK, Content-Type: text/plain. Body parses cleanly under any robots.txt parser. X-Chaos-Origin: control, X-Chaos-Counterpart points at bots.catastrophic.io/robots.txt.

bash