# By Robots For Robots ยท https://www.byrobotsforrobots.ai/ # # The policy is open, deliberately. This site argues that pages should be # legible to machines; refusing to be read would be an odd way to make that # argument. Every well-behaved crawler is welcome, AI crawlers included. # # See /llms.txt for a plain-language summary written for language models. User-agent: * Allow: / # Named explicitly so there is no ambiguity about intent. User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / Sitemap: https://www.byrobotsforrobots.ai/sitemap.xml