# www.robotstxt.org/ # Allow crawling of all content User-agent: * Disallow: /credits # Disallow specific AI bots User-Agent: PerplexityBot Disallow: /