# Search engines and AI search/answer engines are welcome on public pages: question titles and answer # counts only (answers are for members). AI training crawlers are not. Automated collection of member # content is prohibited by the terms: /terms#no-scraping. About this site for AI assistants: /llms.txt User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Disallow: /mcp Disallow: /c/ Disallow: /app/ Disallow: /_member/ Disallow: /admin Disallow: /oauth/ Disallow: /authorize Disallow: /token Disallow: /register Disallow: /revoke Disallow: /.well-known/ Disallow: /login Disallow: /signup Disallow: /join Disallow: /logout Disallow: /forgot Disallow: /reset Disallow: /i/ Disallow: /terms/accept Disallow: /static/ Allow: /$ Allow: /llms.txt Allow: /q/ Allow: /places/ Allow: /channels Allow: /channel/ Allow: /communities Allow: /community/ Allow: /u/ Allow: /rules Allow: /terms Allow: /privacy Allow: /about Allow: /help Allow: /safety Allow: /copyright Allow: /trust User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: YouBot User-agent: meta-externalfetcher Content-Signal: search=yes, ai-input=yes, ai-train=no Disallow: /mcp Disallow: /c/ Disallow: /app/ Disallow: /_member/ Disallow: /admin Disallow: /oauth/ Disallow: /authorize Disallow: /token Disallow: /register Disallow: /revoke Disallow: /.well-known/ Disallow: /login Disallow: /signup Disallow: /join Disallow: /logout Disallow: /forgot Disallow: /reset Disallow: /i/ Disallow: /terms/accept Disallow: /static/ Allow: /$ Allow: /llms.txt Allow: /q/ Allow: /places/ Allow: /channels Allow: /channel/ Allow: /communities Allow: /community/ Allow: /u/ Allow: /rules Allow: /terms Allow: /privacy Allow: /about Allow: /help Allow: /safety Allow: /copyright Allow: /trust User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: CCBot User-agent: Google-Extended User-agent: GoogleOther User-agent: Applebot-Extended User-agent: Bytespider User-agent: meta-externalagent User-agent: FacebookBot User-agent: Amazonbot User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: Diffbot User-agent: AI2Bot User-agent: Ai2Bot-Dolma User-agent: omgili User-agent: Timpibot User-agent: ImagesiftBot Disallow: / Sitemap: https://staging.askmazra.com/sitemap.xml