Anthropic-AI
Legacy Anthropic fetcher user-agent.
| Operator | Anthropic |
| Role | On-demand fetcherFetches specific pages on demand for its operator. |
| User agent token | Anthropic-AI |
| robots.txt | The operator documents honouring robots.txt. |
| Operator docs | support.anthropic.com |
Allow or block Anthropic-AI in robots.txt
Add either rule to the robots.txt at your site root. robots.txt is a request, not a lock: this operator documents honouring it, so the rule is normally enough.
Allow
User-agent: Anthropic-AI Allow: /
Block
User-agent: Anthropic-AI Disallow: /
Other Anthropic crawlers
- Claude-UserLive answer fetcher
- Claude-SearchBotAI search crawler
- ClaudeBotTraining crawler
Is Anthropic-AI allowed on your site right now?
The free checker reads your robots.txt and probes your site as each AI crawler, so you see the policy and the reality in one pass.