Technical eligibility, control 14 of 20
T-14 Separate Anthropic crawler purposes
Claude-SearchBot, ClaudeBot and Claude-User must be evaluated according to Anthropic's own documented behaviours, not copied from another platform.
- Priority
- High priority.
- Hard gate
- No
- Change class
- APPROVAL_REQUIRED: Required exact authority must be valid before the consequential action.
- Quality bucket
- Technical eligibility
Why it matters
A single blanket rule for all Anthropic bots will either shut out Claude search visibility or allow training you did not intend. Each bot serves a different purpose, so one setting cannot express three different decisions. Handling them separately keeps your search, training and user-directed access choices clear and testable.
Evidence to review
- Current Anthropic documentation, effective robots policy and request evidence with confidence labels.
How to implement
- Record independent search, training and user-access decisions.
- Check robots rules and delivery failures for the relevant public paths.
- Do not invent an official IP range or copy OpenAI verification rules; document the available verification method and its limits.
How UltimateSEO checks this
Automated. A check in the scan sets PASS or FAIL for this control, and reports UNKNOWN or BLOCKED when its input is missing.
The check looks at: robots.txt groups for ClaudeBot, Claude-SearchBot and Claude-User are evaluated separately with the effective group rules.
States used: PASS, FAIL, UNKNOWN, NOT_APPLICABLE or BLOCKED. UNKNOWN is never shown as a pass. How states work.
Sources
Part of The UltimateSEO Framework v4.3, catalogue dated 2026-10-14. Evidence states, control states and the publish gate are explained on the hub.