Skip to content
AI visibility glossary

ClaudeBot

In short

Anthropic's crawler that collects web content.

Example

Writing a separate rule for this bot with a "User-agent: ClaudeBot" line in robots.txt.

Where you'll see it in AILens

The AI bot access (AGT-010) and training bot decision (AGT-011) controls.

Anthropic also uses separate bot names for search and for user requests. Check the current list in Anthropic's documentation before writing rules.

Often confused with

Check what this article covers on your own site.

Check your site
ClaudeBot | AILens