Skip to main content

Discover answers and insights from the Anthropic team

Search results for:sitte
Does Anthropic crawl data from the web, and how can site owners block the crawler?
Below is information on the three robots that Anthropic uses and how to set your site preferences to… When a site restricts ClaudeBot access, it signals that the site's future materials should be excluded… Disabling Claude-User on your site prevents our system from retrieving your content in response to a
Reporting, Blocking, and Removing Content from Claude
Remove content from your site Applicable: all content types Removing content from your site is… As a site owner, you can control what shows up in Claude outputs that use web search… your files Applicable: all content types If you have confidential or private content on your site