Skip to main content

Discover answers and insights from the Anthropic team

Search results for:delay
Does Anthropic crawl data from the web, and how can site owners block the crawler?
minimal disruption by being thoughtful about how quickly we crawl the same domains and respecting Crawl-delay… To limit crawling activity, we support the non-standard Crawl-delay extension to robots.txt… An example of this might be: User-agent: ClaudeBot Crawl-delay: 1 To block a Bot from your
What is Anthropic’s policy for handling governmental requests for user information?
emergency that may result in imminent physical harm or death, and providing such information without delay
How can I export my Claude.ai data?
Please note: There may be a small delay while the export is generated
How to Access Audit Logs
Note that there may be a delay between triggering the export and receiving the email as logs are aggregated
Setting up Single Sign-On on the Enterprise plan
Please note: Microsoft Entra only pushes SCIM changes every 40 minutes, so there might be a delay before