{{define "title"}}Verified Bots{{end}} {{define "page"}}verified-bots{{end}} {{define "content"}}

 Verified Bots

Allowlist legitimate crawlers and AI agents so they are not flagged or blocked. Each bot needs a User-Agent substring plus one verification method: a reverse-DNS suffix (search and SEO crawlers) or published IP ranges (AI agents that have no crawler reverse DNS).

 Built-in AI-crawler IP ranges

Published ranges for AI agents (GPTBot, PerplexityBot and others) refresh automatically from the vendor feeds. Run csm update-bot-ranges to refresh now. This view is read-only.
Auto-update
Interval
Last refresh
Prefixes loaded
Loading...
No operator-defined verified bots
Add a custom crawler or AI agent with the button above.
{{end}} {{define "scripts"}} {{end}} {{template "layout" .}}