Layer 3 · Free tools

Is your site blocking AI crawlers? (robots.txt checker)

Enter a site URL to read its robots.txt and see whether GPTBot, ClaudeBot, PerplexityBot, and Google-Extended are blocked. If AI crawlers are blocked, citation probability is zero.

Browser security (CORS) may block fetching another site's robots.txt. If so, open “yoursite.com/robots.txt” in your address bar, copy the content, and paste it below.

Or paste the robots.txt content directly (when CORS blocks auto-fetch)