19 bots AI Crawler Readiness Assessment
Is your site visible to AI?
Check whether ChatGPT, Claude, Perplexity and other AI crawlers can reach and read your pages: robots.txt, firewall blocks, JavaScript rendering, meta directives and more.
Tests
GPTBot
ClaudeBot
PerplexityBot
Google-Extended
OAI-SearchBot
+14 more
🎁
Sign up for free and get 3 free scans to analyze your websites!
Unknown
Suitability Status
Suitability Score
ℹ️
How the score is calculated:
Uses weighted factors based on importance:
Critical (84% total):
• robots.txt: 25% (penalty if AI crawlers not explicitly allowed)
• HTTP response: 20% (slow/unstable URLs penalized)
• Paywall/login barriers: 15%
• Meta directives: 12% (penalty if not explicitly allowing)
• TOS restrictions: 12%
Important (14% total):
• HTTP headers: 6%
• Rate limiting: 4%
• SEO score: 4% (missing canonical penalized)
Less Critical (2% total):
• Semantic structure: 1%
• Content type: 1%
Errors apply additional penalty (up to 40%)
Score levels:
≥0.7: Suitable
0.4-0.7: Caution
<0.4: Not Suitable
Uses weighted factors based on importance:
Critical (84% total):
• robots.txt: 25% (penalty if AI crawlers not explicitly allowed)
• HTTP response: 20% (slow/unstable URLs penalized)
• Paywall/login barriers: 15%
• Meta directives: 12% (penalty if not explicitly allowing)
• TOS restrictions: 12%
Important (14% total):
• HTTP headers: 6%
• Rate limiting: 4%
• SEO score: 4% (missing canonical penalized)
Less Critical (2% total):
• Semantic structure: 1%
• Content type: 1%
Errors apply additional penalty (up to 40%)
Score levels:
≥0.7: Suitable
0.4-0.7: Caution
<0.4: Not Suitable
0.00