Question 1

Is this tool really free?

Accepted Answer

Yes — no signup, no email required. Paste a URL or your robots.txt content and get results immediately.

Question 2

What's the difference between retrieval and training bots?

Accepted Answer

Retrieval bots (OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-User, Bingbot, etc.) fetch your pages live to cite them in an AI answer. Training bots (GPTBot, ClaudeBot, CCBot, Google-Extended) only feed a model's training data — blocking them doesn't affect whether you're cited today.

Question 3

My site is on Shopify or WordPress — can I still use this?

Accepted Answer

Yes. The tool works on any live site's robots.txt, and the results page gives platform-specific fix instructions for both Shopify and WordPress.

AI Crawler Check: Does Your Robots.txt Block ChatGPT & Perplexity?

FAQ