ReadyForLLM
All free tools

AI Bot Audit

See which AI crawlers your robots.txt actually controls.

We pull your robots.txt and check every major LLM crawler. Allowed, blocked, or completely unmentioned. Unmentioned is the danger state — it means whoever scrapes you scrapes you.

Try nytimes.com for a site with deliberate AI policy, or your own to see what's actually live.

Next step

Set per-bot policies with AI Shield

Learn more