Free · Instant · No sign-up
Can AI engines read your website?
Enter a domain and see in seconds what your robots.txt allows GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot and 11 other crawlers, whether your content is readable without JavaScript, and what to fix first. No email, no sales call.
What the check covers
Six things that decide whether AI engines can use your pages
AI crawler access
robots.txt evaluated per crawler with the deciding rule — search, user-initiated and training crawlers separately. Plus noindex and CDN bot challenges.
Content without JavaScript
Words in the HTML a crawler receives, and signals of an empty app shell. Most AI crawlers don't run JavaScript.
Structured data
Which JSON-LD types the page declares, whether they parse, and whether anything says who is behind the site.
Metadata
Title, meta description, canonical, language, hreflang and the H1 — the basics systems use to understand a page.
Discovery files
An XML sitemap (declared in robots.txt or at /sitemap.xml) and an llms.txt at the site root.
HTTP basics
Status code, HTTPS, http→https redirect, redirect chain and time to first byte.
Readiness is not visibility
The check tells you whether AI can read you — not what it says about you
A perfect score means crawlers can reach, read and understand your pages. Whether ChatGPT, Perplexity or Google's AI Overviews then recommend you depends on what they find about you across the web, and it changes from answer to answer. Measuring that takes tracked prompts, every day, across engines and markets.
- One answer = one prompt × one engine × one day, stored with its text and citations
- Visibility, mention rate, share of voice, position, citations and sentiment
- Competitors and the sources AI engines cite for your topics
- Open source: self-host for free or use AutoSEO Cloud
From check to results
What to do after the check
- 1
Fix access and rendering
Work through the high-impact fixes: crawler access, server-rendered content, noindex, HTTP errors.
- 2
Add structure
Organization and page-level JSON-LD, clear titles and descriptions, a sitemap and optionally llms.txt.
- 3
Track real answers
Add the prompts your customers ask to AutoSEO and see how engines answer them over time.
- 4
Close the gaps
Use competitor, source and sentiment data to decide which pages and mentions to work on next.
Questions about the check
What does the free AI visibility check test?
Whether AI engines can reach and read your site: what your robots.txt allows 15 AI and search crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, Googlebot, Bingbot, Applebot-Extended, Meta-ExternalAgent, Amazonbot, CCBot), whether the content is in the HTML without JavaScript, which JSON-LD types and metadata the page has, whether llms.txt and an XML sitemap exist, and HTTP basics such as status, HTTPS, redirects and response time.
Does the check show whether ChatGPT or Perplexity mention my brand?
No. It measures readiness — whether AI engines can read and cite your pages — not what they answer. To see actual answers you have to run prompts against the engines over time, because answers vary between runs. That is what AutoSEO's AI visibility tracking does: it asks ChatGPT, Perplexity, Gemini, Claude, Google AI Overviews and other engines your prompts on a schedule and measures visibility, position, citations and sentiment.
How is the score calculated?
Five weighted categories: AI crawler access 30%, content readable without JavaScript 25%, structure and metadata 20%, HTTP and performance 15%, discovery files 10%. Within crawler access, AI search crawlers count 65%, user-initiated fetchers 20% and training crawlers 15%. Every issue appears in the fix list with its severity; the list is sorted by impact.
Should I allow AI training crawlers like GPTBot or ClaudeBot?
That is a business decision, and the check treats it as one: blocked training crawlers only cost a few points and are listed as low priority. Blocking a training crawler does not block the same vendor's search crawler — GPTBot and OAI-SearchBot, or ClaudeBot and Claude-SearchBot, are controlled separately — and blocking Google-Extended does not affect Google Search or AI Overviews.
How does the check evaluate robots.txt?
Like a crawler following RFC 9309 and Google's documentation: a crawler obeys the groups that name it (case-insensitive) and only falls back to User-agent: when none exists; the longest matching rule wins and allow wins a tie; ` and $` wildcards are supported. A robots.txt that answers with a server error counts as "everything disallowed", a 404 as "everything allowed". The table shows the deciding rule and its line number.
Do I need an llms.txt?
It helps, but it is not critical. llms.txt is a proposed convention (llmstxt.org) for a Markdown summary of a site for AI assistants. The major AI crawlers don't document using it, so the check gives it only 3 of 100 points. An XML sitemap matters more.
Why does the result mention a bot challenge?
Your CDN or firewall answered our checker with a challenge page (for example a Cloudflare bot check) instead of your content. Our checker identifies itself honestly as AutoSEO-Check/1.0; AI crawlers are usually treated the same way, and some CDNs block AI crawlers by default. Allow the verified crawlers you want to be visible in.
Does the check run JavaScript?
No, deliberately. It reads the HTML exactly as a crawler receives it. If your content only appears after JavaScript runs, most AI crawlers won't see it — and neither does the check.
Can I check a single page instead of the homepage?
Yes. Enter the full URL. The page itself is analyzed and robots.txt is evaluated for that path; robots.txt, llms.txt and the sitemap are read from the site's root.
What happens with the data?
There is no sign-up and no email. The checked domain and the result are not stored in a database: results are kept in memory for 10 minutes so that repeated checks don't hit the site again, and your IP address is used in memory for rate limiting. The check fetches only public URLs and refuses private or internal addresses.
Track what AI engines actually answer
Open source AI visibility tracking and SEO suite. Self-host for free, or let us run it for $50/month.