Find out what search engines and AI actually see.
Paste a URL. This crawls the page four ways — as a browser, as Googlebot, as GPTBot and as ClaudeBot — reads robots.txt, the sitemap and llms.txt, pulls Google's own field data, and scores the page across all four search disciplines. Every problem comes with the fix, written out and ready to paste.
Results
What the four scores mean
| Discipline | What it decides | Who enforces it | The usual failure |
|---|---|---|---|
| SEO Classic search |
Whether you rank in Google. | Googlebot and the ranking systems. | A stray noindex, a blocked path in robots.txt, or a slow Largest Contentful Paint. |
| AEO Answer engines |
Whether you win the featured snippet or the direct answer. | Google's snippet extractor and AI Overviews. | Questions answered in the fourth paragraph instead of the first sentence. |
| GEO Generative engines |
Whether an AI cites you rather than a competitor. | ChatGPT, Claude, Perplexity, Gemini. | Adjectives where there should be figures, and no named author or date. |
| AIO AI crawler access |
Whether an AI can fetch and read the page at all. | Your server, your CDN and your robots.txt. | Content built by JavaScript, or a firewall quietly 403-ing every AI bot. |
The four overlap but do not substitute for each other. A page can rank first in Google and still be invisible to ChatGPT, and a page can be perfectly readable by every AI crawler and rank nowhere.
What each audit runs
- Fetches the page as a browser, then again as Googlebot, Bingbot, GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Applebot, meta-externalagent and CCBot — and compares what each one received.
- Parses robots.txt with proper group matching, so a specific rule for one crawler is not confused with the wildcard group.
- Resolves the sitemap, including sitemap index files, and checks the audited URL is in it.
- Tests http:// redirection, www consolidation, and whether a missing URL returns a real 404.
- Reads titles, headings, canonicals, hreflang, schema, Open Graph and content from the raw HTML — what a crawler receives, before JavaScript runs.
- Pulls Core Web Vitals field data and the Lighthouse score from Google PageSpeed Insights.
- Generates a filled-in llms.txt, robots.txt, schema blocks and meta tags from your own pages.
Common questions
What is the difference between SEO, AEO, GEO and AIO?
SEO decides whether you rank; AEO decides whether you are quoted; GEO decides whether an AI cites you; AIO decides whether an AI can read you at all. A page can pass one and fail the others — and AIO failures are invisible in Google Analytics, because a crawler that gets blocked never becomes a session.
Can AI crawlers read a JavaScript website?
Mostly no. Googlebot renders JavaScript on a second pass, but GPTBot, ClaudeBot, PerplexityBot and CCBot do not execute JavaScript at all. If your content is assembled in the browser, those crawlers receive an empty page, which is why this tool reports the word count of the raw HTML rather than of the rendered page.
Does blocking GPTBot hurt my Google rankings?
No — GPTBot has nothing to do with Google. It is worth separating the two kinds of AI crawler, though: training crawlers like GPTBot and CCBot build long-term familiarity with your brand, while on-demand fetchers like ChatGPT-User, Perplexity-User and Claude-User fire when a real person asks an assistant about your page right now. Blocking the second kind costs you live referrals.
What is llms.txt and do I need one?
It is a markdown file at your domain root that tells AI assistants what your site contains and which URL is authoritative for each topic. It is not yet an official standard and no engine is obliged to read it, but it costs an hour, it is one of the few AI-specific signals you fully control, and this tool generates a filled-in one from your own pages.
How do I know if Google has indexed my page?
Search site:yoururl in Google, or use URL Inspection in Search Console. Google's URL Inspection API does report index status — the verdict, the coverage state and the canonical Google actually chose — but only for a property whose ownership you have verified, so no tool can report it for a URL it does not own. Anything claiming to check an arbitrary URL is either scraping search results — unreliable, and against Google's terms — or guessing from technical signals. This report links Google's own tools, pre-filled with your URL, and separately audits every technical reason a page could be excluded.
Why does this say a crawler is blocked when my robots.txt allows it?
Because robots.txt is a request and your server is the enforcer. Cloudflare and similar firewalls commonly refuse AI crawlers by User-Agent regardless of what robots.txt says, and a bot challenge returns HTTP 200 — so it looks fine to every tool that only reads robots.txt. This checker makes a real request as each crawler and reports what actually came back.
Last updated · Built and maintained by Sili.