Crawlability
Crawlability is whether a page can actually be fetched and read by a crawler at all — including both traditional search engine bots and AI crawlers — without being blocked by robots.txt, authentication walls, or a rendering pipeline that only delivers content after client-side JavaScript executes. It is a precondition for both search ranking and AI-answer citation.
A page can have excellent content and complete structured data and still fail to rank or be cited if it isn't crawlable in the first place. Crawlability failures include robots.txt rules that block entire sections of a site, pages that require a login or session to view content that should be public, and rendering pipelines where the meaningful content only appears after JavaScript runs client-side — which some crawlers, including many AI crawlers, do not execute.
Revvye checks crawlability as a foundation underneath its AI crawler access and structured data dimensions: there's no point evaluating whether a page's schema markup is complete if the page itself is silently blocked from being fetched. This is why the AI crawler access check specifically verifies that a site's robots.txt and rendering pipeline would let a crawler read the pages that matter — service pages, provider pages, location pages — not just confirm that a robots.txt file exists.
Crawlability problems are often invisible to a human visiting the site normally, because a browser executes JavaScript and ignores robots.txt; they only surface when something reads the site the way a crawler does, which is exactly what Revvye's scan is built to check.
See if this is leaking revenue on your site.
The free scan checks this and seven other dimensions in minutes.