Robots.txt and sitemap checker
Type your site. We read robots.txt, find your sitemap (from robots.txt or the usual locations), and check what a search engine would get from both.
Free, no sign-up. We read public pages and DNS only, and keep nothing.
What it checks
- Googlebot and Bingbot are not blocked from the whole site
- A sitemap exists and lists pages
- robots.txt names the sitemap
- Sitemap URLs use the hostname the site serves on
- Change dates that mean something
Why it matters
A robots.txt that blocks the whole site, or a sitemap full of redirecting addresses, quietly costs search traffic and shows up in no other report.
No sitemap is not a fault: search engines also find pages by following links. It is reported, not failed.
One level of sitemap index is followed.
This is one check. The free audit runs all of them.
Security headers, DMARC and SPF, search tags, structured data, sitemap, AI crawler access, accessibility and real-user speed, on up to 20 pages in a real browser, with a fix prompt for each finding.