What this tool checks
- HTTP status
- Sitemap directives
- Disallow rules
- Site-wide blocks
SEO Audit Tools
Robots.txt Checker
Fetch and summarise a site robots.txt file.
Run the check
Enter a public target. Checks are a point-in-time sample; private and internal addresses are blocked.
Why it matters
Robots.txt guides crawlers and can accidentally block important pages.
Plain-English examples
- Check for Disallow: / before launch
Recommended fixes
- Include sitemap directives
- Avoid site-wide blocks unless intentional
Understanding the result
Use findings as a starting point, confirm the intended configuration with your provider, and retest after a change. A successful check does not guarantee security, delivery, uptime or search rankings. Results depend on public DNS and what the server exposes at the time of the check.
Related tools
Run these checks next for a fuller picture.
Meta Tag Analyser
Review title, description, canonical, robots and viewport meta tags.
Run checkSEO Snapshot
Run focused checks for metadata, headings, crawl signals, schema, links and images.
Run checkSitemap Checker
Find sitemap.xml or sitemap_index.xml and count entries.
Run checkRedirect Checker
Trace URL redirects, show each hop and flag chains that can slow SEO crawls or migrations.
Run checkNeed help fixing the result?
