Crawl Rules.
Revealed.
Robots.txt Checker
Is this page blocked? One click fetches robots.txt, parses every rule, tells you if the current URL is allowed.
Full robots.txt analysis.
Parses All Directives
World First Browser OS
Launch from Quick Launch
150+ Tools
Why Check
Robots.txt?
Invisible blocks kill rankings.
A single Disallow line can remove your entire site from Google. Developers add rules during staging. Agencies inherit old configs. Plugin migrations overwrite settings.
The result: pages you want indexed get blocked. Pages that should be blocked get crawled.
The fix: Check robots.txt on any URL. See exactly which rules apply. Know if Googlebot can reach the page you’re looking at—instantly. Crawl access is one check. The other eight Technical SEO Tools cover schema, links, speed, and authority.
Part of the
Technical SEO Toolkit
Tools that work together in the Technical SEO toolkit.
Dead links kill SEO. Find them before Google does. Red borders. Clickable sidebar. Fixed in minutes.
Skip the copy-paste. Click once. MOZ opens with the current site's domain authority.
Every other tool tests one page at a time. Run up to 25 simultaneous tests via the official Google PSI API - multiple URLs, multiple runs, all a.
One wrong redirect costs you rankings. A 302 instead of a 301. A chain four hops deep. An HTTPS downgrade buried in the middle.You'd never know.
13 HTML5 elements. Green borders show which you're using. Red X marks which you're missing.
One click extracts all JSON-LD. See exactly what Google sees. Visualize schema as interactive nodes.
Check what any page looked like last year. Last month. Last decade. No copy-pasting URLs.
Google Analytics. Facebook Pixel. HotJar. LinkedIn Insight. See what marketing tools any website is running.
Four common sitemap locations. Checked in seconds. Green means found. Grey means missing.