How do I check my robots.txt in Google Search Console?
Technical SEO
Google retired the dedicated robots.txt tester in Search Console in 2022. Current options for checking your robots.txt:
- URL Inspection tool - Inspect any URL; it will show "Blocked by robots.txt" if applicable
- View directly - Access
yourdomain.com/robots.txtin a browser to check the current rules - Settings in Search Console - Go to Settings > Crawl stats to see if Googlebot is being blocked from sections of your site
- Third-party testers - Tools like Google's Search Console robots.txt tester or online validators
How AutoPSEO helps
Pair Search Console’s technical reports with AutoPSEO’s On-Page SEO Check, which crawls your top pages and tells you whether the query each page ranks for appears in its title, meta description and H1, and with the Subdomain & Folder report that maps performance onto your URL structure.
More in Technical SEO
- How do I check mobile usability errors in Google Search Console?
- How do I check structured data in Google Search Console?
- How do I find and fix 404 errors in Google Search Console?
- What is the Page Experience report in Google Search Console?
- How do I check rich results in Google Search Console?
- Does Google Search Console show my crawl budget?
Ready to see what your Search Console data is hiding?
Connect a property and every report fills in immediately. No credit card needed.