Where is the Crawl stats report in Google Search Console?

Crawl stats is not in the left navigation with the other reports. Open Settings, then Crawl stats > Open report. It shows how Googlebot has fetched your site over the last 90 days.

The report is only available for root-level properties: a domain property, or a URL-prefix property at the root of a domain or subdomain. A URL-prefix property for a subfolder such as https://example.com/blog/ does not get one, since crawling is measured per host.

What it contains

• Three totals over time: total crawl requests, total download size and average response time.
• By response: 200, 301, 304, 403, 404, 5xx and more. A rising share of 5xx or a growing average response time is the signal to act on.
• By file type: HTML, image, JavaScript, CSS, JSON, PDF and others.
• By purpose: discovery means a URL Google had not seen before, refresh means a re-crawl. A site publishing regularly with almost no discovery crawling is worth investigating.
• By Googlebot type: smartphone, desktop, image, video, page resource load, AdsBot and others.
• Host status: whether robots.txt was fetchable, whether DNS resolved and whether the server was reachable, over the last 90 days.

How to read it

Look at shape rather than absolute numbers. A crawl-request drop that coincides with a response-time spike usually means Google throttled itself because your server slowed down. A sudden jump in requests for one file type often means a template started emitting new URLs. A red host status entry outranks everything else in the report, because a failed robots.txt fetch can pause crawling of the whole host.

Tip: crawl stats has no Search Console API. Performance data can be pulled through the Search Analytics API and index state through the URL Inspection API, but crawl stats can only be read in the interface, so treat server log files as the exportable version of this data.

For what to do with the findings, see crawl budget and robots.txt.

How AutoPSEO helps

Because Google exposes no crawl-stats API, AutoPSEO cannot mirror this report. Where an API does exist, it does: with a Bing Webmaster key connected, AutoPSEO shows daily Bing crawl stats and a filterable list of Bing crawl issues per URL. See Bing crawl issues.