Rudra Kasturi Inc.

Article · SEO

How HTTP status codes affect Google crawling: a reference table and an error triage routine

SUMMARY

Google's status code page (last updated 4 February 2026) says 2xx content may be considered for indexing, redirects are followed up to 10 hops with 301 and 308 as strong signals, 4xx URLs are not indexed and are removed over time, and 5xx and 429 slow crawling. The reference table and routine are ours.

A status code is the first thing a crawler learns about a URL, and often the only thing it needs. Google’s page (last updated 4 February 2026 as we read it) covers the top 20 status codes it meets. This post condenses it into a table and a weekly routine.

Best for: SEO leads, developers and site reliability teams.

Status codes: 2xx is considered for indexing, 3xx redirects are followed, 4xx content is not used, 5xx and 429 slow crawling

What Google says

  • 2xx. Content may be considered for processing, such as indexing, but a 2xx does not guarantee indexing. If the content looks like an error or an empty page, Search Console shows a soft 404. 204 means no content, so there is nothing to process.
  • 3xx. Google’s crawlers follow up to 10 redirect hops by default. Content from the redirecting URL is ignored and the target’s content is processed. 301 and 308 are strong signals that the target should be processed. 302 and 307 are weak signals. Google treats the pairs the same but advises using the semantically correct code so other clients benefit.
  • 304. Signals that the content is the same as last time. It has no effect on indexing otherwise.
  • 4xx. Google does not use content from 4xx URLs. It does not index them, and URLs already indexed are removed. All 4xx except 429 are treated the same way: newly encountered 404 pages are not processed, and crawling frequency gradually decreases. Do not use 401 or 403 to limit crawl rate, because 4xx codes except 429 have no effect on it.
  • 429 and 5xx. Both prompt crawlers to slow down temporarily. 429 is treated as a server error. For Search, already indexed URLs are kept for a time but eventually dropped, and URLs that persistently return a server error are removed. Once the server returns 2xx again, Google gradually increases the crawl rate.

Reference table (our summary)

You seeGoogle doesYou should
200 with a thin “not found” pageMay report a soft 404Return a real 404 or 410
301 or 308Treats target as the page to processUse for permanent moves
302 or 307Follows, but a weak signalUse only for temporary moves
Redirect chain over 10 hopsMay stop followingCollapse to one hop
404 or 410Stops using the URL over timeFine for removed content
403 used to slow the crawlerNo crawl-rate effectUse 429 or 503 temporarily instead
500, 502, 503Slows crawling, drops persistent errorsFix quickly, and keep outages short

What to do: weekly triage

StepOwnerTimeHow to checkDone when
1. Export crawl or log status countsDeveloper30 minGroup by code for Googlebot requestsA table of counts per code
2. Find soft 404 candidatesSEO30 minSearch Console soft 404 report and 200 pages with error textA list of pages to fix
3. Shorten redirect chainsDeveloper1 hourCrawl for hops above oneNo chain over two hops
4. Check 5xx and 429 spikesDeveloper, ops30 minServer logs by hourCause and fix noted
5. Confirm key pages return 200SEO20 minTen priority URLs, headers checkedAll 200 without redirects
6. Record changesSEO10 minDated noteA running log exists

Common mistakes

  • Serving “page not found” text with a 200.
  • Using 403 or 401 as a crawl throttle.
  • Leaving a site on 503 for days during maintenance.
  • Using a temporary redirect for a permanent move.

Related: which redirect to use, 5xx errors and robots.txt, server logs method and how to remove a page. This post covers status codes only. Results are not guaranteed.

Sources