5XX Errors

5XX error codes occur when the server is unable to complete a request from a user. There are several 5XX errors which may be generated for a number of different reasons, due to internal server errors, bad gateways or a server timeout. Our Hangout Notes cover a range of these issues, with recommendations for addressing and reducing these.

Google Treats Permanently 503’ing Robots.txt as an Error & Eventually Crawls the Site Normally

December 13, 2019 Source

If a robots.txt returns a 503 for an extended period of time, Google will treat this as a permanent error and crawl the site normally to see what can be discovered.

Google Doesn’t Crawl Any URLs From Hostname When Robots.txt Temporarily 503s

December 13, 2019 Source

If Google encounters a 503 when crawling a robots.txt file, it will temporarily not crawl any URLs on that hostname.

Google Will Not Render JavaScript Content if The Page Returns a Redirect or Error Code

November 12, 2019 Source

If you have a page which contains JavaScript content but it returns a redirect or an error code, Google will not spend time rendering the content. For example, if you use JavaScript on a 404 page to display an error message or links. With redirects, Google does not need to render the content in order to follow the redirect to the new page.

Google Checks Status Code Pages Before Attempting to Render

October 18, 2019 Source

Google checks the status code of a page before doing anything else, such as rendering content. This helps to identify which pages can be indexed and which pages it shouldn’t render. For example, if your page returns a 404, Google won’t render anything from it.

Signals Are Kept For 4xx or 5xx Error Pages Previously Dropped from the Index When They Are Re-added

September 3, 2019 Source

If your pages displayed a 4xx or 5xx error for a while and were dropped from the index but become available again after a month or so, for example, Google will be able to return them to the search results in the same state they were before. They won’t have to start trying to rank from nothing.

Google Can Periodically Try to Recrawl 5xx Error Pages

September 3, 2019 Source

If a server error is shown on a page for as long as a week, Google can treat this in a similar way to a 404 error and will reduce the crawling of that page and remove it from the index, but will still access the page every now and again to see if the content is available again. If so, the page will be indexed again.

Google Won’t Necessarily Follow the Date or Time Set in Retry-After Header

August 21, 2018 Source

The Retry-After HTTP header is good practice to use alongside a 503 status code, but Google doesn’t always follow this as many sites use it in a generic way, and may retry your site sooner than you’ve specified.

Avoid Serving a 503 Error for Days in a Row to Keep Site in Search

August 21, 2018 Source

If a site serves a 503 error for several days in a row, then Google may start to assume that your site might be completely gone rather than temporarily unavailable and start removing pages from search.

Related Topics

4XX Errors Redirects