This category covers some critical checks of the overall website, assessing its reachability, index status and any errors.
Checks if the site is available (status code 200 for the home page) and is crawlable (collecting valid data).
- Status code other than 200
“The website was unreachable. Please check if the website is accessible from a browser.”
“The website was reachable and successfully crawled.”
2. Search Engine Index
Checks to see that we get ranking data for all search engines.
“This website is not indexed in by <search engine name>, <search engine name>.”
“This website is indexed in all supported search engines.”
If the site is blacklisted by any of the search engines it should show up as one of the errors below, describing the problem.
“This website is blacklisted by Baidu.”
“This website is blacklisted by Baidu and Sogou.”
“This website is blacklisted by all search engines.”
“This website is not blacklisted by any search engine.”
4. Error Pages
This is the summary of status codes of all internal links crawled. The status codes you need to check for are 200,301,302,4XX,5XX. The errors are categorised as:
- Red - Any pages with 4XX &5XX
- Orange - Any pages with 301, 302
- Green - All pages with 200
“5 page errors were found.”
This would be red or orange depending on if there are any 4XX / 5XX errors or only 3XX errors
“No page errors were found.”
5. Average Page Load time
This section shows the average response time of the website and also if the website is using gzip compression. The response time is calculated by Total response / Number of Pages Crawled. Response times are categorised as:
- <=3s (“FAST” in Green)
- >3s and <=8s (“AVERAGE”, in Orange)
- >8s (“SLOW” in Red)
“1 page is taking longer than 10s to load.”
“Average website page load time was 8.9 seconds which is slow.”
“Average website page load time was 2.83 seconds which is average.”
“Average website page load time was 1.9 seconds which is fast.”
Checks to see whether gzip compression is being used on the website
“This website does not use gzip compression.”
“This website uses gzip compression.”
Check to see if the robots.txt file is accessible.
“Unable to locate robots.txt file for this website.”
“Robots.txt file is present for the website.”
Checks whether the site is using https protocol
“This website does not use https.”
“This website uses https protocol.”