![\"search-engine-crawl\"](\"https:\/\/www.improvemysearchranking.com\/wp-content\/uploads\/2022\/07\/search-engine-crawl.png\")
<\/p>\nAfter a website is crawled by search engine crawlers, getting indexed is the second big step towards building an organic traffic stream. If your web pages are not getting indexed by Google, you won\u2019t be receiving organic traffic. It is as simple as that.<\/p>\n
Sometimes, you may think that you have done everything right. But Google is still not indexing your web pages.<\/p>\n
If you are facing a similar situation, here is a list of potential reasons why Google may not be indexing your website.<\/p>\n
Identifying, confirming, and fixing these issues will likely lead Google to start indexing your web pages on the SERPs.<\/p>\n
First, the most common and obvious reason \u2014 the robots.txt file on your website may be blocking Google from indexing the pages on your site.<\/p>\n
In case you don\u2019t know, robots.txt allows you to inform Google which pages it should index or not. It is not uncommon to make an error and disallow important pages on your website in the robots.txt file.<\/p>\n
The robots.txt file looks like this.<\/p>\n
<\/p>\n
Note that there is nothing after \u201cDisallow:\u201d.<\/p>\n
That means that nothing is disallowed, and search engine crawlers are allowed to index every single page on your website.<\/p>\n
However, even a simple forward flash could change that.<\/p>\n
![\"indexing-local-business\"](\"https:\/\/www.improvemysearchranking.com\/wp-content\/uploads\/2022\/07\/indexing-local-business.png\")
<\/p>\n
The forward slash means that the root folder of your website has been disallowed, which means that search engine crawlers are not allowed to index any page on your website.<\/p>\n
Make sure that the robots.txt file on your website is exactly how it should be.<\/p>\n
Other than robots.txt, there is another method to prevent Google from indexing web pages \u2014 by using the Noindex, Nofollow meta tags.<\/p>\n
Unlike the robots.txt file, Noindex, Nofollow meta tags work on a page-by-page basis. Unless you want Google not to index a certain page (for example, a thank you page that appears after an e-transaction is complete), make sure that the pages do not have the Noindex, Nofollow meta tags.<\/p>\n
Check the HTML source code of the page and search for keywords such as \u201cnoindex\u201d and \u201cnofollow\u201d and change them so they read index,follow instead.<\/p>\n
Pages with redirect loops are not likely to get indexed. That\u2019s because these pages send search engine crawlers on a loop.<\/p>\n
Check the HTML source code of the web page and see if you can find a duplicate URL pointing back to itself.<\/p>\n
Sometimes, these issues do not appear in Google Search Console. In that case, you may want to use an external site audit tool, such as Screaming Frog<\/a>, SEMRush<\/a>, or Ahrefs<\/a>.<\/p>\n Remove the redirect, re-submit the page for indexing in Google Search Console, and check again in a few days. The Google Search Console should show the green indexing status.<\/p>\n If a web page is buried within folders, Google may not reach that page at all. If the search engine crawlers cannot crawl a web page, they cannot index it.<\/p>\n Here is an example of such a page navigation structure.<\/p>\n www.domainname.com\/shop\/shoes\/men-shoes\/men-nike-shoes\/men-nike-running-shoes\/men-nike-zoom-x-shoes.html<\/a><\/p>\n Google may drop the crawl if it cannot find a web page after crawling 3-4 folders. Therefore, make sure to structure your website in a way that makes it easier for Google to find all the web pages.<\/p>\n Sometimes, Google cannot find a page because there is no path leading to it.<\/p>\n Google uses links to find different web pages on the site. Think of it as a spider web. One page may lead to another page, and so on and so forth.<\/p>\n Since orphan pages do not have any other pages linking to them, they are easy to miss.<\/p>\n Ideally, there should not be an orphan page on your site. Make sure to create internal links from relevant pages to every single page on your site. Creating this web of internal links from and to every web page on your site makes it easier for Google to crawl each page, pass link equity, and index them.<\/p>\n Missing sitemaps may not be a huge issue, but it does make the job more difficult for Google to find, crawl, and index all the pages on your site.<\/p>\n Without a sitemap, Google is flying blind. Sitemaps help Google navigate your website more efficiently and find, crawl, and index more pages.<\/p>\n You can create a sitemap file easily with a plugin such as the Yoast SEO plugin<\/a> and submit it to Google via Google Search Console<\/a>.<\/p>\n Google does not want to index and rank websites that take forever to load and provide a poor user experience. Depending on how slow your website is, Google may decide to drop a web page altogether \u2014 instead of demoting it on the SERP.<\/p>\n Use a tool like Google PageSpeed Insights <\/a>or GTMetrix<\/a> to see how fast your pages load.<\/p>\n There are many things that can go wrong when it comes to indexing, but the reasons mentioned above are the most common ones.<\/p>\n If you\u2019ve been struggling with your local business<\/a> website because your pages aren\u2019t getting indexed, this checklist is a good point to start.<\/p>\n If you have any questions or need help, give us a call.<\/p>\n <\/p>\n Related articles<\/strong><\/p>\n <\/p>\n4. Crawl depth<\/h2>\n
5. Orphan pages<\/h2>\n
6. Missing sitemaps<\/h2>\n
7. A site that takes forever to load<\/h2>\n
Conclusion<\/h2>\n
\n
Need help with your Local Business SEO<\/a>?<\/h2>\n
SEO Company for Small Businesses<\/a><\/h3>\n