Googlebot Crawls More Pages Than Existing Ones

November 11th, 2006 | RSS Feed

If you're new here, you may want to subscribe to our Full RSS feed to get a daily digest of news around search engine industry.

In October Google had posted Googlebot activity reports displaying number of pages on the sites crawled in last three months by Googlebot. Some people then questioned Google about how crawled pages are higher than actual number of pages on sites. The official Google Webmaster Central blog clarifies the question. According to it there are many factors involved in determining crawling of pages by Googlebot . The main factors are

Pages it already knows about
Links from other web pages (within your site and on other sites)
Pages listed in your Sitemap file

Click here to subscribe to our RSS feed to get a daily digest of news around search engine industry. PageTraffic SEO Blog is updated four times a day and is ranked as one of the best search engine resources blog by Pandia!

Did you like this article?

Know The Number Of Pages That Googlebot Crawls!
If you want to know the number of pages, that Googlebot has crawled in your site for the last 90 day...
How Does Googlebot Find/Index Hidden FTP Logs?
Google's crawler constantly scours the Internet for pages to index. This is why it's important...
Google Webmaster Sitemaps Report Update
Few days back there were reports on Google Webmaster sitemaps tool having a bug that shows old...
Better Details About When Googlebot Last Visited a Page
10 Solid Ways to Increase the Google Crawl Rate for Your Website!

Comments

This website uses IntenseDebate comments, but they are not currently loaded because either your browser doesn't support JavaScript, or they didn't load fast enough.