Google Stops Crawling Blog Posts Not on Blogspot.com?

August 8th, 2008 | 2,574 Views RSS Feed

If you're new here, you may want to subscribe to our Full RSS feed to get a daily digest of news around search engine industry.

According to Search Engine Roundtable, it seems that Google has stopped crawling the blogs that aren't hosted on blogspot.com domains, meaning that the blogs on private domains and the Blogger aren't being crawled and indexed. As per some of the posts that have surface on Google Groups and DigitalPoint Forums, Googlebot has stopped the crawling of such blogs since July 30th 2008.

Here are some excerpts from the thread at Google Groups:

"Hi Google Team,

I am always a nice Google user. But it seems Google has stopped crawling suddenly for one of my blog. For the best of my knowledge, i never did anything against Google. And in last update got PR4 for that blog.

I have sent a recosideration request. What else i can do? There is no way to know why Google stopped crawling suddenly for no reason. My Pages are still there in index and ranking as well, but new pages
but new pages stopped indexing. From 30 July, no visit of Google. In webmaster when i submitted my sitemap again then status is pending from more than 21 hours. Please guide me to solve this problem."

"Yeah. My CRAWLING Statistics graph in webmaster tools is all the way
at the lowest point.
HELLO… Google…"

"yeap i agree! the problem comes either from blogger or from google
bots

Please someone from Google, come on let's tell us what is happening?

is there any problem with google servers that hinder our sites from
being normally crawled???"

"For GOD'S SAKE.
It's not an incoming link problem.
This is the millionth time I have heard this.
Yes. Incoming links helps the crawl.
However, before August,
my relatively new site was crawled every day."

"I find that crawl frequency has to do with incoming links, if you have
weak references from other sites you get crawled less, if you have
links pointing to you from sites that google considers "quality" you
get a faster crawl. Could it be this simple?"

Here are some excerpts from the thread at DigitalPoint Forums:

"Even google is not crawling my pages as well from past few days but I didn't noticed that, thanks for writing this but what we should now? Any method to overcome from this?"

"Dude. I don't know. I am trying to just wait it out, but time is ticking. If I can't do this for a living, I have to get a job."

Click here to subscribe to our RSS feed to get a daily digest of news around search engine industry. PageTraffic SEO Blog is updated four times a day and is ranked as one of the best search engine resources blog by Pandia!

Did you like this article?

Google Patches Up the Blogger Crawling Issues Along With Pending Sitemaps Concerns!
At the beginning of this month, we had reported that, Google had stopped crawling the blogs that wer...
NORAD To Track Santa With Google
The Official Google Blog reports that NORAD or the North American Aerospace Defense Command, would t...
Now Rank Better In Google Blog Search
Google Operating System informs that Google Blog search ranks the search results by relevancy. The s...
Get Back The Information You Missed
Matt Cutts On "Paid Posts!"

Comments

This website uses IntenseDebate comments, but they are not currently loaded because either your browser doesn't support JavaScript, or they didn't load fast enough.

51229 Responses2008-08-08+13%3A57%3A43Navneet+Kaushal to “Google Stops Crawling Blog Posts Not on Blogspot.com?”

mani Says:
August 8th, 2008 at 10:46
It happened to my blog also
how to resolve it.. Please help me

Thanks,
Mani
Annelies Says:
August 12th, 2008 at 04:18
Since the 5th of August Google stopped crawling my blog as well. Before then it was crawled daily and ranking very well…
Now I can hardly find my blog for not even long tail keywords.
What is going on??
il maistro Says:
August 13th, 2008 at 07:48
The same has happened to my blog also. It was crawled daily (even every 4-5 hours) and suddenly the homepage is not in google cache anymore. I thought this would be temporary but it's been more than two weeks and the problem continues. And not only for my main blog but also for others blog I maintain. Too strange!
Brad Hart @ A DoFollow Blog Says:
November 16th, 2008 at 05:49
What a load of crap. Google didn't stop indexing any blogs or I would have noticed. As owner of more than a dozen personal blogs and manager of over 50 others I can tell you no such thing happened. Your blog might have been indexed as well as you would have liked or as often as you thought it should, but they didn't stop indexing. My charges were all indexed and cached from August to present and not a single one is on blogspot.
Roony william Says:
May 15th, 2009 at 01:26
The same has happened to my blog also.it was crawled daily and meanwhile almost since last 1 month it doesnt… my all keywords ar on top in google…and prblem still continues….and starnge thing is…my sitemap has been crawled…so plz help me…..n tell me how to overcome this prblem..
vijay Says:
August 3rd, 2009 at 18:26
Hi all there,

Me also facing the same problem as all you.But coming to this site also not get any satisfied answer to our problem.
So, please anybody give us solution.

Thanks & Regards,
Vijay
lee Says:
September 11th, 2009 at 20:49
andy@itpittsburgh.com
lee Says:
September 11th, 2009 at 20:51
oops sorry wrong post,what i was asking was. Why is my blog never updated http://www.diyanswerdirect.com and http://www.diyanswerdirect.com i have updated everything and am getting bored of waiting for google and bing to update there search. they are very tight lol
yourfreeblog Says:
December 14th, 2009 at 12:22
Thank you for information. But it seems still google is crawling Top level domain blogs.