New Crawler: MSNBot/2.0b by Live Search

December 15th, 2008 | RSS Feed

If you're new here, you may want to subscribe to our Full RSS feed to get a daily digest of news around search engine industry.

The Live Search has come up with an entirely new search engine crawler that is named as msnbot/2.0b

According to The Live Search Blog,

“You’ll still see the current version msnbot/1.1 (+http://search.msn.com/msnbot.htm) as Live Search’s primary user agent. We intend to ensure that any robots exclusion protocol you are using is respected. As such, you don’t need to update your Robots.txt file. We plan on crawling at a slow speed during the tests with the updated version.”

The feature is currently on a test mode but will replace the old spider very soon! The new spider will respect the current robots.txt protocol set up for MSNBot, so the users will not find any kind of additional need to set up anything new in their robots.txt file.

Above all, Microsoft promised to crawl slowly in their msnbot/2.0b tests.

Click here to subscribe to our RSS feed to get a daily digest of news around search engine industry. PageTraffic SEO Blog is updated four times a day and is ranked as one of the best search engine resources blog by Pandia!

Did you like this article?

Bing Revamps MSNBot 2's Workload
Microsoft recently announced that it's going to ramp up MSNBot 2, which is currently in beta version...
Live Search Is Crawling JavaScript with MSNBot-Media
Discussion is on at WebmasterWorld that Live Search is crawling JavaScript with MSNBot-Media. Till n...
Microsoft Implements DNS Policies For Bot verification
Remember, a couple of months ago Google told us how to verify Googlebot. It explained verification r...
MSNBot 1.1 Retires and Gives Way to Bot 2.0
Holiday Update For Live Search?

Comments

This website uses IntenseDebate comments, but they are not currently loaded because either your browser doesn't support JavaScript, or they didn't load fast enough.

57224 Responses2008-12-15+09%3A58%3A51Navneet+Kaushal to “New Crawler: MSNBot/2.0b by Live Search”

iliyas Says:
December 15th, 2008 at 03:30
is this bot on sematic search based or intent search, pls explain about its more working
Certification Says:
December 16th, 2008 at 04:02
Nice work man..keep it up.
Bing Revamps MSNBot 2’s Workload » Tech Ground Says:
July 21st, 2009 at 06:54
[...] which is currently in beta version. Webmasters may now notice the new bot in their log files. The beta version was released in December 2008, and the useragent is similar to the original [...]
MSNBot 2’s Workload Revamped by Bing | Webbyn.com Says:
July 21st, 2009 at 06:57
[...] may now notice the new bot in their log files. The beta… « Yahoo's Newest Home Page Not All Good with Google Earnings [...]