MSRBot Bot & Microsoft Bot Behave Mysteriously On Some Servers!

Complaints are appearing at two different forums about the search engine crawlers from Microsoft. Reportedly, at WebmasterWorld , MSRbot, Microsoft's research bot is being said to crawl pages that don't even exist.

The MSRbot seems to ask for some non-existent pages, further the URLs it has supplied in UA string, simply can't reach anywhere, reports a WebmasterWorld member. "Note, before they were crawling from above.net, ip – 209.249.11.x and now they are coming from ip owned by microsoft. Since their behaviour is suspicious i banned them through .htaccess. anybody else seeing this?," said marodhum. Apparently, this issue isn't news, because as far back as April 2003 it was there and continues to be like that till today. At the same time it doesn't look to be linked with the Live Search team.

The other complaint features at the DigitalPoint Forums where, it's being noticed that MSNBot's quite busy on particular forum. "Hello, Has Live search gone mad, they have 10 things crawling my forum:Is there a reason for this, it has happened at least five times in the last two days with sudden spikes," says Calum.

The discussions continue at WebmasterWorld & DigitalPoint Forums.

Click here to subscribe to our RSS feed to get a daily digest of news around search engine industry. PageTraffic SEO Blog is updated four times a day and is ranked as one of the best search engine resources blog by Pandia!