Crawl Improvements By Yahoo!

Yahoo! is working hard to impart fresh updates to its “crawl, index and ranking systems.” Recently, a significant reduction on the crawling intensity was noticed as it has now become more efficient and less aggressive. The fresh updates will be relatively important for webmasters.

According to Yahoo! Search Blog:

“In response to feedback from the community, we’re reducing our crawling machines by a significant amount with this update, so you might have observed a significant reduction in crawl load from us along with fewer machine IP addresses hitting you over the last few days. The new crawler continues to improve comprehensiveness and freshness of coverage while also enhancing crawl efficiency, which reduces spurious load on websites.”

Yahoo! experienced an increase in their crawl load while testing and rolling out updates, in support for 'Dynamic URL Rewriting' in Site Explorer. It is working on different internal policies to ensure this doesn't happen, even temporarily, in the future.

Read the whole blog here.

Click here to subscribe to our RSS feed to get a daily digest of news around search engine industry. PageTraffic SEO Blog is updated four times a day and is ranked as one of the best search engine resources blog by Pandia!