Yahoo's Crawler Slurp Increases Activity

As seen on Digital Point Forum and Webmaster World, there has been an increase in activity in Yahoo's crawler, Slurp.

Some of the remarks were, “I have too many Yahoo! Slurp spiders crawling my site frequently. Looks like more than the actual users / visitors in my community, these spiders are querying my forum database (MySQL) a lot causing it to reach the max_questions limit and reducing the performance of the site. Though I want yahoo spider to crawl and index my site, I want it to be done adequately without affecting site performance. ”

For a better knowledge, read threads at Digital Point Forum and Webmaster World.

Click here to subscribe to our RSS feed to get a daily digest of news around search engine industry. PageTraffic SEO Blog is updated four times a day and is ranked as one of the best search engine resources blog by Pandia!