08.01.06
Bots
According to Yahoo! blog they have their new bot (Yahoo! Slurp) version in action that will reduce the number of requests and bandwidth consuption to crawled sites.
Almost at the same time MSN renamed few its bots (they all were named the same before) to help better distinguish them apart. So from now:
The MSN Shopping bot - msnbot-products
The MSN News bot - msnbot-news
The MSN Search bot - msnbot
The MSN Image Search bot - msnbot-media
This will help you better understand what is MSN doing on your site
Incognito-R said,
August 1, 2006 at 11:43 pm
I think that it’s a good renew
kayleigh said,
November 7, 2006 at 12:09 am
you really need to just get a straight forward web site that leads you to getting robots addresses for msn