As of now I’ve banned MSN from my site (the bot, not users). In the first 15 days of March, MSN Bot hit my site over 1,200 times. Thats 100 hits a day. Now I like feeling all special because I think my sites getting read alot — but MSN is way out of hand. I’m not sure why their bot is behaving so baddly, but it is. (Its not the spam pages either — I checked). Google has no problems with my site — just MSN. Oh well, what ever. I hate micro$oft anyways.
I still need to devise some sort of RBL for the .htaccess file.