I've now moved from a web hosting provider that offered "unlimited" resources (I'd name and shame because they suck so bad, but I won't even give them that publicity to the search engines) to one that has specific monthly limits. As a result, I've been going through two-and-a-half years of apache logs and implementing various filters to cut down on spammers, scrapers, bots, and snoops. There are two major groups of pests: there are the "illicit" ones, the comment spammers, script kiddies, and so on. And there are the "legitimate" ones - corporate/government entities, and the ones who do the ...