Just a couple of small changes to the site that I want to make public. Very boring stuff.
First of all, I've recently been slammed by some searchbots that are retrieving, then ignoring, my robots.txt file. This file specifically states files and folders that I don't want indexed by 'bots. I make these areas off-limts for bandwidth reasons, or for simple site functionality purposes.
For example, I don't want 'bots bumping up any 'blog entries - those are for actual people who like the entries.
I also don't want 'bots searching the raw 'blog files themselves, and I don't want them downloading all of my movies files.
Well I've become sick of 'bots ignoring these rules, so I've decided to block them completely. This was done with an easy addition to my .htaccess file:
As I see new 'bots ignoring my simple robots.txt file I'll block their asses as well.
(Just after I posted this entry I got slammed by another asshole, so his address is now blocked as well.)
Another thing that's been bugging me lately is that I've been getting what's called referer spam. This is when assholes modify their browser to change where they appear to be coming from. Many people, for privacy reasons, will simply change this value to a blank or something. But these assholes are replacing the real referer value with a URL to a site they're hawking.
My .htaccess file can deal with these people as well:
In the example of above I send anyone with the string viagra in their referer to a site that I'm hoping will get them fired if they hit it at work.
On a completely unrelated note, I've changed my site search function to just go to Google. My own home-made search script wasn't working correctly and I just haven't found the time to debug it. This change was for the site search only - the 'blog search is still home-grown.
And finally, I'm beginning to contemplate another site redesign. If I actually decide to do this then barenada.com V5.00 will feature a cleaner design and will make even more use of CSS.