« Another proposed reason why the US invaded Iraq
7 Fallacies of Distributed Computing »

Another badly behaving bot

rawiswar/0.1 libwww-perl/5.66
linko/0.1 libwww-perl/5.66

Both come from 24.114.189.44 (they are probably the same bot, just renamed). From 13:27:07 today, it did a sustained download of my whole weblog (without looking at any robots.txt file). That’s annoying. Not as annoying as crawler918.com was (but they’re looking at robots.txt now, so things do improve), but that’s just because I don’t know what they’re doing with this information yet. I bet it’s something bad, but there’s no EVIDENCE as such.

And not just my weblog, bad cess to them.

This entry was posted on Saturday, April 12th, 2003 at 9:48 pm and is filed under Tech. You can follow any responses to this entry through the RSS 2.0 feed. You can skip to the end and leave a response. Pinging is currently not allowed.

One Response to “Another badly behaving bot”

  1. sherzod Says:
    April 14th, 2003 at 6:51 pm

    Yeah, the same thing with my blog. Some annoying bot from Canada!

    # in your .htaccess (or httpd.conf)
    Order allow,deny
    Allow from all
    Deny from 24.114.189.44

    That should teach the suckers!

Leave a Reply