Re: DOS From "inktomi.com"?

[Dan Hollis <goemon () ANIME NET>]

On Tue, 22 Aug 2000, PARKIN, MICHAEL M (PBI) wrote:
> I've seen repeated connections from inktomi's web crawler bots, but never at
> a level that affected performance.  As I remember, the inktomi bots do
> respect the robots.txt protocol and will go away if your system tells them
> to.

If there is no http server, there is no robots.txt to fetch, and inktomi
will proceed to pummel that machine into the ground.

-Dan