Re: mail archive searching

From: PsychoTekk .de <psychotekk@dont-contact.us>
Date: Sat, 31 Aug 2002 16:02:10 +0100

good idea i think.
crawlers like googlebot usually take care that a site
is not hammered too much in a short period of time
and bad bots like email harvesters don't respect
robots.txt anyways

regards,
 Clemens

> So, is there any consensus on the mail archive indexing via Google?
>
> I'm for allowing it.
>
> Rob

-- 
__________________________________________________________
Sign-up for your own FREE Personalized E-mail at Mail.com
http://www.mail.com/?sr=signup

Received on Sat Aug 31 2002 - 09:08:15 MDT

This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 16:16:18 MST