about cache duplicates

--MimeMultipartBoundary
Content-type: text/plain; charset=US-ASCII
Content-transfer-encoding: 7BIT

On 20 Aug 97 at 10:51, Dean Gaudet wrote:

> On Wed, 20 Aug 1997, Redfern Ian wrote:
>
> > Worth thinking about. My cache currently shows zero Content-MD5 headers
> > received in the 200,000 parsed today, even though Apache now supports
> > it, so clearly nobody is using it yet on their servers to be helpful to
> > caches.
>
> It's computationally expensive to compute MD5s for all content.
> Until/unless Apache gets some sort of "cached metadata" concept I doubt
> anyone will turn this on. Right now to send Content-MD5 it has to
> regenerate it on the fly. There's other metadata that would be nice to
> cache (such as a defalted version of the object). So it might happen. It
> is something that could be implemented as a module by an interested party.

    Making md5 of contents is really useless - most of the vapour goes to
 /dev/null.
    redirector allows you to manually setup which URL's are redirected to
 common place, and at least allows you to reduce large file duplicates.

    If anyone is interested, I have a pending work on yet another
 redirector (regredir.pl), check at
       http://cache.online.ee/squid/
    Basically, it allows you to do whatever you want, redirect based on
 matching regexps, substitute matched string by configured one, redirect
 based on match in ls-LR file to remote site, eg. local mirror, You can
 even evaluate perl expression for matched url, thus do whatever you want
 with given URL, and etc.etc.
    There is also a script that tries to find duplicates in your cache:
 "Reusables"

 Note. I'm still not using this on our production server, although in tests
 it behaved as expected. Partly because I'm a little afraid of redirecting
 url at my will, partly because I don;t have enough spare ram to keep
 few 10s perl script hanging around...

 If any of you finds these useful, I'd love to hear your comments.

 ----------------------------------------------------------------------
  Andres Kroonmaa mail: andre@online.ee
  Network Manager
  Organization: MicroLink Online Tel: 6308 909
  Tallinn, Sakala 19 Pho: +372 6308 909
  Estonia, EE0001 http://www.online.ee Fax: +372 6308 901
 ----------------------------------------------------------------------

--MimeMultipartBoundary--
Received on Tue Jul 29 2003 - 13:15:42 MDT