Fwd: AW: [squid-users] Corrupt downloads via squid cache

From: Henrik Nordstrom <hno@dont-contact.us>
Date: Fri, 28 Jun 2002 14:29:39 +0200

---------- Forwarded Message ----------

Subject: AW: [squid-users] Corrupt downloads via squid cache
Date: Fri, 28 Jun 2002 13:20:23 +0200
From: Markus.Rietzler@rzf.fin-nrw.de
To: hno@marasystems.com

> On Wednesday 26 June 2002 13.46, Markus.Rietzler@rzf.fin-nrw.de wrote:
> > squid version 2.4.stable6 using cache_type aufs (maybe we switch
> > back to ufs - how buggy is aufs at the moment?)
>
> aufs is not known to be buggy.

        ==> then this should be changed in squid.conf.default
               see this lines from squid.conf

        (...)
        # Type specifies the kind of storage system to use. Most
        # everyone will want to use "ufs" as the type. If you are
using
        # Async I/O (--enable async-io) on Linux or Solaris, then you
may
        # want to try "aufs" as the type. Async IO support may be
        # buggy, however, so beware.
        (...)

> > squid hierachy caches, all using parent-proxies no siblings, that
> > look like
>
> This is however shared with the few other reports I have seen on the
> subject. All reports I have seen on currupted downloads have been
> using a hierarchy of Squid caches.
>
> You need to try to isolate where in your hierarchy the downloads are
> being corrupted, and then concentrate on the requests received there
> (log_mime_hdrs is a good start, should allow the requests to be
> replayed relatively easily)

        ==> a few tests have shown that downloads from our internet-squid
(3) are ok
               downloads from the squids inside our lan/firewall ware
(sometimes) corrupt

                (1) user-proxy -> (2) centra-gateway-proxy -> firewall ->
(3) internet-squid -> internet

               it seems to be no difference if you download from (1) or (2)
the files get corrupt.
               as (1) connects to (2) and this one ask our internet-squid it
seems to be a problem
               between (2) and (3). could the firewall cause any problems?
we are working on a
               performance problem with our squids. could it be, that they
are connected to the
               download prob's?

               this is similar to the postings from may, where they sad as
soon they are using the
               squid from their isp as parent then files get corrupt if they
connect direct to the internet
               everything is ok.

> Regards
> Henrik

makrus

-------------------------------------------------------

>
> On Wednesday 26 June 2002 13.46, Markus.Rietzler@rzf.fin-nrw.de wrote:
>
> > squid version 2.4.stable6 using cache_type aufs (maybe we switch
> > back to ufs - how buggy is aufs at the moment?)
>
> aufs is not known to be buggy.

        ==> then this should be changed in squid.conf.default
               see this lines from squid.conf

        (...)
        #       Type specifies the kind of storage system to use.  Most
        #       everyone will want to use "ufs" as the type.  If you are using
        #       Async I/O (--enable async-io) on Linux or Solaris, then you may
        #       want to try "aufs" as the type.  Async IO support may be
        #       buggy, however, so beware.
        (...)

>
> > squid hierachy caches, all using parent-proxies no siblings, that
> > look like
>
> This is however shared with the few other reports I have seen on the
> subject. All reports I have seen on currupted downloads have been
> using a hierarchy of Squid caches.
>
> You need to try to isolate where in your hierarchy the downloads are
> being corrupted, and then concentrate on the requests received there
> (log_mime_hdrs is a good start, should allow the requests to be
> replayed relatively easily)

        ==> a few tests have shown that downloads from our internet-squid (3) are ok
               downloads from the squids inside our lan/firewall ware (sometimes) corrupt

                (1) user-proxy -> (2) centra-gateway-proxy -> firewall -> (3) internet-squid -> internet

               it seems to be no difference if you download from (1) or (2) the files get corrupt.
               as (1) connects to (2) and this one ask our internet-squid it seems to be a problem
               between (2) and (3). could the firewall cause any problems? we are working on a
               performance problem with our squids. could it be, that they are connected to the
               download prob's?

               this is similar to the postings from may, where they sad as soon they are using the
               squid from their isp as parent then files get corrupt if they connect direct to the internet
               everything is ok.

>
> Regards
> Henrik
>

makrus

Received on Fri Jun 28 2002 - 06:29:43 MDT