Re: [squid-users] Fw: squid download file larger than 2GB

On 16/03/11 23:19, Jigar Raval wrote:
> Hello,
>
> We are facing issue of downloading file larger than 2GB
> using squid. Following is the status of squid. We have
> installed it with large-file support.
>
>
> Squid Cache: Version 3.0.STABLE25
>
> configure options: '--prefix=/usr/local/squidnew'
> '--enable-delay-pools' '--enable-arp-acl'
> '--disable-internal-dns'

That is not a great idea. It forces Squid to use the slow/blocking OS
resolver (max capacity ~200 req/sec).

> '--enable-basic-auth-helpers=NCSA,LDAP,YP'
> '--enable-large-files'

That should be: --with-large-files

>
> Following is the status of linux kernel. It is 32-bit
>
> 2.6.9-5.ELsmp #1 SMP Wed Jan 5 19:30:39 EST 2005 i686 i686
> i386 GNU/Linux
>
> We are getting following error in store.log file while
> downloading iso using http or ftp.
>
> WARNING: preventing off_t overflow for http://ftp.jaist.ac.jp/pub/Linux
> /openSUSE/distribution/11.4/iso/openSUSE-11.4-DVD-x86_64.iso
>
> WARNING: preventing off_t overflow for http://mirrors.isu.net.sa/pub/opensuse/distribution/11.4/iso/openSUSE-11.4-DVD-x86_64.iso
>
> We have also used iptables to redirect all port 80 request
> to our defined squid port.
>
> What could be the reason ?. Should we upgrade to 64-bit
> linux ?

The message indicates off_t is 32-bit. --with-large-files makes it
64-bit if your compiler supports the ILP32_OFFBIG environment.

I suggest an upgrade to Squid-3.1.10 or later though. There were some
cache size accounting problems with >2GB files discovered and fixed
recently.

Amos

-- 
Please be using
   Current Stable Squid 2.7.STABLE9 or 3.1.11
   Beta testers wanted for 3.2.0.5