[squid-users] Corruption problem of download files from squid

From: John Mok <jmok@dont-contact.us>
Date: Mon, 06 Nov 2006 22:31:23 +0800

Hi,

I am using Squid STABLE4 on FC3 with common configurations in squid.conf :-

http_port 8080
acl QUERY urlpath_regex cgi-bin \? \.asp asp .asp \.jsp jsp .jsp \.dll
.dll servlet Servlet .do
no_cache deny QUERY
maximum_object_size 716800 KB
....
refresh_pattern -i windowsupdate.com/.*\.(cab|exe|psf) 4320 100% 43200
reload-into-ims
refresh_pattern -i download.microsoft.com/.*\.(cab|exe|psf) 4320 100% 43200
reload-into-ims
....

The squid proxy server works well most of the time. However, when I
tried to download a PDF from the following :-

http://www.citizenwatch.com/COA/English/settingsresults.asp?caliber=7871

I found that the PDF file was corrupted that the file size was less than
it should be. The complete file size was 82,831 bytes when downloaded
directly from Internet bypassing squid proxy, but the download file via
squid proxy was only 78,784 bytes. Moreover, the result file size varied
every time the file was downloaded, e.g. the file sizes were 31536
bytes, 79320 bytes etc.

I tried with IE6 SP2 and Firefox 1.5.0.7/2.0, and Squid SABLE5, and the
same problem remained. I hope someone could advise what went wrong, and
how to fix the problem. The following are the access, cache and store logs.

Thanks a lot.

John Mok

=== Start of access log ===

1162802103.646 2326 10.144.1.85 TCP_MISS/200 79756 GET
http://www.citizenwatch.com/Database/download.asp? - DIRECT/38.113.20.13
application/octet-stream
1162802114.356 1842 10.144.1.85 TCP_MISS/200 81204 GET
http://www.citizenwatch.com/Database/download.asp? - DIRECT/38.113.20.13
application/octet-stream
1162802125.577 2003 10.144.1.85 TCP_MISS/200 78308 GET
http://www.citizenwatch.com/Database/download.asp? - DIRECT/38.113.20.13
application/octet-stream

=== end of access log ===

=== Start of store log ===

1162802103.646 RELEASE -1 FFFFFFFF 39C25B8E3BF68042B69000730D133D70 200
1162802306 -1 -1 application/octet-stream 82070/79320 GET
http://www.citizenwatch.com/Database/download.asp?
1162802114.356 RELEASE -1 FFFFFFFF C2EEB6F47FEE9B5B367106B8D66A66F7 200
1162802317 -1 -1 application/octet-stream 82070/80768 GET
http://www.citizenwatch.com/Database/download.asp?
1162802125.577 RELEASE -1 FFFFFFFF D0A382F77EF0A96AD1BBF0766593CCB9 200
1162802328 -1 -1 application/octet-stream 82070/77872 GET
http://www.citizenwatch.com/Database/download.asp?

=== End of store log ===

=== Start of cache log ===

2006/11/06 16:34:48| storeDirWriteCleanLogs: Starting...
2006/11/06 16:34:48| 65536 entries written so far.
2006/11/06 16:34:48| 131072 entries written so far.
2006/11/06 16:34:48| 196608 entries written so far.
2006/11/06 16:34:48| 262144 entries written so far.
2006/11/06 16:34:48| Finished. Wrote 322644 entries.
2006/11/06 16:34:48| Took 0.6 seconds (520784.1 entries/sec).
2006/11/06 16:34:48| logfileRotate: /var/squid/logs/store.log
2006/11/06 16:34:48| logfileRotate: /var/squid/logs/access.log

=== End of cache log ===
Received on Mon Nov 06 2006 - 07:34:42 MST

This archive was generated by hypermail pre-2.1.9 : Fri Dec 01 2006 - 12:00:03 MST