Re: AW: [squid-users] SQUID 3.3.8 doesn't cache files greater than 50KB

From: Eliezer Croitoru <eliezer_at_ngtech.co.il>
Date: Sun, 18 May 2014 17:17:25 +0300

Hey there,

There is a way to force a fetch of a full object when a partial byte
range accrues.
You can take a look at the example here:
http://wiki.squid-cache.org/SquidFaq/WindowsUpdate#How_do_I_make_Windows_Updates_cache.3F

Which is intended for windows update but also applies for other downloads.
My recommendation is to use the options wisely to not consume too much
of the bandwidth without any real reason.

Eliezer

On 05/16/2014 07:50 PM, Joachim Rahm wrote:
> Thanks Amos,
>
> Is there any way to cache pdfs?
> Could the pdfs converted, so that they are cachable?
> Or has the web-application to be changed?
>
> Regard
>
> Joachim
>
> -----Ursprüngliche Nachricht-----
> Von: joachim.rahm_at_jrwebsites.de [mailto:joachim.rahm_at_jrwebsites.de]
> Gesendet: Freitag, 16. Mai 2014 13:34
> An: Amos Jeffries
> Cc: squid-users_at_squid-cache.org
> Betreff: Re: [squid-users] SQUID 3.3.8 doesn't cache files greater than 50KB
>
> Hi,
> thanks for the responses.
> I looked into the strange behavior a little bit more in detail and noticed,
> that only pdf-files are concerned.
> All other files, also greater than 50k, are cached, only pdfs are not
> cached.
> In the squid.conf I have:
>
> refresh_pattern ^ftp: 43200 0% 43200
> refresh_pattern ^gopher: 1440 0% 1440
> refresh_pattern -i \.(gif|png|jpg|jpeg|ico)$ 43200 0% 43200 override-expire
> ignore-no-cache ignore-no-store ignore-private refresh_pattern -i
> \.(iso|avi|wav|mp3|mp4|mpeg|swf|flv|x-flv)$ 43200 0% 43200 override-expire
> ignore-no-cache ignore-no-store ignore-private refresh_pattern -i
> \.(deb|rpm|exe|zip|tar|tgz|ram|rar|bin|ppt|doc|pdf|tiff)$ 43200 0% 43200
> override-expire ignore-no-cache ignore-no-store ignore-private
> refresh_pattern -i (/cgi-bin/|\?) 0 0% 0
> refresh_pattern (Release|Packages(.gz)*)$ 0 20% 2880
> refresh_pattern . 0 20% 4320
>
>
> In the access-log I found:
>
> 1400221694.741 889 192.168.0.232 TCP_MISS_ABORTED/200 8704 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221696.022 1167 192.168.0.232 TCP_MISS/206 26089 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221696.655 624 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221697.345 687 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221697.807 1146 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221698.643 833 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221700.545 2684 192.168.0.232 TCP_MISS/206 197037 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221701.731 1182 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221702.529 1922 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221703.538 1006 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221704.170 622 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221705.030 857 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221706.319 1283 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221707.155 833 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221708.020 863 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221715.392 386 192.168.0.232 TCP_MISS_ABORTED/206 10145 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221716.368 870 192.168.0.232 TCP_MISS/206 26089 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221717.561 1168 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221718.848 1283 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221720.008 2441 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221721.082 1069 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221723.787 3725 192.168.0.232 TCP_MISS/206 197037 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221727.264 3474 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221727.635 3789 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221729.404 1304 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221730.828 1418 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221731.916 1084 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221733.161 1243 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221734.491 1326 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
> 1400221735.529 1035 192.168.0.232 TCP_MISS/206 65969 GET
> http://forfix.de/test/1.pdf - HIER_DIRECT/85.214.232.151 application/pdf
>
> If I rename the file 1.pdf in 1.exe, it would work.
>
> Best regards
>
> Joachim
>
>
>
>
>> On 15/05/2014 11:17 a.m., Dan Charlesworth wrote:
>>> I think there was a bug fixed very recently to do with the fact that
>>> `maximum_object_size` is ignored if it comes after `cache_dir` in the
>>> conf.
>>>
>>> If you switch the order or move use `cache_dir max-size=n` then it
>>> should be alright.
>>>
>>> On 15 May 2014 04:18, Joachim Rahm wrote:
>>>> Hi,
>>>>
>>>> I installed a squid on an ubuntu 14 server.
>>>> In the access.log I get for files greater than about 50KB the error
>>>> code TCP_MISS_ABORTED and the files are not cached.
>>
>>
>> MISS is server being contacted for data.
>> ABRTED is the client giving up before the response happens.
>>
>> Given that responses under 50KB happen:
>> * Look to your network for TCP "window scaling" issues.
>> * look for PMTUd issues (somebody blocking ICMP usually).
>>
>> Amos
>>
>
>
Received on Sun May 18 2014 - 14:19:30 MDT

This archive was generated by hypermail 2.2.0 : Mon May 19 2014 - 12:00:05 MDT