Re: [squid-users] SQUID makes few slow connections (see video)

From: Nyamul Hassan <mnhassan_at_usa.net>
Date: Wed, 2 Jun 2010 00:30:28 +0600

Did you check if you are hitting the FD limit?  An output of "General
Runtime Information" from the "cachemgr.cgi" would provide some better
information.

Also, it appears you are using squid to provide local users better
access to the internet at large (also known as forward proxy).  In
that case, you might want to use the COSS file storage offered by the
2.x series.  We use the latest stable 2.7STABLE9 with great results.

Regards
HASSAN

On Wed, Jun 2, 2010 at 00:22, Tytus Rogalewski <tytanick_at_gmail.com> wrote:
>
> Hi guys, i have problem with slow performance in my squid
> When i enter the page WITHOUT squid, pages are loaded in ~1 sec,
> but when i turn on SQUID - page load in 70% in 1 sec, and then few
> images are loading very slowly
>
> I made flash movie - you can see how this slow connevting VIA squid works
> http://sky-link.net/temp/squid/squid_performance.html (10 MB - i have
> slow connection so you need to wait few mins :)
>
> ----------------------------
> Server Hardware:
> Core2Duo E4600 3.0 Ghz
> 4 GB ramu
> Dysk Szajsung 640GB (w fstabie dopisany noatime 0 0)
>
> Server Soft:
> Linux Gentoo
> squid-3.0.19 or 3.0.20 is the same thing
>
>
> ============================
> Squid, access.log
> You can see in second collumn when did image loaded fully. (1000 = 1 sec)
> Look at 3 last rows, 3 sec,m 6 sec ened even 12 sec ? wtf ?
>
> 1275413778.282    401 192.168.0.2 TCP_MISS/200 20538 GET
> http://allegro.pl/76700_dodatki_i_ozdoby.html? - DIRECT/193.23.48.134
> text/html
> 1275413778.417     41 192.168.0.2 TCP_MISS/200 2845 GET
> http://img16.allegroimg.pl/photos/64x48/10/52/33/52/1052335222 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.426     48 192.168.0.2 TCP_MISS/200 1955 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748223 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.436     53 192.168.0.2 TCP_MISS/200 2124 GET
> http://img14.allegroimg.pl/photos/64x48/10/47/88/44/1047884413 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.447     61 192.168.0.2 TCP_MISS/200 2564 GET
> http://img04.allegroimg.pl/photos/64x48/10/60/13/27/1060132706 -
> DIRECT/194.0.251.213 image/jpeg
> 1275413778.461     70 192.168.0.2 TCP_MISS/200 1880 GET
> http://img17.allegroimg.pl/photos/64x48/10/48/29/44/1048294443 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.473     82 192.168.0.2 TCP_MISS/200 1811 GET
> http://img17.allegroimg.pl/photos/64x48/10/48/29/45/1048294559 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.487     95 192.168.0.2 TCP_MISS/200 1906 GET
> http://img17.allegroimg.pl/photos/64x48/10/48/29/46/1048294688 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.503     73 192.168.0.2 TCP_MISS/200 2226 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749248 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.511    124 192.168.0.2 TCP_MISS/200 2012 GET
> http://img11.allegroimg.pl/photos/64x48/10/48/20/58/1048205827 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.526    137 192.168.0.2 TCP_MISS/200 2475 GET
> http://img11.allegroimg.pl/photos/64x48/10/48/21/13/1048211380 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.541      0 192.168.0.2 TCP_DENIED/403 353 GET
> http://allegro.hit.gemius.pl/_1275413783164/rexdot.gif? - NONE/-
> text/html
> 1275413778.549     41 192.168.0.2 TCP_MISS/200 2422 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749229 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.600     47 192.168.0.2 TCP_MISS/200 480 GET
> http://www.google-analytics.com/__utm.gif? - DIRECT/209.85.129.101
> image/gif
> 1275413778.615     55 192.168.0.2 TCP_MISS/200 2692 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/40/1048114081 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.659     42 192.168.0.2 TCP_MISS/200 2754 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/40/1048114095 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.669    289 192.168.0.2 TCP_MISS/200 2488 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749270 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.678    298 192.168.0.2 TCP_MISS/200 2274 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749255 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.688    305 192.168.0.2 TCP_MISS/200 2747 GET
> http://img11.allegroimg.pl/photos/64x48/10/52/72/84/1052728463 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.697    318 192.168.0.2 TCP_MISS/200 1962 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748228 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.711    334 192.168.0.2 TCP_MISS/200 2148 GET
> http://img14.allegroimg.pl/photos/64x48/10/47/74/07/1047740767 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.724     62 192.168.0.2 TCP_MISS/200 2298 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/41/1048114124 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.736    359 192.168.0.2 TCP_MISS/200 2206 GET
> http://img06.allegroimg.pl/photos/64x48/10/47/47/49/1047474911 -
> DIRECT/194.0.251.213 image/jpeg
> 1275413778.749     79 192.168.0.2 TCP_MISS/200 2562 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/41/1048114135 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.762     83 192.168.0.2 TCP_MISS/200 2429 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/12/11/1048121165 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.773    395 192.168.0.2 TCP_MISS/200 2564 GET
> http://img04.allegroimg.pl/photos/64x48/10/59/76/37/1059763730 -
> DIRECT/194.0.251.213 image/jpeg
> 1275413778.785     72 192.168.0.2 TCP_MISS/200 2130 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/25/20/1048252001 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.796     71 192.168.0.2 TCP_MISS/200 2152 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/25/24/1048252448 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.806     55 192.168.0.2 TCP_MISS/200 2470 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/25/49/1048254966 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.819     46 192.168.0.2 TCP_MISS/200 2635 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/30/20/1048302014 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.833     42 192.168.0.2 TCP_MISS/200 2120 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/36/39/1048363990 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.843     43 192.168.0.2 TCP_MISS/200 2219 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/36/40/1048364001 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413781.456   3073 192.168.0.2 TCP_MISS/200 2332 GET
> http://img11.allegroimg.pl/photos/64x48/10/52/73/36/1052733644 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413784.420   6042 192.168.0.2 TCP_MISS/200 2431 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748244 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413790.419  12041 192.168.0.2 TCP_MISS/200 2131 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748241 -
> DIRECT/194.0.251.214 image/jpeg
>
>
> ===========================
> SQUID SETTINGS
>
> http_port 8123 transparent
> cache_mgr tytan..._at_gmail.com
> visible_hostname sky-link.net
> error_directory /usr/share/squid/errors/Polish_clean
>
> cache_mem 1500 MB # ilosc ramu
> memory_pools on
> memory_pools_limit 100 MB
> cache_swap_low  94
> cache_swap_high 98
> fqdncache_size 51200
> ipcache_size 51200
> ipcache_low 90
> ipcache_high 95
> pipeline_prefetch on
> minimum_object_size 0 KB
> maximum_object_size 50000 KB
> maximum_object_size_in_memory 512 KB
> half_closed_clients on
> shutdown_lifetime 2 seconds
> #ident_timeout 1 seconds
> cache_replacement_policy heap LFUDA
> memory_replacement_policy heap lru
> #cache_dir aufs /mnt/dysk/squid 100000 256 256
> cache_dir aufs /mnt/dysk/squid 20000 32 256
> #quick_abort_min 200 KB
> #quick_abort_max 200 KB
> quick_abort_min 0 KB
> quick_abort_max 0 KB
>
> ### OPCJE ###
> icp_port 0
> htcp_port 0
> icp_access deny all
> htcp_access deny all
> snmp_port 0
> snmp_access deny all
>
> ### LOGI ###
> access_log /var/log/squid/access.log
> cache_log /var/log/squid/cache.log
> cache_store_log /var/log/squid/store.log
> log_fqdn on # pelne nazwy domen w logach
> #debug_options ALL,1
>
> ie_refresh on
> cache_effective_user squid
> cache_effective_group squid
> negative_ttl 1 minutes
> positive_dns_ttl 24 hours
> negative_dns_ttl 1 minutes
>
> ## ACL
> acl manager proto cache_object
> acl localhost src 127.0.0.1/255.255.255.255
> acl sky-link src 192.168.0.0/255.255.255.0 #Nasza LAN
> acl SSL_ports port 443 563
> acl Safe_ports port 21 80 442 563 70 210 280 488 591 777 1025-65535
> acl CONNECT method CONNECT
> #acl MCONN maxconn 300
> # Youtube ACL
> acl youtube_domains
> dstdomain .youtube.com .googlevideo.com .ytimg.com .wrzuta.pl
>
> ### ADL Blokada Reklam ###
> acl allowlist_urlregex url_regex "/etc/squid/acl/
> allowlist_urlregex.acl"
> acl allowlist_dstdomain dstdomain "/etc/squid/acl/
> allowlist_dstdomain.acl"
> acl denylist_urlregex url_regex "/etc/squid/acl/denylist_urlregex.acl"
> acl denylist_dstdomain dstdomain "/etc/squid/acl/
> denylist_dstdomain.acl"
>
> ## HTTP ACCESS
> http_access allow allowlist_dstdomain
> http_access allow allowlist_urlregex
> http_access deny denylist_urlregex
> http_access deny denylist_dstdomain
> http_access allow sky-link
> http_access allow manager localhost
> http_access deny manager
> http_access deny CONNECT !SSL_ports
> http_access deny !Safe_ports
> http_access deny youtube_domains
>
> #tcp_outgoing_address 79.190.121.50
> #zph_tos_local 8
> #zph_tos_peer 0
> #zph_tos_parent off
>
> #vary_ignore_expire on
> #relaxed_header_parser on
> #server_persistent_connections off
>
> request_header_max_size 100 KB
> refresh_pattern -i \.(gif|png|jpg|jpeg|ico|bmp)$ 10080  90%    43200
> refresh-ims
> refresh_pattern -i \.(iso|avi|wav|ogg|mp3|mp4|mpg|mpeg|swf|flv|x-flv)$
> 10080  90%    43200 refresh-ims
> refresh_pattern -i \.(deb|rpm|exe|zip|tar|gz|bz2|tgz|ram|rar|bin|ppt|
> doc|tiff)$ 10080  90%    43200 refresh-ims
> refresh_pattern windowsupdate.com/.*\.(cab|exe|dll)             10080
> 90%    43200 refresh-ims
> refresh_pattern download.microsoft.com/.*\.(cab|exe|dll)        10080
> 90%    43200 refresh-ims
> refresh_pattern au.download.windowsupdate.com/.*\.(cab|exe|dll) 10080
> 90%    43200 refresh-ims
> refresh_pattern symantecliveupdate.com/.*\.(zip|exe)            10080
> 90%    43200 refresh-ims
> refresh_pattern windowsupdate.com/.*\.(cab|exe)                 10080
> 90%    43200 refresh-ims
> refresh_pattern download.microsoft.com/.*\.(cab|exe)            10080
> 90%    43200 refresh-ims
> refresh_pattern avast.com/.*\.(vpu|vpaa)                        10080
> 90%    43200 refresh-ims
> refresh_pattern .                                               0
> 90%    43200 refresh-ims
>
>
> --
> Z pozdrowieniami
> Tytus Rogalewski
> mail: tytanick{monkey}gmail.com
> www.sky-link.net
> gg: 210533
> skype: tytanick
Received on Tue Jun 01 2010 - 18:31:15 MDT

This archive was generated by hypermail 2.2.0 : Wed Jun 02 2010 - 12:00:03 MDT