[squid-users] Squid Slow Downloads problem--large files

From: adam.cheng <adam.cheng@dont-contact.us>
Date: Tue, 18 Jul 2006 11:53:52 +0800

Hi, squid-user

In my test , Apache is much more faster than squid when there are about
30Mbps load.

brief result:

-->large file download testing (10M and 40M)
-->Current load: 15Mbps (squid service)
-->IOwait: 6%
-->test result: (same box, same environment)
        Apache: 60~70Mbytes/s
        Squid: 700~900Kbytes/s (HIT from squid cache)
        
Detail information listed below.

----------------------------------------------------------------------------
--------------------
->Hi, squid-users:
->
->I have met a slow download problem of squid , would anybody like to tell
me what’s
->the matter with my squid Or is there any way to resolve this problem ?
->
->Squid info:
->
->[root@CHN-SH-3-341 ~]# squid -v
->Squid Cache: Version 2.5.STABLE12
->configure options: --prefix=/usr/local/squid --enable-epoll
--disable-ident-lookups
->--enable-async-io=160 --enable-storeio=ufs,aufs,diskd --enable-snmp
->--enable-cache-digests --enable-useragent-log --enable-referer-log
->--enable-kill-parent-hack --enable--internal-dns
->----------------------------------------------
->
->
->squid.conf:
->
->http_port 80
->icp_port 0
->acl httpmp3 url_regex -i ^http://.*\.mp3$
->no_cache deny httpmp3
->acl httpwmv url_regex -i ^http://.*\.wmv$
->no_cache deny httpwmv
->acl httprm url_regex -i ^http://.*\.rm$
->no_cache deny httprm
-> cache_mem 1768 MB
-> cache_swap_low 70
-> cache_swap_high 80
->maximum_object_size 204800 KB
->minimum_object_size 0 KB
->maximum_object_size_in_memory 102400 KB
-> cache_replacement_policy lru
-> memory_replacement_policy lru
->cache_dir diskd /data/cache1 28000 16 256
->cache_dir diskd /data/cache2 28000 16 256
->logformat squid_custom_log %ts.%03tu %6tr %>a %Ss/%03Hs %<st %rm %ru
->%un %Sh/%<A %mt "%{Referer}>h" "%{User-Agent}>h" "%{Cookie}>h"
->cache_access_log /data/proclog/log/squid/access.log squid_custom_log
->cache_log /data/proclog/log/squid/cache.log
->cache_store_log none
->pid_filename /var/run/squid.pid
-> hosts_file /etc/hosts
-> diskd_program /usr/local/squid/libexec/diskd
-> unlinkd_program /usr/local/squid/libexec/unlinkd
->
->
->refresh_pattern -i ^http://player.toodou.com.* 2073600 100% 2073600
->ignore-reload
->refresh_pattern -i ^http://www.blogcn.com.* 1440 50% 1440
->refresh_pattern -i ^http://images.blogcn.com.* 1440 50% 1440
->refresh_pattern -i ^http://female.blogcn.com.* 1440 50% 1440
->refresh_pattern -i ^http://img.365ren.com.* 720 100% 720
->refresh_pattern -i ^http://cfs1.365ren.com.* 720 100% 720
->refresh_pattern -i ^http://cafe-img.365ren.com.* 720 100% 720
->refresh_pattern -i ^http://cafe-cfs1.365ren.com.* 720 100% 720
->refresh_pattern -i ^http 60 0% 60 ignore-reload
->collapsed_forwarding on
->refresh_stale_hit 0 minute
->request_timeout 30 seconds
-> persistent_request_timeout 3 seconds
-> pconn_timeout 60 seconds
->acl all src 0.0.0.0/0.0.0.0
->acl manager proto cache_object
->acl localhost src 127.0.0.1/255.255.255.255
->acl to_localhost dst 127.0.0.0/8
->acl SSL_ports port 443 563
->acl Safe_ports port 80 # http
->acl Safe_ports port 21 # ftp
->acl Safe_ports port 443 563 # https, snews
->acl Safe_ports port 70 # gopher
->acl Safe_ports port 210 # wais
->acl Safe_ports port 1025-65535 # unregistered ports
->acl Safe_ports port 280 # http-mgmt
->acl Safe_ports port 488 # gss-http
->acl Safe_ports port 591 # filemaker
->acl Safe_ports port 777 # multiling http
->acl CONNECT method CONNECT
->acl monitor src 192.168.1.0/255.255.255.0
->http_access allow manager
->http_access allow manager monitor
->http_access deny manager
->acl PURGE method PURGE
->http_access allow PURGE localhost
->http_access deny purge
->acl snmppublic snmp_community public
->snmp_access allow snmppublic localhost
->http_access deny !Safe_ports
->http_access deny CONNECT !SSL_ports
->http_access allow all
->http_reply_access allow all
-> cache_mgr squid@chinacache.com
-> cache_effective_user squid
-> cache_effective_group squid
->visible_hostname CHN-SH-3-341
->httpd_accel_host virtual
->httpd_accel_port 80
->httpd_accel_single_host off
->httpd_accel_with_proxy off
->httpd_accel_uses_host_header on
->dns_testnames original1.chinacache.com original2.chinacache.com
-> logfile_rotate 0
->
->cachemgr_passwd test4squid config
-> store_avg_object_size 20 KB
->client_db off
->header_access X-Cache-Lookup deny all
->snmp_port 3401
->acl snmppublic snmp_community public
-> client_persistent_connections off
-> server_persistent_connections off
->vary_ignore_expire on
->strip_query_terms off
->negative_ttl 0 minute
->dns_retransmit_interval 10 seconds
->store_dir_select_algorithm round-robin
->dns_timeout 2 minute
->negative_dns_ttl 1 minute
->connect_timeout 30 seconds
->read_timeout 15 minutes
->
->--------------------------------------------------------------------------
-
->
->Test information: (all test was done to the same box, )
->
->Squid with 80 port:
->
->[root@CHN-SH-3-571 ~]# wget -SO test
->http://player.toodou.com/flv/001/126/216/1126216.flv
->--18:56:54-- http://player.toodou.com/flv/001/126/216/1126216.flv
-> => `test'
->Resolving player.toodou.com... 192.168.1.131
->Connecting to player.toodou.com|192.168.1.131|:80... connected.
->HTTP request sent, awaiting response...
-> HTTP/1.0 200 OK
-> Date: Fri, 14 Jul 2006 05:45:42 GMT
-> Content-Length: 42254194
-> Content-Type: application/octet-stream
-> ETag: "-1897917552"
-> Last-Modified: Wed, 12 Jul 2006 11:34:09 GMT
-> Server: Microsoft-IIS/6.0
-> X-Cache: HIT from origin-player.toodou.com
-> Via: 1.0 CHN-SH-4-912 (NetCache NetApp/5.5R5D8), 1.1 CHN-SH-3-911
->(NetCache NetApp/6.0.3)
-> Age: 39548
-> X-Cache: HIT from CHN-SH-3-341
-> Connection: close
->Length: 42,254,194 (40M) [application/octet-stream]
->
->100%[==============================================
->=====================>] 42,254,194 1.19M/s ETA 00:00
->
->18:57:09 (2.76 MB/s) - `test' saved [42254194/42254194]
->
->
->Squid with 8081 port:
->
->[root@CHN-SH-3-571 ~]# wget -SO test
->http://player.toodou.com:8081/flv/001/126/216/1126216.flv
->--19:07:56-- http://player.toodou.com:8081/flv/001/126/216/1126216.flv
-> => `test'
->Resolving player.toodou.com... 192.168.1.131
->Connecting to player.toodou.com|192.168.1.131|:8081... connected.
->HTTP request sent, awaiting response...
-> HTTP/1.0 200 OK
-> Date: Fri, 14 Jul 2006 05:45:42 GMT
-> Content-Length: 42254194
-> Content-Type: application/octet-stream
-> ETag: "-1897917552"
-> Last-Modified: Wed, 12 Jul 2006 11:34:09 GMT
-> Server: Microsoft-IIS/6.0
-> X-Cache: HIT from origin-player.toodou.com
-> Via: 1.0 CHN-SH-4-912 (NetCache NetApp/5.5R5D8), 1.1 CHN-SH-3-911
->(NetCache NetApp/6.0.3)
-> Age: 40210
-> X-Cache: HIT from CHN-SH-3-341
-> Connection: close
->Length: 42,254,194 (40M) [application/octet-stream]
->
->100%[==============================================
->=====================>] 42,254,194 1.26M/s ETA 00:00
->
->19:08:10 (2.85 MB/s) - `test' saved [42254194/42254194]
->
->
->Apache with 8080 port:
->
->
->[root@CHN-SH-3-571 ~]# wget -SO test
->http://player.toodou.com:8080/1126216.flv
->--19:25:45-- http://player.toodou.com:8080/1126216.flv
-> => `test'
->Resolving player.toodou.com... 192.168.1.131
->Connecting to player.toodou.com|192.168.1.131|:8080... connected.
->HTTP request sent, awaiting response...
-> HTTP/1.1 200 OK
-> Date: Sun, 16 Jul 2006 11:25:45 GMT
-> Server: Apache/2.0.52 (Red Hat)
-> Last-Modified: Sun, 16 Jul 2006 10:33:34 GMT
-> ETag: "2bd0f-284bf72-7212fb80"
-> Accept-Ranges: bytes
-> Content-Length: 42254194
-> Connection: close
-> Content-Type: text/plain; charset=UTF-8
->Length: 42,254,194 (40M) [text/plain]
->
->100%[==============================================
->=====================>] 42,254,194 57.04M/s
->
->19:25:46 (57.01 MB/s) - `test' saved [42254194/42254194]
->
->
->Best Regards,
->Adam
->
->
->
->
->
-> 程冬 Adam Cheng
-> 网络运行维护部/Network Support & Maintenance
-> Tel: (86-10) 64373399-802
-> Fax: (86-10) 64374251
-> Email: adam.cheng@chinacache.com
-> http://www.chinacache.com
->=====================================
-> 北京蓝汛通信技术有限责任公司
-> 北京市朝阳区酒仙桥中路10号星科大厦A座6层
-> 邮编:100016
-> 6th Floor, Tower A, Galaxy Building,
-> No.10 Jiuxianqiao Zhonglu, Chaoyang District,
-> Beijing 100016 P.R China
->=====================================
->
->
->
Received on Mon Jul 17 2006 - 21:54:47 MDT

This archive was generated by hypermail pre-2.1.9 : Tue Aug 01 2006 - 12:00:01 MDT