[squid-users] Optimizing squid

From: Clark Allan Dave <clark.dave@dont-contact.us>
Date: Thu, 22 May 2003 09:08:11 +0200

I have inherited a squid proxy; it is quite a loaded proxy and has many problems so I am trying to optimize it. At peak load it has over 470 users with a request per minute at about 600, and the hit rate on disk is about 50 % and memory is about 5% and transfers about 2.5 Gb of new data a day.

I will upgrade the H/W this weekend with a second hard disk dedicated ,just to cache .This will be a 20 GB IDE disk
Current is 8 GB drive, the disks are using UFS. Also I will increase ram to 768 MB.

This is the configuration I propose to use, can you look at and tell me if needs to be altered.

Also is it worth upgrading to squid 2.5 stable, as we run 2.5 Devel.

Many Thanks in advance

Regards Dave Clark

http_port 81
ftp_user proxyadm.tma@siemens.com
cache_peer proxy.sbs.de parent 81 0 no-query default
cache_peer proxy.siemens.de parent 81 0 no-query weight=2 default
cache_mem 32 MB
maximum_object_size 40 MB
minimum_object_size 4 KB
ipcache_size 2048
fqdncache_size 2048
cache_dir ufs /usr/local/squid/cache 1024 16 256
cache_store_log none
log_fqdn on
dns_nameservers 163.242.244.2
refresh_pattern . 0 20% 4320
refresh_pattern -i exe$ 0 50% 999999
refresh_pattern -i zip$ 0 50% 999999
refresh_pattern -i tar\.gz$ 0 50% 999999
refresh_pattern -i tgz$ 0 50% 999999
acl all src 0.0.0.0/0.0.0.0
acl manager proto cache_object
acl localhost src 127.0.0.1/255.255.255.255
acl SSL_ports port 443 563
acl Safe_ports port 21 80 81 82 100 444 9700 8080 1997 # http
#acl Safe_ports port 21 # ftp
acl Safe_ports port 443 563 # https, snews
acl Safe_ports port 444 # snpp
acl Safe_ports port 70 # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535 # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
#acl Safe_ports port 5190 #icq
acl CONNECT method CONNECT
http_access allow CONNECT SSL_ports
http_access deny !Safe_ports
acl class1 src 163.242.237.0/255.255.255.0
acl class2 src 163.242.244.0/255.255.255.0
acl class3 src 163.242.245.0/255.255.255.0
acl class4 src 163.242.236.0/255.255.255.0
http_access allow class1
http_access allow class2
http_access allow class3
http_access allow class4
http_access allow all
acl POST method post
acl MP3 urlpath_regex \.[mM][pP][3]
http_access allow andreea MP3
http_access deny MP3 !POST
acl extension url_regex \.avi$ \.mp3$ \mp3$ .\mp3$ \.mp4$ \.mov$ \.mpeg$ \.mpg$ \.axf$
http_access allow andreea extension
http_access deny extension
acl network src 0/0
http_reply_access allow all
miss_access allow manager
miss_access allow all
cache_mgr proxyadm.tma@siemens.com
logfile_rotate 4
memory_pools on
cachemgr_passwd pacproxy shutdown
cachemgr_passwd pac info/stats/objects
store_objects_per_bucket 50
client_db on
buffered_logs on

Taken from cachemgr (old config)

Connection information for squid:
        Number of clients accessing cache: 469
        Number of HTTP requests received: 339059
        Number of ICP messages received: 0
        Number of ICP messages sent: 0
        Number of queued ICP replies: 0
        Request failure ratio: 0.00%
        HTTP requests per minute: 262.0
        ICP messages per minute: 0.0
        Select loop called: 3424304 times, 22.671 ms avg
Cache information for squid:
        Request Hit Ratios: 5min: 6.9%, 60min: 8.1%
        Byte Hit Ratios: 5min: 15.0%, 60min: 12.8%
        Request Memory Hit Ratios: 5min: 4.6%, 60min: 4.7%
        Request Disk Hit Ratios: 5min: 50.2%, 60min: 44.4%
        Storage Swap size: 642396 KB
        Storage Mem size: 10040 KB
        Mean Object Size: 27.00 KB
        Requests given to unlinkd: 1998
Median Service Times (seconds) 5 min 60 min:
        HTTP Requests (All): 0.30459 0.49576
        Cache Misses: 0.33943 0.52331
        Cache Hits: 0.00721 0.00919
        Near Hits: 0.30459 0.42149
        Not-Modified Replies: 0.00286 0.00179
        DNS Lookups: 0.00094 0.00094
        ICP Queries: 0.00000 0.00000
Resource usage for squid:
        UP Time: 77633.849 seconds
        CPU Time: 1062.470 seconds
        CPU Usage: 1.37%
        CPU Usage, 5 minute avg: 1.60%
        CPU Usage, 60 minute avg: 5.83%
        Maximum Resident Size: 0 KB
        Page faults with physical i/o: 374
Memory usage for squid via mallinfo():
        Total space in arena: 24916 KB
        Ordinary blocks: 19520 KB 3640 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 192 KB 1 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 5396 KB
        Total in use: 19712 KB 79%
        Total free: 5396 KB 22%
Memory accounted for:
        Total accounted: -1 KB
        memPoolAlloc calls: 47640454
        memPoolFree calls: 47533440
File descriptor usage for squid:
        Maximum number of file descriptors: 1024
        Largest file desc currently in use: 311
        Number of file desc currently in use: 184
        Files queued for open: 0
        Available number of file descriptors: 840
        Reserved number of file descriptors: 100
        Store Disk files open: 13
Internal Data Structures:
         24182 StoreEntries
          1406 StoreEntries with MemObjects
          1342 Hot Object Cache Items
         23791 on-disk objects

Also anyone who has information on how to understand Cachemgr , please tell me where I can find any information
SIEMENS V D O SV  IO IT CO
A u t o m o t i v e

Calea Martirilor Nr. 1
Timisoara 1900
Network Support
Dave Clark
Tel: 00 4(0) 0256 308735
Email:clark.dave@siemens.com
Received on Thu May 22 2003 - 01:08:25 MDT

This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 17:16:51 MST