[squid-users] Squid Server Getting Slow -Cache Errors !!!

From: Narayanan Subramaniam <narayanan.s@dont-contact.us>
Date: Wed, 22 Mar 2006 09:48:17 +0530

Dear all

    i am facing a new problem with squid as the connections are getting
slow every hour . Users are getting "404, page not found " message, when
this problem occurs .Then either i had to restart squid or reboot the
machine
inorder to get squid back to job. Again the problem repeats in the
next hour.

Following are the details of my setup.

Hardware Configuration
----------------------

IBM X226 with Dual Xeon Process 2.4 GHZ with 512 MB ECC DDR RAM

Operating System
-----------------

Red Hat Enterprise Linux 3 (2.4 kernel)

Following is my squid.conf

/etc/squid/squid.conf
-----------------------------------------
http_port 10.0.0.1:6588
hierarchy_stoplist cgi-bin ?
acl QUERY urlpath_regex cgi-bin \?
no_cache deny QUERY
cache_mem 512 MB
 cache_swap_low 45
 cache_swap_high 60
 maximum_object_size 2048 KB
cache_dir aufs /var/spool/squid 10000 16 256
hosts_file /etc/hosts
auth_param basic children 5
auth_param basic realm Squid proxy-caching web server
auth_param basic credentialsttl 2 hours
refresh_pattern ^ftp: 1440 20% 10080
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern . 0 20% 4320
acl all src 0.0.0.0/0.0.0.0
acl manager proto cache_object
acl localhost src 127.0.0.1/255.255.255.255
acl to_localhost dst 127.0.0.0/8
acl SSL_ports port 443 563
acl Safe_ports port 80 # http
acl Safe_ports port 21 # ftp
acl Safe_ports port 443 563 # https, snews
acl Safe_ports port 70 # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535 # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl CONNECT method CONNECT
acl ourlan src 10.0.0.0/255.255.255.0
http_access allow ourlan
http_access deny all
http_access allow manager localhost
http_access deny manager
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports
http_access allow localhost
http_access deny all
http_reply_access allow all
icp_access allow all
visible_hostname ciftpdc
logfile_rotate 1
 memory_pools off
coredump_dir /var/spool/squid

Following are the error messages in cache.log

-------------------------------------------
2006/03/21 15:40:17| sslReadServer: FD 86: read failure: (104)
Connection reset by peer
2006/03/21 15:47:48| Preparing for shutdown after 3463 requests
2006/03/21 15:47:48| Waiting 30 seconds for active connections to finish
2006/03/21 15:47:48| FD 10 Closing HTTP connection
2006/03/21 15:48:19| Shutting down...
2006/03/21 15:48:19| FD 11 Closing ICP connection
2006/03/21 15:48:19| Closing unlinkd pipe on FD 9
2006/03/21 15:48:19| aioSync: flushing pending I/O operations
2006/03/21 15:48:19| aioSync: done
2006/03/21 15:48:19| storeDirWriteCleanLogs: Starting...
2006/03/21 15:48:20| Finished. Wrote 1082 entries.
2006/03/21 15:48:20| Took 0.0 seconds (793255.1 entries/sec).
CPU Usage: 5.490 seconds = 2.450 user + 3.040 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 544
Memory usage for squid via mallinfo():
        total space in arena: 7721 KB
        Ordinary blocks: 7180 KB 168 blks
        Small blocks: 0 KB 5 blks
        Holding blocks: 460 KB 2 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 541 KB
        Total in use: 7640 KB 99%
        Total free: 541 KB 7%
2006/03/21 15:48:20| aioSync: flushing pending I/O operations
2006/03/21 15:48:20| aioSync: done
2006/03/21 15:48:20| aioSync: flushing pending I/O operations
2006/03/21 15:48:20| aioSync: done
2006/03/21 15:48:20| Open FD 14 async-io completetion
event: main
2006/03/21 15:48:20| Open FD 15 async-io completetion
event: threads
2006/03/21 15:48:20| Squid Cache (Version 2.5.STABLE3): Exiting
normally.
2006/03/21 15:48:20| Starting Squid Cache version 2.5.STABLE3 for i386-
redhat-linux-gnu...
2006/03/21 15:48:20| Process ID 4899
2006/03/21 15:48:20| With 1024 file descriptors available
2006/03/21 15:48:20| DNS Socket created at 0.0.0.0, port 32791, FD 4
2006/03/21 15:48:20| Adding nameserver 203.197.12.42
from /etc/resolv.conf
2006/03/21 15:48:20| Adding nameserver 202.54.6.60 from /etc/resolv.conf
2006/03/21 15:48:20| Adding nameserver 4.2.2.2 from /etc/resolv.conf
2006/03/21 15:48:20| User-Agent logging is disabled.
2006/03/21 15:48:20| Referer logging is disabled.
2006/03/21 15:48:20| Unlinkd pipe opened on FD 9
2006/03/21 15:48:20| Swap maxSize 10240000 KB, estimated 787692 objects
2006/03/21 15:48:20| Target number of buckets: 39384
2006/03/21 15:48:20| Using 65536 Store buckets
2006/03/21 15:48:20| Max Mem size: 524288 KB
2006/03/21 15:48:20| Max Swap size: 10240000 KB
2006/03/21 15:48:20| Rebuilding storage in /var/spool/squid (CLEAN)
2006/03/21 15:48:20| Using Least Load store dir selection
2006/03/21 15:48:20| Set Current Directory to /var/spool/squid
2006/03/21 15:48:20| Loaded Icons.
2006/03/21 15:48:21| Accepting HTTP connections at 10.0.0.1, port 6588,
FD 11.
2006/03/21 15:48:21| Accepting ICP messages at 0.0.0.0, port 3130, FD
12.
2006/03/21 15:48:21| WCCP Disabled.
2006/03/21 15:48:21| Ready to serve requests.
2006/03/21 15:48:21| Done reading /var/spool/squid swaplog (1082
entries)
2006/03/21 15:48:21| Finished rebuilding storage from disk.
2006/03/21 15:48:21| 1082 Entries scanned
2006/03/21 15:48:21| 0 Invalid entries.
2006/03/21 15:48:21| 0 With invalid flags.
2006/03/21 15:48:21| 1082 Objects loaded.
2006/03/21 15:48:21| 0 Objects expired.
2006/03/21 15:48:21| 0 Objects cancelled.
2006/03/21 15:48:21| 0 Duplicate URLs purged.
2006/03/21 15:48:21| 0 Swapfile clashes avoided.
2006/03/21 15:48:21| Took 0.3 seconds (3944.7 objects/sec).
2006/03/21 15:48:21| Beginning Validation Procedure
2006/03/21 15:48:21| Completed Validation Procedure
2006/03/21 15:48:21| Validated 1082 Entries
2006/03/21 15:48:21| store_swap_size = 10156k
2006/03/21 15:48:21| storeLateRelease: released 0 objects
 2006/03/21 15:48:21| squidaio_queue_request: WARNING - Queue congestion
+ squid
------------------------------------------------------------------------

Once this error message comes"squidaio_queue_request: WARNING - Queue
congestion + squid",
squid gets slow.

Please suggest anything to be done to fine tune the performance. Any
configuration changes required in cache_mem or cache_dir?

Any help is appreciated.

Thanks in Advance

Narayanan

________________________________________________________________________
Received on Tue Mar 21 2006 - 21:14:25 MST

This archive was generated by hypermail pre-2.1.9 : Sat Apr 01 2006 - 12:00:04 MST