My squid proxy server keeps going down.
It runs fine most of the day but periodically it just stops processing any
request. I seem to have plenty of disk space. I am runing this on a P2 -
300mhz processor with 384mb memory. This configuration had been running for
about a month with no problems. The only change we have made would be the
number of users.
Friday I completely removed all of my cache and rebuilt it.
It seems to happen the worst early in the morning. Some days after
restarting several times early in the AM it will run the rest of the day.
When this occurs I cannot gracefully shutdown the proxy. When it comes back
up it the cache is dirty, but it seems to clean it. While in this condition
I can't use the cachemgr to check anything.
I don't find any errors in either the access.log, cache.log, system log
files, or coming accross the console.
Here is the only thing I get in my cache.log
2000/08/07 00:00:02| storeDirWriteCleanLogs: Starting...
2000/08/07 00:00:03| Finished. Wrote 25548 entries.
2000/08/07 00:00:03| Took 0.1 seconds (398527.4 entries/sec).
2000/08/07 00:00:03| storeLogRotate: Rotating.
2000/08/07 00:00:03| accessLogRotate: Rotating
2000/08/07 06:19:05| Preparing for shutdown after 70057 requests
2000/08/07 06:19:05| Waiting 10 seconds for active connections to finish
2000/08/07 06:19:05| FD 3 Closing HTTP connection
2000/08/07 06:19:17| Shutting down...
2000/08/07 06:19:17| FD 9 Closing ICP connection
2000/08/07 06:19:17| Closing unlinkd pipe on FD 16
2000/08/07 06:19:17| storeDirWriteCleanLogs: Starting...
2000/08/07 06:19:17| Finished. Wrote 27368 entries.
2000/08/07 06:19:17| Took 0.1 seconds (400111.1 entries/sec).
CPU Usage: 483.040 seconds = 290.030 user + 193.010 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 6076
Memory usage for squid via mallinfo():
total space in arena: 125509 KB
Ordinary blocks: 125015 KB 121 blks
Small blocks: 0 KB 0 blks
Holding blocks: 15432 KB 3 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 493 KB
Total in use: 140447 KB 112%
Total free: 493 KB 0%
2000/08/07 06:19:17| Squid Cache (Version 2.3.STABLE2): Exiting normally.
2000/08/07 06:20:09| Starting Squid Cache version 2.3.STABLE2 for
i686-pc-linux-gnu...
2000/08/07 06:20:09| Process ID 17804
2000/08/07 06:20:09| With 1024 file descriptors available
2000/08/07 06:20:09| Performing DNS Tests...
2000/08/07 06:20:09| Successful DNS name lookup tests...
2000/08/07 06:20:09| DNS Socket created on FD 1
2000/08/07 06:20:09| Adding nameserver 128.1.4.253 from /etc/resolv.conf
2000/08/07 06:20:09| Adding nameserver 128.1.1.4 from /etc/resolv.conf
2000/08/07 06:20:09| helperOpenServers: Starting 5 'ncsa_auth' processes
2000/08/07 06:20:09| Unlinkd pipe opened on FD 11
2000/08/07 06:20:09| Swap maxSize 2048000 KB, estimated 157538 objects
2000/08/07 06:20:09| Target number of buckets: 3150
2000/08/07 06:20:09| Using 8192 Store buckets
2000/08/07 06:20:09| Max Mem size: 153600 KB
2000/08/07 06:20:09| Max Swap size: 2048000 KB
2000/08/07 06:20:09| Rebuilding storage in /cache (CLEAN)
2000/08/07 06:20:09| Rebuilding storage in /usr/cache (CLEAN)
2000/08/07 06:20:09| Rebuilding storage in /home/cache (CLEAN)
2000/08/07 06:20:09| Set Current Directory to /cache
2000/08/07 06:20:09| Loaded Icons.
2000/08/07 06:20:09| SmartFilter init: Initialized and enabled
2000/08/07 06:20:09| Accepting HTTP connections at 0.0.0.0, port 3128, FD
17.
2000/08/07 06:20:09| Accepting ICP messages at 0.0.0.0, port 3130, FD 18.
2000/08/07 06:20:09| WCCP Disabled.
2000/08/07 06:20:09| Ready to serve requests.
2000/08/07 06:20:12| Configuring Parent pigpen.sbec.com/80/0
2000/08/07 06:20:12| Done reading /usr/cache swaplog (6404 entries)
2000/08/07 06:20:13| Done reading /home/cache swaplog (7290 entries)
2000/08/07 06:20:13| Done reading /cache swaplog (13674 entries)
2000/08/07 06:20:13| Finished rebuilding storage from disk.
2000/08/07 06:20:13| 27368 Entries scanned
2000/08/07 06:20:13| 0 Invalid entries.
2000/08/07 06:20:13| 0 With invalid flags.
2000/08/07 06:20:13| 27368 Objects loaded.
2000/08/07 06:20:13| 0 Objects expired.
2000/08/07 06:20:13| 0 Objects cancelled.
2000/08/07 06:20:13| 0 Duplicate URLs purged.
2000/08/07 06:20:13| 0 Swapfile clashes avoided.
2000/08/07 06:20:13| Took 4.1 seconds (6667.2 objects/sec).
2000/08/07 06:20:13| Beginning Validation Procedure
2000/08/07 06:20:13| Completed Validation Procedure
2000/08/07 06:20:13| Validated 27368 Entries
2000/08/07 06:20:13| store_swap_size = 281006k
2000/08/07 06:20:13| storeLateRelease: released 0 objects
2000/08/07 06:35:55| aclMatchProxyAuth: user 'stilescw' has changed IP
address
2000/08/07 06:40:34| clientSendMoreData: Deferring
/www.cnbc.com/onlycnbc/images
/icon_homepage.gif
2000/08/07 06:45:55| aclMatchProxyAuth: user 'stilescw' has changed IP
address
2000/08/07 06:54:39| aclDecodeProxyAuth: Disallowing empty password,user is
'wingatwh'
2000/08/07 06:54:42| aclDecodeProxyAuth: Disallowing empty password,user is
'wingatwh'
2000/08/07 07:37:52| CACHEMGR: root@127.0.0.1 requesting 'menu'
2000/08/07 07:37:54| CACHEMGR: root@127.0.0.1 requesting 'filedescriptors'
2000/08/07 07:38:00| CACHEMGR: root@127.0.0.1 requesting 'filedescriptors'
2000/08/07 07:38:07| CACHEMGR: root@127.0.0.1 requesting 'filedescriptors'
2000/08/07 07:38:12| CACHEMGR: root@127.0.0.1 requesting 'filedescriptors'
2000/08/07 07:39:44| CACHEMGR: root@127.0.0.1 requesting 'filedescriptors'
2000/08/07 07:39:51| CACHEMGR: root@127.0.0.1 requesting 'filedescriptors'
2000/08/07 07:48:34| parseHttpRequest: Requestheader contains NULL
characters
2000/08/07 07:48:34| clientReadRequest: FD 16 Invalid Request
2000/08/07 07:56:15| Starting Squid Cache version 2.3.STABLE2 for
i686-pc-linux-gnu...
2000/08/07 07:56:15| Process ID 17994
2000/08/07 07:56:15| With 1024 file descriptors available
2000/08/07 07:56:15| Performing DNS Tests...
2000/08/07 07:56:15| Successful DNS name lookup tests...
2000/08/07 07:56:15| DNS Socket created on FD 1
2000/08/07 07:56:15| Adding nameserver 128.1.4.253 from /etc/resolv.conf
2000/08/07 07:56:15| Adding nameserver 128.1.1.4 from /etc/resolv.conf
2000/08/07 07:56:15| helperOpenServers: Starting 5 'ncsa_auth' processes
2000/08/07 07:56:16| Unlinkd pipe opened on FD 11
2000/08/07 07:56:16| Swap maxSize 2048000 KB, estimated 157538 objects
2000/08/07 07:56:16| Target number of buckets: 3150
2000/08/07 07:56:16| Using 8192 Store buckets
2000/08/07 07:56:16| Max Mem size: 153600 KB
2000/08/07 07:56:16| Max Swap size: 2048000 KB
2000/08/07 07:56:16| Rebuilding storage in /cache (DIRTY)
2000/08/07 07:56:16| Rebuilding storage in /usr/cache (DIRTY)
2000/08/07 07:56:16| Rebuilding storage in /home/cache (DIRTY)
2000/08/07 07:56:16| Set Current Directory to /cache
2000/08/07 07:56:16| Loaded Icons.
2000/08/07 07:56:16| SmartFilter init: Initialized and enabled
2000/08/07 07:56:16| Accepting HTTP connections at 0.0.0.0, port 3128, FD
17.
2000/08/07 07:56:16| Accepting ICP messages at 0.0.0.0, port 3130, FD 18.
2000/08/07 07:56:16| WCCP Disabled.
2000/08/07 07:56:16| Ready to serve requests.
2000/08/07 07:56:19| Configuring Parent pigpen.sbec.com/80/0
2000/08/07 07:56:19| Done reading /usr/cache swaplog (8414 entries)
2000/08/07 07:56:19| Done reading /home/cache swaplog (8780 entries)
2000/08/07 07:56:19| Done reading /cache swaplog (17175 entries)
2000/08/07 07:56:19| Finished rebuilding storage from disk.
2000/08/07 07:56:19| 34082 Entries scanned
2000/08/07 07:56:19| 0 Invalid entries.
2000/08/07 07:56:19| 0 With invalid flags.
2000/08/07 07:56:19| 33774 Objects loaded.
2000/08/07 07:56:19| 0 Objects expired.
2000/08/07 07:56:19| 283 Objects cancelled.
2000/08/07 07:56:19| 33 Duplicate URLs purged.
2000/08/07 07:56:19| 0 Swapfile clashes avoided.
2000/08/07 07:56:19| Took 4.0 seconds (8471.5 objects/sec).
2000/08/07 07:56:19| Beginning Validation Procedure
2000/08/07 07:56:20| Completed Validation Procedure
2000/08/07 07:56:20| Validated 33766 Entries
2000/08/07 07:56:20| store_swap_size = 373041k
2000/08/07 07:56:21| storeLateRelease: released 0 objects
2000/08/07 07:59:57| Preparing for shutdown after 623 requests
2000/08/07 07:59:57| Waiting 10 seconds for active connections to finish
2000/08/07 07:59:57| FD 17 Closing HTTP connection
2000/08/07 08:00:08| Shutting down...
2000/08/07 08:00:08| FD 18 Closing ICP connection
2000/08/07 08:00:08| Closing unlinkd pipe on FD 11
2000/08/07 08:00:08| storeDirWriteCleanLogs: Starting...
2000/08/07 08:00:08| Finished. Wrote 33942 entries.
2000/08/07 08:00:08| Took 0.1 seconds (446540.6 entries/sec).
CPU Usage: 6.340 seconds = 3.070 user + 3.270 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 732
Memory usage for squid via mallinfo():
total space in arena: 6401 KB
Ordinary blocks: 6118 KB 134 blks
Small blocks: 0 KB 0 blks
Holding blocks: 15432 KB 3 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 282 KB
Total in use: 21550 KB 337%
Total free: 282 KB 4%
2000/08/07 08:00:08| Squid Cache (Version 2.3.STABLE2): Exiting normally.
2000/08/07 08:00:15| Starting Squid Cache version 2.3.STABLE2 for
i686-pc-linux-gnu...
2000/08/07 08:00:15| Process ID 18063
2000/08/07 08:00:15| With 1024 file descriptors available
2000/08/07 08:00:15| Performing DNS Tests...
2000/08/07 08:00:15| Successful DNS name lookup tests...
2000/08/07 08:00:15| DNS Socket created on FD 1
2000/08/07 08:00:15| Adding nameserver 128.1.4.253 from /etc/resolv.conf
2000/08/07 08:00:15| Adding nameserver 128.1.1.4 from /etc/resolv.conf
2000/08/07 08:00:15| helperOpenServers: Starting 5 'ncsa_auth' processes
2000/08/07 08:00:15| Unlinkd pipe opened on FD 11
2000/08/07 08:00:15| Swap maxSize 2048000 KB, estimated 157538 objects
2000/08/07 08:00:15| Target number of buckets: 3150
2000/08/07 08:00:15| Using 8192 Store buckets
2000/08/07 08:00:15| Max Mem size: 153600 KB
2000/08/07 08:00:15| Max Swap size: 2048000 KB
2000/08/07 08:00:15| Rebuilding storage in /cache (CLEAN)
2000/08/07 08:00:15| Rebuilding storage in /usr/cache (CLEAN)
2000/08/07 08:00:15| Rebuilding storage in /home/cache (CLEAN)
2000/08/07 08:00:15| Set Current Directory to /cache
2000/08/07 08:00:15| Loaded Icons.
2000/08/07 08:00:15| SmartFilter init: Initialized and enabled
2000/08/07 08:00:15| Accepting HTTP connections at 0.0.0.0, port 3128, FD
17.
2000/08/07 08:00:15| Accepting ICP messages at 0.0.0.0, port 3130, FD 18.
2000/08/07 08:00:15| WCCP Disabled.
2000/08/07 08:00:15| Ready to serve requests.
2000/08/07 08:00:18| Configuring Parent pigpen.sbec.com/80/0
2000/08/07 08:00:18| Done reading /usr/cache swaplog (8286 entries)
2000/08/07 08:00:19| Done reading /home/cache swaplog (8679 entries)
2000/08/07 08:00:19| Done reading /cache swaplog (16977 entries)
2000/08/07 08:00:19| Finished rebuilding storage from disk.
2000/08/07 08:00:19| 33942 Entries scanned
2000/08/07 08:00:19| 0 Invalid entries.
2000/08/07 08:00:19| 0 With invalid flags.
2000/08/07 08:00:19| 33942 Objects loaded.
2000/08/07 08:00:19| 0 Objects expired.
2000/08/07 08:00:19| 0 Objects cancelled.
2000/08/07 08:00:19| 0 Duplicate URLs purged.
2000/08/07 08:00:19| 0 Swapfile clashes avoided.
2000/08/07 08:00:19| Took 4.0 seconds (8470.5 objects/sec).
2000/08/07 08:00:19| Beginning Validation Procedure
2000/08/07 08:00:19| Completed Validation Procedure
2000/08/07 08:00:19| Validated 33942 Entries
2000/08/07 08:00:19| store_swap_size = 373880k
2000/08/07 08:00:20| storeLateRelease: released 0 objects
Received on Mon Aug 07 2000 - 07:13:37 MDT
This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 16:54:44 MST