[squid-users] running out of filedescriptors

From: Jacobi Michael CRPH <JacobiM@dont-contact.us>
Date: Tue, 5 Nov 2002 16:33:21 -0500

Earlier today my squid (2.4Stable7) running on a RedHat 6.2 died on me. Included below is an excerpt from the CACHE.LOG from the system. I checked the system and it has a file descriptor limit of 4096. Any quick ideas on what to do so this doesn't happen again?

Thanks!

Mike Jacobi

EXCERPT from CACHE.LOG:

2002/11/05 12:09:09| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:09:25| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:09:41| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:09:57| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:10:13| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:10:29| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:10:45| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:11:01| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:11:17| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:11:33| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:11:41| parseHttpRequest: Unsupported method 'POLL'
2002/11/05 12:11:41| clientReadRequest: FD 97 Invalid Request
2002/11/05 12:11:49| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:12:05| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:12:21| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:12:37| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:12:53| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:13:09| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:17:01| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:17:17| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:17:50| WARNING! Your cache is running out of filedescriptors
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 1
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 2
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 3
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 4
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 5
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 6
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 7
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 8
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 9
2002/11/05 12:17:59| comm_poll: poll failure: (12) Cannot allocate memory
2002/11/05 12:17:59| Select loop Error. Retry 10
FATAL: Select Loop failed!
Squid Cache (Version 2.4.STABLE7): Terminated abnormally.
CPU Usage: 24651.860 seconds = 9161.170 user + 15490.690 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 5244861
Memory usage for squid via mallinfo():
        total space in arena: 295930 KB
        Ordinary blocks: 288100 KB 12704 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 432 KB 2 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 7830 KB
        Total in use: 288532 KB 97%
        Total free: 7830 KB 3%
2002/11/05 12:17:59| storeDirWriteCleanLogs: Starting...
2002/11/05 12:18:02| WARNING: Closing open FD 13
2002/11/05 12:18:34| 65536 entries written so far.
2002/11/05 12:18:46| 131072 entries written so far.
2002/11/05 12:18:53| 196608 entries written so far.
2002/11/05 12:18:55| Finished. Wrote 222403 entries.
2002/11/05 12:18:55| Took 53.1 seconds (4187.5 entries/sec).
2002/11/05 12:18:58| Starting Squid Cache version 2.4.STABLE7 for i686-pc-linux-gnu...
2002/11/05 12:18:58| Process ID 1724
2002/11/05 12:18:58| With 1024 file descriptors available
2002/11/05 12:18:58| Performing DNS Tests...
FATAL: ipcache_init: DNS name lookup tests failed.
Squid Cache (Version 2.4.STABLE7): Terminated abnormally.
CPU Usage: 0.010 seconds = 0.010 user + 0.000 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 443
2002/11/05 12:29:42| Starting Squid Cache version 2.4.STABLE7 for i686-pc-linux-gnu...
2002/11/05 12:29:42| Process ID 1882
2002/11/05 12:29:42| With 1024 file descriptors available
2002/11/05 12:29:42| Performing DNS Tests...
2002/11/05 12:31:20| Starting Squid Cache version 2.4.STABLE7 for i686-pc-linux-gnu...
2002/11/05 12:31:20| Process ID 459
2002/11/05 12:31:20| With 1024 file descriptors available
2002/11/05 12:31:20| Performing DNS Tests...
2002/11/05 12:31:20| Successful DNS name lookup tests...
2002/11/05 12:31:20| DNS Socket created on FD 4
2002/11/05 12:31:20| Adding nameserver 157.187.16.10 from /etc/resolv.conf
2002/11/05 12:31:20| Adding nameserver 157.187.16.3 from /etc/resolv.conf
2002/11/05 12:31:20| Unlinkd pipe opened on FD 9
2002/11/05 12:31:20| Swap maxSize 2560000 KB, estimated 196923 objects
2002/11/05 12:31:20| Target number of buckets: 9846
2002/11/05 12:31:20| Using 16384 Store buckets
2002/11/05 12:31:20| Max Mem size: 196608 KB
2002/11/05 12:31:20| Max Swap size: 2560000 KB
2002/11/05 12:31:20| Rebuilding storage in /usr/local/squid/cache (CLEAN)
2002/11/05 12:31:20| Using Least Load store dir selection
2002/11/05 12:31:20| Set Current Directory to /usr/local/squid/cache
2002/11/05 12:31:20| Loaded Icons.
2002/11/05 12:31:20| Accepting HTTP connections at 0.0.0.0, port 3128, FD 11.
2002/11/05 12:31:20| Accepting HTTP connections at 0.0.0.0, port 80, FD 13.
2002/11/05 12:31:20| Accepting ICP messages at 0.0.0.0, port 3130, FD 14.
2002/11/05 12:31:20| WCCP Disabled.
2002/11/05 12:31:20| Ready to serve requests.
2002/11/05 12:31:21| Configuring Parent osprey-in.navsses.navy.mil/80/7
2002/11/05 12:31:21| Configuring Parent ostrich-in.navsses.navy.mil/80/7
2002/11/05 12:31:22| Store rebuilding is 1.8% complete
2002/11/05 12:31:37| Store rebuilding is 49.7% complete
2002/11/05 12:31:49| Done reading /usr/local/squid/cache swaplog (222403 entries)
2002/11/05 12:31:49| Finished rebuilding storage from disk.
2002/11/05 12:31:49| 222403 Entries scanned
2002/11/05 12:31:49| 0 Invalid entries.
2002/11/05 12:31:49| 0 With invalid flags.
2002/11/05 12:31:49| 222403 Objects loaded.
2002/11/05 12:31:49| 0 Objects expired.
2002/11/05 12:31:49| 0 Objects cancelled.
2002/11/05 12:31:49| 0 Duplicate URLs purged.
2002/11/05 12:31:49| 0 Swapfile clashes avoided.
2002/11/05 12:31:49| Took 28.7 seconds (7751.4 objects/sec).
2002/11/05 12:31:49| Beginning Validation Procedure
2002/11/05 12:31:49| Completed Validation Procedure
2002/11/05 12:31:49| Validated 222402 Entries
2002/11/05 12:31:49| store_swap_size = 2307396k
2002/11/05 12:31:49| storeLateRelease: released 50 objects
Received on Tue Nov 05 2002 - 14:33:39 MST

This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 17:11:10 MST