Re: [squid-users] squid Version 2.6.STABLE16 crashing with url_rewriters]

Goj, Dirk wrote:

> Hi there.
>
> Yesterday my proxy started crashing with following error message:
>
> 2008/01/31 14:04:12| Starting Squid Cache version 2.6.STABLE16 for i386-debian-linux-gnu...
> 2008/01/31 14:04:12| Process ID 22919
> 2008/01/31 14:04:12| With 1024 file descriptors available
> 2008/01/31 14:04:12| Using epoll for the IO loop
> 2008/01/31 14:04:12| Performing DNS Tests...
> 2008/01/31 14:04:12| Successful DNS name lookup tests...
> 2008/01/31 14:04:12| DNS Socket created at 0.0.0.0, port 37010, FD 6
> 2008/01/31 14:04:12| Adding nameserver 62.206.1.4 from /etc/resolv.conf
> 2008/01/31 14:04:12| Adding nameserver 62.206.2.4 from /etc/resolv.conf
> 2008/01/31 14:04:12| helperOpenServers: Starting 5 'squidGuard' processes
> 2008/01/31 14:04:12| User-Agent logging is disabled.
> 2008/01/31 14:04:12| Referer logging is disabled.
> 2008/01/31 14:04:12| Unlinkd pipe opened on FD 16
> 2008/01/31 14:04:12| Swap maxSize 10240000 KB, estimated 787692 objects
> 2008/01/31 14:04:12| Target number of buckets: 39384
> 2008/01/31 14:04:12| Using 65536 Store buckets
> 2008/01/31 14:04:12| Max Mem size: 8192 KB
> 2008/01/31 14:04:12| Max Swap size: 10240000 KB
> 2008/01/31 14:04:12| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
> 2008/01/31 14:04:12| Rebuilding storage in /usr/local/squid/var/cache (CLEAN)
> 2008/01/31 14:04:12| Using Least Load store dir selection
> 2008/01/31 14:04:12| Current Directory is /
> 2008/01/31 14:04:12| Loaded Icons.
> 2008/01/31 14:04:12| Accepting proxy HTTP connections at 0.0.0.0, port 3128, FD18
> 2008/01/31 14:04:12| Accepting ICP messages at 0.0.0.0, port 3130, FD 19.
> 2008/01/31 14:04:12| Accepting HTCP messages on port 4827, FD 20.
> 2008/01/31 14:04:12| Accepting SNMP messages on port 3401, FD 21.
> 2008/01/31 14:04:12| WCCP Disabled.
> 2008/01/31 14:04:12| Ready to serve requests.
> 2008/01/31 14:04:12| Store rebuilding is 2.8% complete
> 2008/01/31 14:04:12| WARNING: url_rewriter #1 (FD 7) exited
> 2008/01/31 14:04:13| Done reading /usr/local/squid/var/cache swaplog (146478 entries)
> 2008/01/31 14:04:13| Finished rebuilding storage from disk.
> 2008/01/31 14:04:13| 146478 Entries scanned
> 2008/01/31 14:04:13| 0 Invalid entries.
> 2008/01/31 14:04:13| 0 With invalid flags.
> 2008/01/31 14:04:13| 146478 Objects loaded.
> 2008/01/31 14:04:13| 0 Objects expired.
> 2008/01/31 14:04:13| 0 Objects cancelled.
> 2008/01/31 14:04:13| 0 Duplicate URLs purged.
> 2008/01/31 14:04:13| 0 Swapfile clashes avoided.
> 2008/01/31 14:04:13| Took 0.7 seconds (195566.6 objects/sec).
> 2008/01/31 14:04:13| Beginning Validation Procedure
> 2008/01/31 14:04:13| Completed Validation Procedure
> 2008/01/31 14:04:13| Validated 146478 Entries
> 2008/01/31 14:04:13| store_swap_size = 2671964k
> 2008/01/31 14:04:13| WARNING: url_rewriter #2 (FD 8) exited
> 2008/01/31 14:04:13| storeLateRelease: released 0 objects
> 2008/01/31 14:04:14| WARNING: url_rewriter #3 (FD 9) exited
> 2008/01/31 14:04:14| Too few url_rewriter processes are running
> 2008/01/31 14:04:14| storeDirWriteCleanLogs: Starting...
> 2008/01/31 14:04:14| WARNING: Closing open FD 18
> 2008/01/31 14:04:14| commSetEvents: epoll_ctl(EPOLL_CTL_DEL): failed on fd=18: (1) Operation not permitted
> 2008/01/31 14:04:14| 65536 entries written so far.
> 2008/01/31 14:04:14| 131072 entries written so far.
> 2008/01/31 14:04:14| Finished. Wrote 146478 entries.
> 2008/01/31 14:04:14| Took 0.0 seconds (6418843.1 entries/sec).
> FATAL: The url_rewriter helpers are crashing too rapidly, need help!
>
> Squid Cache (Version 2.6.STABLE16): Terminated abnormally.
> CPU Usage: 0.580 seconds = 0.260 user + 0.320 sys
> Maximum Resident Size: 0 KB
> Page faults with physical i/o: 0
> Memory usage for squid via mallinfo():
> total space in arena: 16272 KB
> Ordinary blocks: 16186 KB 11 blks
> Small blocks: 0 KB 0 blks
> Holding blocks: 504 KB 2 blks
> Free Small blocks: 0 KB
> Free Ordinary blocks: 85 KB
> Total in use: 16690 KB 99%
> Total free: 85 KB 1%
>
> When I restart squid from webmin or from ssh the same thing happens. Changed nothing at squid itself. Search the internet and found one thing that the helper (squidGuard) may have a to big logfile. But it's not the logfile. When I disable the helper squidGuard squid runs normally. It's the squidGuard which hasn't changed too... access rights to squidguard-db's are ok. Every folder and file same user like the squid is running under...
>
> I'm out of ideas...
>
> May anyone of you have ideas ?
>
> Thx!
>
>
> Dirk Goj
>
>
>
>
> Mit freundlichen Grüßen
>
> Udo Täubrich Betreuungs GmbH
> i. A. Dirk Goj
>
> Westpreussenstr. 38
> 47809 Krefeld
> Tel: 02151-1570 1766
> Fax: 02151-1570 1789
> _____________________________________________________________________________
>
> Geschäftsführer: Ralph Krahl, Roland Stübing
> Registergericht: Amtsgericht Krefeld HRB 8906
>
>
> Die in dieser E-Mail enthaltenen Informationen sind moeglicherweise vertraulich und koennen von rechtlicher Bedeutung sein. Diese Mail ist ausschliesslich für den Adressaten bestimmt und jeglicher Zugriff durch andere Personen ist nicht zulaessig. Falls Sie nicht der beabsichtigte Empfaenger sind, ist jegliche Veroeffentlichung, Vervielfaeltigung, Verteilung oder sonstige in diesem Zusammenhang stehende Handlung untersagt und unter Umstaenden ungesetzlich. Sollten Sie nicht der vorgesehene Empfaenger dieser E-Mail sein, informieren Sie bitte den Absender und loeschen Sie sie danach.
>
> This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail you have received this e-mail by mistake and delete this e-mail from your system.
>
> As you know, messages sent by e-mail can be manipulated by third parties. For this reason our e-mail messages are generally not legally binding. This message (and any files transmitted with it) may contain confidential and/or privileged material. The information transmitted is intended only for the person or entity to which it is addressed.
> If you have received this e-mail in error please notify the sender or the system manager immediately by reply e-mail and delete this message and any attachments. Any review, disclosure, copy, distribution or other use of contents of this message by persons or entities other than the intended recipient is prohibited.
>
Its related with squidguard, take a look at its db. something is making
it crash. have you scanned the squidguard db's with db_verify?
Received on Fri Feb 01 2008 - 02:57:14 MST