RE: [squid-users] Too many open files

From: Peter Retief <peter_at_swenitech.com>
Date: Thu, 25 Jul 2013 08:43:46 +0200

>>
>> To handle the load I have 6 workers, each allocated its own physical
>> disk (noatime).
>>
>> I have set "ulimit -Sn 16384" and "ulimit -Hn 16384", by setting
>> /etc/security/limits.conf as follows:
>>
>> # - Increase file descriptor limits for Squid
>> * soft nofile 16384
>> * hard nofile 16384
>>
>> The squid is set to run as user "squid". If I login as root, then "su
>> squid", the ulimits are set correctly. For root, however, the ulimits
>> keep reverting to 1024.
>>
>> squidclient mgr:info gives:
>>
>> Maximum number of file descriptors: 98304
>> Largest file desc currently in use: 18824
>> Number of file desc currently in use: 1974

> Amos replied:

>That biggest-FD value is too high for workers that only have 16K available
each.
Do you mean
>I've just fixed the calculation there (was adding together the values for
each biggest-FD instead of comparing with max())

Do you mean you've patched the source code, and if so, how do I get that
patch? Do I have to move from the stable trunk?

>Note that if one of the workers is reaching the limit of available FD, then
you will get that message from that worker while the others run fine with
less FD consumed.
>Can you display the entire and exact cache.log line which that error
message is contained in please?

The first log occurences are:
2013/07/23 08:26:13 kid2| Attempt to open socket for EUI retrieval failed:
(24) Too many open files
2013/07/23 08:26:13 kid2| comm_open: socket failure: (24) Too many open
files
2013/07/23 08:26:13 kid2| Reserved FD adjusted from 100 to 15394 due to
failures
2013/07/23 08:26:13 kid2| '/share/squid/errors/en-za/ERR_CONNECT_FAIL': (24)
Too many open files
2013/07/23 08:26:13 kid2| WARNING: Error Pages Missing Language: en-za
2013/07/23 08:26:13 kid2| WARNING! Your cache is running out of
filedescriptors

Then later:
2013/07/23 10:00:11 kid2| WARNING! Your cache is running out of
filedescriptors
2013/07/23 10:00:27 kid2| WARNING! Your cache is running out of
filedescriptors

After that, the errors become prolific

Thanks for the help.

Peter
Received on Thu Jul 25 2013 - 06:43:55 MDT

This archive was generated by hypermail 2.2.0 : Thu Jul 25 2013 - 12:00:10 MDT