[squid-users] out of FDs in spite of 65535 file descriptors

Hello all,

above issue seems to be old. But I did all according to docs/wiki etc.

Squid is used as accelerator. We currently have 156 GB in use all
spreaded on four disks with 6206547 files which makes an average object
size of ca. 25 kB. But there are a lot of files smaller than 10 kB. The
average outgoing traffic is at 12 Mbits/sec

"ulimit -n 65535" in init.d-script and compiled with 65535 file
descriptors(more infos below).

What happens is that Squid runs for about two days until there are no
more file descriptors left and it just stops serving files with all
processes still running. In cache.log I can find this:
2008/08/04 06:44:01| client_side.cc(2690) WARNING! Your cache is running
out of filedescriptors

Has anyone here an idea where to look or what I can do?

Thanks for any help,

--
	Markus Meyer
Version and compiletime options(default Debian Unstable package)
===============================
# squid3 -v
Squid Cache: Version 3.0.STABLE7
configure options:  '--build=x86_64-linux-gnu' '--prefix=/usr' 
'--includedir=${prefix}/include' '--mandir=${prefix}/share/man' 
'--infodir=${prefix}/share/info' '--sysconfdir=/etc' 
'--localstatedir=/var' '--libexecdir=${prefix}/lib/squid3' 
'--disable-maintainer-mode' '--disable-dependency-tracking' '--srcdir=.' 
'--datadir=/usr/share/squid3' '--sysconfdir=/etc/squid3' 
'--mandir=/usr/share/man' '--with-cppunit-basedir=/usr' 
'--enable-inline' '--enable-async-io=8' 
'--enable-storeio=ufs,aufs,coss,diskd,null' 
'--enable-removal-policies=lru,heap' '--enable-poll' 
'--enable-delay-pools' '--enable-cache-digests' '--enable-snmp' 
'--enable-htcp' '--enable-select' '--enable-carp' '--with-large-files' 
'--enable-underscores' '--enable-icap-client' 
'--enable-auth=basic,digest,ntlm' 
'--enable-basic-auth-helpers=LDAP,MSNT,NCSA,PAM,SASL,SMB,YP,getpwnam,multi-domain-NTLM' 
'--enable-ntlm-auth-helpers=SMB' 
'--enable-digest-auth-helpers=ldap,password' 
'--enable-external-acl-helpers=ip_user,ldap_group,session,unix_group,wbinfo_group' 
'--with-filedescriptors=65536' '--with-default-user=proxy' 
'--enable-epoll' '--enable-linux-netfilter' 
'build_alias=x86_64-linux-gnu' 'CC=cc' 'CFLAGS=-g -Wall -O2' 'LDFLAGS=' 
'CPPFLAGS=' 'CXX=g++' 'CXXFLAGS=-g -Wall -O2'
Current configuration(IPs obfuscated)
=====================================
authenticate_cache_garbage_interval 3600 seconds
authenticate_ttl 3600 seconds
authenticate_ip_ttl 0 seconds
acl all src 0.0.0.0/0.0.0.0
acl manager proto cache_object
acl CMI_Clients src 127.0.0.1
acl snmppublic snmp_community public
acl photo3 urlpath_regex ^/photo3
acl port80 port 80
http_access Allow manager CMI_Clients
http_access Deny manager
http_access Allow port80
icp_access Deny all
htcp_access Deny all
htcp_clr_access Deny all
ident_lookup_access Deny all
http_port 0.0.0.0:80 defaultsite=proxy.of.us vport
cache_peer 192.168.1.12 Parent 80 0 no-query no-digest round-robin 
originserver
cache_peer_access seed1 Deny photo3
cache_peer_access seed1 Allow all
cache_peer 192.168.1.13 Parent 80 0 no-query no-digest round-robin 
originserver
cache_peer_access seed2 Allow photo3
cache_peer_access seed2 Allow all
dead_peer_timeout 10 seconds
cache_mem 0 bytes
maximum_object_size_in_memory 8192 bytes
memory_replacement_policy lru
cache_replacement_policy lru
cache_dir aufs /web/cache/1 111954 290 256 IOEngine=DiskThreads
cache_dir aufs /web/cache/2 111954 290 256 IOEngine=DiskThreads
cache_dir aufs /web/cache/3 111954 290 256 IOEngine=DiskThreads
cache_dir aufs /web/cache/4 111954 290 256 IOEngine=DiskThreads
store_dir_select_algorithm least-load
max_open_disk_fds 0
minimum_object_size 0 bytes
maximum_object_size 4194304 bytes
cache_swap_low 90
cache_swap_high 95
access_log none
cache_log /var/log/squid3/cache.log
cache_store_log none
logfile_rotate 0
emulate_httpd_log off
log_ip_on_direct on
mime_table /usr/share/squid3/mime.conf
log_mime_hdrs off
pid_filename /var/run/squid3.pid
debug_options ALL,1
log_fqdn off
client_netmask 255.255.255.255
strip_query_terms on
buffered_logs off
ftp_user Squid@
ftp_list_width 32
ftp_passive on
ftp_sanitycheck on
ftp_telnet_protocol on
diskd_program /usr/lib/squid3/diskd
unlinkd_program /usr/lib/squid3/unlinkd
url_rewrite_children 5
url_rewrite_concurrency 0
url_rewrite_host_header on
url_rewrite_bypass off
quick_abort_min 16 KB
quick_abort_max 16 KB
quick_abort_pct 95
read_ahead_gap 16384 bytes
negative_ttl 300 seconds
positive_dns_ttl 21600 seconds
negative_dns_ttl 60 seconds
range_offset_limit 0 bytes
minimum_expiry_time 60 seconds
store_avg_object_size 13 KB
store_objects_per_bucket 20
request_header_max_size 20480 bytes
reply_header_max_size 20480 bytes
request_body_max_size 0 bytes
via on
ie_refresh off
vary_ignore_expire off
request_entities off
relaxed_header_parser on
forward_timeout 240 seconds
connect_timeout 60 seconds
peer_connect_timeout 30 seconds
read_timeout 900 seconds
request_timeout 300 seconds
persistent_request_timeout 120 seconds
client_lifetime 86400 seconds
half_closed_clients on
pconn_timeout 60 seconds
ident_timeout 10 seconds
shutdown_lifetime 30 seconds
cache_mgr markus.meyer_at_koeln.de
mail_program mail
cache_effective_user proxy
httpd_suppress_version_string on
visible_hostname localhost
umask 23
announce_period 31536000 seconds