Re: [squid-users] problem with squid 3.0 and filedescriptors

From: Leonardo Rodrigues Magalhães <leolistas_at_solutti.com.br>
Date: Tue, 22 Jul 2008 20:35:03 -0300

Amos Jeffries escreveu:
> Leonardo Rodrigues Magalhães wrote:
>>
>> Hello Guys,
>>
>> This is the third time i have 'Your cache is running out of
>> filedescriptors' problem with squid 3.0. I have never had similar
>> problem with 2.5 versions which i was used to use (skipped from 2.5
>> directly to 3.0)
>
> Which particular sub-version of 3.0 are you using?
> This AuthUser message reminds me of a memory leak fixed in STABLE7.

    Hi Amos,

    I have upgraded to STABLE8 but im still seeing some filedescriptors
of type File being kept open.

http://pastebin.com/f7b2f9338

    i have analyzed opened files and noticed they have really been
accessed through squid on the last hours, but last access was several
hours ago .... and files are held opened for some unknown reason for me.

2 examples:

[root_at_firewall squid]# strings /var/squid/07/55/00075590 | grep http
http://tk2.stb01.s-msn.com/i/3B/98672E1C1825A2E817F6481B1FD83.swf

[root_at_firewall squid]# grep
"http://tk2.stb01.s-msn.com/i/3B/98672E1C1825A2E817F6481B1FD83.swf"
access.log | ./converte.sh | tail -1
Tue Jul 22 10:46:22 2008 14 192.168.0.163 TCP_HIT/206 20634 GET
http://tk2.stb01.s-msn.com/i/3B/98672E1C1825A2E817F6481B1FD83.swf -
NONE/- application/x-shockwave-flash
[root_at_firewall squid]#

[root_at_firewall squid]# date
Tue Jul 22 20:24:36 BRT 2008
[root_at_firewall squid]#

    so file /var/squid/07/55/00075590, which is still being kept open,
was really accessed almost 10 hours ago !

[root_at_firewall squid]# strings /var/squid/00/75/00007579 | grep http
http://www2.dm.com.br/fotos/digital_pagina/7564/27307p.jpg

[root_at_firewall squid]# grep
"http://www2.dm.com.br/fotos/digital_pagina/7564/27307p.jpg" access.log
| ./converte.sh | tail -1
Tue Jul 22 16:02:05 2008 10 192.168.0.139 TCP_HIT/200 141766 GET
http://www2.dm.com.br/fotos/digital_pagina/7564/27307p.jpg renata.vilela
NONE/- image/jpeg
[root_at_firewall squid]#

[root_at_firewall squid]# date
Tue Jul 22 20:28:01 BRT 2008
[root_at_firewall squid]#

    so file /var/squid/00/75/00007579, which is still kept open, was
accessed 6 hours and some minutes ago .....

    proxy is running for some few hours now, but i'm already seeing lost
file descriptors. With some days/weeks, i'll probably see exactly the
same thing i was seeing before upgrading: LOTS of File filedescriptors
unnecessarily opened and, in some point, squid will start giving 'not
enough filedescriptors' errors ....

    on 'squid -k shutdown', im still seeing lots of:

2008/07/22 20:31:44| Open FD 162 /var/squid/02/9B/00029B57
2008/07/22 20:31:44| Open FD 210 /var/squid/02/E9/0002E921
2008/07/22 20:31:44| Open FD 218 /var/squid/02/4D/00024D8B
2008/07/22 20:31:44| Open FD 272 /var/squid/04/D9/0004D91F
2008/07/22 20:31:44| Squid Cache (Version 3.0.STABLE8): Exiting normally.

    and all those FDs points to file that were accessed several hours
ago, like the 2 examples i showed above on this message.

    this is exactly the same behavior i was seeing on STABLE6.

    is there anything i can do for helping identifying and debuging this
which seems to me to be a bug ?

    thanks !

-- 
	Atenciosamente / Sincerily,
	Leonardo Rodrigues
	Solutti Tecnologia
	http://www.solutti.com.br
	Minha armadilha de SPAM, NÃO mandem email
	gertrudes_at_solutti.com.br
	My SPAMTRAP, do not email it
Received on Tue Jul 22 2008 - 23:35:20 MDT

This archive was generated by hypermail 2.2.0 : Wed Jul 23 2008 - 12:00:05 MDT