Re: [squid-users] problem with squid 3.0 and filedescriptors

From: Amos Jeffries <squid3_at_treenet.co.nz>
Date: Wed, 23 Jul 2008 14:47:59 +1200 (NZST)

>
>
> Amos Jeffries escreveu:
>> Leonardo Rodrigues Magalhães wrote:
>>>
>>> Hello Guys,
>>>
>>> This is the third time i have 'Your cache is running out of
>>> filedescriptors' problem with squid 3.0. I have never had similar
>>> problem with 2.5 versions which i was used to use (skipped from 2.5
>>> directly to 3.0)
>>
>> Which particular sub-version of 3.0 are you using?
>> This AuthUser message reminds me of a memory leak fixed in STABLE7.
>
> Hi Amos,
>
> I have upgraded to STABLE8 but im still seeing some filedescriptors
> of type File being kept open.
>
> http://pastebin.com/f7b2f9338
>
> i have analyzed opened files and noticed they have really been
> accessed through squid on the last hours, but last access was several
> hours ago .... and files are held opened for some unknown reason for me.
>
> 2 examples:
>
> [root_at_firewall squid]# strings /var/squid/07/55/00075590 | grep http
> http://tk2.stb01.s-msn.com/i/3B/98672E1C1825A2E817F6481B1FD83.swf
>
> [root_at_firewall squid]# grep
> "http://tk2.stb01.s-msn.com/i/3B/98672E1C1825A2E817F6481B1FD83.swf"
> access.log | ./converte.sh | tail -1
> Tue Jul 22 10:46:22 2008 14 192.168.0.163 TCP_HIT/206 20634 GET
> http://tk2.stb01.s-msn.com/i/3B/98672E1C1825A2E817F6481B1FD83.swf -
> NONE/- application/x-shockwave-flash
> [root_at_firewall squid]#
>
> [root_at_firewall squid]# date
> Tue Jul 22 20:24:36 BRT 2008
> [root_at_firewall squid]#
>
> so file /var/squid/07/55/00075590, which is still being kept open,
> was really accessed almost 10 hours ago !
>
>
> [root_at_firewall squid]# strings /var/squid/00/75/00007579 | grep http
> http://www2.dm.com.br/fotos/digital_pagina/7564/27307p.jpg
>
> [root_at_firewall squid]# grep
> "http://www2.dm.com.br/fotos/digital_pagina/7564/27307p.jpg" access.log
> | ./converte.sh | tail -1
> Tue Jul 22 16:02:05 2008 10 192.168.0.139 TCP_HIT/200 141766 GET
> http://www2.dm.com.br/fotos/digital_pagina/7564/27307p.jpg renata.vilela
> NONE/- image/jpeg
> [root_at_firewall squid]#
>
> [root_at_firewall squid]# date
> Tue Jul 22 20:28:01 BRT 2008
> [root_at_firewall squid]#
>
> so file /var/squid/00/75/00007579, which is still kept open, was
> accessed 6 hours and some minutes ago .....
>
> proxy is running for some few hours now, but i'm already seeing lost
> file descriptors. With some days/weeks, i'll probably see exactly the
> same thing i was seeing before upgrading: LOTS of File filedescriptors
> unnecessarily opened and, in some point, squid will start giving 'not
> enough filedescriptors' errors ....
>
> on 'squid -k shutdown', im still seeing lots of:
>
> 2008/07/22 20:31:44| Open FD 162 /var/squid/02/9B/00029B57
> 2008/07/22 20:31:44| Open FD 210 /var/squid/02/E9/0002E921
> 2008/07/22 20:31:44| Open FD 218 /var/squid/02/4D/00024D8B
> 2008/07/22 20:31:44| Open FD 272 /var/squid/04/D9/0004D91F
> 2008/07/22 20:31:44| Squid Cache (Version 3.0.STABLE8): Exiting normally.
>
> and all those FDs points to file that were accessed several hours
> ago, like the 2 examples i showed above on this message.
>
> this is exactly the same behavior i was seeing on STABLE6.
>
> is there anything i can do for helping identifying and debuging this
> which seems to me to be a bug ?
>

Does truly look like a bug.
Can you register this as a bug with as much info as you can get on it in
STABLE8. This gets a little technical for squid-users now. I'll follow up
further in bugzilla so we can track the issue properly.

For bugzilla this extra info will be helpful:
You earlier located the debug message indicating AuthUser. Is that still
present exactly the same? or has it changed?
We are going to have to track down; firstly what object is not being
released, and then why thats happening.

Thank you.

Amos
Received on Wed Jul 23 2008 - 02:48:03 MDT

This archive was generated by hypermail 2.2.0 : Wed Jul 23 2008 - 12:00:05 MDT