Re: [squid-users] Problem with increasing memory utilization

From: Adrian Chadd <adrian_at_freebsd.org>
Date: Wed, 23 Jul 2008 01:03:59 +0800

Well its certainly possible that a regression was introduced between versions.

Just file a bug report in bugzilla - http://bugs.squid-cache.org/

2008/7/23 Leandro Oliveira da Silva <leandro_at_webconnection.com.br>:
> Hi!
>
> I'll give a try, but something that deserve mention is that in my office I
> have a linux server with squid 3.0 and this is not happening. Besides the
> machine itself, the other difference is the mandriva version (here I have
> 2006.0 and in my clients I have 2008.0). I'm downloading the 2008.1
> mandrinva version and will try with it too.
>
> Thanks,
> Leandro
>
> -----Mensagem original-----
> De: adrian.chadd_at_gmail.com [mailto:adrian.chadd_at_gmail.com] Em nome de Adrian
> Chadd
> Enviada em: terça-feira, 22 de julho de 2008 13:39
> Para: Leandro Oliveira da Silva
> Cc: squid-users_at_squid-cache.org
> Assunto: Re: [squid-users] Problem with increasing memory utilization
>
> Try squid-2.7; a bunch of delay pools related fixes went into there
> which should be fix the reconfigure case?
>
>
>
> Adrian
>
> 2008/7/22 Leandro Oliveira da Silva <leandro_at_webconnection.com.br>:
>> Hello all!
>>
>> I have a strange problem with squid. I use squid not for caching, but for
>> control with squidGuard, manage two links using tcp_outgoing_address and
>> control traffic with delay_pool.
>> Because of a known bug in 2.6 versions I couldn't use the delay pool since
> I
>> use reconfigure from time to time and in 3.0 it's working fine, but every
>> time I use reconfigure the "Total memory in arena" increases 300k aprox
>> (also noted using top and ps), in a few hours the memory is all used up
> and
>> it stars to use swap. I have servers using 3.0STABLE1, stable5 and stable8
>> and it happens in all of them.
>> The main reason for using the squid -k reconfigure is that I have users
>> logging in and out all day long (and night sometimes) and I need reload
> the
>> squidguard. I've read in this list that I can use just squid –k rotate,
> but
>> sometimes I need to reconfigure because of changes in the internet address
>> (for tcp_outgoing_address) or rules for delay_pool.
>> My question is why the memory increases in every reconfigure? I've already
>> disables delay_pools, tcp_outgoing_address, squidguard and any created
> acls
>> and the problem persists.
>> Below is my squid.conf and spec of one of my server. Any help is
>> appreciate.
>>
>> Thanks,
>> Leandro
>>
>> CPU model name: Intel(R) Pentium(R) 4 CPU 3.00GHz (some servers with Dual
>> Core)
>> Memory: 1GB (some servers with 2GB)
>> Kernel: 2.6.25 (som with 2.6.23)
>> Linux: Mandriva 2008.0
>>
>> [root_at_localhost ~]# squidclient mgr:info | grep 'in arena'
>> Total space in arena: 122608 KB
>> [root_at_localhost ~]# squid –k reconfigure
>> [root_at_localhost ~]# squidclient mgr:info | grep 'in arena';date
>> Total space in arena: 123004 KB
>>
>> Squid.conf:
>>
>> auth_param basic children 5
>> auth_param basic realm Squid proxy-caching web server
>> auth_param basic credentialsttl 2 hours
>> auth_param basic casesensitive off
>> acl manager proto cache_object
>> acl localhost src 127.0.0.1/32
>> acl to_localhost dst 127.0.0.0/8
>> acl SSL_ports port 443
>> acl Safe_ports port 80 # http
>> acl Safe_ports port 21 # ftp
>> acl Safe_ports port 443 # https
>> acl Safe_ports port 70 # gopher
>> acl Safe_ports port 210 # wais
>> acl Safe_ports port 1025-65535 # unregistered ports
>> acl Safe_ports port 280 # http-mgmt
>> acl Safe_ports port 488 # gss-http
>> acl Safe_ports port 591 # filemaker
>> acl Safe_ports port 777 # multiling http
>> acl CONNECT method CONNECT
>> http_access allow manager localhost
>> http_access deny manager
>> http_access deny !Safe_ports
>> http_access deny CONNECT !SSL_ports
>> http_access allow all
>> http_reply_access allow all
>> icp_access allow all
>> htcp_access allow all
>> http_port 3128 transparent
>> hierarchy_stoplist cgi-bin ?
>> cache_dir null /dev/null
>> access_log /var/log/squid/access.log squid
>> cache_log /var/log/squid/cache.log
>> cache_store_log /var/log/squid/store.log
>> pid_filename /var/run/squid.pid
>> acl QUERY urlpath_regex cgi-bin \?
>> cache deny QUERY
>> refresh_pattern ^ftp: 1440 20% 10080
>> refresh_pattern ^gopher: 1440 0% 1440
>> refresh_pattern . 0 20% 4320
>> cache_effective_user squid
>> cache_effective_group squid
>> visible_hostname 10.125.123.1
>> icp_port 0
>> htcp_port 0
>> no_cache deny all
>> dns_nameservers 127.0.0.1
>> hosts_file none
>> coredump_dir /var/cache
>>
>>
>>
>> squid –v:
>> Squid Cache: Version 3.0.STABLE8
>> configure options: '--target' 'i586-mandriva-linux-gnu'
> '--program-prefix='
>> '--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/sbin'
>> '--sbindir=/usr/sbin' '--sysconfdir=/etc/squid' '--datadir=/usr/share'
>> '--includedir=/usr/include' '--libdir=/usr/lib'
>> '--libexecdir=/usr/lib/squid' '--localstatedir=/var'
>> '--sharedstatedir=/usr/com' '--mandir=/usr/share/man'
>> '--infodir=/usr/share/info' '--x-includes=/usr/X11R6/include'
>> '--x-libraries=/usr/X11R6/lib' '--enable-icap-support' '--enable-poll'
>> '--enable-snmp' '--enable-removal-policies=heap,lru'
>> '--enable-storeio=aufs,coss,diskd,ufs,null' '--enable-useragent-log'
>> '--enable-referer-log' '--enable-cachemgr-hostname=localhost'
>> '--enable-truncate' '--enable-underscores' '--enable-carp'
>> '--enable-async-io' '--enable-htcp' '--enable-delay-pools'
>> '--enable-linux-netfilter' '--enable-ssl' '--enable-arp-acl'
>> '--enable-auth=basic,digest,ntlm'
>>
> '--enable-basic-auth-helpers=multi-domain-NTLM,getpwnam,YP,SMB,PAM,NCSA,MSNT
>> ,LDAP' '--enable-ntlm-auth-helpers=SMB,fakeauth,no_check'
>> '--enable-digest-auth-helpers=password'
>> '--enable-external-acl-helpers=ip_user,ldap_group,unix_group,wbinfo_group'
>> '--disable-follow-x-forwarded-for' '--with-pthreads'
>> '--disable-dependency-tracking' '--disable-ident-lookups'
>> 'target_alias=i586-mandriva-linux-gnu'
>>
>>
>
>
Received on Tue Jul 22 2008 - 17:04:03 MDT

This archive was generated by hypermail 2.2.0 : Wed Jul 23 2008 - 12:00:05 MDT