Re: [squid-users] -k reconfigure to slow

From: Guido Marino Lorenzutti <glorenzutti_at_jusbaires.gov.ar>
Date: Wed, 04 Nov 2009 23:44:50 -0300

Amos Jeffries <squid3_at_treenet.co.nz> escribió:

> On Wed, 04 Nov 2009 16:39:08 -0300, Guido Marino Lorenzutti
> <glorenzutti_at_jusbaires.gov.ar> wrote:
>> Sorry, can't help you with the problem. But I have a question instead :)
>>
>> Where did you get the ip-user-helper.pl ?
>>
>> Tryin' to help... i have also 1k connections, squid 2.7 and it takes
>> that time too... i found that if i reduce the number of helpers it
>> starts up faster.
>>
>> I have 180 NTLM, 10 basic, and 75 squid_ldap_group childrens..
>> With less, it starts faster.
>>
>> If you do squid -k reconfigure and watch the proceess list, you will
>> see that the squid dosen't work until all the childrens are running...
>> it would be great that the squids starts as soon as ONE child per type
>> is running... or to have a minimum childrens, and a maximum childrens...
>
> Hmm, interesting idea that max/min. Thank you.
> I'm planning on some alterations for faster performance on helper
> startup/restart 'one day'.
>
> Amos

This would be GREAT. Imagine that if you can set a min/max you don't
have to restart to add more helpers, it would start up faster... uff..
sooo much better...

>
>>
>> Sorry for my english, never study :)
>>
>> Luis Daniel Lucio Quiroz <luis.daniel.lucio_at_gmail.com> escribió:
>>
>>> Le mardi 3 novembre 2009 22:50:58, Amos Jeffries a écrit :
>>>> Luis Daniel Lucio Quiroz wrote:
>>>> > HI squids,
>>>> >
>>>> > We have 2 squid server, one with load other with minimal (1-2
> users).
>>>> > After doing a -k reconfigure, the loaded server delays 40 seconds,
> but
>>>> > unloaded 2 seconds. Look:
>>>> >
>>>> > Unloaded:
>>>> > 2009/11/03 19:01:14| Processing Configuration File:
>>>> > /etc/squid/squid.conf
>>>> > (depth 0)
>>>> > 2009/11/03 19:01:14| Processing Configuration File:
>>>> > /etc/squid/squid.acl
>>>> > (depth 1)
>>>> > 2009/11/03 19:01:14| WARNING: HTTP requires the use of Via
>>>> > 2009/11/03 19:01:14| Initializing https proxy context
>>>> > 2009/11/03 19:01:14| Store logging disabled
>>>> > 2009/11/03 19:01:14| User-Agent logging is disabled.
>>>> > 2009/11/03 19:01:14| Referer logging is disabled.
>>>> > 2009/11/03 19:01:14| DNS Socket created at 0.0.0.0, port 49328, FD 8
>>>> > 2009/11/03 19:01:14| Adding nameserver 127.0.0.1 from
> /etc/resolv.conf
>>>> > 2009/11/03 19:01:14| Adding domain sat.gob.mx from /etc/resolv.conf
>>>> > 2009/11/03 19:01:14| Adding domain insys-corp.com.mx from
>>>> > /etc/resolv.conf 2009/11/03 19:01:14| helperOpenServers: Starting
>>>> > 32/32
>>>> > 'squidGuard' processes 2009/11/03 19:01:15| helperOpenServers:
>>>> > Starting
>>>> > 16/16 'digest_ldap_auth' processes
>>>> > 2009/11/03 19:01:15| helperOpenServers: Starting 32/32
>>>> > 'squid_ldap_group'
>>>> > processes
>>>> > 2009/11/03 19:01:15| helperOpenServers: Starting 32/32
>>>> > 'ip-user-helper.pl' processes
>>>>
>>>> Wow! thats a LOT of helper processes for 2 users.
>>>>
>>>> They start fast enough though.
>>>>
>>>> > 2009/11/03 19:01:16| Accepting HTTP connections at 0.0.0.0, port
>>>> > 3128,
>>>> > FD 57. 2009/11/03 19:01:16| Accepting ICP messages at 0.0.0.0, port
>>>> > 3130,
>>>> > FD 122. 2009/11/03 19:01:16| Accepting HTCP messages on port 4827,
> FD
>>>> > 123. 2009/11/03 19:01:16| Accepting SNMP messages on port 3401, FD
>>>> > 124.
>>>> >
>>>> > Loaded:
>>>> > 2009/11/03 18:59:05| Processing Configuration File:
>>>> > /etc/squid/squid.conf
>>>> > (depth 0)
>>>> > 2009/11/03 18:59:05| Processing Configuration File:
>>>> > /etc/squid/squid.acl
>>>> > (depth 1)
>>>> > 2009/11/03 18:59:05| WARNING: HTTP requires the use of Via
>>>> > 2009/11/03 18:59:05| Initializing https proxy context
>>>> > 2009/11/03 18:59:05| Store logging disabled
>>>> > 2009/11/03 18:59:05| User-Agent logging is disabled.
>>>> > 2009/11/03 18:59:05| Referer logging is disabled.
>>>> > 2009/11/03 18:59:05| DNS Socket created at 0.0.0.0, port 35507, FD 8
>>>> > 2009/11/03 18:59:05| Warning: Could not find any nameservers. Trying
>>>> > to
>>>> > use localhost
>>>> > 2009/11/03 18:59:05| Please check your /etc/resolv.conf file
>>>> > 2009/11/03 18:59:05| or use the 'dns_nameservers' option in
>>>> > squid.conf.
>>>>
>>>> Oops! major problem with DNS on this server.
>>>>
>>>> > 2009/11/03 18:59:05| helperOpenServers: Starting 32/32 'squidGuard'
>>>> > processes 2009/11/03 18:59:17| helperOpenServers: Starting 16/16
>>>> > 'digest_ldap_auth' processes
>>>> > 2009/11/03 18:59:23| helperOpenServers: Starting 32/32
>>>> > 'squid_ldap_group'
>>>> > processes
>>>> > 2009/11/03 18:59:34| helperOpenServers: Starting 32/32
>>>> > 'ip-user-helper.pl' processes
>>>> > 2009/11/03 18:59:47| Accepting HTTP connections at 0.0.0.0, port
>>>> > 3128,
>>>> > FD 57. 2009/11/03 18:59:47| Accepting ICP messages at 0.0.0.0, port
>>>> > 3130,
>>>> > FD 122. 2009/11/03 18:59:47| Accepting HTCP messages on port 4827,
> FD
>>>> > 123. 2009/11/03 18:59:47| Accepting SNMP messages on port 3401, FD
>>>> > 124.
>>>> > 2009/11/03 18:59:47| Pinger socket opened on FD 126
>>>> > 2009/11/03 18:59:47| Configuring Parent 127.0.0.1/8080/7
>>>> > 2009/11/03 18:59:47| Configuring Parent 10.10.50.232/8080/7
>>>> >
>>>> > I wonder to know if there is a way i can speed this up.
>>>>
>>>> An old rule-of-thumb in computing is to start with the first reported
>>>> problem and see how many of the following disappearr
>>>>
>>>> For you that is as Squid suggests "Please check your /etc/resolv.conf
>>>> file".
>>>>
>>>> The slow server seems to have no DNS servers available. This could be
>>>> causing any kind of problems for the helpers later on. All of the
> extra
>>>> delay is during the startup process of the helpers.
>>>>
>>>> Amos
>>>>
>>>
>>> You were right, I was missing DNS, whoever, look, delay is still slow.
>>> about
>>> 54 sec to reconfigure. What other think I may change. This is a
> loaded
>>> server, with about 1k connections.
>>>
>>> 2009/11/04 11:15:35| Reconfiguring Squid Cache (version
> 3.0.STABLE19)...
>>> 2009/11/04 11:15:35| FD 76 Closing HTTP connection
>>> 2009/11/04 11:15:35| FD 141 Closing ICP connection
>>> 2009/11/04 11:15:35| FD 142 Closing HTCP socket
>>> 2009/11/04 11:15:35| FD 143 Closing SNMP socket
>>> 2009/11/04 11:15:35| Processing Configuration File:
> /etc/squid/squid.conf
>>> (depth 0)
>>> 2009/11/04 11:15:35| Processing Configuration File:
>>> /etc/squid/squid.acl (depth
>>> 1)
>>> 2009/11/04 11:15:35| WARNING: HTTP requires the use of Via
>>> 2009/11/04 11:15:35| Initializing https proxy context
>>> 2009/11/04 11:15:35| Store logging disabled
>>> 2009/11/04 11:15:35| User-Agent logging is disabled.
>>> 2009/11/04 11:15:35| Referer logging is disabled.
>>> 2009/11/04 11:15:35| DNS Socket created at 0.0.0.0, port 60779, FD 8
>>> 2009/11/04 11:15:35| Adding nameserver 127.0.0.1 from squid.conf
>>> 2009/11/04 11:15:35| helperOpenServers: Starting 32/32 'squidGuard'
>>> processes
>>> 2009/11/04 11:15:51| helperOpenServers: Starting 16/16
> 'digest_ldap_auth'
>>> processes
>>> 2009/11/04 11:15:59| helperOpenServers: Starting 32/32
> 'squid_ldap_group'
>>> processes
>>> 2009/11/04 11:16:15| helperOpenServers: Starting 32/32
>>> 'ip-user-helper.pl'
>>> processes
>>> 2009/11/04 11:16:31| Accepting HTTP connections at 0.0.0.0, port
>>> 3128, FD 78.
>>> 2009/11/04 11:16:31| Accepting ICP messages at 0.0.0.0, port 3130, FD
>>> 143.
>>> 2009/11/04 11:16:31| Accepting HTCP messages on port 4827, FD 144.
>>> 2009/11/04 11:16:31| Accepting SNMP messages on port 3401, FD 391.
>>>
>
Received on Thu Nov 05 2009 - 02:45:07 MST

This archive was generated by hypermail 2.2.0 : Thu Nov 05 2009 - 12:00:03 MST