Re: [squid-users] Diskd Message Queues and Shared memory for FreeBSD 6.x

From: Tek Bahadur Limbu <teklimbu@dont-contact.us>
Date: Fri, 10 Nov 2006 13:08:27 +0545

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello Alexandre and Adrian,

Actually, these are the requests of my Alteon load-balancer which is
used to divide the load among our dozen Squid proxy servers. But I
don't know why the Alteon load-balancer are sending those kind of
requests.

Adrian, I really want to thank you for your response on Diskd. I will
definitely go for AUFS rather than Diskd. However please note that we
are only using FreeBSD servers to run squid.

I have used the following options while compiling Squid-2.6 on
one of my FreeBSD 6.1 server.

 ./configure

 '--bindir=/usr/local/sbin' '--sysconfdir=/usr/local/etc/squid'
'--datadir=/usr/local/etc/squid'
'--libexecdir=/usr/local/libexec/squid'
'--localstatedir=/usr/local/squid' '--enable-removal-policies=lru heap'
'--enable-async-io' '--with-pthreads' '--enable-storeio=ufs diskd null
aufs' '--enable-delay-pools' '--enable-snmp' '--enable-carp'
'--enable-htcp' '--enable-auth=ntlm,basic' '--enable-cache-digests'
'--enable-underscores' '--enable-useragent-log' '--enable-async-io=48'
'--enable-time-hack' '--enable-arp-acl' '--enable-kqueue'
'--enable-poll' '--enable-select' '--enable-icp'
'--enable-pf-transparent' '--enable-ipf-transparent'
'--with-large-files' '--enable-large-cache-files'
'--enable-follow-x-forwarded-for' '--enable-ssl' '--prefix=/usr/local'
'amd64-portbld-freebsd6.1' 'build_alias=amd64-portbld-freebsd6.1'
'host_alias=amd64-portbld-freebsd6.1'
'target_alias=amd64-portbld-freebsd6.1'

Are there any errors and problems in my compilation?
Any help and suggestions will really be appreciated.


On Fri, 10 Nov 2006 03:09:48 -0300
"Alexandre Correa" <alexandre@sabbath.com.br> wrote:

> i received this message too... i think this is some P2P connections on
> users using port 80 (eg: emule configurated on port 80 to bypass
> protections) ...
>
>
>
> On 11/10/06, Tek Bahadur Limbu <teklimbu@wlink.com.np> wrote:
> > -----BEGIN PGP SIGNED MESSAGE-----
> > Hash: SHA1
> >
> >
> > Thank you very much to everybody for the information. I now know the
> > reason why Squid and the FreeBSD 6.1 box crashes every now and then
> > when I use aufs.
> >
> > I was using Diskd for the past 2 weeks but it caused the Squid
> > process to be zombie when the load goes above 100 requests/second.
> >
> > Also I don't see any kind of useful info on the cache.log when the
> > Squid process gets zombied except for:
> >
> > 2006/11/10 11:28:14| clientReadRequest: FD 142
> > Invalid Request
> > 2006/11/10 11:28:16| parseHttpRequest: Unsupported method 'aa
> > '
> > 2006/11/10 11:28:16| clientReadRequest: FD 253 (x.x.x.x:60181)
> > Invalid Request
> > 2006/11/10 11:28:18| parseHttpRequest: Unsupported method 'aa
> > '
> > 2006/11/10 11:28:18| clientReadRequest: FD 96 (x.x.x.x:60191)
> > Invalid Request
> > 2006/11/10 11:28:20| parseHttpRequest: Unsupported method 'aa
> >
> >
> > I will apply the patch for aufs in my FreeBSD 6.1 (amd 64 bit)
> > server tonight.
> >
> > For the time being, I will try to use ufs.
> >
> > By the way guys, I have these compiled in my FreeBSD 6.1 kernel:
> >
> >
> > options IPFIREWALL #firewall
> > options IPFIREWALL_VERBOSE #enable logging to
> > syslogd(8) options IPFIREWALL_FORWARD #enable
> > transparent proxy options IPFIREWALL_VERBOSE_LIMIT=1000
> > #limit verbosity options IPFIREWALL_FORWARD_EXTENDED
> > #all packet dest changes
> >
> > #DiskD Shared Memory and Message Queue
> > options MSGMAX=32768 (max characters in a message)
> > options MSGMNB=16384
> > options MSGMNI=41
> > options MSGSEG=2049
> > options MSGSSZ=64
> > options MSGTQL=2048
> > options SHMSEG=128
> > options SHMMNI=192
> > options SHMMAX=33554432
> > options SHMMIN=1
> > options SHMALL=8192
> > options MAXDSIZ=2147483648
> > options DFLDSIZ=536870912
> > options CPU_ENABLE_SSE
> > options UFS_DIRHASH
> > options KVA_PAGES=512
> >
> > #other settings (requires a lot of RAM)
> >
> > options MAXFILES=8192
> > options NMBCLUSTERS=32768
> >
> >
> > Please shed some light on this.
> >
> >
> > On Fri, 10 Nov 2006 13:05:06 +0800
> > Adrian Chadd <adrian@creative.net.au> wrote:
> >
> > > On Thu, Nov 09, 2006, Brett Glass wrote:
> > >
> > > > FreeBSD 5.x or higher panics when you attempt to use AUFS,
> > > > UNLESS you apply a very recent patch to the code involving
> > > > kqueues. (I believe that the patch will be in FreeBSD
> > > > 6.2-RELEASE but was not in FreeBSD 6.1-RELEASE.) I had to patch
> > > > the kernel manually to get Squid's AUFS code to work on a
> > > > client's system without crashing it. The patch can also be
> > > > applied to 5.x, I'm sure. See
> > > >
> > > > http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/103127
> > >
> > > Does that mean you're successfully running Squid under FreeBSD +
> > > AUFS?
> > >
> > >
> > >
> > >
> > > Adrian
> > >
> > >
> >
> >
> > - --
> >
> >
> > With best regards and good wishes,
> >
> > Yours sincerely,
> >
> > Tek Bahadur Limbu
> >
> > Jwl Systems Department
> >
> > Worldlink Communications Pvt. Ltd.
> >
> > -----BEGIN PGP SIGNATURE-----
> > Version: GnuPG v1.4.5 (FreeBSD)
> >
> > iD8DBQFFVBRhwXBzLfFnNxQRAsCYAKCdDNvSHDbbPXnboTO+/CmFbaPWtgCg4MZZ
> > vh7ctwUqYe1rM65b5oFNIUE=
> > =w0mu
> > -----END PGP SIGNATURE-----
> >
>
>


- --


With best regards and good wishes,

Yours sincerely,

Tek Bahadur Limbu

Jwl Systems Department

Worldlink Communications Pvt. Ltd.

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (FreeBSD)

iD8DBQFFVCjxwXBzLfFnNxQRAhf4AKDiNGHD9uwEHAs3jXMba6RZoTTWFwCgqhHv
+TFePuJQ0TUpIHQoGQmUuNY=
=8L4z
-----END PGP SIGNATURE-----
Received on Fri Nov 10 2006 - 00:23:49 MST

This archive was generated by hypermail pre-2.1.9 : Fri Dec 01 2006 - 12:00:03 MST