Re: [squid-users] High load server Disk problem

From: Robert Pipca <robertpipca_at_gmail.com>
Date: Wed, 18 Aug 2010 22:12:42 -0300

Hi,

2010/8/18 Jose Ildefonso Camargo Tolosa <ildefonso.camargo_at_gmail.com>:
> Yeah, I missed that last night (I was sleepy, I guess), thanks God you
> people are around!.  Still, he would need faster disk access, unless
> he is talking about 110Mbps (~12MB/s) instead of 110MB/s (~1Gbps).
>
> So, Robert, is that 110Mbps or 1Gbps?

We have 110Mbps of HTTP network traffic (the actual bandwidth is round
250Mbps, but I'm talking about HTTP only).

But aufs doesn't seem to behave that well. I have it with XFS mounted
with noatime. I ran "squid -z" on the aufs cache_dir to see if aufs
behaves better with less objects. It does, but I still get quite a lot
of these:

2010/08/18 21:22:20| squidaio_queue_request: WARNING - Disk I/O overloading
2010/08/18 21:22:35| squidaio_queue_request: WARNING - Disk I/O overloading
2010/08/18 21:22:35| squidaio_queue_request: Queue Length:
current=533, high=777, low=321, duration=20
2010/08/18 21:22:50| squidaio_queue_request: WARNING - Disk I/O overloading
2010/08/18 21:22:50| squidaio_queue_request: Queue Length:
current=669, high=777, low=321, duration=35
2010/08/18 21:23:05| squidaio_queue_request: WARNING - Disk I/O overloading
2010/08/18 21:23:05| squidaio_queue_request: Queue Length:
current=422, high=777, low=321, duration=50
2010/08/18 21:23:22| squidaio_queue_request: WARNING - Disk I/O overloading
2010/08/18 21:41:46| squidaio_queue_request: WARNING - Queue congestion

So, duration keeps growing....so the problem will occur again.

Now, it seems that COSS behaves very nicely.

I'd like to know if I can adjust the max-size option of coss, with
something like "--with-coss-membuf-size" ? Or is really hard-coded?

I use the aufs cache_dir to do youtube and windowsupdate caches. So if
I could increase max-size of the coss cache_dirs to around 100MB, I
could leave the aufs cache_dir to windowsupdate fles only (which are
around 300MB+). Is it possible?

Thanks,

- Robert
Received on Thu Aug 19 2010 - 01:12:48 MDT

This archive was generated by hypermail 2.2.0 : Thu Aug 19 2010 - 12:00:02 MDT