Dear Everyone,
It is now 12AM here (GMT +0600) and very peak time for our ISP. Most of our users are now online. I took a snapshot from my cachemgr to show you guys.
Squid Object Cache: Version 3.1.10
Start Time:Mon, 24 Jan 2011 13:58:44 GMT
Current Time:Mon, 24 Jan 2011 18:04:49 GMT
Connection information for squid:
Number of clients accessing cache: 570
Number of HTTP requests received: 1468986
Number of ICP messages received: 0
Number of ICP messages sent: 0
Number of queued ICP replies: 0
Number of HTCP messages received: 0
Number of HTCP messages sent: 0
Request failure ratio: 0.00
Average HTTP requests per minute since start: 5969.4
Average ICP messages per minute since start: 0.0
Select loop called: 36711620 times, 0.402 ms avg
Cache information for squid:
Hits as % of all requests: 5min: 35.1%, 60min: 35.6%
Hits as % of bytes sent: 5min: 25.6%, 60min: 31.4%
Memory hits as % of hit requests: 5min: 4.5%, 60min: 3.9%
Disk hits as % of hit requests: 5min: 63.3%, 60min: 65.4%
Storage Swap size: 142110940 KB
Storage Swap capacity: 90.0% used, 10.0% free
Storage Mem size: 152228 KB
Storage Mem capacity: 100.1% used, 0.0% free
Mean Object Size: 18.00 KB
Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
HTTP Requests (All): 0.44492 0.44492
Cache Misses: 0.76407 0.80651
Cache Hits: 0.01309 0.01745
Near Hits: 0.35832 0.37825
Not-Modified Replies: 0.00000 0.00000
DNS Lookups: 0.06963 0.09971
ICP Queries: 0.00000 0.00000
Resource usage for squid:
UP Time: 14765.225 seconds
CPU Time: 2012.280 seconds
CPU Usage: 13.63%
CPU Usage, 5 minute avg: 14.37%
CPU Usage, 60 minute avg: 15.29%
Process Data Segment Size via sbrk(): 1778280 KB
Maximum Resident Size: 7213216 KB
Page faults with physical i/o: 3
Memory usage for squid via mallinfo():
Total space in arena: 1778412 KB
Ordinary blocks: 1750711 KB 20784 blks
Small blocks: 0 KB 0 blks
Holding blocks: 44844 KB 13 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 27700 KB
Total in use: 1795555 KB 98%
Total free: 27700 KB 2%
Total size: 1823256 KB
Memory accounted for:
Total accounted: 1325755 KB 73%
memPool accounted: 1325755 KB 73%
memPool unaccounted: 497500 KB 27%
memPoolAlloc calls: 373493434
memPoolFree calls: 375838488
File descriptor usage for squid:
Maximum number of file descriptors: 65535
Largest file desc currently in use: 4467
Number of file desc currently in use: 3790
Files queued for open: 0
Available number of file descriptors: 61745
Reserved number of file descriptors: 100
Store Disk files open: 60
Internal Data Structures:
7896282 StoreEntries
16070 StoreEntries with MemObjects
15496 Hot Object Cache Items
7895225 on-disk objects
Please see and check if there is anything which is not NORMAL, or might be reason for problems discussed below.
Regards
Saiful
----------------------------------------
> From: saifulmr_at_hotmail.com
> To: squid-users_at_squid-cache.org
> Subject: RE: [squid-users] Some pages loading very slow in 3.1.10 Stable
> Date: Tue, 25 Jan 2011 05:00:30 +1100
>
>
> Hi Amor,
> I have recompiled Squid with the following parameters.
>
> ./configure --prefix=/usr/local/squid --enable-async-io=8 --enable-storeio="ufs,aufs,diskd" --enable-removal-policies="lru,heap" --enable-delay-pools --enable-cache-digests --enable-underscores --enable-icap-client --enable-follow-x-forwarded-for --enable-arp-acl --enable-esi --enable-zph-qos --disable-translation --with-large-files --with-filedescriptors=65536 --disable-ipv6 --enable-linux-netfilter
>
> DISK I/O is just like before, on average 5% I would say.
> I am using the default removal policy, not heap.
>
> Well after recompiling it, I can see the Median DNS Lookup time reduced by 10 times are the browsing experience is improved than before. Thank you for that. But those two domains i.e www.music.com.bd and www.djmaza.com problem is not solved. I cannot determine exactly what is stopping it to load the site fast, indeed it loads may be 10 minutes later. To my (amateur) understanding, the problem is with the ads.clicksor.com and the facebook widgets it tries to load, but I am not 100% sure.
>
> Can anyone try to load the site again and see if the problem persists, or how should I exempt those URLs from being caching.
>
> I think the URLS are :-
> 1) http://ads.clicksor.com/showAd.php?pid=102683&adtype=1&sid=152482&zone=
> 2) http://ads.clicksor.com/showAd.php?pid=102683&adtype=9&sid=152482&zone=
> 3) http://www.facebook.com/ajax/connect/activity_widget.php?__a=1&site=www.music.com.bd&width=350&height=225&header=false&colorscheme=light&border_color=%23006a4e&post_form_id=7c21c99b9bd83930bb871649bf465fcf&user=505688880&nb_activities=5&newest=0
>
> URL 3 waiting time sometimes goes more than 800ms. Please advise.
>
> Regards,
> Shishir
>
>
> ----------------------------------------
> > Date: Tue, 25 Jan 2011 01:33:10 +1300
> > From: squid3_at_treenet.co.nz
> > To: squid-users_at_squid-cache.org
> > Subject: Re: [squid-users] Some pages loading very slow in 3.1.10 Stable
> >
> > On 24/01/11 23:09, Michael Hendrie wrote:
> > >
> > > On 24/01/2011, at 8:17 PM, Saiful Alam wrote:
> > >
> > >>
> > >> OK I have kept your suggestion in my mind, but right now I'm not in
> > >> a position to buy two HDD's. May be I can afford to buy 15 days
> > >> later. For the time being, my prime problem is the loading of two
> > >> major sites from where my users download mp3. Those are
> > >>
> > >> www.music.com.bd and www.djmaza.com
> > >>
> > >
> > > Seems to load fine for me but that doesn't mean your slow = my fine.
> > >
> > > I had issues with some random sites being "slow" with 3.1.10 and
> > > tracked it down to squid trying to get AAAA records for the problem
> > > sites (or objects pulled from other sites). Not sure why this was
> > > occurring as IPv6 is not enabled on the OS. I didn't investigate too
> > > much and just recompiled with --disable-ipv6 as it wasn't needed.
> > > Doing so resolved my slow sites issue.
> > >
> >
> > Seems like you actually had IPv6 partially enabled in the OS, and maybe
> > a break in DNS or MTU.
> >
> > When Squid 3.1.10 starts up it probes the OS network capabilities to see
> > if IPv6 connections can be made. When they are possible it enables
> > things like AAAA to use those connections. --disable-ipv6 merely sets
> > the result of that test to always be false.
> >
> > With a reasonably fast DNS response time (under a half second) AAAA
> > lookups will not be noticeable.
> >
> > With working MTU there will be almost zero lag from opening and
> > attempting IPv6 connections on an IPv4-only network.
> >
> > >
> > >> Don't know the reason, but music.com.bd loads very slow. And in
> > >> firebug i see that the problem persists while loading 3 ads from
> > >> ads.clicksor.com and some facebook widgets. Can you please check
> >
> > There you have the problem by the looks of it.
> >
> > Ad servers are very bad for being slow. They usually do a lot of
> > processing or slow operations in the background before replying. Due to
> > their tracking desires they do not permit proxies to cache and speed up
> > their results. Some are more noticeable than others.
> >
> > Facebook is designed in a similar way which also suffers from these
> > heavy processing delay problems on the APIs. But they do seem to be
> > emitting useful cache controls on the static bits to avoid that.
> >
> > You have a choice:
> > put up with it
> > or
> > block those URL from being fetched.
> >
> > >> and try to load these two domains if you're running a Squid 3.1.X
> > >> version and see if everything is alright from your end.
> > >>
> >
> > Amos
> > --
> > Please be using
> > Current Stable Squid 2.7.STABLE9 or 3.1.10
> > Beta testers wanted for 3.2.0.4
>
Received on Mon Jan 24 2011 - 18:08:06 MST
This archive was generated by hypermail 2.2.0 : Tue Jan 25 2011 - 12:00:03 MST