Re: Re: [squid-users] Cache url's with '?' question marks from Adrian Chadd on 2008-03-16 (squid-users)

From: Adrian Chadd <adrian@dont-contact.us>
Date: Sun, 16 Mar 2008 19:15:43 +0900

Erk, HTML email, thats not even done right! *smacks your client* :)

Uhm, start by looking at the header logging feature (mime_${SOMETHING} in squid.conf) to log
request and reply headers.

I'd then use those client requests to create test cases to feed to Squid.

Adrian

On Fri, Mar 14, 2008, Saul Waizer wrote:
> <HTML>
> Adrian,
> QUERY ACL has been removed for over a week, can you give me some pointers as far as looking at the MISSes
> Thanks! 
>
> 
>
> 
>
> 
>
> On Fri , Adrian Chadd <ADRIAN@CREATIVE.NET.AU>sent: 
>
> 
> <BLOCKQUOTE style="PADDING-RIGHT: 0px; PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #f5f5f5 2px solid; MARGIN-RIGHT: 0px">Caching dynamic content doesn't work "like that". 
>
> 
>
> Firstly, removing the QUERY ACL gives you the ability to cache dynamic 
>
> content that returned explicit lifetime. 
>
> 
>
> You need to look at all of those MISSes and see why Squid isn't caching 
>
> them. Its hard to tell from where I'm sitting. 
>
> 
>
> 
>
> 
>
> 
>
> Adrian 
>
> 
>
> 
>
> On Fri, Mar 14, 2008, Saul Waizer wrote: 
>
> > -----BEGIN PGP SIGNED MESSAGE----- 
>
> > Hash: SHA1 
>
> > 
>
> > Amos, 
>
> > 
>
> > I've implemented the example you sent on Dynamic Content but so far i 
>
> > regret to say that no improvement has been made on the hit ratio 
>
> > 
>
> > I added the following to my squid.conf 
>
> > 
>
> > refresh_pattern (/cgi-bin/|\?) 0 0% 0 
>
> > refresh_pattern . 0 20% 4320 
>
> > acl mydomain dstdomain .mydomain.com 
>
> > cache allow mydomain 
>
> > 
>
> > my stats look something like this: 
>
> > 
>
> > 67.5103% TCP_MISS/200 
>
> > 6.07349% TCP_HIT/200 
>
> > 4.55681% TCP_MEM_HIT/200 
>
> > 1.59761% TCP_IMS_HIT/304 
>
> > 
>
> > Any help is appreciated. 
>
> > 
>
> > Thanks 
>
> > 
>
> > 
>
> > 
>
> > Amos Jeffries wrote: 
>
> > > Adrian Chadd wrote: 
>
> > >> G'day, 
>
> > >> 
>
> > >> Just remove the QUERY ACL and the cache ACL line using "QUERY" in it. 
>
> > >> Then turn on header logging (log_mime_hdrs on) and see if the replies 
>
> > >> to the dynamically generated content is actually giving caching info. 
>
> > >> 
>
> > >> 
>
> > >> 
>
> > >> Adrian 
>
> > > 
>
> > > http://wiki.squid-cache.org/ConfigExamples/DynamicContent 
>
> > > 
>
> > > Amos 
>
> > > 
>
> > >> 
>
> > >> On Fri, Feb 29, 2008, Saul Waizer wrote: 
>
> > > Hello List, 
>
> > > 
>
> > > I am having problems trying to cache images*/content that comes from a 
>
> > > URL containing a question mark on it ('?') 
>
> > > 
>
> > > Background: 
>
> > > I am running squid Version 2.6.STABLE17 on FreeBSD 6.2 as a reverse 
>
> > > proxy to accelerate content hosted in America served in Europe. 
>
> > > 
>
> > > The content comes from an application that uses TOMCAT so a URL 
>
> > > requesting dynamic content would look similar to this: 
>
> > > 
>
> > > http://domain.com/storage/storage?fileName=/.domain.com-1/usr/14348/image/thumbnail/th_8837728e67eb9cce6fa074df7619cd0d193_1_.jpg 
>
> > > 
>
> > > 
>
> > > The result of such request always results on a MISS with a log similar 
>
> > > to this: 
>
> > > 
>
> > > TCP_MISS/200 8728 GET http://domain.com/storage/storage? - 
>
> > > FIRST_UP_PARENT/server_1 image/jpg 
>
> > > 
>
> > > I've added this to my config: acl QUERY urlpath_regex cgi-bin as you can 
>
> > > see bellow but it makes no difference and I tried adding this: 
>
> > > acl QUERY urlpath_regex cgi-bin \? and for some reason ALL requests 
>
> > > result in a MISS. 
>
> > > 
>
> > > Any help is greatly appreciated. 
>
> > > 
>
> > > My squid config looks like this: (obviously real ip's were changed) 
>
> > > 
>
> > > ################# STANDARD ACL'S ############################### 
>
> > > acl all src 0.0.0.0/0.0.0.0 
>
> > > acl manager proto cache_object 
>
> > > acl localhost src 127.0.0.1/255.255.255.255 
>
> > > acl to_localhost dst 127.0.0.0/8 
>
> > > ################# REVERSE CONFIG FOR SITE ##### 
>
> > > http_port 80 accel vhost 
>
> > > cache_peer 1.1.1.1 parent 80 0 no-query originserver name=server_1 
>
> > > acl sites_server_1 dstdomain domain.com 
>
> > > ################# REVERSE ACL'S FOR OUR DOMAINS ############## 
>
> > > acl ourdomain0 dstdomain www.domain.com 
>
> > > acl ourdomain1 dstdomain domain.com 
>
> > > http_access allow ourdomain0 
>
> > > http_access allow ourdomain1 
>
> > > http_access deny all 
>
> > > icp_access allow all 
>
> > > ################ HEADER CONTROL ############### 
>
> > > visible_hostname cacheA.domain.com 
>
> > > cache_effective_user nobody 
>
> > > forwarded_for on 
>
> > > follow_x_forwarded_for allow all 
>
> > > header_access All allow all 
>
> > > ############### SNMP CONTROL ############### 
>
> > > snmp_port 161 
>
> > > acl snmppublic snmp_community public1 
>
> > > snmp_access allow all 
>
> > > ############## CACHE CONTROL ################ 
>
> > > access_log /usr/local/squid/var/logs/access.log squid 
>
> > > acl QUERY urlpath_regex cgi-bin 
>
> > > cache_mem 1280 MB 
>
> > > cache_swap_low 95 
>
> > > cache_swap_high 98 
>
> > > maximum_object_size 6144 KB 
>
> > > minimum_object_size 1 KB 
>
> > > maximum_object_size_in_memory 4096 KB 
>
> > > cache_dir ufs /storage/ram_dir1 128 16 256 
>
> > > cache_dir ufs /storage/cache_dir1 5120 16 256 
>
> > > cache_dir ufs /storage/cache_dir2 5120 16 256 
>
> > > cache_dir ufs /storage/cache_dir3 5120 16 256 
>
> > > 
>
> > > Also here is the result of a custom script I made to parse the 
>
> > > access.log that will sort and display the top 22 responses so I can 
>
> > > compare them with cacti, I am trying to increase the Hit ratio but so 
>
> > > far is extremely low. 
>
> > > 
>
> > > 1 571121 69.3643% TCP_MISS/200 
>
> > > 2 98432 11.9549% TCP_HIT/200 
>
> > > 3 51590 6.26576% TCP_MEM_HIT/200 
>
> > > 4 47009 5.70938% TCP_MISS/304 
>
> > > 5 17757 2.15664% TCP_IMS_HIT/304 
>
> > > 6 11982 1.45525% TCP_REFRESH_HIT/200 
>
> > > 7 11801 1.43327% TCP_MISS/404 
>
> > > 8 6810 0.827095% TCP_MISS/500 
>
> > > 9 2508 0.304604% TCP_MISS/000 
>
> > > 10 1323 0.160682% TCP_MISS/301 
>
> > > 11 1151 0.139792% TCP_MISS/403 
>
> > > 12 1051 0.127647% TCP_REFRESH_HIT/304 
>
> > > 13 430 0.0522248% TCP_REFRESH_MISS/200 
>
> > > 14 127 0.0154245% TCP_CLIENT_REFRESH_MISS/200 
>
> > > 15 83 0.0100806% TCP_MISS/401 
>
> > > 16 81 0.00983769% TCP_CLIENT_REFRESH_MISS/304 
>
> > > 17 35 0.00425085% TCP_MISS/503 
>
> > > 18 20 0.00242906% TCP_DENIED/400 
>
> > > 19 19 0.00230761% TCP_HIT/000 
>
> > > 20 19 0.00230761% TCP_DENIED/403 
>
> > > 21 14 0.00170034% TCP_SWAPFAIL_MISS/200 
>
> > > 22 1 0.000121453% TCP_SWAPFAIL_MISS/30 
>
> > > 
>
> > > Thanks! 
>
> > > 
>
> > > 
>
> > > 
>
> > > 
>
> > >> 
>
> > 
>
> > -----BEGIN PGP SIGNATURE----- 
>
> > Version: GnuPG v1.4.6 (GNU/Linux) 
>
> > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org 
>
> > 
>
> > iD8DBQFH2ugEAcr37anguZsRAixSAJ9GioRmL42D1bOSVveMKYcpi21fygCfd4VP 
>
> > UMqi1CB3vQ5IeaTblK/vYQM= 
>
> > =6XUg 
>
> > -----END PGP SIGNATURE----- 
>
> 
>
> -- 
>
> - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support - 
>
> - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA - 
>
> 
>
> </BLOCKQUOTE> </HTML>

-- 
- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
- $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -

Received on Sun Mar 16 2008 - 04:00:20 MDT

This archive was generated by hypermail pre-2.1.9 : Tue Apr 01 2008 - 13:00:05 MDT