RE: [squid-users] Accelerator not Caching for specified times.

From: AJ Lemke <aj.lemke@dont-contact.us>
Date: Thu, 26 Jun 2003 09:27:02 -0500

Here is a snippet of the access.log.1:
xx.xxx.x.182 - - [24/Jun/2003:06:00:00 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 277 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Mon, 23 Jun 2003 13:30:51
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=343497;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=34440469; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [24/Jun/2003:06:15:00 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 277 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Mon, 23 Jun 2003 13:30:51
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=343497;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=34440469; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [24/Jun/2003:08:14:59 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 277 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Mon, 23 Jun 2003 13:30:51
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=343497;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=34440469; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [24/Jun/2003:09:29:58 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 419 TCP_MISS:DIRECT
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Tue, 24 Jun 2003 14:30:03
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=347386;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=79182654; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [24/Jun/2003:09:44:58 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 275 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Tue, 24 Jun 2003 14:30:03
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=347386;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=79182654; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [24/Jun/2003:09:59:58 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 276 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Tue, 24 Jun 2003 14:30:03
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=347386;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=79182654; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [24/Jun/2003:12:29:57 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 277 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Tue, 24 Jun 2003 14:30:03
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=347386;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=79182654; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]

Here is a snippet of the access.log.0:
xx.xxx.x.182 - - [25/Jun/2003:08:29:58 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 277 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Tue, 24 Jun 2003 14:30:03
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=347386;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=79182654; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [25/Jun/2003:08:44:58 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 277 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Tue, 24 Jun 2003 14:30:03
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=347386;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=79182654; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [25/Jun/2003:08:59:58 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 277 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Tue, 24 Jun 2003 14:30:03
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=347386;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=79182654; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [25/Jun/2003:10:14:57 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 420 TCP_MISS:DIRECT
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Wed, 25 Jun 2003 15:15:02
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=350394;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=90797320; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [25/Jun/2003:10:29:57 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 276 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Wed, 25 Jun 2003 15:15:02
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=350394;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=90797320; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [25/Jun/2003:10:44:57 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 277 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Wed, 25 Jun 2003 15:15:02
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=350394;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=90797320; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]
xx.xxx.x.182 - - [25/Jun/2003:14:14:55 -0500] "GET
http://www.someURL.com/timestamp.cfm HTTP/1.0" 200 278 TCP_MEM_HIT:NONE
[Host: www.someURL.com\r\nReferer:
http://www.someURL.com/\r\nUser-Agent: ColdFusion\r\n] [HTTP/1.1 200
OK\r\nServer: Microsoft-IIS/5.0\r\nDate: Wed, 25 Jun 2003 15:15:02
GMT\r\nContent-type: text/html\r\nPage-Completion-Status:
Normal\r\nPage-Completion-Status: Normal\r\nSet-Cookie: CFID=350394;
expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\nSet-Cookie:
CFTOKEN=90797320; expires=Sun, 27-Sep-2037 00:00:00 GMT; path=/; \r\n\r]

Refresh Pattern:
# www.someUrl.com 1 month
refresh_pattern -i www\.someUrl\.com 43200 20% 1440
ignore-reload
refresh_pattern -i someUrl\.com 43200 20% 1440
ignore-reload

Is there any other information that is needed to help diagnose why this
isn't caching for 1 month as specified?

Thanks for any help you can offer.

AJ

-----Original Message-----
From: Henrik Nordstrom [mailto:hno@squid-cache.org]
Sent: Thursday, June 19, 2003 2:15 PM
To: AJ Lemke; squid-users@squid-cache.org
Subject: Re: [squid-users] Accelerator not Caching for specified times.

Please extract a few lines of your access.log according to the
requirements outlined below.

Regards
Henrik

On Thursday 19 June 2003 19.03, AJ Lemke wrote:
> Here is the Refresh Pattern
> # www.someUrl.org 1 month
> refresh_pattern -i www\.someUrl3\.org 43200 20% 1440
> ignore-reload
> refresh_pattern -i someUrl3\.org 43200 20% 1440
> ignore-reload
>
> I have the logfile I have grepped out the www.someurl.com so only that

> record is returned. The access log is about a meg so I put it up on
> the web. http://Base1.securitylabs.com/access.txt
>
> -----Original Message-----
> From: Henrik Nordstrom [mailto:hno@squid-cache.org]
> Sent: Thursday, June 19, 2003 10:35 AM
> To: AJ Lemke; squid-users@squid-cache.org
> Subject: Re: [squid-users] Accelerator not Caching for specified
> times.
>
> On Thursday 19 June 2003 16.13, AJ Lemke wrote:
> > Just following up on this. I have not been able to solve this.
> > I have tried changing the cache time to lower values and the site
> > caches
> >
> > for the specified time. I start bringing the times up greater than
> > 4 hours and caching becomes irratic. I have it specified for 2 day
> > as of right now. It seems to caches for about 24-30 hours. There
> > seems to be no pattern to to the cache times.
> >
> > Any help would be appreciated.
>
> Please enable log_mime_hdrs and then show the request history of the
> URL in question, and your refresh_pattern settings.
>
> log_mime_hdrs allows us to see what is going on, but to gain an
> understanding some history of the object is needed
>
> 1) A initial TCP_MISS/TCP_REFRESH_MISS where the object got cached
> 2) Maybe some TCP_HIT [remove duplicates if there is many]
> 3) The next TCP_MISS/TCP_REFRESH_MISS where you think the object
> should have been a HIT..
>
> This can then be applied to rules about cachable request and your
> refresh_patterns to verify if the object should really have been a
> hit, or if there is a valid reason to why it was processed as a cache
> miss.
>
> Regards
> Henrik

-- 
Donations welcome if you consider my Free Squid support helpful.
https://www.paypal.com/xclick/business=hno%40squid-cache.org
If you need commercial Squid support or cost effective Squid or firewall
appliances please refer to MARA Systems AB, Sweden
http://www.marasystems.com/, info@marasystems.com
Received on Thu Jun 26 2003 - 08:27:34 MDT

This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 17:17:39 MST