Re: Time for squid 3.0 STABLE2 ?

From: Amos Jeffries <squid3@dont-contact.us>
Date: Wed, 05 Mar 2008 00:58:43 +1300

Guido Serassio wrote:
> Hi Amos,
>
> At 11:35 01/03/2008, Amos Jeffries wrote:
>
>> The above is only solved by manually removing the swap.state file.
>> There is something funky going on with the permissions before these
>> high-level swap.state operations.
>> I've seen it here in HEAD and thought it in the code not ported back.
>>
>> This is a blocker if it's in 3.0.
>
> I think that here there is some Windows specific big problem. On
> Windows, when running as a service, there are no file permissions
> problems. I have just deleted the swap.state file, and after few
> requests ....
>
> 2008/03/01 12:36:02| setMaxFD: Cannot increase: setrlimit() not
> supported on this system
> 2008/03/01 12:36:02| Starting Squid Cache version 3.0.STABLE1-CVS for
> i686-pc-winnt...
> 2008/03/01 12:36:02| Running as Squid Windows System Service on Windows
> Server 2003
> 2008/03/01 12:36:02| Service command line is:
> 2008/03/01 12:36:02| Process ID 3232
> 2008/03/01 12:36:02| With 2048 file descriptors available
> 2008/03/01 12:36:02| With 2048 CRT stdio descriptors available
> 2008/03/01 12:36:02| Windows sockets initialized
> 2008/03/01 12:36:02| Performing DNS Tests...
> 2008/03/01 12:36:02| Successful DNS name lookup tests...
> 2008/03/01 12:36:02| DNS Socket created at 0.0.0.0, port 1194, FD 5
> 2008/03/01 12:36:02| Adding nameserver 172.30.128.1 from Registry
> 2008/03/01 12:36:02| Adding nameserver 172.30.1.1 from Registry
> 2008/03/01 12:36:02| Adding nameserver 172.30.1.2 from Registry
> 2008/03/01 12:36:02| User-Agent logging is disabled.
> 2008/03/01 12:36:02| Referer logging is disabled.
> 2008/03/01 12:36:02| Unlinkd pipe opened on FD 8
> 2008/03/01 12:36:02| Local cache digest enabled; rebuild/rewrite every
> 3600/3600 sec
> 2008/03/01 12:36:02| Store logging disabled
> 2008/03/01 12:36:02| Swap maxSize 102400 KB, estimated 7876 objects
> 2008/03/01 12:36:02| Target number of buckets: 393
> 2008/03/01 12:36:02| Using 8192 Store buckets
> 2008/03/01 12:36:02| Max Mem size: 8192 KB
> 2008/03/01 12:36:02| Max Swap size: 102400 KB
> 2008/03/01 12:36:02| Version 1 of swap file with LFS support detected...
> 2008/03/01 12:36:02| Rebuilding storage in c:/squid/var/cache (CLEAN)
> 2008/03/01 12:36:02| Using Least Load store dir selection
> 2008/03/01 12:36:02| Set Current Directory to c:/squid/var/cache
> 2008/03/01 12:36:02| Loaded Icons.
> 2008/03/01 12:36:02| Accepting HTTP connections at 0.0.0.0, port 3128,
> FD 14.
> 2008/03/01 12:36:02| Accepting ICP messages at 0.0.0.0, port 3130, FD 15.
> 2008/03/01 12:36:02| HTCP Disabled.
> 2008/03/01 12:36:02| Ready to serve requests.
> 2008/03/01 12:36:02| Done reading c:/squid/var/cache swaplog (138 entries)
> 2008/03/01 12:36:02| Finished rebuilding storage from disk.
> 2008/03/01 12:36:02| 138 Entries scanned
> 2008/03/01 12:36:02| 0 Invalid entries.
> 2008/03/01 12:36:02| 0 With invalid flags.
> 2008/03/01 12:36:02| 138 Objects loaded.
> 2008/03/01 12:36:02| 0 Objects expired.
> 2008/03/01 12:36:02| 0 Objects cancelled.
> 2008/03/01 12:36:02| 0 Duplicate URLs purged.
> 2008/03/01 12:36:02| 0 Swapfile clashes avoided.
> 2008/03/01 12:36:02| Took 0.08 seconds (1746.84 objects/sec).
> 2008/03/01 12:36:02| Beginning Validation Procedure
> 2008/03/01 12:36:02| Completed Validation Procedure
> 2008/03/01 12:36:02| Validated 301 Entries
> 2008/03/01 12:36:02| store_swap_size = 1508
> 2008/03/01 12:36:03| storeLateRelease: released 0 objects
> 2008/03/01 12:36:59| WARNING: Closing open FD 50
> 2008/03/01 12:36:59| diskHandleWrite: FD 11: disk write error: (9) Bad
> file descriptor
> 2008/03/01 12:36:59| storeDirWriteCleanLogs: Starting...
> 2008/03/01 12:36:59| WARNING: Closing open FD 9
> 2008/03/01 12:36:59| xrename: Cannot rename
> c:/squid/var/cache/swap.state.clean to c:/squid/var/cache/swap.state:
> (17) File exists
> 2008/03/01 12:36:59| Finished. Wrote 229 entries.
> 2008/03/01 12:36:59| Took 0.01 seconds (15266.67 entries/sec).
> FATAL: Write failure -- check your disk space and cache.log
> Squid Cache (Version 3.0.STABLE1-CVS): Terminated abnormally.
>
> Regards
>
> Guido
>

Two bugs in there. The FD issue seems to be Windows-Specific.

The swap.state one is wider. I've written it up as bug 2249
http://www.squid-cache.org/bugs/show_bug.cgi?id=2249

I've kicked off a clean build and test now on the 3.0 code to see if I
can reproduce it easily outside HEAD and since its more critical branch
at present.

It does not seem to be obliging. But don't have time to test properly
myself this week.

Amos

-- 
Please use Squid 2.6STABLE17+ or 3.0STABLE1+
There are serious security advisories out on all earlier releases.
Received on Tue Mar 04 2008 - 04:58:12 MST

This archive was generated by hypermail pre-2.1.9 : Tue Apr 01 2008 - 13:00:10 MDT