Welcome to my very quick squid page. I'm one of the squid committers and I'm also the mail postmaster in my spare time.

Here are some quick caching-related links that may be of interest (they are to me!)

• http://www.mnot.net/cache_docs/ - Mark Nottingham's tutorial for Web Authors and Webmasters
• http://research.compaq.com/wrl/techreports/abstracts/99.3.html - Research paper on Errors in timestamp-based HTTP header values (local pdf)
• http://www.hpl.hp.com/techreports/1999/HPL-1999-69.html - Enhancement and Validation of Squid's Cache Replacement Policy (local pdf)
• Dynamic Parallel Access to Replicated Content in the Internet - (local pdf)
• Asynchronous I/O Support in Linux 2.5 (Not quite 'caching', but interesting nonetheless) - (local pdf)
• dCache - the commodity cache (IEEE 2004) (local pdf)
• Improving Disk I/O Performance by using Raw Disk for Web Proxy Servers (link)

Here are some of the talks I've presented involving squid in the last couple of years.

• Nanog 17 - Distributed content caching in large networks
• Nanog 18 - Distributed content caching in large networks, part II
• UWA CIIPS / EE Department : Squid - the anatomy of an internet appliance
• Manchester Linux Users Group : Squid - the anatomy of an internet appliance (Note: there's a lot of slides here!)
• West Australian Internet Association meeting - Squid project update
• SAGE-AU WA talk - Squid
• SAGE-AU 2002 - Squid 2.5 tutorial - coming soon!
• SLUG talk - writing network servers

Cyclic FS work

The COSS improvements are now in Squid-2.6; It seems quite stable. Check it out! Note - use the latest 2.6 snapshot, not the latest release.

Some notes from a Squid-dev person circa 2001; the points are still valid but at least the code is stable. This has some profiling information from Steven Wilton showing COSS off in production.

• FreeBSD/Solaris: COSS code uses Posix AIO. FreeBSD users will need to load the vfs_aio module and may need to tweak the vfs options. Edit src/fs/coss/store_coss.h and comment out "#define USE_AUFSOPS" before building.
• Linux: the Posix AIO support in Linux is currently a bit lacking; edit src/fs/coss/store_coss.h and uncomment "#define USE_AUFSOPS".
• My configure line - I use Linux-2.6 and so I'll use epoll/threads. FreeBSD users shouldn't use the thread and epoll options. I use this configure line: env CFLAGS='-Wall -g' ./configure --prefix="/home/adrian/work/squid/run-coss" --enable-storeio="ufs aufs null coss" --enable-epoll --disable-poll --quiet --with-aufs-threads=16 --with-large-files --enable-large-cache-files
• Note the --with-large-files - you need this in order to use COSS effectively (spools > 2gig in size.)
• FreeBSD users: don't use 'aufs'; use 'diskd'
• COSS should be the FIRST set of cache_dir lines! If it can't put an object in a COSS filestore Squid will then try the next cache_dir entries in order. So have one or two COSS cache_dirs (with a max-objsize of 64-128k) and then an AUFS or DISKD store_dir to get the 'other' objects

Todo list

Its In the Wiki now.

IPv6 from Husni against Squdi-2.6.STABLE13 - tidied up - s26_s13_ipv6_1.diff

If you find anything that you think should be on here, you can email me at adrian@creative.net.au.