Extended Cache Statistics - A TERENA sponsored project
 


  • The project proposal - annex I to the contract.

  • Deliverable 1:
    • Initial phase (documentation: see table 1 below)
      Outline of the mandatory and extended set of data to obtain from a logfile.

  • Deliverable 2:
    • Implementation phase (documentation: see table 1 below)
      Deliverable 2 contains a short description of this early release of the seafood software. Seafood parses a Squid-2.2.STABLE4 log file and prints an output similar to that of calamaris. The documentation includes a compilation guide, a configuration guide, an installation guide, a short Q&A section, a to-do-list, and a list of deviations from the Deliverable D1 proposal.

      The documentation is also contained as PostScript and PDF in the software bundle, see table below. The software and accompanying tools are listed below.

  • Deliverable 3:
    • Database development phase (documentation: see table 1 below)
      Description of the database schema, the extensions to seafood and the database management scripts. A new version of seafood was released, please see the table below for the latest version.

  • Deliverable 4:
    • Web interface phase (documentation: see table 1 below)
      Implementation of a improved prototypical web interface to the database. Output is plotted with the help of a patched version of gnuplot, the patch is part of the source distribution.

  • Documentation:

Table 1: The Seafood Documentation
Date Documentation PDF PS Phase
12 Jan 00 14:57 Deliverable 4 119 KB 881 KB web interface to the DB
29 Oct 99 15:23 Deliverable 3 70 KB 194 KB Database design
03 Sep 99 14:12 Deliverable 2, Update 3 228 KB 443 KB Update on implementation
23 Aug 99 14:55 Deliverable 2, Update 2 208 KB 412 KB Update on implementation
20 Aug 99 17:30 Deliverable 2, Update 1 191 KB 386 KB Update on implementation
10 Aug 99 17:30 Deliverable 2, Original 191 KB 381 KB Implementation
10 Jun 99 15:16 Deliverable 1 48 KB 171 KB Initial phase

For a complete overview of the project and implementation, I suggest a reading of D1, D2.3, D3 and D4, in that order. Later documents will improve details mentioned in earlier ones.

  • Software:
    • The old software was slow, and not capable of parsing Squid-2 log files. Since it is discontinued, it will no longer be available from this location.
    • The Seafood software:

Table 2: The New Seafood Software
Date Software [KB] Remarks
02 Feb 01 12:12 Seafood V.010202 (1.16) 688 Snap shot for the interested user, uses bzip2 >= 1.0 with Linux.
01 Feb 01 13:20 Seafood V.010201 (1.14) 685 Snap shot for the interested user.
09 Aug 00 14:43 Seafood V.000807 (1.14) 625 Bug fixes to the complete rework in order to accomodate squid-internal objects (see below).

Please note that this is still a sneak-preview release. You will need to check your old seafood.conf against the new one for additional options and changed defaults! The Web-UI is not up to the new ingredients, and if you update your database, you will need to add two new tables.

28 Jul 00 17:49 irrhelper.cc (1.4) 13 There was a severe bug in the latest IRR helper supplied version. The helper contained experimental code which resulted in an all-MISS scenario. Please replace with this file.
27 Jul 00 09:45 Seafood V.000727 (1.14) 625 Complete rework in order to accomodate Squid-internal objects like cache digests and internal icons, since those objects will result in a more optimistic HIT-rate when counted as regular TCP payload traffic.

On popular demand, file-extensions are also accomodated now.

Please note that this is an intermediate sneak-preview release. You will need to check your old seafood.conf against the new one for additional options and changed defaults! The Web-UI is not up to the new ingredients, and if you update your database, you will need to add two new tables.

09 Jun 00 11:51 Seafood V.000609 624 Some fixes for FreeBSD, the latest gui changes.
12 Jan 00 15:06 Seafood V.000112 624 The final collection, fixed some bugs in the database design and database access.
24 Dec 99 12:15 Seafood V.991224 619 This is the christmas carol collection: Fixed nocious bug in database intermediate format generator which resulted in summary hierarchy numbers instead of the broken down ones. The database scripts are vastly improved, and a prototypical web interface is contained. Supported databases are Oracle 7+ and PostGreSQL 6.5+.
29 Nov 99 16:18 Seafood V.991129 613 Fixed bug in configuration aliasing which led to wrong results. Also introduced new configuration option to warn about NONE results which are (correctly) counted as TCP.
25 Nov 99 16:13 Seafood V.991125 600 Fixed bug in IRR cache algorithm which led to repeated look-ups for already known AS resolutions; and thus increased latency.
29 Oct 99 17:29 Seafood V.991029 600 Many bug fixes, GDBM database format for DNS and IRR helpers, added new output format for database input, to be parsed by a post processing script. Database management scripts are part of the software.

03 Sep 99 15:11 Seafood V.990903 570 Many bug fixes, new external DNS and IRR helper processes for an even speedier processing. You will need to remove your old DNS and IRR cache after an update (the cache file format changed).

23 Aug 99 15:51 Seafood V.990823 483 Bug fixes for the DNS and IRR caches.
20 Aug 99 16:45 Seafood V.990820 530 A later version with some bug fixes for Linux/glibc2.1, NDBM removed, external decompressor, etc. See contained CHANGELOG file. Also, the documentation contained within was updated accordingly.
16 Aug 99 15:10 seafood.conf 15 An update of the configuration file supplied with the sources, will be part of the next release. Contains tags for older versions of Squid, in particular contains tags from squid-2.2s4, 2.1p1, 2.0p2, and 1.NOVM.22. Fixes a spelling bug. Configures the DNS and IRR cache *not* to be used, so you can experience the raw performance.
10 Aug 99 13:31 Seafood V.990809 501 An early version of the software which is known to be compilable with g++ 2.8.1 using Linux and Solaris. Also known to be compilable by the native compilers of Irix and Solaris. You must use GNU make, GNU lex (flex) and GNU yacc (bison).

Some pieces of software necessary to run seafood successfully is mentioned in table 3. Also, you might want to have a look at PostGreSQL for a powerful freeware relational database which knows about 64 bit integers, or Oracle for an industrial strength database.
Table 3: Useful Software for the Build Process
Date Software [KB] Remarks
[an error occurred while processing this directive] GNU make 3.78.1 756 GNU make. Alternatively use a mirror near you.
[an error occurred while processing this directive] gdbm 1.8.0 131 GNU DBM. Alternatively use a mirror near you.
[an error occurred while processing this directive] gnuplot 3.7 1133 Gnuplot. Alternatively use the original site. The necessary patch is included in the Seafood software package.
[an error occurred while processing this directive] zlib 1.1.3 165 The ZLib compression library. Alternatively use the official site.
[an error occurred while processing this directive] bzip2 0.9.5d 451 The BZip2 compression library. Alternatively use the official site.
[an error occurred while processing this directive] bzip2 1.0.1 451 The BZip2 compression library. Alternatively use the official site.


cache-admins@rvs.uni-hannover.de