[SQU] What is happening?

From: Matthias Barnutz <barney@dont-contact.us>
Date: Tue, 7 Nov 2000 02:02:47 +0100

Hi!

What is happening here? Why does Squid load exactly the same files multiple
times? The effect ist, that the byte hit ratio goes high into the negative
(around -200 or -300 %). How can I prevent this situation? Please help!

Look at this and watch out for the different downloads of those *.mpg files:

And afterward you can see a byte hit ratio of -423 %. What the hell is
this??? I thought Squid should save bandwith. But it seems to waste
bandwith. Please note, that a) there are no other neighbouring caches, and
b) the bandwith waste is reality, I can confirm it with measurements on the
routers.

Cache Manager menu

----------------------------------------------------------------------------

----
Active file descriptors:
File Type   Tout Nread  * Nwrite * Remote Address        Description
---- ------ ---- -------- -------- --------------------- -------------------
-----------
   0 Log       0       0        0                        stdin
   1 Log       0       0        0                        stdout
   2 Log       0       0        0                        stderr
   3 Log       0       0        0
/var/squid/logs/cache.log
   5 Socket    0 3788998   767110  .0                    DNS Socket
   6 File      0       0  51361759
/var/squid/logs/access.log
   7 Socket    0       0*       0  .0                    HTTP Socket
   8 Socket 1438     253*     349  129.217.240.22.2908
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
   9 Socket    0  298768  25710886  127.0.0.1.2026        squidGuard #1
  10 Socket    0   36847  3098690  127.0.0.1.2028        squidGuard #2
  11 Socket    0   10464   865984  127.0.0.1.2030        squidGuard #3
  12 Socket    0    3111   255774  127.0.0.1.2032        squidGuard #4
  13 Socket    0     993    82885  127.0.0.1.2034        squidGuard #5
  14 Socket    0     451    37798  127.0.0.1.2036        squidGuard #6
  15 Socket    0     239    19521  127.0.0.1.2038        squidGuard #7
  16 Socket    0     141    12169  127.0.0.1.2040        squidGuard #8
  17 Pipe      0       0        0                        unlinkd -> squid
  18 Socket    0      82     6869  127.0.0.1.2042        squidGuard #9
  19 Socket    0      49     4390  127.0.0.1.2044        squidGuard #10
  20 Pipe      0       0        0                        squid -> unlinkd
  21 File      0       0  6118176
/var/squid/cache/swap.state
  22 Socket 1439     251*       0  129.217.240.22.2945
http://128.206.177.86/files/Dark%20Angel/DA1x03.mpg
  23 Socket    1     387*    2469  129.217.240.114.2919  Reading next
request
  24 Socket    1     251*    4690  129.217.240.186.1677  Reading next
request
  25 File      0       0  2209776
/var/squid/cache2/swap.state
  26 Socket 1438     252*     348  129.217.240.22.2906
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
  27 Socket 1439     251*       0  129.217.240.22.2943
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  28 Socket    1     753*    1263  129.217.241.195.4146  Reading next
request
  29 Socket 1421     248* 12882269  129.217.240.22.2519
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  30 Socket 1439     251*       0  129.217.240.22.2944
http://128.206.177.86/files/Dark%20Angel/DA1x03.mpg
  31 Socket   15  547069*     692  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
  32 Socket    1    1893*   17781  129.217.240.186.1633  Reading next
request
  33 Socket 1439     251*       0  129.217.240.22.2946
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  34 Socket   14       0*     688  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x03.mpg
  35 Socket   14       0*     688  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  36 Socket   15 13018822*     688  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  37 Socket   15       0*     688  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x03.mpg
  38 Socket    1       0        0* 128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  39 Socket    0    1284*    3013  129.217.240.191.1319
152.163.243.121:5190
  40 Socket 1439     251*       0  129.217.240.22.2947
http://128.206.177.86/files/Dark%20Angel/DA1x03.mpg
  41 Socket   15  217731*     692  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
  42 Socket    1       0        0* 128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x03.mpg
  43 Socket 1439     250*       0  129.217.240.22.2948
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  44 Socket 1439     579        0  129.217.241.147.2055
http://praline.novia.net/engine/gab.cgi
  45 Socket    1       0        0* 216.40.15.244.80
http://praline.novia.net/engine/gab.cgi
  46 Socket    1       0        0* 128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  47 Socket   15 247381111*     692  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x01-2.mpg
  48 Socket    0    2974*    1100  152.163.243.121.5190
152.163.243.121:5190
  49 Socket 1440      89*       0  129.217.240.1.2693
cache_object://proxy.nef.wh.uni-dortmund.de/filedescriptors
  50 Socket    1   22448*  110776  129.217.240.102.4167  Reading next
request
  52 Socket 1438     252*     348  129.217.240.22.2907
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
  53 Socket 1438     253*     348  129.217.240.22.2905
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
  61 Socket    1     632*     443  129.217.241.148.2313  Reading next
request
  66 Socket    1     623*     443  129.217.241.148.2314  Reading next
request
  67 Socket    1     522*   29480  129.217.240.186.1602  Reading next
request
  68 Socket   15  506107*     692  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
  70 Socket    1    1349*     888  129.217.240.22.2925   Reading next
request
  71 Socket   15 10625295*     688  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x03.mpg
  74 Socket    1     267*    3816  129.217.240.186.1620  Reading next
request
  75 Socket    1     888*     664  129.217.240.22.2924   Reading next
request
  76 Socket    0    1782*   87445  129.217.240.77.1175   Reading next
request
  77 Socket    1     258*   29144  129.217.240.186.1605  Reading next
request
  78 Socket   15  453753*     692  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
  79 Socket    1    2292*    6636  129.217.240.186.1674  Reading next
request
  80 Socket    1     236*   13573  129.217.240.186.1635  Reading next
request
  81 Socket    1     321*     221  129.217.240.22.2931   Reading next
request
  83 Socket    1     360*     208  129.217.240.22.2932   Reading next
request
  84 Socket 1439     251*       0  129.217.240.22.2933
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  85 Socket    1     234*   18096  129.217.240.186.1636  Reading next
request
  86 Socket    1     264*    2225  129.217.240.186.1631  Reading next
request
  87 Socket    1     257*   11460  129.217.240.186.1609  Reading next
request
  88 Socket    1     264*    3645  129.217.240.186.1610  Reading next
request
  89 Socket   14       0*     688  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x04.mpg
  90 Socket    1     264*    3883  129.217.240.186.1611  Reading next
request
  91 Socket    1     264*    4488  129.217.240.186.1612  Reading next
request
  92 Socket 1424     248* 10105178  129.217.240.22.2607
http://128.206.177.86/files/Dark%20Angel/DA1x03.mpg
  93 Socket    1    1014*     666  129.217.240.22.2926   Reading next
request
  94 Socket    1   67463*    9508  64.29.207.228.80      www.ontrack.com
idle connection
  95 Socket    1     433*     390  129.217.240.22.2937   Reading next
request
  96 Socket    1     233*    1230  129.217.240.186.1637  Reading next
request
  97 Socket    1  125355* 2153228  129.217.240.102.4065  Reading next
request
  98 Socket    1     387*    2466  129.217.240.114.2920  Reading next
request
  99 Socket    1     801*     373  129.217.240.186.1613  Reading next
request
 100 Socket    1     260*    3801  129.217.240.186.1614  Reading next
request
 101 Socket 1439     233*       0  129.217.240.186.1638
http://www.kiis.net/b3.gif
 102 Socket    1       0        0* 151.196.213.243.80
http://www.kiis.net/b3.gif
 103 Socket    1     260*    2730  129.217.240.186.1615  Reading next
request
 104 Socket    1     264*    3368  129.217.240.186.1616  Reading next
request
 105 Socket    1     234*    1766  129.217.240.186.1639  Reading next
request
 106 Socket    1    1011*   25880  129.217.240.114.2918  Reading next
request
 107 Socket    1     234*    1675  129.217.240.186.1640  Reading next
request
 108 Socket    1    4674*     760  61.129.64.153.80      www.netants.com
idle connection
 109 Socket    1     264*    4251  129.217.240.186.1618  Reading next
request
 110 Socket    1     233*    1958  129.217.240.186.1641  Reading next
request
 111 Socket    1     263*    8856  129.217.240.186.1619  Reading next
request
 112 Socket    1     676*     443  129.217.240.22.2927   Reading next
request
 113 Socket    1    2443*     664  129.217.240.186.1621  Reading next
request
 114 Socket    1     267*    3210  129.217.240.186.1622  Reading next
request
 115 Socket    1     233*    1839  129.217.240.186.1642  Reading next
request
 116 Socket    1     259*   16019  129.217.240.186.1623  Reading next
request
 117 Socket    1     474*    2267  129.217.240.186.1643  Reading next
request
 118 Socket    1     259*   16633  129.217.240.186.1624  Reading next
request
 119 Socket    1     364*   13103  129.217.240.22.2938   Reading next
request
 120 Socket    1     265*    3500  129.217.240.186.1625  Reading next
request
 121 Socket    1     267*    2967  129.217.240.186.1626  Reading next
request
 122 Socket    1     468*    5722  129.217.240.186.1644  Reading next
request
 123 Socket 1439     253*       0  129.217.240.22.2941
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
 124 Socket    1     265*    4149  129.217.240.186.1627  Reading next
request
 125 Socket   14       0*     692  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x01-1.mpg
 126 Socket    1     258*    6991  129.217.240.186.1628  Reading next
request
 128 Socket    1     267*    2871  129.217.240.186.1629  Reading next
request
 129 Socket    1     267*    2294  129.217.240.186.1630  Reading next
request
 130 Socket    1     582*    7815  129.217.241.148.2311  Reading next
request
 131 Socket    1     736*    1212  129.217.240.229.1388  Reading next
request
 132 Socket    1     394*     477  129.217.241.195.4147  Reading next
request
 133 Socket    1     301*   15071  129.217.240.186.1676  Reading next
request
 134 Socket    1     379*    3290  129.217.240.114.2921  Reading next
request
 135 Socket    1     233*    1824  129.217.240.186.1646  Reading next
request
 137 Socket    1     234*    1786  129.217.240.186.1647  Reading next
request
 139 Socket    1     233*    1595  129.217.240.186.1648  Reading next
request
 140 Socket    1     233*    1636  129.217.240.186.1649  Reading next
request
 141 Socket    1     234*    1866  129.217.240.186.1650  Reading next
request
 142 Socket    1     233*    1359  129.217.240.186.1651  Reading next
request
 143 Socket   14 265858451*     688  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x03.mpg
 144 Socket    1     384*    1807  129.217.240.114.2922  Reading next
request
 146 Socket    1    2411*     976  64.29.207.228.80      www.ontrack.com
idle connection
 147 Socket    1    3235*     960  64.29.207.228.80      www.ontrack.com
idle connection
 148 Socket    1     238*    1319  129.217.240.186.1653  Reading next
request
 150 Socket    1     236*    1795  129.217.240.186.1654  Reading next
request
 151 Socket    1    1752*     970  64.29.207.228.80      www.ontrack.com
idle connection
 153 Socket    1     234*    1703  129.217.240.186.1655  Reading next
request
 155 Socket    1    2199*    1435  129.217.240.186.1657  Reading next
request
 156 Socket    1     604*   32585  129.217.240.186.1659  Reading next
request
 159 Socket    1     329*    1678  64.27.92.123.80       www14.brinkster.com
idle connection
 162 Socket    1     239*    3708  129.217.240.186.1665  Reading next
request
 167 Socket    1     801*     476  129.217.240.186.1668  Reading next
request
 168 Socket   14 269915843*     674  128.206.177.86.80
http://128.206.177.86/files/Dark%20Angel/DA1x01-2.mpg
 169 Socket    1     165*     908  64.27.92.123.80       www14.brinkster.com
idle connection
 171 Socket    1     312*     219  129.217.240.229.1390  Reading next
request
 173 Socket    1     164*     908  64.27.92.123.80       www14.brinkster.com
idle connection
 177 Socket    1     165*     906  64.27.92.123.80       www14.brinkster.com
idle connection
----------------------------------------------------------------------------
----
Generated Tue, 07 Nov 2000 00:45:52 GMT, by
cachemgr.cgi/2.3.STABLE4@emil.nef.wh.uni-dortmund.de
Cache Manager menu
----------------------------------------------------------------------------
----
Squid Object Cache: Version 2.3.STABLE4
Start Time: Thu, 02 Nov 2000 22:28:15 GMT
Current Time: Tue, 07 Nov 2000 00:56:43 GMT
Connection information for squid:
 Number of clients accessing cache: 320
 Number of HTTP requests received: 1298217
 Number of ICP messages received: 0
 Number of ICP messages sent: 0
 Number of queued ICP replies: 0
 Request failure ratio:  0.00%
 HTTP requests per minute: 219.7
 ICP messages per minute: 0.0
 Select loop called: 20459410 times, 17.327 ms avg
Cache information for squid:
 Request Hit Ratios: 5min: 43.1%, 60min: 32.4%
 Byte Hit Ratios: 5min: -423.7%, 60min: -271.9%
 Storage Swap size: 2972647 KB
 Storage Mem size: 16384 KB
 Storage LRU Expiration Age:   3.46 days
 Mean Object Size: 11.09 KB
 Requests given to unlinkd: 336332
Median Service Times (seconds)  5 min    60 min:
 HTTP Requests (All):   0.46965  0.68577
 Cache Misses:          1.05672  1.11539
 Cache Hits:            0.01745  0.01745
 Near Hits:             1.05672  0.80651
 Not-Modified Replies:  0.00865  0.01164
 DNS Lookups:           0.00094  0.21305
 ICP Queries:           0.00000  0.00000
Resource usage for squid:
 UP Time: 354508.366 seconds
 CPU Time: 15118.340 seconds
 CPU Usage: 4.26%
 CPU Usage, 5 minute avg: 5.09%
 CPU Usage, 60 minute avg: 5.41%
 Maximum Resident Size: 0 KB
 Page faults with physical i/o: 343923
Memory usage for squid via mallinfo():
 Total space in arena:   54438 KB
 Ordinary blocks:        50832 KB   2322 blks
 Small blocks:               0 KB      0 blks
 Holding blocks:           500 KB      2 blks
 Free Small blocks:          0 KB
 Free Ordinary blocks:    3605 KB
 Total in use:           51332 KB 94%
 Total free:              3605 KB 7%
Memory accounted for:
 Total accounted:        41695 KB
File descriptor usage for squid:
 Maximum number of file descriptors:   1024
 Largest file desc currently in use:    168
 Number of file desc currently in use:   51
 Files queued for open:                   0
 Available number of file descriptors:  973
 Reserved number of file descriptors:   100
 Store Disk files open:                   0
Internal Data Structures:
 268118 StoreEntries
   3345 StoreEntries with MemObjects
   3337 Hot Object Cache Items
 268005 Filemap bits set
 268005 on-disk objects
----------------------------------------------------------------------------
----
Generated Tue, 07 Nov 2000 00:56:43 GMT, by
cachemgr.cgi/2.3.STABLE4@emil.nef.wh.uni-dortmund.de
Thanks for your help!
Matthias
--
To unsubscribe, see http://www.squid-cache.org/mailing-lists.html
Received on Mon Nov 06 2000 - 18:06:37 MST

This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 16:56:15 MST