Hi there, can somebody suggest how should I provide more info?
at that time squid does not response to squidclient anymore.
Cheers.
On Mon, Jan 24, 2011 at 8:28 PM, Sunny <sunyucong_at_gmail.com> wrote:
> Hi there,
>
> since I upgraded to 3.1 (both .6 .9 and .10) have such problem.
>
> After I issue "squid3 -k shutdown", the squid will exit but the
> process won't stop after it clams "exit normally"
>
> The process will still use 100% cpu and network connections are not
> closed due to output of "netstat"
>
> root_at_cache-1:/tmp/squid-3.1.10/errors/zh-cn# ps aux | grep squid
> root 12557 0.0 0.0 32272 1180 ? Ss 19:56 0:00
> /usr/sbin/squid3 -YCF -f /etc/squid3/squid.conf
> proxy 12559 53.5 21.9 924084 889552 ? Rl 19:56 14:04
> (squid) -YCF -f /etc/squid3 squid.conf
> root 12691 11.0 0.0 8952 876 pts/0 S+ 20:22 0:00 grep
> --color=auto squid
>
>
> I'm running squid on a virtual machine ubuntu 10.04. Here attached the
> exiting log.
>
>
> 2011/01/24 20:18:08| Preparing for shutdown after 8692 requests
> 2011/01/24 20:18:08| Waiting 30 seconds for active connections to finish
> 2011/01/24 20:18:08| FD 11 Closing HTTP connection
> 2011/01/24 20:18:39| Shutting down...
> 2011/01/24 20:18:39| FD 12 Closing ICP connection
> 2011/01/24 20:18:39| FD 18 Closing SNMP socket
> 2011/01/24 20:18:39| Closing unlinkd pipe on FD 13
> 2011/01/24 20:18:39| storeDirWriteCleanLogs: Starting...
> 2011/01/24 20:18:40| 65536 entries written so far.
> 2011/01/24 20:18:41| 131072 entries written so far.
> 2011/01/24 20:18:42| 196608 entries written so far.
> 2011/01/24 20:18:43| 262144 entries written so far.
> 2011/01/24 20:18:44| 327680 entries written so far.
> 2011/01/24 20:18:45| 393216 entries written so far.
> 2011/01/24 20:18:47| 458752 entries written so far.
> 2011/01/24 20:18:49| 524288 entries written so far.
> 2011/01/24 20:18:50| 589824 entries written so far.
> 2011/01/24 20:18:52| 655360 entries written so far.
> 2011/01/24 20:18:54| 720896 entries written so far.
> 2011/01/24 20:18:56| 786432 entries written so far.
> 2011/01/24 20:18:57| 851968 entries written so far.
> 2011/01/24 20:18:59| 917504 entries written so far.
> 2011/01/24 20:19:01| 983040 entries written so far.
> 2011/01/24 20:19:03| 1048576 entries written so far.
> 2011/01/24 20:19:04| 1114112 entries written so far.
> 2011/01/24 20:19:06| 1179648 entries written so far.
> 2011/01/24 20:19:08| 1245184 entries written so far.
> 2011/01/24 20:19:10| 1310720 entries written so far.
> 2011/01/24 20:19:11| 1376256 entries written so far.
> 2011/01/24 20:19:13| 1441792 entries written so far.
> 2011/01/24 20:19:15| 1507328 entries written so far.
> 2011/01/24 20:19:17| 1572864 entries written so far.
> 2011/01/24 20:19:18| 1638400 entries written so far.
> 2011/01/24 20:19:20| 1703936 entries written so far.
> 2011/01/24 20:19:22| 1769472 entries written so far.
> 2011/01/24 20:19:23| 1835008 entries written so far.
> 2011/01/24 20:19:24| 1900544 entries written so far.
> 2011/01/24 20:19:26| 1966080 entries written so far.
> 2011/01/24 20:19:28| 2031616 entries written so far.
> 2011/01/24 20:19:29| 2097152 entries written so far.
> 2011/01/24 20:19:31| 2162688 entries written so far.
> 2011/01/24 20:19:33| 2228224 entries written so far.
> 2011/01/24 20:19:34| 2293760 entries written so far.
> 2011/01/24 20:19:36| 2359296 entries written so far.
> 2011/01/24 20:19:37| 2424832 entries written so far.
> 2011/01/24 20:19:39| 2490368 entries written so far.
> 2011/01/24 20:19:40| 2555904 entries written so far.
> 2011/01/24 20:19:41| 2621440 entries written so far.
> 2011/01/24 20:19:43| 2686976 entries written so far.
> 2011/01/24 20:19:44| 2752512 entries written so far.
> 2011/01/24 20:19:46| 2818048 entries written so far.
> 2011/01/24 20:19:47| 2883584 entries written so far.
> 2011/01/24 20:19:49| 2949120 entries written so far.
> 2011/01/24 20:19:50| 3014656 entries written so far.
> 2011/01/24 20:19:51| 3080192 entries written so far.
> 2011/01/24 20:19:52| 3145728 entries written so far.
> 2011/01/24 20:19:53| 3211264 entries written so far.
> 2011/01/24 20:19:54| 3276800 entries written so far.
> 2011/01/24 20:19:56| 3342336 entries written so far.
> 2011/01/24 20:19:57| 3407872 entries written so far.
> 2011/01/24 20:19:58| 3473408 entries written so far.
> 2011/01/24 20:19:59| 3538944 entries written so far.
> 2011/01/24 20:20:00| 3604480 entries written so far.
> 2011/01/24 20:20:01| 3670016 entries written so far.
> 2011/01/24 20:20:02| 3735552 entries written so far.
> 2011/01/24 20:20:04| 3801088 entries written so far.
> 2011/01/24 20:20:05| 3866624 entries written so far.
> 2011/01/24 20:20:06| 3932160 entries written so far.
> 2011/01/24 20:20:08| 3997696 entries written so far.
> 2011/01/24 20:20:09| 4063232 entries written so far.
> 2011/01/24 20:20:10| 4128768 entries written so far.
> 2011/01/24 20:20:11| 4194304 entries written so far.
> 2011/01/24 20:20:13| 4259840 entries written so far.
> 2011/01/24 20:20:14| 4325376 entries written so far.
> 2011/01/24 20:20:15| 4390912 entries written so far.
> 2011/01/24 20:20:17| Finished. Wrote 4452698 entries.
> 2011/01/24 20:20:17| Took 97.97 seconds (45450.00 entries/sec).
> CPU Usage: 682.340 seconds = 318.740 user + 363.600 sys
> Maximum Resident Size: 3468800 KB
> Page faults with physical i/o: 13
> Memory usage for squid via mallinfo():
> total space in arena: 845072 KB
> Ordinary blocks: 844827 KB 664 blks
> Small blocks: 0 KB 5 blks
> Holding blocks: 43556 KB 11 blks
> Free Small blocks: 0 KB
> Free Ordinary blocks: 244 KB
> Total in use: 888383 KB 105%
> Total free: 245 KB 0%
> 2011/01/24 20:20:17| Open FD UNSTARTED 8 DNS Socket IPv6
> 2011/01/24 20:20:17| Open FD READ/WRITE 9 DNS Socket IPv4
> 2011/01/24 20:20:17| Open FD UNSTARTED 12 ICP Socket
> 2011/01/24 20:20:17| Open FD UNSTARTED 18 SNMP Port
> 2011/01/24 20:20:17| Open FD READ/WRITE 22 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 23 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 24 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 26 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 27 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 28 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 29 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 30 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 32 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 34 Reading next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 36 profile.ak.fbcdn.net idle
> connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 37 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 40 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 41 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 43 1.31.channel.facebook.com
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 45 ent.hunantv.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 46 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 49 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 50 www.mitbbs.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 53 Reading next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 56 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 57 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 59 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 60 entimage.hunantv.com idle
> connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 61 entimage.hunantv.com idle
> connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 62 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 63 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 65 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 68 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 70 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 74 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 75 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 77 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 78 Waiting for next request
> 2011/01/24 20:20:17| Open FD READING 79 Reading next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 81
> http://01893758378.166.channel.facebook.com/x/2228217953/761686
> 2011/01/24 20:20:17| Open FD READ/WRITE 82 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 84 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 86 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 87 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 89 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 92 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 93 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 95 Waiting for next request
> 2011/01/24 20:20:17| Open FD WRITING 97 /mnt/spool2/00/4B/0000961F
> 2011/01/24 20:20:17| Open FD READ/WRITE 98 10.0.1.6 idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 99 photos-a.ak.fbcdn.net
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 100 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 101 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 103 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 106 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 108 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 109 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 112
> http://0.124.channel.facebook.com/x/659542725/3280603720/false/
> 2011/01/24 20:20:17| Open FD WRITING 113 /mnt/spool2/00/44/000089D8
> 2011/01/24 20:20:17| Open FD READ/WRITE 114 Waiting for next request
> 2011/01/24 20:20:17| Open FD WRITING 117
> http://0.37.channel.facebook.com/x/4239529040/2174762095/false/
> 2011/01/24 20:20:17| Open FD READ/WRITE 119 Reading next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 121 vthumb.ak.fbcdn.net idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 126 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 130 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 131 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 132 5.31.channel.facebook.com
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 133
> http://dl3.pornhost.com/files/33ffe96d04fc79f064550b9058fc848c/
> 2011/01/24 20:20:17| Open FD READ/WRITE 134 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 139 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 141 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 142 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 144 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 145 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 146 img.wonbao.net idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 147 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 149 Reading next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 151
> http://0782145705.74.channel.facebook.com/x/2780167499/68197858
> 2011/01/24 20:20:17| Open FD READ/WRITE 152 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 153 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 154 Reading next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 155 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 157 0.31.channel.facebook.com
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 158 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 161 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 162 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 163
> http://dl3.pornhost.com/files/2fd784e8702cf8f7a4885458e5d61c99/
> 2011/01/24 20:20:17| Open FD READ/WRITE 164 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 165 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 166 www.gutschein-codes.de
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 168 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 170 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 173 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 177 static.ak.fbcdn.net idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 180 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 181 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 182 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 184 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 190 www.mitbbs.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 191 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 192 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 193 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 195 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 196 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 200 2.31.channel.facebook.com
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 202 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 208 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 210 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 214 www.gutschein-codes.de
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 215 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 217 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 218 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 219
> 0.111.channel.facebook.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 224 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 225 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 226 photos-c.ak.fbcdn.net
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 227 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 228 4.31.channel.facebook.com
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 230 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 232 6.31.channel.facebook.com
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 233 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 234 photos-c.ak.fbcdn.net
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 235 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 238 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 240 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 241 cs1.hunantv.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 245 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 246 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 248 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 251 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 252 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 254 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 261 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 265 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 266 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 267 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 272 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 273 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 274
> 0.159.channel.facebook.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 276 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 277 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 278 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 279 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 280 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 283 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 285 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 289 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 291 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 292 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 294 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 296 cs1.hunantv.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 297 static.ak.fbcdn.net idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 299 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 302 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 304 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 306 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 307 photos-f.ak.fbcdn.net
> idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 308 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 310 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 311 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 312 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 314 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 315 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 316 10.0.1.6 idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 317 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 321 www.ijinshan.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 323 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 326 tj.aitongji.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 327 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 328 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 329 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 330 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 331 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 332 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 333 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 334 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 335 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 337 www.daohang365.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 342 Reading next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 343 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 345
> http://s1.ntdtv.com/flv/2011/1-25/flv5650396464a5fc1c531a94ac1a
> 2011/01/24 20:20:17| Open FD WRITING 346 /mnt/spool2/00/42/0000848D
> 2011/01/24 20:20:17| Open FD READ/WRITE 351 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 353 minigameimg.qq.com idle connection
> 2011/01/24 20:20:17| Open FD READ/WRITE 354 Waiting for next request
> 2011/01/24 20:20:17| Open FD READ/WRITE 357 Waiting for next request
> 2011/01/24 20:20:18| Squid Cache (Version 3.1.10): Exiting normally.
>
Received on Thu Jan 27 2011 - 10:14:20 MST
This archive was generated by hypermail 2.2.0 : Thu Jan 27 2011 - 12:00:03 MST