[squid-users] Squid 3.0 stable20 crash

From: Kingsley Foreman <kingsley_at_internode.com.au>
Date: Thu, 28 Jan 2010 22:49:19 +1030

I've been getting some crashes in squid, anything ranging from 1 per day to about 5

So far I have this information.

From debugging cache.log i've replaced the url's with ......

2010/01/28 22:35:08.202| clientPackMoreRanges: out: start: 1159767631 spec[0]: [0, 1159773605), len: 1159773605 debt: 5974
2010/01/28 22:35:08.202| clientStreamRead: Calling 1 with cbdata 0x7f7d1efd8620 from node 0xbdbf68
2010/01/28 22:35:08.202| store_client::copy: 239DA444F4446A2B976F900A9B348824, from 1159767896, for length 4096, cb 1, cbdata 0x7f7d1efd7568
2010/01/28 22:35:08.202| storeClientCopy2: 239DA444F4446A2B976F900A9B348824
2010/01/28 22:35:08.202| store_client::doCopy: co: 1159767896, hi: 1159773870
2010/01/28 22:35:08.202| store_client::doCopy: Copying normal from memory
2010/01/28 22:35:08.202| memCopy: [1159767896,1159771992)
2010/01/28 22:35:08.202| clientReplyContext::sendMoreData: http://........, 1159771992 bytes (4096 new bytes)
2010/01/28 22:35:08.202| clientReplyContext::sendMoreData: FD 20 'http://............out.offset=1159767631
2010/01/28 22:35:08.202| clientStreamCallback: Calling 1 with cbdata 0x7f7d1effb3f0 from node 0xbdbee8
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 5974
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 5974
2010/01/28 22:35:08.202| ClientSocketContext::canPackMoreRanges: returning 1
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 5974
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 5974
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 5974
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 5974
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 5974
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: was 5974 now 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| comm_write: FD 20: sz 4096: hndl 1: data 0x7f7d1effa388.
2010/01/28 22:35:08.202| commHandleWrite: FD 20: off 0, sz 4096.
2010/01/28 22:35:08.202| commHandleWrite: write() returns 4096
2010/01/28 22:35:08.202| commio_complete_callback: called for 20 (0, 11)
2010/01/28 22:35:08.202| comm_iocallbackpending: 0
2010/01/28 22:35:08.202| comm_calliocallback: 0
2010/01/28 22:35:08.202| comm_calliocallback: 0
2010/01/28 22:35:08.202| commio_call_callback: called for 20
2010/01/28 22:35:08.202| client_side.cc(1299) clientWriteBodyComplete schedules clientWriteComplete
2010/01/28 22:35:08.202| clientWriteComplete: FD 20, sz 4096, err 0, off 1159771997, len 0x7f7d1d8afa50
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| ClientSocketContext::canPackMoreRanges: returning 1
2010/01/28 22:35:08.202| ClientSocketContext::pullData: FD 20
2010/01/28 22:35:08.202| ClientSocketContext::getNextRangeOffset: http offset 1159771727
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| ClientSocketContext::canPackMoreRanges: returning 1
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| clientPackMoreRanges: in: offset: 1159771727
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| clientPackMoreRanges: out: start: 1159771727 spec[0]: [0, 1159773605), len: 1159773605 debt: 1878
2010/01/28 22:35:08.202| clientStreamRead: Calling 1 with cbdata 0x7f7d1efd8620 from node 0xbdbf68
2010/01/28 22:35:08.202| store_client::copy: 239DA444F4446A2B976F900A9B348824, from 1159771992, for length 4096, cb 1, cbdata 0x7f7d1efd7568
2010/01/28 22:35:08.202| storeClientCopy2: 239DA444F4446A2B976F900A9B348824
2010/01/28 22:35:08.202| store_client::doCopy: co: 1159771992, hi: 1159773870
2010/01/28 22:35:08.202| store_client::doCopy: Copying normal from memory
2010/01/28 22:35:08.202| memCopy: [1159771992,1159776088)
2010/01/28 22:35:08.202| clientReplyContext::sendMoreData: http://.........., 1159773870 bytes (1878 new bytes)
2010/01/28 22:35:08.202| clientReplyContext::sendMoreData: FD 20 'http://...... out.offset=1159771727
2010/01/28 22:35:08.202| clientStreamCallback: Calling 1 with cbdata 0x7f7d1effb3f0 from node 0xbdbee8
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| ClientSocketContext::canPackMoreRanges: returning 1
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 1878
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: was 1878 now 0
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 0
2010/01/28 22:35:08.202| HttpHdrRangeIter::debt: debt is 0
2010/01/28 22:35:08.202| comm_write: FD 20: sz 1878: hndl 1: data 0x7f7d1effa388.
2010/01/28 22:35:08.202| commHandleWrite: FD 20: off 0, sz 1878.
2010/01/28 22:35:08.202| commHandleWrite: write() returns 1878
2010/01/28 22:35:08.202| commio_complete_callback: called for 20 (0, 11)
2010/01/28 22:35:08.202| comm_iocallbackpending: 0
2010/01/28 22:35:08.202| comm_calliocallback: 0
2010/01/28 22:35:08.202| comm_calliocallback: 0
2010/01/28 22:35:08.202| commio_call_callback: called for 20
2010/01/28 22:35:08.202| client_side.cc(1299) clientWriteBodyComplete schedules clientWriteComplete
2010/01/28 22:35:08.202| clientWriteComplete: FD 20, sz 1878, err 0, off 1159773875, len 0x7f7d1d8afa50
2010/01/28 22:35:08.202| client_side_reply.cc(944) storeOKTransferDone out.offset=1159773605 objectLen()=1159773870 headers_sz=265
2010/01/28 22:35:08.202| clientReplyStatus: transfer is DONE
2010/01/28 22:35:08.202| clientReplyStatus: stream was not expected to complete!
2010/01/28 22:35:08.202| client_side.cc(1566) initiateClose: closing for STREAM_UNPLANNED_COMPLETE|STREAM_FAILED
2010/01/28 22:35:08.202| comm_close: FD 20
2010/01/28 22:35:08.202| commSetTimeout: FD 20 timeout -1
2010/01/28 22:35:08.202| commio_complete_callback: called for 20 (-10, 11)
2010/01/28 22:35:08.202| commio_call_callback: called for 20
2010/01/28 22:35:08.202| client_side.cc(2541) clientReadRequest FD 20 size 0
2010/01/28 22:35:08.202| commCallCloseHandlers: FD 20
2010/01/28 22:35:08.202| commCallCloseHandlers: ch->handler=1 data=0xbcb1c8
2010/01/28 22:35:08.202| ConnStateData::close: FD 20
2010/01/28 22:35:08.202| clientStreamDetach: Detaching node 0xbdbf68
2010/01/28 22:35:08.202| Freeing clientStreamNode 0xbdbf68
2010/01/28 22:35:08.202| clientStreamDetach: Calling 1 with cbdata 0x7f7d1efd8620
2010/01/28 22:35:08.202| clientStreamDetach: Detaching node 0xbdbee8
2010/01/28 22:35:08.202| Freeing clientStreamNode 0xbdbee8
2010/01/28 22:35:08.202| storeUnregister: called for '239DA444F4446A2B976F900A9B348824'
2010/01/28 22:35:08.202| storePendingNClients: returning 0
2010/01/28 22:35:08.202| StoreEntry::unlock: key '239DA444F4446A2B976F900A9B348824' count=1
2010/01/28 22:35:08.202| httpRequestFree: http://.....
2010/01/28 22:35:08.203| ACLChecklist::~ACLChecklist: destroyed 0xbe7dc8
2010/01/28 22:35:08.203| cleaning hdr: 0x2530eae0 owner: 3
2010/01/28 22:35:08.203| cleaning hdr: 0x2530eae0 owner: 3
2010/01/28 22:35:08.203| StoreEntry::unlock: key '239DA444F4446A2B976F900A9B348824' count=0
2010/01/28 22:35:08.203| storePendingNClients: returning 0
2010/01/28 22:35:08.203| UFSSwapDir::dereference: referencing 0x7f7d1d8afa50 1/4125
2010/01/28 22:35:08.203| HeapKeyGen_StoreEntry_LRU: 239DA444F4446A2B976F900A9B348824 heap_age=1.00 lastref=1264672683.00
2010/01/28 22:35:08.203| HeapKeyGen_StoreEntry_LRU: url=http://.........
2010/01/28 22:35:08.203| StoreEntry::purgeMem: Freeing memory-copy of 239DA444F4446A2B976F900A9B348824
2010/01/28 22:35:08.203| store.cc(378) destroyMemObject 0x1d3a9b10
2010/01/28 22:35:08.203| MemObject.cc(97) del MemObject 0x1d3a9b10

________________________________________________________________________________________
And a coredump

warning: Can not parse XML syscalls information; XML support was disabled at compile time.
GNU gdb (Gentoo 7.0 p2) 7.0
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-pc-linux-gnu".
For bug reporting instructions, please see:
<http://bugs.gentoo.org/>...
Reading symbols from /usr/sbin/squid...(no debugging symbols found)...done.
[New Thread 11449]
[New Thread 11450]
[New Thread 11448]
[New Thread 11451]
[New Thread 11452]
[New Thread 11455]
[New Thread 11458]
[New Thread 11459]
[New Thread 11456]
[New Thread 11480]
[New Thread 11467]
[New Thread 11453]
[New Thread 11454]
[New Thread 11462]
[New Thread 11493]
[New Thread 11469]
[New Thread 11457]
[New Thread 11487]
[New Thread 11473]
[New Thread 11461]
[New Thread 11472]
[New Thread 11463]
[New Thread 11508]
[New Thread 11470]
[New Thread 11460]
[New Thread 11503]
[New Thread 11478]
[New Thread 11474]
[New Thread 11464]
[New Thread 11509]
[New Thread 11471]
[New Thread 11465]
[New Thread 11501]
[New Thread 11506]
[New Thread 11485]
[New Thread 11477]
[New Thread 11468]
[New Thread 11500]
[New Thread 11475]
[New Thread 11466]
[New Thread 11496]
[New Thread 11505]
[New Thread 11486]
[New Thread 11479]
[New Thread 11497]
[New Thread 11489]
[New Thread 11476]
[New Thread 11490]
[New Thread 11510]
[New Thread 11492]
[New Thread 11481]
[New Thread 11499]
[New Thread 11498]
[New Thread 11483]
[New Thread 11484]
[New Thread 11488]
[New Thread 11507]
[New Thread 11494]
[New Thread 11482]
[New Thread 11502]
[New Thread 11495]
[New Thread 11491]
[New Thread 11511]
[New Thread 11504]

warning: Can't read pathname for load map: Input/output error.
Reading symbols from /lib/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /usr/lib/libssl.so.0.9.8...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libssl.so.0.9.8 Reading symbols from /usr/lib/libcrypto.so.0.9.8...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libcrypto.so.0.9.8 Reading symbols from /lib/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/librt.so.1
Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done.
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /lib/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libresolv.so.2
Reading symbols from /lib/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /usr/lib/gcc/x86_64-pc-linux-gnu/4.1.2/libstdc++.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/gcc/x86_64-pc-linux-gnu/4.1.2/libstdc++.so.6
Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.6
Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libz.so.1
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib/libnss_compat.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_compat.so.2 Reading symbols from /lib/libnss_nis.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_nis.so.2
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2 Reading symbols from /lib/libnss_dns.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_dns.so.2
Core was generated by `/usr/sbin/squid -NCd1 -f /etc/squid/squid-fe-8084.conf'.
Program terminated with signal 11, Segmentation fault.
#0 0x00000000004b2170 in ?? ()

(gdb) bt
#0 0x00000000004b2170 in ?? ()
#1 0x00000000004b2197 in ?? ()
#2 0x00000000004b2197 in ?? ()
#3 0x00000000004b2197 in ?? ()
#4 0x00000000004b2197 in ?? ()
#5 0x00000000004b2197 in ?? ()
#6 0x00000000004b2197 in ?? ()
#7 0x00000000004b2197 in ?? ()
#8 0x00000000004b2197 in ?? ()
#9 0x00000000004b2197 in ?? ()
#10 0x00000000004b2197 in ?? ()
#11 0x00000000004b2197 in ?? ()
#12 0x00000000004b2197 in ?? ()
#13 0x00000000004b2197 in ?? ()
#14 0x00000000004b2197 in ?? ()
#15 0x00000000004b2197 in ?? ()
#16 0x00000000004b2197 in ?? ()
#17 0x00000000004b2197 in ?? ()
#18 0x00000000004b2197 in ?? ()
#19 0x00000000004b2197 in ?? ()
#20 0x00000000004b2197 in ?? ()
#21 0x00000000004b2197 in ?? ()
#22 0x00000000004b2197 in ?? ()
#23 0x00000000004b2197 in ?? ()
#24 0x00000000004b2197 in ?? ()
#25 0x00000000004b2197 in ?? ()
#26 0x00000000004b2197 in ?? ()
#27 0x00000000004b2197 in ?? ()
#28 0x00000000004b2197 in ?? ()
#29 0x00000000004b2197 in ?? ()
#30 0x00000000004b2197 in ?? ()
#31 0x00000000004b2197 in ?? ()
#32 0x00000000004b2197 in ?? ()
#33 0x00000000004b2197 in ?? ()
#34 0x00000000004b2197 in ?? ()
#35 0x00000000004b2197 in ?? ()
#36 0x00000000004b2197 in ?? ()
#37 0x00000000004b2197 in ?? ()
#38 0x00000000004b2197 in ?? ()
#39 0x00000000004b2197 in ?? ()
#40 0x00000000004b2197 in ?? ()
#41 0x00000000004b2197 in ?? ()
#42 0x00000000004b2197 in ?? ()
#43 0x00000000004b2197 in ?? ()
#44 0x00000000004b2197 in ?? ()
#45 0x00000000004b2197 in ?? ()
#46 0x00000000004b2197 in ?? ()
#47 0x00000000004b2197 in ?? ()
#48 0x00000000004b2197 in ?? ()
#49 0x00000000004b2197 in ?? ()
#50 0x00000000004b2197 in ?? ()
#51 0x00000000004b2197 in ?? ()

Any suggestions would be great

Kingsley
Received on Thu Jan 28 2010 - 12:19:54 MST

This archive was generated by hypermail 2.2.0 : Thu Jan 28 2010 - 12:00:04 MST