03-07-2012 09:37 PM - edited 03-16-2019 10:00 AM
Anyone seen this core dump before on ccm process? Not finding any bugs that match on cisco / hot RSS feeds / etc yet. I know should probably do SU3 or latest 8.6, but wondering if anyone seen this before...
Syslogs at time of CCM service core dump. This was just before midnight when system use is low and there was nothing really going on, no backup active yet, etc. Traces gone from time of the dump.
Date: Mar 6 23:21:47
Machine Name: CCM
Severity: Critical
App ID: Cisco CallManager
Message: : 46640: CCM: Mar 07 2012 05:21:47.961 UTC : %UC_CALLMANAGER-2-CallManagerFailure: %[HostName=CCM][IPAddress=1.2.3.4][Reason=4][Text=][ClusterID=CCM-Cluster][NodeID=CCM]: Indicates an internal failure in Unified CM
Date: Mar 6 23:21:47
Machine Name: CCM
Severity: Critical
App ID: Cisco CallManager
Message: : 46641: CCM: Mar 07 2012 05:21:47.961 UTC : %UC_CALLMANAGER-2-CallManagerFailure: %[HostName=CCM][IPAddress=1.2.3.4][Reason=4][Text=CCM Intentional Abort: SignalName: StationInitKeepAliveTimeout, DestPID: StationInit[2:100:50:1]][ClusterID=CCM-Cluster][NodeID=CCM]: Indicates an internal failure in Unified CM
Core Dump Analysis:
Continue (y/n)?y
Using host libthread_db library "/lib/tls/libthread_db.so.1".
Core was generated by `/usr/local/cm/bin/ccm'.
Program terminated with signal 6, Aborted.
Reading symbols from /lib/csa/libcsa.so.6...done.
Loaded symbols for /lib/csa/libcsa.so.6
Reading symbols from /usr/local/cm/lib/libuuidpp.so...done.
Loaded symbols for /usr/local/cm/lib/libuuidpp.so
Reading symbols from /usr/local/cm/lib/libJNIPIWriter.so...done.
Loaded symbols for /usr/local/cm/lib/libJNIPIWriter.so
Reading symbols from /usr/local/cm/lib/libpcre.so.0...done.
Loaded symbols for /usr/local/cm/lib/libpcre.so.0
Reading symbols from /usr/local/cm/lib/libdbnotify.so...done.
Loaded symbols for /usr/local/cm/lib/libdbnotify.so
Reading symbols from /usr/local/cm/lib/libldap-2.4.so.2...done.
Loaded symbols for /usr/local/cm/lib/libldap-2.4.so.2
Reading symbols from /usr/local/cm/lib/liblber-2.4.so.2...done.
Loaded symbols for /usr/local/cm/lib/liblber-2.4.so.2
Reading symbols from /usr/local/cm/lib/libdbl.so...done.
Loaded symbols for /usr/local/cm/lib/libdbl.so
Reading symbols from /usr/local/cm/lib/libpreferences.so...done.
Loaded symbols for /usr/local/cm/lib/libpreferences.so
Reading symbols from /usr/local/cm/lib/libodbc++-mt.so.4...done.
Loaded symbols for /usr/local/cm/lib/libodbc++-mt.so.4
Reading symbols from /usr/local/cm/db/informix/lib/cli/libifdmr.so...done.
Loaded symbols for /usr/local/cm/db/informix/lib/cli/libifdmr.so
Reading symbols from /usr/local/cm/db/informix/lib/cli/libthcli.so...done.
Loaded symbols for /usr/local/cm/db/informix/lib/cli/libthcli.so
Reading symbols from /usr/local/cm/db/informix/lib/esql/libifgls.so...done.
Loaded symbols for /usr/local/cm/db/informix/lib/esql/libifgls.so
Reading symbols from /usr/local/cm/lib/libCryptoUtil.so...done.
Loaded symbols for /usr/local/cm/lib/libCryptoUtil.so
Reading symbols from /usr/local/cm/lib/libxerces-c.so.27...done.
Loaded symbols for /usr/local/cm/lib/libxerces-c.so.27
Reading symbols from /usr/local/platform/lib/libACE.so.5.5.1...done.
Loaded symbols for /usr/local/platform/lib/libACE.so.5.5.1
Reading symbols from /usr/local/cm/lib/libstlport.so.5.1...done.
Loaded symbols for /usr/local/cm/lib/libstlport.so.5.1
Reading symbols from /lib/libresolv.so.2...done.
Loaded symbols for /lib/libresolv.so.2
Reading symbols from /usr/local/cm/lib/libcurl.so.4...done.
Loaded symbols for /usr/local/cm/lib/libcurl.so.4
Reading symbols from /usr/lib/libz.so.1...done.
Loaded symbols for /usr/lib/libz.so.1
Reading symbols from /lib/libcap.so.1...done.
Loaded symbols for /lib/libcap.so.1
Reading symbols from /lib/libgcc_s.so.1...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/tls/libc.so.6...done.
Loaded symbols for /lib/tls/libc.so.6
Reading symbols from /lib/tls/libpthread.so.0...done.
Loaded symbols for /lib/tls/libpthread.so.0
Reading symbols from /lib/tls/libm.so.6...done.
Loaded symbols for /lib/tls/libm.so.6
Reading symbols from /lib/tls/librt.so.1...done.
Loaded symbols for /lib/tls/librt.so.1
Reading symbols from /lib/libdl.so.2...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/tls/libuuid.so.1...done.
Loaded symbols for /lib/tls/libuuid.so.1
Reading symbols from /usr/local/cm/db/informix/lib/esql/libifglx.so...done.
Loaded symbols for /usr/local/cm/db/informix/lib/esql/libifglx.so
Reading symbols from /lib/libcrypt.so.1...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /usr/lib/libstdc++.so.6...done.
Loaded symbols for /usr/lib/libstdc++.so.6
Reading symbols from /usr/lib/libidn.so.11...done.
Loaded symbols for /usr/lib/libidn.so.11
Reading symbols from /usr/lib/libgssapi_krb5.so.2...done.
Loaded symbols for /usr/lib/libgssapi_krb5.so.2
Reading symbols from /usr/lib/libkrb5.so.3...done.
Loaded symbols for /usr/lib/libkrb5.so.3
Reading symbols from /lib/libcom_err.so.2...done.
Loaded symbols for /lib/libcom_err.so.2
Reading symbols from /usr/lib/libk5crypto.so.3...done.
Loaded symbols for /usr/lib/libk5crypto.so.3
Reading symbols from /lib/ld-linux.so.2...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/libnss_files.so.2...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /usr/local/cm/db/informix/lib/esql/igo4a304.so...done.
Loaded symbols for /usr/local/cm/db/informix/lib/esql/igo4a304.so
#0 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
====================================
backtrace
===================================
#0 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1 0x04fd4825 in raise () from /lib/tls/libc.so.6
#2 0x04fd6289 in abort () from /lib/tls/libc.so.6
#3 0x08426127 in preabort () at ProcessCMProcMon.cpp:80
#4 0x084276b3 in CMProcMon::verifySdlTimerServices () at ProcessCMProcMon.cpp:774
#5 0x08427ed8 in CMProcMon::callManagerMonitorThread (cmProcMon=0xb25528b0) at ProcessCMProcMon.cpp:411
#6 0x008a2bf3 in ACE_OS_Thread_Adapter::invoke (this=0xcb95ce8) at OS_Thread_Adapter.cpp:94
#7 0x008630a3 in ace_thread_adapter (args=0x0) at Base_Thread_Adapter.cpp:137
#8 0x0045a3cc in start_thread () from /lib/tls/libpthread.so.0
#9 0x05078f0e in clone () from /lib/tls/libc.so.6
====================================
info registers
====================================
eax 0x0 0
ecx 0x6adc 27356
edx 0x6 6
ebx 0x783 1923
esp 0x6a3aba4 0x6a3aba4
ebp 0x6a3abb8 0x6a3abb8
esi 0x6adc 27356
edi 0x50d7ff4 84770804
eip 0x93c7a2 0x93c7a2
eflags 0x202 514
cs 0x73 115
ss 0x7b 123
ds 0xc02d007b -1070792581
es 0x7b 123
fs 0x0 0
gs 0x33 51
====================================
info threads
====================================
49 process 1923 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
48 process 10476 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
47 process 23835 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
46 process 23864 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
45 process 23865 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
44 process 23882 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
43 process 24085 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
42 process 24100 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
41 process 24102 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
40 process 24450 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
39 process 24451 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
38 process 24498 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
37 process 27251 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
36 process 27252 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
35 process 27253 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
34 process 27254 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
33 process 27255 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
32 process 27256 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
31 process 27257 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
30 process 27258 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
29 process 27331 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
28 process 27332 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
27 process 27333 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
26 process 27334 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
25 process 27335 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
24 process 27336 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
23 process 27337 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
22 process 27338 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
21 process 27339 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
20 process 27340 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
19 process 27341 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
18 process 27342 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
17 process 27343 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
16 process 27344 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
15 process 27345 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
14 process 27346 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
13 process 27347 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
12 process 27348 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
11 process 27349 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
10 process 27350 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
9 process 27351 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
8 process 27352 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
7 process 27353 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
6 process 27354 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
5 process 27355 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
4 process 27357 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
3 process 27358 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
2 process 27359 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
* 1 process 27356 0x0093c7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
Thanks
04-04-2012 05:42 PM
Do you have any answer about this issue? we have the same problem also with the same version
thanks in advance
04-04-2012 09:42 PM
No, I did not find solution for this yet and it has only happened the one time.
07-30-2012 08:20 PM
The core dumps were related to a ccm loop
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: