Cisco 7507 got rebooted with crashinfo.. need help

Unanswered Question
Apr 3rd, 2010

Hi friends

,

Our 7507 router got rebooted with crashinfo.. need help to decode and to find the root cause..

Attached below show version and error logs with crashinfo attachment..

=====================Show version==========================

------------------ show version ------------------

Cisco Internetwork Operating System Software

IOS (tm) RSP Software (RSP-IK9SV-M), Version 12.3(26), RELEASE SOFTWARE (fc2)

Technical Support: http://www.cisco.com/techsupport

Copyright (c) 1986-2008 by cisco Systems, Inc.

Compiled Mon 17-Mar-08 20:51 by dchih

ROM: System Bootstrap, Version 12.0(10r)S1, RELEASE SOFTWARE (fc1)

CB-DR-CR01 uptime is 1 day, 3 hours, 32 minutes

System returned to ROM by reload at 02:13:14 UTC Fri Apr 2 2010

System restarted at 07:43:29 IST Fri Apr 2 2010

System image file is "disk0:rsp-ik9sv-mz.123-26.bin"

Last reload reason: Unknown reason

This product contains cryptographic features and is subject to United

States and local country laws governing import, export, transfer and

use. Delivery of Cisco cryptographic products does not imply

third-party authority to import, export, distribute or use encryption.

Importers, exporters, distributors and users are responsible for

compliance with U.S. and local country laws. By using this product you

agree to comply with applicable laws and regulations. If you are unable

to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:

http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to

[email protected].

cisco RSP8 (R7000) processor with 131072K/8216K bytes of memory.

R7000 CPU at 250MHz, Implementation 39, Rev 3.3, 256KB L2, 2048KB L3 Cache

Last reset from power-on

G.703/E1 software, Version 1.0.

G.703/JT2 software, Version 1.0.

X.25 software, Version 3.0.0.

Bridging software.

Primary Rate ISDN software, Version 1.1.

Channelized E1, Version 1.0.

Chassis Interface.

4 VIP6-80 RM7000B controllers (2 FastEthernet)(8 Serial)(40 E1).

1 VIP4-80 RM7000 controller (16 E1).

2 FastEthernet/IEEE 802.3 interface(s)

124 Serial network interface(s)

2043K bytes of non-volatile configuration memory.

62976K bytes of ATA PCMCIA card at slot 0 (Sector size 512 bytes).

16384K bytes of Flash internal SIMM (Sector size 256K).

Slave in slot 2 is running Cisco Internetwork Operating System Software

IOS (tm) RSP Software (RSP-DW-M), Version 12.3(26), RELEASE SOFTWARE (fc2)

Technical Support: http://www.cisco.com/techsupport

Copyright (c) 1986-2008 by cisco Systems, Inc.

Compiled Mon 17-Mar-08 20:55 by dchih

Slave: Loaded from system

Slave: cisco RSP8 (R7000) processor with 131072K bytes of memory.

Configuration register is 0x2102

===============================Show inventory====================

------------------ show inventory ------------------

NAME: "7507mx chassis, ID:60307762", DESCR: "7507mx chassis"

PID: 132 , VID: Hardware Version : 1.01, Board Revision : A0, SN: 60307762

NAME: "Line Card 0", DESCR: "Versatile Interface Processor (VIP6-80)"

PID: VIP6-80 , VID: Hardware Version : 2.03, Board Revision : B0, SN: 34143559

NAME: "Card Slot 0, Bay 0", DESCR: "8 port, software configurable Multichannel T1/E1 without TDM Port Adapter"

PID: PA-MC-8TE1+ , VID: Hardware Version : 3.0, Board Revision : B0, SN: JAE0943NXNY

NAME: "Line Card 1", DESCR: "Versatile Interface Processor (VIP6-80)"

PID: VIP6-80 , VID: Hardware Version : 2.03, Board Revision : B0, SN: 34250368

NAME: "Card Slot 1, Bay 0", DESCR: "8 port, software configurable Multichannel T1/E1 without TDM Port Adapter"

PID: PA-MC-8TE1+ , VID: Hardware Version : 3.0, Board Revision : B0, SN: JAE0943NRDJ

NAME: "Card Slot 1, Bay 1", DESCR: "8 port, software configurable Multichannel T1/E1 without TDM Port Adapter"

PID: PA-MC-8TE1+ , VID: Hardware Version : 3.0, Board Revision : B0, SN: JAE0943NXQS

NAME: "Line Card 2", DESCR: "R7000"

PID: RSP8 , VID: Hardware Version : 1.07, Board Revision : A0, SN: 34251995

NAME: "RSP at Slot 3", DESCR: "R7000"

PID: RSP8 , VID: Hardware Version : 1.7, Board Revision : A0, SN: 34251982

NAME: "Line Card 4", DESCR: "Versatile Interface Processor (VIP6-80)"

PID: VIP6-80 , VID: Hardware Version : 2.03, Board Revision : B0, SN: 34250459

NAME: "Card Slot 4, Bay 0", DESCR: "Dual Port FastEthernet (RJ45)"

PID: PA-2FE-TX , VID: Hardware Version : 1.1, Board Revision : A0, SN: JAE0933JBWV

NAME: "Card Slot 4, Bay 1", DESCR: "8 Port Serial Adapter ( V35)"

PID: PA-8T-V35 , VID: Hardware Version : 1.17, Board Revision : A0, SN: 34050247

NAME: "Line Card 5", DESCR: "Versatile Interface Processor (VIP6-80)"

PID: VIP6-80 , VID: Hardware Version : 2.03, Board Revision : B0, SN: 33826297

NAME: "Card Slot 5, Bay 0", DESCR: "8 port, software configurable Multichannel T1/E1 without TDM Port Adapter"

PID: PA-MC-8TE1+ , VID: Hardware Version : 3.0, Board Revision : C1, SN: JAE1009X3ZN

NAME: "Card Slot 5, Bay 1", DESCR: "8 port, software configurable Multichannel T1/E1 without TDM Port Adapter"

PID: PA-MC-8TE1+ , VID: Hardware Version : 3.0, Board Revision : C0, SN: JAE1004UHN9

NAME: "Line Card 6", DESCR: "Versatile Interface Processor (VIP4-80)"

PID: VIP4-80 , VID: Hardware Version : 2.04, Board Revision : A0, SN: 35411523

NAME: "Card Slot 6, Bay 0", DESCR: "8 port, software configurable Multichannel T1/E1 without TDM Port Adapter"

PID: PA-MC-8TE1+ , VID: Hardware Version : 3.0, Board Revision : C1, SN: JAE11054GQF

NAME: "Card Slot 6, Bay 1", DESCR: "8 port, software configurable Multichannel T1/E1 without TDM Port Adapter"

PID: PA-MC-8TE1+ , VID: Hardware Version : 3.0, Board Revision : C1, SN: JAE11054GPM

======================================Error in crashinfo============================

Apr 2 07:43:01 IST: %SYS-3-MGDTIMER: Previous timer has bad forward linkage, timer = 44835D40.

-Process= "CallMIB Background", ipl= 0, pid= 151

-Traceback= 404A4F80 404A52A8 4084DFE8

Apr 2 07:43:01 IST: %SCHED-3-UNEXPECTEDTIMER: Unknown timer expiration, timer = 42D01D38, type 17602.

-Process= "CallMIB Background", ipl= 0, pid= 151

-Traceback= 4084E038

07:43:03 IST Fri Apr 2 2010: TLB (load or instruction fetch) exception, CPU signal 10, PC = 0x40999250

--------------------------------------------------------------------

Possible software fault. Upon reccurence, please collect

crashinfo, "show tech" and contact Cisco Technical Support.

--------------------------------------------------------------------

-Traceback= 40999250 40999FAC 4017AB94 401E0430 401E1908 401CB624

$0 : 00000000, AT : 42CA0000, v0 : 4084B644, v1 : 00000000

a0 : 0C127250, a1 : 44835D38, a2 : 00000000, a3 : 00008676

t0 : 00000030, t1 : 3400E701, t2 : 34008700, t3 : FFFF00FF

t4 : 00000083, t5 : 3E840024, t6 : 00000400, t7 : 43907704

s0 : 00000000, s1 : 44835D38, s2 : 4084B644, s3 : 448BDBF0

s4 : 43610000, s5 : 448BDBF0, s6 : 44830AA4, s7 : 42140000

t8 : 4485282C, t9 : 00000000, k0 : 30408401, k1 : 30410000

gp : 42CA3D90, sp : 4485279C, s8 : 00000000, ra : 40999FAC

EPC : 40999250, ErrorEPC : 0AA60045, SREG : 3400E703

MDLO : 00000001, MDHI : 03300440, BadVaddr : 0C12729A

DATA_START : 0x420F9430

Cause 00000008 (Code 0x2): TLB (load or instruction fetch) exception

=== Start of Crashinfo Collection (07:43:03 IST Fri Apr 2 2010) ===

For image:

Cisco Internetwork Operating System Software

IOS (tm) RSP Software (RSP-IK9SV-M), Version 12.3(26), RELEASE SOFTWARE (fc2)

Technical Support: http://www.cisco.com/techsupport

Copyright (c) 1986-2008 by cisco Systems, Inc.

Compiled Mon 17-Mar-08 20:51 by dchih

regards

Amar

I have this problem too.
0 votes
  • 1
  • 2
  • 3
  • 4
  • 5
Overall Rating: 0 (0 ratings)
Loading.
Giuseppe Larosa Sat, 04/03/2010 - 05:11

Hello Amar,

from the information you have attached:

>>

Apr 2 07:43:01 IST: %SYS-3-MGDTIMER: Previous timer has bad forward linkage, timer = 44835D40.

-Process= "CallMIB Background", ipl= 0, pid= 151

-Traceback= 404A4F80 404A52A8 4084DFE8

Apr 2 07:43:01 IST: %SCHED-3-UNEXPECTEDTIMER: Unknown timer expiration, timer = 42D01D38, type 17602.

-Process= "CallMIB Background", ipl= 0, pid= 151

-Traceback= 4084E038

07:43:03 IST Fri Apr 2 2010: TLB (load or instruction fetch) exception, CPU signal 10, PC = 0x40999250

--------------------------------------------------------------------

Possible software fault. Upon reccurence, please collect

crashinfo, "show tech" and contact Cisco Technical Support.

--------------------------------------------------------------------

You have likely hit a SW bug

I will give a look at bug  toolkit and will update this post

Hope to help

Giuseppe

Actions

This Discussion