hanmgw01# hanmgw01# hanmgw01# Trunk-6 Firmware Crashed at 16:03:16 VietNam Mon Apr 30 2001 Bad exception occurred on trunk DFC processor in slot 6 !!! Exception vector number = 0x1 ------ Begin Trunk-6 Crash Dump ------- --------Stack Trace-------- ra = 0x7DAC fp = 0x3FFBE0 ra = 0x12930 fp = 0x3FFBF8 ra = 0x132FC fp = 0x3FFC20 ra = 0x1339C fp = 0x3FFC40 ra = 0x16358 fp = 0x3FFC60 ra = 0x16C50 fp = 0x3FFD10 -----Exception Stack Frame----- program counter (ssr0) = 0x124AC status register (ssr1) = 0x1002 link register (lr) = 0x1249C general Registers: r0 = 0x8000, r1 = 0x5555AAAA r2 = 0x5555AAAA, r3 = 0x8000 r4 = 0x1002, r5 = 0x9002 r6 = 0x3FFD88, r7 = 0x0 r8 = 0x6, r9 = 0x8000 r10 = 0x106828, r11 = 0x3FFBF8 r12 = 0x0 ------ End of Trunk-6 Crash Dump ------ Trunk-6 restarted 1 times since last system reload *Apr 30 16:03:16.102: %DSX1-3-FIRMWARE_RESTART: T1/E1 Firmware in slot 6 restarted System received a divide by zero exception 16:03:45 VietNam Mon Apr 30 2001: Breakpoint exception, CPU signal 8, PC = 0x60211394 -------------------------------------------------------------------- Possible software fault. Upon reccurence, please collect crashinfo, "show tech" and contact Cisco Technical Support. -------------------------------------------------------------------- -Traceback= 0x60211394 0x61821690 0x61429B0C 0x6184A200 0x620066B4 0x6200710C 0x618324D4 0x61833D8C $0 : 00000000, AT : 63180000, v0 : 00000000, v1 : 00000000 a0 : 00000000, a1 : 00000000, a2 : 00000000, a3 : 00000000 t0 : 6343D2F0, t1 : 3400FF01, t2 : 3400E100, t3 : FFFF00FF t4 : 6069E050, t5 : 00000049, t6 : 1205D440, t7 : 00000000 s0 : 00000007, s1 : 64BB61F0, s2 : 64D4D150, s3 : 64BB6200 s4 : 64BB61F0, s5 : 64DE2FDC, s6 : 64D4D170, s7 : 633EDF70 t8 : 68418F78, t9 : 00000000, k0 : 64DDA234, k1 : 6066D830 gp : 63182370, sp : 66D7B450, s8 : 00000000, ra : 6021116C EPC : 60211394, ErrorEPC : BFC00858, SREG : 3400FF03 MDLO : FFFFFFFF, MDHI : 00000000, BadVaddr : 00000021 DATA_START : 0x620824F0 Cause 80000024 (Code 0x9): Breakpoint exception Bus Watcher Counters cor_l2cache_data_ecc_count = 0 bad_l2cache_data_ecc_count = 0 cor_l2cache_tag_ecc_count = 0 bad_l2cache_tag_ecc_count = 0 cor_memory_data_ecc_count = 0 bad_memory_data_ecc_count = 0 bus_errors = 0 BCM Status Registers A_SCD_BUS_ERR_STATUS = 0000000080000000 A_BUS_ERR_DATA_0 = 9961C9BA5C4A281E A_BUS_ERR_DATA_1 = B980C3A680DB83C8 A_BUS_ERR_DATA_2 = 0A0CAECB93009F8B A_BUS_ERR_DATA_3 = C3F1482F4B27E68B A_SCD_SYSTEM_REVISION = 00000001112423FF A_IO_INTERRUPT_STATUS = 0000000000000000 A_IO_INTERRUPT_ADDR0 = 0000000000000000 A_IO_INTERRUPT_ADDR1 = 0000000000000000 System Controller Network Interrupts: Interrupt Register is at 0xB0020040 (0x00000C8000180000) BCM interrupt mask 0xFF7C03BEFFE0FCC2 Registered Interrupts: Level Mask Count Data Interrupt Handler 0 0x0000000100000000 0 0x00000000 0x60345870 (GT96124 Interrupt handler) 0 0x0000000000100000 252771 0x64831330 0x6032D3F8 (GigabitEthernet0/1) 0 0x0000000000080000 249631 0x64807950 0x6032D3F8 (GigabitEthernet0/0) 0 0x0000040000000000 67767 0x00000000 0x607D726C (Low IRQ interrupt) 1 0x0000100000000000 0 0x00000000 0x600752DC (BCM1125 GPIO12 - BITS IRQ interrupt) 1 0x0000000000000020 0 0x638D2BFC 0x607E73A8 (SB1125 Timer 3) 1 0x0000000000000010 0 0x638D2B34 0x607E73A8 (SB1125 Timer 2) 1 0x0000000000000008 0 0x638D2A6C 0x607E73A8 (SB1125 Timer 1) 1 0x0000000000000004 0 0x638D29A4 0x607E73A8 (SB1125 Timer 0) 1 0x0000080000000000 380939 0x00000000 0x607D758C (High IRQ interrupt) 3 0x0000800000000000 0 0x00000000 0x6035B7F0 (OIR Interrupt) 4 0x0000400000000000 0 0x00000000 0x607DF8F8 (NRBUS Parity Error) 4 0x0000200000000000 0 0x00000000 0x607DF8F8 (IO Error) 4 0x0000004000000000 0 0x00000000 0x607DF8F8 (IO_BUS_Parity Error) 4 0x007C00000000E0C2 0 0x00000000 0x607E57DC (Spurious Intr ERROR Handler) 4 0x0000000000020000 0 0x00000000 0x607E62C8 (Corrected ECC Error Handler) 4 0x0000000000010000 0 0x00000000 0x607E52CC (Bad ECC Error Handler) 4 0x0003000000000000 0 0x62F05654 0x607E539C (BCM1125 Host LDT Bridge Error Handler) 4 0x0000000000040000 0 0x00000000 0x607E5650 (BCM1125 IO-Bus Error Handler) 4 0x0080000000000000 0 0x00000000 0x607E5424 (BCM1125 Host PCI Bridge Error Handler) 6 0x0000000000000001 0 0x00000000 0x607E57DC (Watchdog Timer 0 Handler) HT 600MHz Retry Count 0 BCM1125H HT Host Bridge, handle=0 BCM bridge, config=0x0 (0x00):dev, vendor id = 0x0002166D (0x04):status, command = 0x00100107 (0x08):class code, revid = 0x06000003 (0x0C):hdr, lat timer, cls = 0x00010000 (0x18):bus id registers = 0x001B0100 (0x1C):secondary status = 0x00000141 (0x20):mem base/limit = 0x5FF04300 (0x30):io upper limit/base = 0x00010001 (0x34):capabilities ptr = 0x00000040 (0x38):expansion rom bar = 0x00000000 (0x3C):bridge ctrl = 0x00020000 (0x40):LDT cmd, cap id, = 0x20000008 (0x44):Link config/control = 0x00000020 (0x48):Link frequency = 0x801F0423 (0x50):SRIcmd, srirxden, sritxden = 0x50211010 (0x54):SRI tx numerator = 0x0000FFFF (0x58):SRI rx numerator = 0x0000FFFF (0x68):Error status/control = 0x00009A49 (0x6C):Tx ctrl, databufalloc = 0x00041515 (0xC8):Tx buffer count max = 0x00FFFFFF (0xDC):Rx CRC expected = 0x696EE617 (0xF0):Rx CRC received = 0xC6C7C940 BCM PCI Host Bridge: bus_no=0, device_no=0 DeviceID=0x0001, VendorID=0x166D, Cmd=0x0146, Status=0x02A0 Cls=0x06/0x00/0x00, Rev=0x03, LatencyTimer=0x2C, CacheLineSize=0x10 BaseAddr0=0x60000008, BaseAddr1=0x00000000, MaxLat=0x00, MinGnt=0x00 SubsysDeviceID=0x0000, SubsysVendorID=0xFFFF, ErrorAddr=0x00030400 Additional Status = 0x00000020 PLX HT2PCI Bridge A for PCM Tracer & DFC 2,4,6, handle=0 PLX HT7520 bridge, config=0x0 (0x00):dev, vendor id = 0x74501022 (0x04):status, command = 0x02300107 (0x08):class code, revid = 0x06040012 (0x0C):hdr, lat timer, cls = 0x00810000 (0x18):bus id registers = 0x000E0201 (0x1C):secondary status = 0x02200141 (0x20):mem base/limit = 0x4FF04300 (0x30):io upper limit/base = 0x00010001 (0x34):capabilities ptr = 0x000000A0 (0x3C):bridge ctrl = 0x00020000 (0x40):miscellaneous = 0x000C0004 (0x4C):prefetch ctrl = 0x00000446 (0xC0):ht cmd, cap id = 0x00410008 (0xC4):link cfg/ctrl side a = 0x00112020 (0xC8):link cfg/ctrl side b = 0x770020D0 (0xCC):link freq ctrl side a = 0x00350422 (0xD0):link freq ctrl side b = 0x00350402 PLX HT2PCI Bridge B, for DFC 1,3,5,7 (0x00):dev, vendor id = 0x74501022 (0x04):status, command = 0x02300107 (0x08):class code, revid = 0x06040012 (0x0C):hdr, lat timer, cls = 0x00810000 (0x18):bus id registers = 0x001B0F01 (0x1C):secondary status = 0x022001A1 (0x20):mem base/limit = 0x5FF05000 (0x30):io upper limit/base = 0x00010001 (0x34):capabilities ptr = 0x000000A0 (0x3C):bridge ctrl = 0x00020000 (0x40):miscellaneous = 0x000F0004 (0x4C):prefetch ctrl = 0x00000446 DFC1 PCI2PCI Bridge, Handle=0 PERICOM bridge chip, Primary Bus 15, Secondary Bus 16,config=0x0 (0x00):dev, vendor id = 0x815012D8 (0x04):status, command = 0x02B00107 (0x08):class code, revid = 0x06040004 (0x0C):hdr, lat timer, cls = 0x0001FF08 (0x18):sec lat,cls & bus no = 0x1812100F (0x1C):sec status, io base = 0x02A00101 (0x20):mem base & limit = 0x53F05000 (0x24):prefetch membase/lim = 0x00015001 (0x30):io base/lim upper16 = 0x00000000 (0x3C):bridge ctrl = 0x01000000 (0x40):arb/serr, chip ctrl = 0x03F00000 (0x44):pri/sec trgt wait t. = 0x00000000 (0x48):sec write attmp ctr = 0x00000000 (0x4C):pri write attmp ctr = 0x70003A98 (0x64):serr disable, gpio = 0xF0000010 (0x68):sec clk ctrl,serrsta = 0x00003FC0 DFC3 PCI2PCI Bridge, Handle=0 PERICOM bridge chip, Primary Bus 15, Secondary Bus 19,config=0x0 (0x00):dev, vendor id = 0x815012D8 (0x04):status, command = 0x02B00107 (0x08):class code, revid = 0x06040004 (0x0C):hdr, lat timer, cls = 0x0001FF08 (0x18):sec lat,cls & bus no = 0x1815130F (0x1C):sec status, io base = 0x02A00101 (0x20):mem base & limit = 0x57F05400 (0x24):prefetch membase/lim = 0x00015401 (0x30):io base/lim upper16 = 0x00000000 (0x3C):bridge ctrl = 0x01000000 (0x40):arb/serr, chip ctrl = 0x03F00000 (0x44):pri/sec trgt wait t. = 0x00000000 (0x48):sec write attmp ctr = 0x00000000 (0x4C):pri write attmp ctr = 0x70003A98 (0x64):serr disable, gpio = 0xF0000010 (0x68):sec clk ctrl,serrsta = 0x00003FC0 DFC4 PCI2PCI Bridge, Handle=0 PERICOM bridge chip, Primary Bus 2, Secondary Bus 9,config=0x0 (0x00):dev, vendor id = 0x815012D8 (0x04):status, command = 0x02B00107 (0x08):class code, revid = 0x06040004 (0x0C):hdr, lat timer, cls = 0x0001FF08 (0x18):sec lat,cls & bus no = 0x180B0902 (0x1C):sec status, io base = 0x02A00101 (0x20):mem base & limit = 0x4BF04800 (0x24):prefetch membase/lim = 0x00014801 (0x30):io base/lim upper16 = 0x00000000 (0x3C):bridge ctrl = 0x01000000 (0x40):arb/serr, chip ctrl = 0x03F00000 (0x44):pri/sec trgt wait t. = 0x00000000 (0x48):sec write attmp ctr = 0x00000000 (0x4C):pri write attmp ctr = 0x70003A98 (0x64):serr disable, gpio = 0xF0000010 (0x68):sec clk ctrl,serrsta = 0x00003FC0 DFC5 PCI2PCI Bridge, Handle=0 PERICOM bridge chip, Primary Bus 15, Secondary Bus 22,config=0x0 (0x00):dev, vendor id = 0x815012D8 (0x04):status, command = 0x02B00107 (0x08):class code, revid = 0x06040004 (0x0C):hdr, lat timer, cls = 0x0001FF08 (0x18):sec lat,cls & bus no = 0x1818160F (0x1C):sec status, io base = 0x02A00101 (0x20):mem base & limit = 0x5BF05800 (0x24):prefetch membase/lim = 0x00015801 (0x30):io base/lim upper16 = 0x00000000 (0x3C):bridge ctrl = 0x01000000 (0x40):arb/serr, chip ctrl = 0x03F00000 (0x44):pri/sec trgt wait t. = 0x00000000 (0x48):sec write attmp ctr = 0x00000000 (0x4C):pri write attmp ctr = 0x70003A98 (0x64):serr disable, gpio = 0xF0000010 (0x68):sec clk ctrl,serrsta = 0x00003FC0 DFC6 PCI2PCI Bridge, Handle=0 PERICOM bridge chip, Primary Bus 2, Secondary Bus 12,config=0x0 (0x00):dev, vendor id = 0x815012D8 (0x04):status, command = 0x02B00107 (0x08):class code, revid = 0x06040004 (0x0C):hdr, lat timer, cls = 0x0001FF08 (0x18):sec lat,cls & bus no = 0x180E0C02 (0x1C):sec status, io base = 0x02A00101 (0x20):mem base & limit = 0x4FF04C00 (0x24):prefetch membase/lim = 0x00014C01 (0x30):io base/lim upper16 = 0x00000000 (0x3C):bridge ctrl = 0x01000000 (0x40):arb/serr, chip ctrl = 0x03F00000 (0x44):pri/sec trgt wait t. = 0x00000000 (0x48):sec write attmp ctr = 0x00000000 (0x4C):pri write attmp ctr = 0x70003A98 (0x64):serr disable, gpio = 0xF0000010 (0x68):sec clk ctrl,serrsta = 0x00003FC0 DFC7 PCI2PCI Bridge, Handle=0 PERICOM bridge chip, Primary Bus 15, Secondary Bus 25,config=0x0 (0x00):dev, vendor id = 0x815012D8 (0x04):status, command = 0x02B00107 (0x08):class code, revid = 0x06040004 (0x0C):hdr, lat timer, cls = 0x0001FF08 (0x18):sec lat,cls & bus no = 0x181B190F (0x1C):sec status, io base = 0x02A00101 (0x20):mem base & limit = 0x5FF05C00 (0x24):prefetch membase/lim = 0x00015C01 (0x30):io base/lim upper16 = 0x00000000 (0x3C):bridge ctrl = 0x01000000 (0x40):arb/serr, chip ctrl = 0x03F00000 (0x44):pri/sec trgt wait t. = 0x00000000 (0x48):sec write attmp ctr = 0x00000000 (0x4C):pri write attmp ctr = 0x70003A98 (0x64):serr disable, gpio = 0xF0000010 (0x68):sec clk ctrl,serrsta = 0x00003FC0 GT 96124 PCI Registers: (0x00):dev, vendor id = 0x967A11AB (0x04):status, command = 0x02A00007 (0x0C):hdr, lat timer, cls = 0x0000F800 (0x20):internal regs mem-maped bar = 0x41000000 (0x24):internal regs io-maped bar = 0x00000001 Writing crashinfo to flash:crashinfo_20010430-090345 16:03:45 VietNam Mon Apr 30 2001: Breakpoint exception, CPU signal 8, PC = 0x60211394 -------------------------------------------------------------------- Possible software fault. Upon reccurence, please collect crashinfo, "show tech" and contact Cisco Technical Support. -------------------------------------------------------------------- -Traceback= 0x60211394 0x61821690 0x61429B0C 0x6184A200 0x620066B4 0x6200710C 0x618324D4 0x61833D8C $0 : 00000000, AT : 63180000, v0 : 00000000, v1 : 00000000 a0 : 00000000, a1 : 00000000, a2 : 00000000, a3 : 00000000 t0 : 6343D2F0, t1 : 3400FF01, t2 : 3400E100, t3 : FFFF00FF t4 : 6069E050, t5 : 00000049, t6 : 1205D440, t7 : 00000000 s0 : 00000007, s1 : 64BB61F0, s2 : 64D4D150, s3 : 64BB6200 s4 : 64BB61F0, s5 : 64DE2FDC, s6 : 64D4D170, s7 : 633EDF70 t8 : 68418F78, t9 : 00000000, k0 : 64DDA234, k1 : 6066D830 gp : 63182370, sp : 66D7B450, s8 : 00000000, ra : 6021116C EPC : 60211394, ErrorEPC : BFC00858, SREG : 3400FF03 MDLO : FFFFFFFF, MDHI : 00000000, BadVaddr : 00000021 DATA_START : 0x620824F0 Cause 80000024 (Code 0x9): Breakpoint exception -Traceback= 0x60211394 0x61821690 0x61429B0C 0x6184A200 0x620066B4 0x6200710C 0x618324D4 0x61833D8C === Flushing messages (16:03:45 VietNam Mon Apr 30 2001) === Buffered messages: P 21 in slot 3, changed state to up *Apr 30 15:58:59.927: %DSPRM-5-UPDOWN: DSP 20 in slot 3, changed state to up *Apr 30 15:59:01.543: %DSPRM-5-UPDOWN: DSP 19 in slot 3, changed state to up *Apr 30 15:59:03.531: %DSPRM-5-UPDOWN: DSP 18 in slot 3, changed state to up *Apr 30 15:59:05.151: %DSPRM-5-UPDOWN: DSP 17 in slot 3, changed state to up *Apr 30 15:59:06.727: %DSPRM-5-UPDOWN: DSP 16 in slot 3, changed state to up *Apr 30 15:59:08.539: %DSPRM-5-UPDOWN: DSP 15 in slot 3, changed state to up *Apr 30 15:59:10.143: %DSPRM-5-UPDOWN: DSP 14 in slot 3, changed state to up *Apr 30 15:59:11.755: %DSPRM-5-UPDOWN: DSP 13 in slot 3, changed state to up *Apr 30 15:59:13.743: %DSPRM-5-UPDOWN: DSP 12 in slot 3, changed state to up *Apr 30 15:59:15.371: %DSPRM-5-UPDOWN: DSP 11 in slot 3, changed state to up *Apr 30 15:59:16.979: %DSPRM-5-UPDOWN: DSP 10 in slot 3, changed state to up *Apr 30 15:59:18.979: %DSPRM-5-UPDOWN: DSP 9 in slot 3, changed state to up *Apr 30 15:59:20.611: %DSPRM-5-UPDOWN: DSP 8 in slot 3, changed state to up *Apr 30 15:59:22.183: %DSPRM-5-UPDOWN: DSP 7 in slot 3, changed state to up *Apr 30 15:59:24.191: %DSPRM-5-UPDOWN: DSP 6 in slot 3, changed state to up *Apr 30 15:59:25.807: %DSPRM-5-UPDOWN: DSP 5 in slot 3, changed state to up *Apr 30 15:59:27.427: %DSPRM-5-UPDOWN: DSP 4 in slot 3, changed state to up *Apr 30 15:59:29.775: %DSPRM-5-UPDOWN: DSP 3 in slot 3, changed state to up *Apr 30 15:59:31.131: %DSPRM-5-UPDOWN: DSP 2 in slot 3, changed state to up *Apr 30 15:59:32.747: %DSPRM-5-UPDOWN: DSP 1 in slot 3, changed state to up *Apr 30 15:59:34.347: %DSPRM-5-UPDOWN: DSP 24 in slot 4, changed state to up *Apr 30 15:59:36.379: %DSPRM-5-UPDOWN: DSP 23 in slot 4, changed state to up *Apr 30 15:59:38.003: %DSPRM-5-UPDOWN: DSP 22 in slot 4, changed state to up *Apr 30 15:59:40.067: %DSPRM-5-UPDOWN: DSP 21 in slot 4, changed state to up *Apr 30 15:59:41.695: %DSPRM-5-UPDOWN: DSP 20 in slot 4, changed state to up *Apr 30 15:59:43.275: %DSPRM-5-UPDOWN: DSP 19 in slot 4, changed state to up *Apr 30 15:59:45.307: %DSPRM-5-UPDOWN: DSP 18 in slot 4, changed state to up *Apr 30 15:59:46.903: %DSPRM-5-UPDOWN: DSP 17 in slot 4, changed state to up *Apr 30 15:59:48.551: %DSPRM-5-UPDOWN: DSP 16 in slot 4, changed state to up *Apr 30 15:59:50.551: %DSPRM-5-UPDOWN: DSP 15 in slot 4, changed state to up *Apr 30 15:59:52.167: %DSPRM-5-UPDOWN: DSP 14 in slot 4, changed state to up *Apr 30 15:59:53.743: %DSPRM-5-UPDOWN: DSP 13 in slot 4, changed state to up *Apr 30 15:59:55.743: %DSPRM-5-UPDOWN: DSP 12 in slot 4, changed state to up *Apr 30 15:59:57.359: %DSPRM-5-UPDOWN: DSP 11 in slot 4, changed state to up *Apr 30 15:59:58.983: %DSPRM-5-UPDOWN: DSP 10 in slot 4, changed state to up *Apr 30 16:00:00.955: %DSPRM-5-UPDOWN: DSP 9 in slot 4, changed state to up *Apr 30 16:00:02.575: %DSPRM-5-UPDOWN: DSP 8 in slot 4, changed state to up *Apr 30 16:00:04.151: %DSPRM-5-UPDOWN: DSP 7 in slot 4, changed state to up *Apr 30 16:00:06.167: %DSPRM-5-UPDOWN: DSP 6 in slot 4, changed state to up *Apr 30 16:00:07.755: %DSPRM-5-UPDOWN: DSP 5 in slot 4, changed state to up *Apr 30 16:00:09.383: %DSPRM-5-UPDOWN: DSP 4 in slot 4, changed state to up *Apr 30 16:00:11.439: %DSPRM-5-UPDOWN: DSP 3 in slot 4, changed state to up *Apr 30 16:00:13.075: %DSPRM-5-UPDOWN: DSP 2 in slot 4, changed state to up *Apr 30 16:00:14.639: %DSPRM-5-UPDOWN: DSP 1 in slot 4, changed state to up *Apr 30 16:00:16.087: %DSPRM-5-UPDOWN: DSP 8 in slot 5, changed state to up *Apr 30 16:00:17.551: %DSPRM-5-UPDOWN: DSP 7 in slot 5, changed state to up *Apr 30 16:00:19.003: %DSPRM-5-UPDOWN: DSP 6 in slot 5, changed state to up *Apr 30 16:00:20.459: %DSPRM-5-UPDOWN: DSP 5 in slot 5, changed state to up *Apr 30 16:00:21.919: %DSPRM-5-UPDOWN: DSP 4 in slot 5, changed state to up *Apr 30 16:00:23.375: %DSPRM-5-UPDOWN: DSP 3 in slot 5, changed state to up *Apr 30 16:00:24.831: %DSPRM-5-UPDOWN: DSP 2 in slot 5, changed state to up *Apr 30 16:00:26.283: %DSPRM-5-UPDOWN: DSP 1 in slot 5, changed state to up *Apr 30 16:03:16.102: %DSX1-3-FIRMWARE_RESTART: T1/E1 Firmware in slot 6 restarted Queued messages: *Apr 30 16:03:45.154: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output. Spurious IO-Error Interrupt No warm reboot Storage *** System received an FPU exception *** signal= 0x8, code= 0x24, context= 0x63432ed4 PC = 0x606a39d4, SP = 0x62ef1848, RA = 0x6066a098 Cause Reg = 0x00000c20, Status Reg = 0x34008002