LAP 1131G crash due to Unexpected exception - Cisco Community

2356

Views

0

Helpful

6

Replies

Hi,

We've a redundant WLC with 5.0.148 Release and all was working great with both 1242AG and 1131AG LAP until... we decided to use 1131G LAP!!!

I've tried to upgrade to 5.1 Release but no way the symptom is still present and it start create me some big problems...

After I configure a LAP out-of-the-box all is working fine, it register itself to both WLCs and it setup correcty in H-REAP Mode with WLAN Override with ONLY the WLAN to deploy on this LAP...

After you physically install the AP and power on all is still wokring fine....but from this point it's a disaster: every modification done on an existing WLAN, or a new one, will cause this LAP (ONLY 1131G) to crash causing itself to reboot continuosly also if the WLAN is not configured to be "pushed" to this LAP.

The only solution is to Power Off/On the LAP; After this the LAP is working fine with also the modification applied to the WLAN Configured on this LAP, in case there were some...but If I do some new changes all these LAPs will reboot due to a Traceback and a Unexpected Exception to CPU Vector (see below)

: Unexpected exception to CPUvector 2000, PC = 0x167764 , LR = 0x167758

-Traceback= 0x167764 0x1A3E04 0x55540 0x55A50 0x1A0CD0

CPU Register Context:

MSR = 0x00029230 CR = 0x30000003 CTR = 0x0028B1B0 XER = 0xE0000001

R0 = 0x00029230 R1 = 0x00AB72C0 R2 = 0x00000000 R3 = 0x00000000

R4 = 0x001675F0 R5 = 0x00000013 R6 = 0x0086B2B4 R7 = 0x0000005D

R8 = 0x00ABFE40 R9 = 0x0000000F R10 = 0x00840000 R11 = 0x00000000

R12 = 0x30000003 R13 = 0x00000000 R14 = 0x00000000 R15 = 0x00000000

R16 = 0x00000000 R17 = 0x00000000 R18 = 0x00000000 R19 = 0x00000000

R20 = 0x00000000 R21 = 0x00000000 R22 = 0x00000000 R23 = 0x00000000

R24 = 0x00000000 R25 = 0x00000000 R26 = 0x00000000 R27 = 0x00000000

R28 = 0x00000000 R29 = 0x00160000 R30 = 0x00000000 R31 = 0x0000000F

=== Flushing messages () ===

Nested exception_rom_monitor call (2 times)

Unexpected exception to CPUvector 2000, PC = 167764

-Traceback= 0x167764 0x1A3E04 0x55540 0x55A50 0x1A0CD0

Exception (2000)! Debug Exception (Could be NULL pointer dereference)

SRR0 = 0x00055A0C SRR1 = 0x00029230 SRR2 = 0x0028ED94 SRR3 = 0x00021030

ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x84000000 DBSR = 0x01000000

CPU Register Context:

Vector = 0x00002000 PC = 0x00167764 MSR = 0x00029230 CR = 0x30000003

LR = 0x00167758 CTR = 0x0028B1B0 XER = 0xE0000001

R0 = 0x00029230 R1 = 0x00AB72C0 R2 = 0x00000000 R3 = 0x00000000

R4 = 0x001675F0 R5 = 0x00000013 R6 = 0x0086B2B4 R7 = 0x0000005D

R8 = 0x00ABFE40 R9 = 0x0000000F R10 = 0x00840000 R11 = 0x00000000

R12 = 0x30000003 R13 = 0x00000000 R14 = 0x00000000 R15 = 0x00000000

R16 = 0x00000000 R17 = 0x00000000 R18 = 0x00000000 R19 = 0x00000000

R20 = 0x00000000 R21 = 0x00000000 R22 = 0x00000000 R23 = 0x00000000

R24 = 0x00000000 R25 = 0x00000000 R26 = 0x00000000 R27 = 0x00000000

R28 = 0x00000000 R29 = 0x00160000 R30 = 0x00000000 R31 = 0x0000000F

Stack trace:

PC = 0x00167764, SP = 0x00AB72C0

Frame 00: SP = 0x00AB72E0 PC = 0x00167714

Frame 01: SP = 0x00AB7300 PC = 0x001A3E04

Frame 02: SP = 0x00AB7320 PC = 0x00055540

Frame 03: SP = 0x00AB7428 PC = 0x00055A50

Frame 04: SP = 0x00000000 PC = 0x001A0CD0

Cisco IOS Software, C1130 Software (C1130-K9W8-M), Version 12.4(13d)JA, RELEASE SOFTWARE (fc2)

Technical Support: http://www.cisco.com/techsupport

Copyright (c) 1986-2008 by Cisco Systems, Inc.

Compiled Fri 08-Feb-08 17:21 by prod_rel_team

Has anyone experienced this behaviour with LAP1131G??? What were the operations done to correct this behaviour?

Thx a lot

Regards

omar

6 Replies 6

Am seeing the exact same thing on a pair of 4402's with IOS 4.2.112.0. Sure looks like a bug.

Regards,

Clarence

Hi Clarence,

I've opened a TAC Case and let you know asap what are the solution

See ya

Any updates on this case? I have the same problem with a LAP 1131G, "unexpected exception to CPUvector 1100..". I tried a hard reset but did dont work. The LAP is continuously rebooting. I haven't changed anything on the WLC.

Output:

Loading "flash:/c1130-k9w8-mx.124-23c.JA/c1130-k9w8-mx.124-23c.JA"...#########################################################################################################################################################################################################################################################################################################################################################################################################################################################

File "flash:/c1130-k9w8-mx.124-23c.JA/c1130-k9w8-mx.124-23c.JA" uncompressed and installed, entry point: 0x3000
executing...

.
.
.

Proceeding with system init

Proceeding to unmask interrupts
Initializing flashfs...

flashfs[1]: 38 files, 8 directories
flashfs[1]: 0 orphaned files, 0 orphaned directories
flashfs[1]: Total bytes: 15740928
flashfs[1]: Bytes used: 10649088
flashfs[1]: Bytes available: 5091840
flashfs[1]: flashfs fsck took 5 seconds.
flashfs[1]: Initialization complete....done Initializing flashfs.

Radio0 present A506 7100 E8000000 A0000000 80000000 3
Radio1 present A506 6700 E8000100 A0040000 80010000 2
.
.
.

cisco AIR-LAP1131AG-E-K9 (PowerPCElvis) processor (revision A0) with 25590K/7168K bytes of memory.
Processor board ID FCZ1051Q0RB
PowerPCElvis CPU at 262Mhz, revision number 0x0950
Last reset from power-on
LWAPP image version 7.0.98.0
1 FastEthernet interface
2 802.11 Radio(s)

32K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address: 00:1A:6C:8F:03:F6
Part Number                          : 73-8962-11
PCA Assembly Number                  : 800-24818-10
PCA Revision Number                  : A0
PCB Serial Number                    : FOC104831CJ
Top Assembly Part Number             : 800-29144-01
Top Assembly Serial Number           : FCZ1051Q0RB
Top Revision Number                  : A0
Product/Model Number                 : AIR-LAP1131AG-E-K9
% Please define a domain-name first.

Press RETURN to get started!

*Mar 1 00:00:06.712: %SOAP_FIPS-2-SELF_TEST_IOS_SUCCESS: IOS crypto FIPS self test passed
*Mar 1 00:00:08.141: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 0
*Mar 1 00:00:09.533: %SOAP_FIPS-2-SELF_TE

00:00:17 UTC Fri Mar 1 2002: Unexpected exception to CPUvector 1100, PC = 0x21B10C , LR = 0x21C500

-Traceback= 0x21B10C 0x21C500 0x2F3A18 0x2F229C 0x2E7034 0x2EF67C 0x2E39D8 0x1A4270

CPU Register Context:
MSR = 0x00029230 CR = 0x53000053 CTR = 0x0017C3C8 XER   = 0xC0000045
R0 = 0x00000000 R1 = 0x01549668 R2 = 0x00000000 R3    = 0x00F98774
R4 = 0x00000142 R5 = 0x00000011 R6 = 0x00000000 R7    = 0xFFFFFFFF
R8 = 0x012CFAEC R9 = 0x0650002B R10 = 0x00BE0000 R11   = 0x00000000
R12 = 0x30000053 R13 = 0x00000000 R14 = 0x00000000 R15   = 0x00000000
R16 = 0x00000000 R17 = 0x00000000 R18 = 0x00000000 R19   = 0x00000000
R20 = 0x00000000 R21 = 0x00000001 R22 = 0x00C912D4 R23   = 0x00000011
R24 = 0x00000000 R25 = 0xFFFFFFFF R26 = 0x0192FCE8 R27   = 0x00000000
R28 = 0x012CFAEC R29 = 0x00F98774 R30 = 0x00F98774 R31   = 0x00000000

Writing crashinfo to flash:/crashinfo_20020301-000018

=== Flushing messages (00:00:20 UTC Fri Mar 1 2002) ===

Buffered messages:

*Mar 1 00:00:06.712: %SOAP_FIPS-2-SELF_TEST_IOS_SUCCESS: IOS crypto FIPS self test passed
*Mar 1 00:00:08.141: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 0
*Mar 1 00:00:09.533: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 1
*Mar 1 00:00:09.657: %LWAPP-3-CLIENTEVENTLOG: Read and initialized AP event log (contains, 1024 messages)

*Mar 1 00:00:09.689: status of voice_diag_test from WLC is false
*Mar 1 00:00:11.804: %LINK-3-UPDOWN: Interface FastEthernet0, changed state to up
*Mar 1 00:00:11.871: %SYS-5-RESTART: System restarted --
Cisco IOS Software, C1130 Software (C1130-K9W8-M), Version 12.4(23c)JA, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2010 by Cisco Systems, Inc.
Compiled Tue 01-Jun-10 13:18 by prod_rel_team
*Mar 1 00:00:11.871: %SNMP-5-COLDSTART: SNMP agent on host V-03-075 is undergoing a cold start
*Mar 1 00:00:11.951: %CAPWAP-5-CHANGED: CAPWAP changed state to DISCOVERY
*Mar 1 00:00:12.130: %SSH-5-ENABLED: SSH 2.0 has been enabled
*Mar 1 00:00:12.130: %LINK-3-UPDOWN: Interface Dot11Radio0, changed state to up
*Mar 1 00:00:12.130: %LINK-3-UPDOWN: Interface Dot11Radio1, changed state to up
*Mar 1 00:00:12.369: %LINK-5-CHANGED: Interface Dot11Radio1, changed state to reset
*Mar 1 00:00:12.370: %LINK-5-CHANGED: Interface Dot11Radio0, changed state to reset
*Mar 1 00:00:12.645: %CDP_PD-4-POWER_OK: Full power - AC_ADAPTOR inline power source
*Mar 1 00:00:12.817: %LINEPROTO-5-UPDOWN: Line protocol on Interface FastEthernet0, changed state to up
*Mar 1 00:00:13.099: %LINK-3-UPDOWN: Interface Dot11Radio1, changed state to up
*Mar 1 00:00:13.135: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to down
*Mar 1 00:00:13.135: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up
*Mar 1 00:00:13.414: %LINK-3-UPDOWN: Interface Dot11Radio0, changed state to up
*Mar 1 00:00:14.414: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to up
Queued messages:
*Mar 1 00:00:23.742: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.

*Mar 1 00:00:11.804: %LINK-3-UPDOWN: Interface FastEthernet0, changed state to up
*Mar 1 00:00:11.871: %SYS-5-RESTART: System restarted --
Cisco IOS Software, C1130 Software (C1130-K9W8-M), Version 12.4(23c)JA, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2010 by Cisco Systems, Inc.
Compiled Tue 01-Jun-10 13:18 by prod_rel_team
*Mar 1 00:00:11.871: %SNMP-5-COLDSTART: SNMP agent on host V-03-075 is undergoing a cold start
*Mar 1 00:00:11.951: %CAPWAP-5-CHANGED: CAPWAP changed state to DISCOVERY
*Mar 1 00:00:12.130: %SSH-5-ENABLED: SSH 2.0 has been enabled
*Mar 1 00:00:12.130: %LINK-3-UPDOWN: Interface Dot11Radio0, changed state to up
*Mar 1 00:00:12.130: %LINK-3-UPDOWN: Interface Dot11Radio1, changed state to up
*Mar 1 00:00:12.369: %LINK-5-CHANGED: Interface Dot11Radio1, changed state to reset
*Mar 1 00:00:12.370: %LINK-5-CHANGED: Interface Dot11Radio0, changed state to reset
*Mar 1 00:00:12.645: %CDP_PD-4-POWER_OK: Full power - AC_ADAPTOR inline power source
*Mar 1 00:00:12.817: %LINEPROTO-5-UPDOWN: Line protocol on Interface FastEthernet0, changed state to up
*Mar 1 00:00:13.099: %LINK-3-UPDOWN: Interface Dot11Radio1, changed state to up
*Mar 1 00:00:13.135: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to down
*Mar 1 00:00:13.135: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up
*Mar 1 00:00:13.414: %LINK-3-UPDOWN: Interface Dot11Radio0, changed state to up
*Mar 1 00:00:14.414: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to up
Nested exception_rom_monitor call (2 times)

Unexpected exception to CPUvector 1100, PC = 21B10C
-Traceback= 0x21B10C 0x21C500 0x2F3A18 0x2F229C 0x2E7034 0x2EF67C 0x2E39D8 0x1A4270

Exception (1100)! Data TLB Miss

SRR0 = 0x0021B10C SRR1 = 0x00029230 SRR2 = 0x00294100 SRR3 = 0x00021230
ESR = 0x00000000 DEAR = 0x06500D73 TSR = 0x84000000 DBSR = 0x00000000

CPU Register Context:
Vector = 0x00001100 PC = 0x0021B10C MSR = 0x00029230 CR = 0x53000053
LR = 0x0021C500 CTR = 0x0017C3C8 XER = 0xC0000045
R0 = 0x00000000 R1 = 0x01549668 R2 = 0x00000000 R3 = 0x00F98774
R4 = 0x00000142 R5 = 0x00000011 R6 = 0x00000000 R7 = 0xFFFFFFFF
R8 = 0x012CFAEC R9 = 0x0650002B R10 = 0x00BE0000 R11 = 0x00000000
R12 = 0x30000053 R13 = 0x00000000 R14 = 0x00000000 R15 = 0x00000000
R16 = 0x00000000 R17 = 0x00000000 R18 = 0x00000000 R19 = 0x00000000
R20 = 0x00000000 R21 = 0x00000001 R22 = 0x00C912D4 R23 = 0x00000011
R24 = 0x00000000 R25 = 0xFFFFFFFF R26 = 0x0192FCE8 R27 = 0x00000000
R28 = 0x012CFAEC R29 = 0x00F98774 R30 = 0x00F98774 R31 = 0x00000000

Stack trace:
PC = 0x0021B10C, SP = 0x01549668
Frame 00: SP = 0x015496A8    PC = 0x00F983F0
Frame 01: SP = 0x015496D8    PC = 0x0021C500
Frame 02: SP = 0x01549720    PC = 0x002F3A18
Frame 03: SP = 0x01549780    PC = 0x002F229C
Frame 04: SP = 0x015497D0    PC = 0x002E7034
Frame 05: SP = 0x015498B0    PC = 0x002EF67C
Frame 06: SP = 0x015498D0    PC = 0x002E39D8
Frame 07: SP = 0x00000000    PC = 0x001A4270

Cisco IOS Software, C1130 Software (C1130-K9W8-M), Version 12.4(23c)JA, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2010 by Cisco Systems, Inc.
Compiled Tue 01-Jun-10 13:18 by prod_rel_team

V-03-075 uptime is 28 seconds

cisco AIR-LAP1131AG-E-K9 (PowerPCElvis) processor (revision A0) with 25590K/7168K bytes of memory.
Processor board ID FCZ1051Q0RB
Xmodem file system is available.sion number 0x0950
flashfs[0]: 38 files, 8 directories
flashfs[0]: 0 orphaned files, 0 orphaned directories
flashfs[0]: Total bytes: 15998976
flashfs[0]: Bytes used: 10653696
flashfs[0]: Bytes available: 5345280

Unless you have a specific reason to, stay away from 5.X and go up to 7.0.98.0 instead.

Yes, I am running version 7.0.98. I see from various release notes that the CPUvector error can be caused by

numerous reasons. The newer sw-releases have fixes for some of these. I have reported the error to my Cisco distributor and they ordered a new AP for me and said it's probably due to hardware error. Sounds a bit strange, but as long as I get a new AP that is working I'm satisfied. We have about 100 AP's (all LAP 1131G light-weight) in our company and 4 WLC's all running 7.0.98.

Hi bvj19722,

The problem was solved in Release 5.1.152.0 provided directly by Cisco...

During last months we've tried to upgrade to the latest 6.0 but also in this case there was a huge problem with the LAPs in a WAN connection where sometimes we've registered loss of connectivity: after reestablish the connection the LAPs were not able anymore to join the WLC without a reboot...

We're plan to upgrade to the latest 7.0 which as mentioned in this thread since finally is supposed to be stable one: https://supportforums.cisco.com/message/3247333#3247333

Regards

O.G

Review Cisco Networking products for a $25 gift card