Cisco Support Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Announcements

Welcome to Cisco Support Community. We would love to have your feedback.

For an introduction to the new site, click here. And see here for current known issues.

New Member

WLC5508 crash, software failed

WLC 5508 has encounted fatal error and continueously reboot.

please let me know the solution

thanks.

- log-

Detecting Hardware ...
set smp_affinity for irq 48
003f
starting pid 1045, tty '/dev/ttyS0': '/usr/bin/gettyOrMwar'
Cryptographic library self-test....passed!
XML config selected
Validating XML configuration
octeon_device_init: found 1 DPs
readCPUConfigData: cardid 0x6070001
Cisco is a trademark of Cisco Systems, Inc.
Software Copyright Cisco Systems, Inc. All rights reserved.
Cisco AireOS Version 7.0.116.0
Firmware Version FPGA 1.3, Env 1.6, USB console 1.27
Initializing OS Services: ok
Initializing Serial Services: ok
Initializing Network Services: ok
Initializing Licensing Services: ok
Starting ARP Services: ok
Starting Trap Manager: ok
Starting Network Interface Management Services: ok
Starting System Services: ok
Starting FIPS Features: ok : Not enabled
Starting Fastpath Hardware Acceleration: broffu broffu_fp_helpers.c:294 SIOCGIFINDEX failed
broffu broffu_fp_helpers.c:294 SIOCGIFINDEX failed
broffu broffu_fp_helpers.c:294 SIOCGIFINDEX failed
broffu_dtl0_create: SYSTEM-REBOOTING:could not bring data plane 0 upDumping a core. This can take a few minutes...
Software Failed on instruction at:
pc = 0x100141e4 (log_error+552), ra = 0x100141b8 (log_error+552)
Dumping registers
CPU Registers:
$ 0   : 00000000 00000001 00000000 12598df0
$ 4   : 00000418 00000001 2cb676bc 2cd673cc
$ 8   : 125109d0 00000000 125109d0 ffffffff
$12   : 00000000 80000010 811b91f0 ffffffff
$16   : ffffffff 0000000e 2cd66510 14aae970
$20   : 15111f38 2e343008 108d8aa8 125914d8
$24   : 00000000 116e33a0                 
$28   : 125714d8 2cd663b0 2cd663b0 100141b8
Hi    : 00000003
Lo    : 33333334
Stack :
        00000000 00000000 00000000 00000000
        0000000a 00000000 00000000 00000013
        00000000 125109d0 00000000 1168b274
        00000044 ffffffff 00000000 00000000
        00000000 00000000 00000000 00000000
        00000000 00000044 00000000 2cd68000
        00000000 00000001 00000000 116ccc6c
        00000000 00000044 00000000 00000000
        00000000 00000000 00000000 12547328
        00000000 12508510 00000000 00000044
        00000000 2cd68000 00000000 14aae970
        00000000 15111f38 00000000 12547328
        00000000 116cc820 00000000 2e343008
        00000000 00000044 00000000 2cd67350
        00000000 2cd66510 00000000 12547328
        00000000 116ccbf4 00000000 0000000e
************************************************************
*             Start Cisco Crash Handler                *
************************************************************
Sys Name:  Cisco_63:67:84
Model:    
Version:   7.0.116.0
Timestamp: Tue Nov 15 15:22:58 2011
SystemUpTime:  0 days 0 hrs 2 mins 5 secs
pid:       1048
TID:       752251728
Task Name: fp_main_task
User Crash:  The system has encountered a fatal condition at broffu_fp_helpers.c:427

------------------------------------------------------------
Analysis of Failure:
  Software was stopped for the following reason:
     The system has encountered a fatal condition at broffu_fp_helpers.c:427

------------------------------------------------------------
System Stack
Frame 0: 0x10012c08: create_crash_dump+7128
Frame 1: 0x10011a1c: create_crash_dump+2540
Frame 2: 0x1000767c: sigsegv_handler+3532
Frame 3: 0x2cd66080: SHA1Final+461639728
Frame 4: 0x100141e4: log_error+596
Frame 5: 0x108d9e80: broffu_dtl0_create+1504
Frame 6: 0x108db65c: broffu_hapiInit+100
Frame 7: 0x108d1d78: dapiInit+8512
Frame 8: 0x10a5821c: dtlDriverInit+76
Frame 9: 0x1078339c: license_ap_count_notify+188
Frame 10: 0x10785548: cfgChangeRegister+216
Frame 11: 0x10784e94: cnfgrInit+4484
Frame 12: 0x10002a58: fp_main+2084

Frame 13: 0x10779f38: osapiTaskAppKeySelfSet+304
Frame 14: 0x116852e0: SHA1Final+1442448
Frame 15: 0x116eac4c: SHA1Final+1858556

------------------------------------------------------------
Semaphore and Mutex Usage
(Caller IP(instruction pointer of caller) Gives one more level
of depth in stack to track the Semaphore and Mutex operation)

------------------------------------------------------------
   Memory Information
System Memory Information:
             Total System Memory: 1028820992 bytes (981.23 Mb)
              Used System Memory: 191766528 bytes (182.89 Mb)
              Free System Memory: 837054464 bytes (798.33 Mb)
System Memory Information:
             Total System Memory: 1028820992 bytes (981.23 Mb)
              Used System Memory: 191766528 bytes (182.89 Mb)
              Free System Memory: 837054464 bytes (798.33 Mb)
Heap information:
         Bytes alloced from RTOS: 2990912 bytes (2.85 Mb)
                     Chunks free: 1 bytes
       Number of mmapped regions: 25
  Total space in mmapped regions: 116703232 bytes (111.30 Mb)
           Total allocated space: 2886392 bytes (2.75 Mb)
           Total non-inuse space: 104520 bytes (102.07 Kb)
      Top-most, releasable space: 104520 bytes (102.07 Kb)
     Total allocated (incl mmap): 119694144 bytes (114.15 Mb)
          Total used (incl mmap): 119589624 bytes (114.05 Mb)
          Total free (incl mmap): 104520 bytes (102.07 Kb)
  Buffer Pooled Malloc Usage
Pool[00]: 16 byte chunks
    chunks in pool:    50000
    chunks in use:     11020
    bytes in use:      176320
    bytes requested:   18279 (158041 overhead bytes)
Pool[01]: 64 byte chunks
    chunks in pool:    40000
    chunks in use:     810
    bytes in use:      51840
    bytes requested:   22963 (28877 overhead bytes)
Pool[02]: 128 byte chunks
    chunks in pool:    20000
    chunks in use:     31
    bytes in use:      3968
    bytes requested:   3145 (823 overhead bytes)
Pool[03]: 256 byte chunks
    chunks in pool:    3000
    chunks in use:     13
    bytes in use:      3328
    bytes requested:   2348 (980 overhead bytes)
Pool[04]: 1024 byte chunks
    chunks in pool:    14000
    chunks in use:     154
    bytes in use:      157696
    bytes requested:   69724 (87972 overhead bytes)
Pool[05]: 2048 byte chunks
    chunks in pool:    1000
    chunks in use:     10
    bytes in use:      20480
    bytes requested:   14904 (5576 overhead bytes)
Pool[06]: 4096 byte chunks
    chunks in pool:    1000
    chunks in use:     16
    bytes in use:      65536
    bytes requested:   47796 (17740 overhead bytes)
Max number of Mbufs:     4608
number of Mbufs Free:    4606
number of Mbufs In Use:  2
------------------------------------------------------------
   Interrupt Status
7: timer                320285             0
40: mailbox0            2198858             0
42: serial                   97             0
72: watchdog                160             0
------------------------------------------------------------
   Octeon Device Status
ifconfig: oct0: error fetching interface information: Device not found
------------------------------------------------------------

..

.

.

.

.

9 REPLIES
Hall of Fame Super Silver

Re: WLC5508 crash, software failed

You need to open a TAC case and get that wlc RMA'd.

Sent from my iPhone

-Scott
*** Please rate helpful posts ***
New Member

Dear Fella,You're right....I

Dear Fella,

You're right....I had the same issue today with WLC 5508. I was open the TAC case & cisco TAC suggested to me for RMA.

 

Cryptographic library self-test....passed!
 
XML config selected
Validating XML configuration
octeon_device_init: found 1 DPs
readCPUConfigData: cardid 0x6070001
Reading 0 hosts from config
Cisco is a trademark of Cisco Systems, Inc.
Software Copyright Cisco Systems, Inc. All rights reserved.
 
Cisco AireOS Version 7.0.250.0
Firmware Version FPGA 1.3, Env 1.6, USB console 1.27
Initializing OS Services: ok
Initializing Serial Services: ok
Initializing Network Services: ok
Initializing Licensing Services: ok
Starting ARP Services: ok
Starting Trap Manager: ok
Starting Network Interface Management Services: ok
Starting System Services: ok
Starting FIPS Features: ok : Not enabled
Starting Fastpath Hardware Acceleration: broffu broffu_fp_helpers.c:294 SIOCGIFINDEX failed
broffu broffu_fp_helpers.c:294 SIOCGIFINDEX failed
broffu broffu_fp_helpers.c:294 SIOCGIFINDEX failed
broffu_dtl0_create: SYSTEM-REBOOTING:could not bring data plane 0 upDumping a core. This can take a few minutes... 
 
Software Failed on instruction at:
 pc = 0x10013fec (log_error+552), ra = 0x10013fc0 (log_error+552)
 
 Dumping registers 
CPU Registers:
$ 0   : 00000000 00000001 00000000 125e8c10
$ 4   : 0000042b 00000001 2cb676bc 2cd673cc
$ 8   : 1255f7b0 00000000 1255f7b0 ffffffff
$12   : 00000000 80000010 811b9770 ffffffff
$16   : 00000003 ffffffff 0000000e 2cd66510
$20   : 151625a8 2e381a74 125e0dac 10907758
$24   : 00000000 11728c00                  
$28   : 125c0dac 2cd663b0 2cd663b0 10013fc0
Hi    : 00000003
Lo    : 33333334
 
Stack : 
        00000000 00000000 00000001 2cd6620c 
        00000000 11f0d528 00000044 ffffffff 
        00000000 1255f7b0 00000000 116cfad4 
        00000000 00000000 00000000 00000000 
        00000000 00000000 00000000 00000000 
        00000000 00000044 00000000 2cd68000 
        00000000 00000001 00000000 1171215c 
        00000000 00000044 00000000 00000000 
        00000000 00000000 00000000 12596738 
        00000000 125572f0 00000000 00000044 
        00000000 2cd68000 00000000 2cd66510 
        00000000 151625a8 00000000 12596738 
        00000000 11711d10 00000000 2e381a74 
        00000000 00000044 00000000 2cd67350 
        00000000 0000000e 00000000 12596738 
        00000000 117120e4 ffffffff ffffffff 
************************************************************
*             Start Cisco Crash Handler                *
************************************************************
Sys Name:
Model:    
Version:   7.0.250.0
Timestamp: Fri Sep 12 13:10:39 2014
SystemUpTime: 0 days 0 hrs 2 mins 2 secs
pid:       1067
TID:       752251728
Task Name: fp_main_task
User Crash: The system has encountered a fatal condition at broffu_fp_helpers.c:427

 

New Member

Re: WLC5508 crash, software failed

Hi,

The controller runs in a boot loop.

The workaround for this is:

1. disconnect the console cable from your controller.

2. Wait 5 minutes. The controller can now boot

3. Reconnect console cable to have access again

4: configure and upgrade to version  6.0.202.0 or higher

Remember when you reload after first installation the controller runs in to the boot loop again if

the console cable is still connected. Do steps 1 - 3  again.

Cheers,

Marc

New Member

WLC5508 crash, software failed

Marc, you are correct.

We are seeing this problem on a 5508 running 7.4.100.0 with FUS 1.7.0.0

Removing the console/Out of band cable solved the problem.

Hall of Fame Super Gold

WLC5508 crash, software failed

I'm with Scott.  You've got a hardware failure.

Contact Cisco TAC and get it RMA-ed.

New Member

WLC5508 crash, software failed

Hi all,

I came across this issue this morning after a pwer cycle half way though the initial config, tried the above solutions (minus a TAC) no joy.

Opened up the WLC and re-seated the flash & RAM cards, restarted and all good.

New Member

WLC5508 crash, software failed

What does broffu stand for?

New Member

Dear allI have 2 WLC 5508 and

Dear all

I have 2 WLC 5508 and it also hit the same problem. Then I can recover 1 of them by reload the RTOS file. This file can find it in internet.

However, 1 of them still hit the same problem in spite of I reload the RTOS firmware.

 

Dear mmeeussen

When I open the WLC, I can only re-seat the RAM cards, how can re-seat the flash or storage because I cannot find it

 

Thank you very much

Thomas

 

 

New Member

Please refer Release Notes

Please refer Release Notes for Cisco Wireless LAN Controllers and Lightweight Access Points for Release 7.4.100.60 at http://www.cisco.com/c/en/us/td/docs/wireless/controller/release/notes/crn74mr1.html

3037
Views
0
Helpful
9
Replies