cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
2073
Views
5
Helpful
1
Comments
Aaron
Cisco Employee
Cisco Employee

The problem - a WLC may crash after being up for 120 days

A 5500, 2500 or WiSM2 controller may crash after running 7.0.240.0 for 120 days.  (In some cases, it may be longer than 120 days.)  Leading up to the crash, mbuf allocations will be seen to increase across time:

(5500-4) >show memory mbuf summary 

Maximum number of Mbufs.......................... 4608
Number of Mbufs Free............................. 1000
Number of Mbufs In Use........................... 3608

This problem only affects release 7.0.240.0.  It does not affect 4400 or WiSM1 controllers.  As 7.0.240.0 was released on Jan. 30, 2013, controllers will start being affected by this bug around May 30, 2013.

This bug is CSCue76126.

Workaround

Perform a scheduled reload of the controller during a change window, before running out of mbufs.

Fixed software

This bug will be fixed in the 7.0 MR5 release, in 1QCY14.  If a 7.0.240.0-based image with the fix for CSCue76126 is required before the 7.0 MR5 release, open a TAC case.

The bug does not affect 7.0.235.3, nor does it affect 7.2 or above.

Comments
cisnerosk
Level 1
Level 1

Thanks for the information, I was having this message logs and didnt know what they meant until I found your document

Just it case somebody else is having the same trouble, these are the logs, Im sure if somebody looks for them at any web search, it will redirect them here.

%SYSTEM-3-MBUF_ALLOC_FAIL: sysapi_if_net.c:602 Cannot allocate new Mbuf.Internal system error.

%SYSTEM-3-MBUFF_ALL_USED: sysapi_if_net.c:223 No free Mbufs available. Shared memory allocation failed. Internal system error.

I am running a WLC 5508 with 7.0.240.0 software version.

A am also running a WLC 4402 and a WLC 2125 with this same version and they work just fine. The three WLCs have almost the same UP time (like 180 days) and the outputs of the "show memory mbuf summary" command  are this:

(4402) >show memory mbuf summary

Maximum number of Mbufs.......................... 4608

Number of Mbufs Free............................. 4601

Number of Mbufs In Use........................... 7

(2125) >show memory mbuf summary

Maximum number of Mbufs.......................... 1536

Number of Mbufs Free............................. 1524

Number of Mbufs In Use........................... 12

And finally, the 5508

(5508) >show memory mbuf summary

Maximum number of Mbufs.......................... 4608

Number of Mbufs Free............................. 43

Number of Mbufs In Use........................... 4565

Im about to reboot it.

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: