5508 WLC with 1142 Waps: Access points randomly dropping out
I am experiencing an issue where seemingly random access points are dropping off from the controller. They are receiving poe via brocade switching and the team has already worked extensively with Brocade to rule out the switching, poe values on individual ports, and available power on the switch as potential causes.
This is an AIR-CT5508-K9 controller running 184.108.40.206 with AIR-LAP1142N-A-K9 access points on the same firmware. There are 31 access points (License for 50) total and they are all on the same network / physical location as the controller.
The controller system log (under show tech-support) is filled with the following:
#DOT1X-3-INVALID_REPLAY_CTR: 1x_eapkey.c:360 Invalid replay counter from client (followed by MAC of client machines)
#DHCP-3-BIND_SRPORT_ERR: dhcp_support.c:373 Binding service port failed.
The WAPs are showing (Monitor > Statisitcs > Select WAP that isn't joined:
There is mismatch between the Requests Received and Responses Sent are different; in this case Received is 12 and sent is 4.
Last error Summary:
Last AP Connection Failure: Number of message retransmission to the AP has reached maximum
Last AP Disconnect Reason: AP's DTLS timer expired
Last Error Occurred Reason: AP got or has been disconnected
Last Error Occurred Reason: Number of message retransmission to the AP has reached maximum
I can provide more information as needed but this point I would like to find a more definitive troubleshooting direction instead of supplying more logs.
Re: 5508 WLC with 1142 Waps: Access points randomly dropping out
This is a bug of this 220.127.116.11 software code. Please upgrade it to 18.104.22.168 (7.4MR1) to fix it. Also make sure your 5508 FUS upgraded (22.214.171.124) as well. Refer this for that & keep in mind this will take 30-40 min downtime to your wireless.
Transferring Crash file from standby: Login to the Active WLC in HA.
From CLI: (Cisco Controller) >transfer upload datatype crash (Cisco
Controller) >transfer upload filename (Cisco
Controller) >transfer upload mode tftp (Cisco Controller) >transfer
This is the start of a display filter cross reference between Wireshark
and OmniPeek. The 1st installment is a table of advanced filters. More
filters will be added as time allows. It is a living doc, so check back
for changes every so often Please feel f...