×

Warning message

  • Cisco Support Forums is in Read Only mode while the site is being migrated.
  • Cisco Support Forums is in Read Only mode while the site is being migrated.

WLC 5508 (7.6.100.0) - AP invalidates primary/backup image after reboot

Unanswered Question
Jan 17th, 2014
User Badges:

I'm running 7.6.100.0 as default in production and wants wlc to boot with 7.5.102.0 if I run into issues regarding the 7.6.100.0.

To prepare I have predownloaded the backup image into all AP's.

However, if one AP reboots while the WLCis still running 7.6.100.0 the AP has an invalid primary image and need to re-download 7.6.100.0.

The backup image is then displayed as "3.0.51.0".


If someone reboots the AP, the reboot time is much longer than usually.

And the download might be an issue for some offices in Middle-East and Asia, since the WLC i located in Europe.

Due to some small VPN internet access lines.


This is something that came with version 7.6.100.0.

Before I upgraded the WLC, I was running 7.5.102.0 as primary and 7.3.112.0 as backup, with no issues regarding reboots and image.



Have anyone encounter this type of problem?

Any tips to solve this is much appreciated.



//Jan-Erik

  • 1
  • 2
  • 3
  • 4
  • 5
Overall Rating: 4 (3 ratings)
Loading.
Scott Fella Sat, 01/18/2014 - 06:35
User Badges:
  • Super Silver, 17500 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 Wireless

I haven't seen this with the newer model access points as I use the pre-download prior to rebooting the WLC to a new code. I currently have WLC's running older code with a newer code define as not active, not default on the WLC but defined as backup image on the access point. I have also rebooted some AP's to make sure that nothing happens during a reboot.

One thing you can do is pre-download the new image and telnet or ssh to the access point and login and look at the flash you should see the image. You can also look at the primary and backup image from the WLC CLI also, but I would look at the AP. If the image is there, I would probably reboot the AP and look at the flash again and see if the image is there or not. Hard to say why it happens, but you would have to dig around to see if a particular AP or maybe AP model. Also see if there is enough flash memory on the AP's and the AP's might be crashing and that's why you are saying the AP's disappear and comes back with a default backup image. There is an issue we are tracking with v7.5 and AP's silent crashing.

Sent from Cisco Technical Support iPhone App

panayiotiscy Wed, 07/02/2014 - 05:34
User Badges:

hello all,

 

as we are also bumping into this problem, is there any suggested workaround?

thanks

Jan-Erik Eikefjord Mon, 01/20/2014 - 12:12
User Badges:

Thanks, Fella for you feedback!


UPDATE


First of all I have narrow it down and found out that the 1130,1140, 1240 and 1250 are OK

AIR-LAP1131AG-E-K9 reboots and starts with prim: 7.6.100.0 backup: 7.5.102.0 status; OK

AIR-LAP1142N-E-K9  reboots and starts with prim: 7.6.100.0 backup: 7.5.102.0 status; OK

AIR-LAP1242AG-E-K9 reboots and starts with prim: 7.6.100.0 backup: 7.5.102.0 status; OK

AIR-LAP1252AG-T-K9 reboots and starts with prim: 7.6.100.0 backup: 7.5.102.0 status; OK



It seems to be related to the 2602 and 3602 series.

Let me described the steps I did to pinpoint these two models.


AIR-CAP2602I-E-K9

1. New-out-of-the-box and runs prim: 7.3.1.73 backup: 0.0.0.0;

2. Self-upgrade prim: 7.6.100.0 backup: 3.0.51.0.  status; Downloading

3. reboots and starts with prim: 7.6.100.0 backup: 3.0.51.0.              

4. Manual upgrade / predownloading backup to; 7.5.102.0

5. rebooting from wlc with prim: 7.6.100.0, backup: 7.5.102.0 -comment; starts up with 7.5.1.73 and does the downloading of prim image. Backup: 0.0.0.0

6. self-reboot after downloading, prim: 7.6.100.0. Comes up with prim: 7.6.100.0 backup: 3.0.51.0.

7. reboots from wlc/manual with prim: 7.6.100.0 backup: 3.0.51.0. -comment; no change, comes up with prim: 7.6.100.0 backup: 3.0.51.0.  




AIR-CAP3602E-E-K9 

1. reboots from WLC and manual with prim: 7.6.100.0, backup: 3.0.51.0 - comment; no problem, comes online with 7.6.100.0/3.0.51.0.

2. Manual upgrade / predownloading backup to; 7.5.102.0

3. rebooting from wlc with prim: 7.6.100.0, backup: 7.5.102.0 -comment; starts up with 7.3.1.73 and does the downloading of prim image. Backup: 0.0.0.0

4. self-reboot after downloading, prim: 7.6.100.0. Comes up with prim: 7.6.100.0 backup: 3.0.51.0.

5. reboots from wlc/manual with prim: 7.6.100.0 backup: 3.0.51.0. -comment; no change, comes up with prim: 7.6.100.0 backup: 3.0.51.0.



During upgrade it gives out this message;


*Jan 20 15:27:29.927: %WIDS-6-ENABLED: IDS Signature is loaded and enabled

Image 7.5.102.0 not found in flash, predownloading.

examining image...

extracting info (286 bytes)

Image info:

    Version Suffix: k9w8-.152-4.JA1

    Image Name: ap3g2-k9w8-mx.152-4.JA1

    Version Directory: ap3g2-k9w8-mx.152-4.JA1

    Ios Image Size: 758272

    Total Image Size: 11520512

    Image Feature: WIRELESS LAN|LWAPP

    Image Family: AP3G2

    Wireless Switch Management Version: 7.5.102.0

Not enough free space to download.

Check for crashinfo/radio coredump and non used image files...

Not enough free space to download image first w/o extracting

deleting existing version(s)...

Deleting current version: flash:/ap3g2-k9w8-mx.152-4.JB3...

Set booting path to recovery image: 'flash:/ap3g2-rcvk9w8-mx/ap3g2-rcvk9w8-mx'...done.

Extracting files...

ap3g2-k9w8-mx.152-4.JA1/ (directory) 0 (bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/img_sign_rel_sha2.cert (1371 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/B5.bin (1816 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/V5.bin (525 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/img_sign_rel.cert (1375 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/Y5.bin (1524 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/file_hashes (5001 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/B2.bin (9328 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/X5.bin (1487 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/final_hash.sig (513 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/final_hash (141 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/info (286 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/E5.bin (1803 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/Y2.bin (5830 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/V2.bin (12826 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/ap3g2-k9w8-mx.152-4.JA1 (206045 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/8004.img (541961 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/E2.bin (18656 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/ap3g2-k9w8-xx.152-4.JA1 (10519307 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/X2.bin (15158 bytes)

ap3g2-k9w8-mx.152-4.JA1/html/ (directory) 0 (bytes)

ap3g2-k9w8-mx.152-4.JA1/html/level/ (directory) 0 (bytes)

ap3g2-k9w8-mx.152-4.JA1/html/level/1/ (directory) 0 (bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/back.shtml (512 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/sitewide.js (16560 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/officeExtendap.css (41801 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/ap_home.shtml.gz (1297 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/appsui.js (563 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/config.js (25812 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/forms.js (20125 bytes)

ap3g2-k9w8-mx.152-4.JA1/html/level/1/images/ (directory) 0 (bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/images/cisco-logo-2007.gif (1648 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/images/info.gif (399 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/images/background_web41.jpg (732 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/1/images/login_homeap.gif (19671 bytes)

ap3g2-k9w8-mx.152-4.JA1/html/level/15/ (directory) 0 (bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/15/officeExtendapSummary.htm (718 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/15/officeExtendapEvent.shtml.gz (988 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/15/officeExtendapMain.shtml.gz (3350 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/15/officeExtendapBanner.htm (7114 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/15/officeExtendapConfig.shtml.gz (2864 bytes)

extracting ap3g2-k9w8-mx.152-4.JA1/html/level/15/officeExtendapHelp.htm (5013 bytes)

extracting info.ver (286 bytes)

New software image installed in flash:/ap3g2-k9w8-mx.152-4.JA1

archive download: takes 251 seconds


New backup software image installed in flash:/ap3g2-k9w8-mx.152-4.JA1/ap3g2-k9w8-mx.152-4.JA1

Reading backup version from flash:/ap3g2-k9w8-mx.152-4.JA1/ap3g2-k9w8-mx.152-4.JA1done.

Writing out the event log to flash:/event.log ...



THEN IT BOOTS ON 7.6.100.0


*Mar  1 00:00:57.047: %CAPWAP-3-ERRORLOG: Did not get log server settings from DHCP.

examining image...

extracting info (286 bytes)

Image info:

    Version Suffix: k9w8-.152-4.JB3

    Image Name: ap3g2-k9w8-mx.152-4.JB3

    Version Directory: ap3g2-k9w8-mx.152-4.JB3

    Ios Image Size: 215552

    Total Image Size: 13660672

    Image Feature: WIRELESS LAN|LWAPP

    Image Family: AP3G2

    Wireless Switch Management Version: 7.6.100.0

Not enough free space to download.

Check for crashinfo/radio coredump and non used image files...

Deleting flash:/ap3g2-k9w8-mx.152-4.JA1

*Mar  1 00:01:07.051: %CAPWAP-3-ERRORLOG: Selected MWAR 'krs-wlc-ha.elkem.com'(index 0).

*Mar  1 00:01:07.051: %CAPWAP-3-ERRORLOG: Go join a capwap controller

*Jan 20 15:37:13.000: %CAPWAP-5-DTLSREQSEND: DTLS connection request sent peer_ip: 144.127.abc.abc peer_port: 5246

*Jan 20 15:37:13.471: %CAPWAP-5-DTLSREQSUCC: DTLS connection created sucessfully peer_ip: 144.127.abc.abcpeer_port: 5246

*Jan 20 15:37:13.471: %CAPWAP-5-SENDJOIN: sending Join Request to 144.127.abc.abc

*Jan 20 15:37:13.475: %CAPWAP-3-ERRORLOG: Invalid event 10 & state 5 combination.

*Jan 20 15:37:13.475: %CAPWAP-3-ERRORLOG: CAPWAP SM handler: Failed to process message type 10 state 5.

*Jan 20 15:37:13.475: %CAPWAP-3-ERRORLOG: Failed to handle capwap control message from controller

*Jan 20 15:37:13.475: %CAPWAP-3-ERRORLOG: Failed to process encrypted capwap packet from 144.127.abc.abcperform archive download capwap:/ap3g2 tar file done (free up 11507200 bytes)

Extracting files...

ap3g2-k9w8-mx.152-4.JB3/ (directory) 0 (bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/V2.bin (12826 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/Y2.bin (5830 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/file_hashes (6108 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/8004.img (553576 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/X5.bin (1519 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/final_hash.sig (513 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/ap3g2-k9w8-tx.152-4.JB3 (73 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/ap3g2-k9w8-xx.152-4.JB3 (12049578 bytes)

*Jan 20 15:39:13.679: %CAPWAP-3-ERRORLOG: Invalid event 48 & state 10 combination.

*Jan 20 15:39:13.679: %CAPWAP-3-ERRORLOG: SM handler: Failed to process timer message. Event 48, state 10

*Jan 20 15:39:13.679: %CAPWAP-3-ERRORLOG: Failed to handle timer message.

*Jan 20 15:39:13.679: %CAPWAP-3-ERRORLOG: Failed to process timer message.

extracting ap3g2-k9w8-mx.152-4.JB3/R5.bin (3406 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/R2.bin (9328 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/img_sign_rel_sha2.cert (1371 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/B2.bin (9328 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/info (286 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/8006.img (543804 bytes)

ap3g2-k9w8-mx.152-4.JB3/html/ (directory) 0 (bytes)

ap3g2-k9w8-mx.152-4.JB3/html/level/ (directory) 0 (bytes)

ap3g2-k9w8-mx.152-4.JB3/html/level/1/ (directory) 0 (bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/forms.js (20125 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/appsui.js (563 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/ap_home.shtml.gz (1297 bytes)

ap3g2-k9w8-mx.152-4.JB3/html/level/1/images/ (directory) 0 (bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/images/info.gif (399 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/images/cisco-logo-2007.gif (1648 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/images/background_web41.jpg (732 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/images/login_homeap.gif (19671 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/config.js (26330 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/sitewide.js (17089 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/officeExtendap.css (41801 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/1/back.shtml (512 bytes)

ap3g2-k9w8-mx.152-4.JB3/html/level/15/ (directory) 0 (bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/15/officeExtendapBanner.htm (7114 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/15/officeExtendapConfig.shtml.gz (2864 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/15/officeExtendapSummary.htm (718 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/15/officeExtendapHelp.htm (5013 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/15/officeExtendapMain.shtml.gz (3350 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/html/level/15/officeExtendapEvent.shtml.gz (988 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/B5.bin (1980 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/E5.bin (1816 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/Y5.bin (1544 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/C2.bin (19822 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/final_hash (141 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/C5.bin (6936 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/img_sign_rel.cert (1375 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/Q5.bin (2790 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/X2.bin (15158 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/E2.bin (18656 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/Q2.bin (5830 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/V5.bin (525 bytes)

extracting ap3g2-k9w8-mx.152-4.JB3/ap3g2-k9w8-mx.152-4.JB3 (207764 bytes)

extracting info.ver (286 bytes)

New software image installed in flash:/ap3g2-k9w8-mx.152-4.JB3

Configuring system to use new image...done.

Writing out the event log to fla

                                sh:/event.log ...

archive download: takes 295 seconds


*Jan 20 15:42:09.163: image upgrade successfully, system is now reloading

*Jan 20 15:42:09.215: %SYS-5-RELOAD: Reload requested by capwap image download proc. Reload Reason: NEW IMAGE DOWNLOAD.

*Jan 20 15:42:09.215: %LWAPP-5-CHANGED: CAPWAP changed state to DOWN

Write of event.log done


I have also tried to remove all the files on the AP, just leaving

Directory of flash:/


   58  -rwx         296  Jan 20 2014 18:33:37 +00:00  env_vars

   13  drwx         448   Dec 9 2013 23:30:23 +00:00  ap3g2-rcvk9w8-mx

Mike Kellner Sat, 03/22/2014 - 22:49
User Badges:

Hello, we will upgrade wlc 5508 from 7.4 to 7.6.100 with many new 2602E APs.

We see now the same space Problem.

 

Exists a official Cisco solution for this problem now?

Exists a working Workaround from your side?

Thanks Mike

Jan-Erik Eikefjord Mon, 03/31/2014 - 05:37
User Badges:

Hi, Mike

As fare as i know there is just not enough free space on the flash to hold two sets of images.

The people from TAC tried also to find a solution, but ended up sending me this information;


Starting with the Cisco IOS releases 15.2(4)JB and 12.4(25e)JAO, on Cisco Aironet 3600 series APs, the backup IOS image is deleted from the system board's Flash memory when the new image is downloaded on to it. This is designed to be so because the system board's Flash memory, which has a total of 31 MB, does not have enough space to store the recovery image, the new image, and the backup image.

We have 2 wlc + HA all with the same version, so if one wlc goes down all the ap wil move to another wlc and not need to do a download of image.

I'm looking forward to the release of 8.1 :) 

 

Scott Fella Mon, 01/20/2014 - 13:00
User Badges:
  • Super Silver, 17500 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 Wireless

Not enough free space to download.

Check the free space on the flash

Sent from Cisco Technical Support iPhone App

Jan-Erik Eikefjord Mon, 01/20/2014 - 13:09
User Badges:

Do you know how can i free more space?


Directory of flash:/


    2  -rwx       49168  Jan 20 2014 19:05:52 +00:00  lwapp_non_apspecific_reap.cfg

    3  drwx         128  Jan 20 2014 18:53:21 +00:00  configs

    4  -rwx         280  Jan 20 2014 19:05:47 +00:00  lwapp_officeextend.cfg

    5  -rwx       75097  Jan 20 2014 19:03:04 +00:00  event.log

    6  -rwx       95008  Jan 20 2014 19:05:54 +00:00  lwapp_reap.cfg

    7  drwx        1792  Jan 20 2014 19:02:57 +00:00  ap3g2-k9w8-mx.152-4.JB3

   58  -rwx        7192  Jan 20 2014 19:05:52 +00:00  private-multiple-fs

   59  -rwx         296  Jan 20 2014 19:05:44 +00:00  env_vars

   13  drwx         448   Dec 9 2013 23:30:23 +00:00  ap3g2-rcvk9w8-mx


31739904 bytes total (10656768 bytes free)

Scott Fella Mon, 01/20/2014 - 14:25
User Badges:
  • Super Silver, 17500 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 Wireless

Well you have 10mb free. Is this AP office extend? What mode is this AP going to be as you can delete some of those files in flash if your not using it. Also you can remove the RCV image if you want. It's a small file though.

Sent from Cisco Technical Support iPhone App

Jan-Erik Eikefjord Tue, 01/21/2014 - 00:07
User Badges:

I'm not running them as Office Extend.

AP mode is FlexConnect and everything else is basicly default.

Sandeep Choudhary Tue, 01/21/2014 - 00:50
User Badges:
  • Purple, 4500 points or more
  • Cisco Designated VIP,

    2017 Wireless

HI Jan,


As per your question, I can say that if AP dont have neoght memory then it show only the primary image:


just like it:

And U r talking about about Mini IOS: 3.0.51.0.

So dont worry about this.

AP will show only Primary Image.


Regards

Dont forget to rate helpful posts.

Sandeep Choudhary Tue, 01/21/2014 - 00:31
User Badges:
  • Purple, 4500 points or more
  • Cisco Designated VIP,

    2017 Wireless

HI Jan,



Jan-Erik Eikefjord wrote:


Do you know how can i free more space?


Directory of flash:/


    2  -rwx       49168  Jan 20 2014 19:05:52 +00:00  lwapp_non_apspecific_reap.cfg

    3  drwx         128  Jan 20 2014 18:53:21 +00:00  configs

    4  -rwx         280  Jan 20 2014 19:05:47 +00:00  lwapp_officeextend.cfg

    5  -rwx       75097  Jan 20 2014 19:03:04 +00:00 event.log

    6  -rwx       95008  Jan 20 2014 19:05:54 +00:00  lwapp_reap.cfg

    7  drwx        1792  Jan 20 2014 19:02:57 +00:00  ap3g2-k9w8-mx.152-4.JB3

   58  -rwx        7192  Jan 20 2014 19:05:52 +00:00  private-multiple-fs

   59  -rwx         296  Jan 20 2014 19:05:44 +00:00  env_vars

   13  drwx         448   Dec 9 2013 23:30:23 +00:00  ap3g2-rcvk9w8-mx


31739904 bytes total (10656768 bytes free)

You can delete event log file, lwapp_officeextend.cfg,lwapp_non_apspecific_reap.cfg and lwapp_reap.cfg





Regards

Scott Fella Mon, 01/20/2014 - 14:28
User Badges:
  • Super Silver, 17500 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 Wireless

I have both 2602 and 3602 in my lab and no issues. I can play around with it and see of I can replicate your issue.

Sent from Cisco Technical Support iPhone App

Thomas McClintic Tue, 01/21/2014 - 10:05
User Badges:

I am replicating this issue. Running 7.6.100 as primary on WLC with 7.4.1.30 as backup.


Pushed backup image to APs, verified in WLC GUI.


Rebooted AP, AP states not enough space. Shows on version 7.5 on the WLC when it is downloading the 7.6 code and back up image of 3.0.51.0.


AP is in a DHCP scope with 7.2 WLCs as options, but HA configured on AP for the 7.6 WLC.

Thomas McClintic Tue, 01/21/2014 - 12:44
User Badges:

Here is from the bootloader

cisco AIR-CAP2602I-A-K9 (PowerPC) processor (revision A0) with 180214K/81920K bytes of memory.
Processor board ID FTX1742J277
PowerPC CPU at 800Mhz, revision number 0x2151
Last reset from power-on
LWAPP image version 7.5.1.73
1 Gigabit Ethernet interface

32K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address: C0:67:AF:6F:30:DB
Part Number                          : 73-14588-02
PCA Assembly Number                  : 800-37899-01
PCA Revision Number                  : A0
PCB Serial Number                    : FOC173512PB
Top Assembly Part Number             : 800-38356-01
Top Assembly Serial Number           : FTX1742J277
Top Revision Number                  : A0
Product/Model Number                 : AIR-CAP2602I-A-K9  
% Please define a domain-name first.


I have never installed 7.5 on a WLC here. It would appear the LWAPP version is incorrectly marked, or something to that affect.


 

examining image...

extracting info (286 bytes)

Image info:

    Version Suffix: k9w8-.152-4.JB3

    Image Name: ap3g2-k9w8-mx.152-4.JB3

    Version Directory: ap3g2-k9w8-mx.152-4.JB3

    Ios Image Size: 215552

    Total Image Size: 13660672

    Image Feature: WIRELESS LAN|LWAPP

    Image Family: AP3G2

    Wireless Switch Management Version: 7.6.100.0

Not enough free space to download.

Check for crashinfo/radio coredump and non used image files...

Deleting flash:/ap3g2-k9w8-mx.v152_2_jb.201310300019 examining image...
extracting info (286 bytes)
Image info:
    Version Suffix: k9w8-.152-4.JB3
    Image Name: ap3g2-k9w8-mx.152-4.JB3
    Version Directory: ap3g2-k9w8-mx.152-4.JB3
    Ios Image Size: 215552
    Total Image Size: 13660672
    Image Feature: WIRELESS LAN|LWAPP
    Image Family: AP3G2
    Wireless Switch Management Version: 7.6.100.0
Not enough free space to download.
Check for crashinfo/radio coredump and non used image files...
Deleting flash:/ap3g2-k9w8-mx.v152_2_jb.201310300019

Sandeep Choudhary Tue, 01/21/2014 - 12:54
User Badges:
  • Purple, 4500 points or more
  • Cisco Designated VIP,

    2017 Wireless

make it factory default(Delete k9w8 image) and upload it agian.


Then try to connect it gaian



Regards

Leo Laohoo Tue, 01/21/2014 - 13:31
User Badges:
  • Super Gold, 25000 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 LAN, Wireless

Oh for goodness sake ...


You gents want to convert this to autonomous right?  Ok, here's a good two-step process which will wipe away your sweat and tears:


1.  Command:  format flash:

2.  Using a TFTP Server to Return to a Previous Release


Now, if you have an existing configuration and you want to maintain the config whilst re-installing the IOS, between step 1 and step 2, save the configuration using the "write" command. 

Thomas McClintic Tue, 01/21/2014 - 14:00
User Badges:

No sir, this issue is two images primary/backup on the AP. Rebooting the AP and the AP requiring an 'upgrade' to join the controller.


Not looking for autonomous.


This bug basically tells us not to predownload backup versions on APs....

Scott Fella Tue, 01/21/2014 - 15:15
User Badges:
  • Super Silver, 17500 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 Wireless

Im going to test this again... I'm adding a new 2602 and will bounce the AP and see what happens.


Thanks,

Scott

Help out other by using the rating system and marking answered questions as "Answered"

Scott Fella Tue, 01/21/2014 - 15:47
User Badges:
  • Super Silver, 17500 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 Wireless

It's probably a bug with the 2602's.  You might want to open a TAC case and reference this thread.


I had the same issue with a 2602e, but not with any other AP types:  Below are outputs from a 2602e and a 3602i


(WLC2504) >show ap image AIR-CAP2602E-A-K9



Total number of APs.............................. 6

Number of APs

        Initiated....................................... 0

        Predownloading.................................. 0

        Completed predownloading........................ 1

        Not Supported................................... 1

        Failed to Predownload........................... 0



                                                 Predownload     Predownload                                  Flexconnect

AP Name            Primary Image  Backup Image   Status          Version        Next Retry Time  Retry Count  Predownload

------------------ -------------- -------------- --------------- -------------- ---------------- ------------ ---------

AIR-CAP2602E-A-K9  7.6.100.0      7.5.102.0      Complete        7.5.102.0      NA               NA         



(WLC2504) >

(WLC2504) >show ap image AIR-CAP2602E-A-K9



Total number of APs.............................. 6

Number of APs

        Initiated....................................... 0

        Predownloading.................................. 0

        Completed predownloading........................ 0

        Not Supported................................... 1

        Failed to Predownload........................... 0



                                                 Predownload     Predownload                                  Flexconnect

AP Name            Primary Image  Backup Image   Status          Version        Next Retry Time  Retry Count  Predownload

------------------ -------------- -------------- --------------- -------------- ---------------- ------------ ---------

AIR-CAP2602E-A-K9  7.3.1.73       0.0.0.0        None            None           NA               NA                      



(WLC2504) >show ap image AIR-CAP3602I-A-K9-Beta



Total number of APs.............................. 6

Number of APs

        Initiated....................................... 0

        Predownloading.................................. 0

        Completed predownloading........................ 0

        Not Supported................................... 1

        Failed to Predownload........................... 0



                                                 Predownload     Predownload                                  Flexconnect

AP Name            Primary Image  Backup Image   Status          Version        Next Retry Time  Retry Count  Predownload

------------------ -------------- -------------- --------------- -------------- ---------------- ------------ ---------

AIR-CAP3602I-A-K9-Beta 7.6.100.0      7.5.102.0      None            None           NA               NA        


(WLC2504) >show ap image AIR-CAP3602I-A-K9-Beta



Total number of APs.............................. 5

Number of APs

        Initiated....................................... 0

        Predownloading.................................. 0

        Completed predownloading........................ 0

        Not Supported................................... 1

        Failed to Predownload........................... 0



                                                 Predownload     Predownload                                  Flexconnect

AP Name            Primary Image  Backup Image   Status          Version        Next Retry Time  Retry Count  Predownload

------------------ -------------- -------------- --------------- -------------- ---------------- ------------ ---------

AIR-CAP3602I-A-K9-Beta 7.6.100.0      7.5.102.0      None            None           NA               NA    



Thanks,

Scott

Help out other by using the rating system and marking answered questions as "Answered"

Jan-Erik Eikefjord Tue, 02/04/2014 - 01:40
User Badges:

This is the reply from TAC on this matter;


Starting with the Cisco IOS releases 15.2(4)JB and 12.4(25e)JAO, on Cisco Aironet 3600 series APs, the backup IOS image is deleted from the system board's Flash memory when the new image is downloaded on to it. This is designed to be so because the system board's Flash memory, which has a total of 31 MB, does not have enough space to store the recovery image, the new image, and the backup image.


Ref. http://tools.cisco.com/squish/b3090

Scott Fella Tue, 02/04/2014 - 03:53
User Badges:
  • Super Silver, 17500 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 Wireless

Thanks for the follow up!

+5

Sent from Cisco Technical Support iPhone App

Leo Laohoo Tue, 01/21/2014 - 15:16
User Badges:
  • Super Gold, 25000 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 LAN, Wireless

What they want you to do is to force the WLC to give you a fresh image because the current FULL controller-based IOS your AP is using could be corrupt.


Now the issue is that there seems to be an issue loading the IOS.  You've got two choices to go over this hurdle:  The long way around the mountain (what you all are doing) or the nice-and-nasty way (format the flash, run the "mode" button and off you go to the next step).

patrick.kofler Mon, 02/03/2014 - 04:07
User Badges:

I have the same issue, but after some tests I think this cannot be easily remedied.
The 2600 Series has 32MB Flash. Each new AP has a recovery image pre-installed, which in that case, is about 7-8MB. So we only have 24MB left.

Checking on the bundle size on the WLC running 7.6 it states the following (command used is: show ap bundle all)


Primary AP Image        Size        (7.6.100.0) 
----------------        ----       
ap1g1                   10876      
ap1g2                   11356      
ap1g3                   7672       
ap3g1                   10248      
ap3g2                   13380      
ap3g3                   0          
ap801                   7524       
ap802                   8968       
c1130                   5092       
c1140                   10096      
c1250                   7264       
c1520                   8396       
c602i                   3756       
version.info                    4  



Secondary AP Image      Size        (7.5.102.0)   
------------------      ----                      
ap1g1                   10776                     
ap1g2                   10116                     
ap3g1                   10156                     
ap3g2                   11276                     
ap801                   7444                      
ap802                   8848                      
c1130                   5092                      
c1140                   10008                     
c1250                   7184                      
c1520                   8288                      
c602i                   3756                      


The one marked in red is the image for the 2600. Subtract about 13.5MB from the remaining 24MB leaves 10.5MB. Definitely not enough for a backup image to be stored in the flash let alone to inflate it in case it would still succeed to be transferred. Additionally this output conforms with your observation that series 1130,1240 and 1250 work without any issues. There is enough space to fit both images as well as the recovery image. I assume that for the 1140 Series the flash is fitting just right .


So, in order to do what you wish is to ssh/telnet into every AP and remove the recovery image to free up enough space for both main images. I tried that on my test AP and it worked.

However, keep in mind that this might not be a solution endorsed by Cisco.


P.S.: If someone knows the equivalent command for showing the AP image sizes on the 5760 WLCs I would be very grateful.


Regards,

Patrick

Scott Fella Mon, 02/03/2014 - 06:01
User Badges:
  • Super Silver, 17500 points or more
  • Hall of Fame,

    The Hall of Fame designation is a lifetime achievement award based on significant overall achievements in the community. 

  • Cisco Designated VIP,

    2017 Wireless

Removing files on flash is okay as long as you know what your doing:)  As far as the 5760, you can see the image size by looking at the flash:


dir flash:mnt/images/ap.bak


Thanks,


Scott

Help out other by using the rating system and marking answered questions as "Answered"

patrick.kofler Mon, 02/03/2014 - 23:42
User Badges:

I just remembered that this "workaround" will only, if you have not yet predownloaded the image to the APs yet. The reason is that after the download the WLC thinks that now its primary and secondary image are stored on the AP and will thus not trigger another predownload. There is no prior space verification done unfortunately.

If the images will continue to get bigger I think it would be good that Cisco enhances the ap image command set to include such failsafe mechanisms.


@Scott: That path is not present. I only see the individual package files(base, drivers, infra, platform, wcm), where one of them contains the actual AP image. I haven't found a way yet to get a peek into those files.


Regards,

Patrick

Rasika Nayanajith Tue, 02/04/2014 - 00:56
User Badges:
  • Purple, 4500 points or more
  • Cisco Designated VIP,

    2017 Wireless

Hi Patrick,


I have checked my 5760 & can see the those images with its size.


5760-1#dir flash:mnt/images/ap.bak

Directory of flash:mnt/images/ap.bak/

40403  -r--          40   Oct 3 2013 22:29:11 +10:00  ap1g2.md5

40402  -r--    11591680   Oct 3 2013 22:29:11 +10:00  ap1g2

40405  -r--          40   Oct 3 2013 22:29:10 +10:00  ap3g1.md5

40404  -r--    10444800   Oct 3 2013 22:29:12 +10:00  ap3g1

40407  -r--          40   Oct 3 2013 22:29:10 +10:00  ap3g2.md5

40406  -r--    13568000   Oct 3 2013 22:29:11 +10:00  ap3g2

40409  -r--          40   Oct 3 2013 22:29:10 +10:00  c1140.md5

40408  -r--    10291200   Oct 3 2013 22:29:11 +10:00  c1140

40410  -r--          11   Oct 3 2013 22:29:11 +10:00  version.info



3641335808 bytes total (3298693120 bytes free)


You should be able to see it in your one as well. Check it again & see


HTH

Rasika


**** Pls rate all useful responses ****

patrick.kofler Tue, 02/04/2014 - 01:10
User Badges:

Hi Rasika,

I checked again. This output represents the flash content of all of our 5760s:


16162  -rwx     2097152  Jan 29 2014 13:59:44 +00:00  nvram_config

16163  -rw-   286925700   Dec 9 2013 09:42:12 +00:00  ct5760-ipservicesk9.SPA.03.03.01.SE.150-1.EZ1.bin

16164  -rw-        1212   Dec 9 2013 12:44:29 +00:00  packages.conf

16166  -rw-    96355812   Dec 9 2013 09:46:08 +00:00  ct5760-base.SPA.03.03.01SE.pkg

16167  -rw-     5616316   Dec 9 2013 09:46:14 +00:00  ct5760-drivers.SPA.03.03.01SE.pkg

16168  -rw-    31611912   Dec 9 2013 09:46:09 +00:00  ct5760-infra.SPA.03.03.01SE.pkg

16170  -rw-    26942336   Dec 9 2013 09:46:10 +00:00  ct5760-platform.SPA.03.03.01SE.pkg

64644  -rw-        2536  Oct 18 2013 14:57:55 +00:00  vlan.dat

24241  drwx        4096   Apr 9 2010 17:47:20 +00:00  guestportal

16169  -rw-    50224444   Dec 9 2013 09:46:11 +00:00  ct5760-iosd-ipservicesk9.SPA.150-1.EZ1.pkg

64646  -rw-   286568868  Apr 10 2010 15:11:59 +00:00  ct5760-ipservicesk9.SPA.03.03.00.SE.150-1.EZ.bin

24249  -rw-    96356448  Apr 16 2010 13:40:28 +00:00  ct5760-base.SPA.03.03.00SE.pkg

24250  -rw-     5616316  Apr 16 2010 13:40:34 +00:00  ct5760-drivers.SPA.03.03.00SE.pkg

24251  -rw-    31634304  Apr 16 2010 13:40:29 +00:00  ct5760-infra.SPA.03.03.00SE.pkg

24252  -rw-    49988784  Apr 16 2010 13:40:32 +00:00  ct5760-iosd-ipservicesk9.SPA.150-1.EZ.pkg

24253  -rw-    26927836  Apr 16 2010 13:40:30 +00:00  ct5760-platform.SPA.03.03.00SE.pkg

24254  -rw-    76040908  Apr 16 2010 13:40:34 +00:00  ct5760-wcm.SPA.10.1.100.0.pkg

16171  -rw-    76170040   Dec 9 2013 09:46:13 +00:00  ct5760-wcm.SPA.10.1.110.0.pkg


There is no mnt directory present.


Regards,

Patrick

Rasika Nayanajith Tue, 02/04/2014 - 01:31
User Badges:
  • Purple, 4500 points or more
  • Cisco Designated VIP,

    2017 Wireless

Hi Patrick,


That's interesting why it is gone missing in your 5760. I have checked this in my 3850s as well  & I can see that mnt folder over there as well. Worth to check this with Cisco TAC as I cannot find any valid reason why it is not there in your case.


3850-2#dir

Directory of flash:/

15490  -rwx     2097152  Jan 16 2014 18:36:49 +11:00  nvram_config

15494  -rw-    79113792  Dec 19 2013 18:33:34 +11:00  cat3k_caa-base.SPA.03.03.01SE.pkg

15495  -rw-     6476476  Dec 19 2013 18:33:34 +11:00  cat3k_caa-drivers.SPA.03.03.01SE.pkg

15496  -rw-    34503664  Dec 19 2013 18:33:34 +11:00  cat3k_caa-infra.SPA.03.03.01SE.pkg

69698  -rw-        1248  Dec 19 2013 18:33:39 +11:00  packages.conf

15498  -rwx         684  Jan 16 2014 18:36:24 +11:00  vlan.dat

15497  -rw-    34788684  Dec 19 2013 18:33:34 +11:00  cat3k_caa-iosd-universalk9.SPA.150-1.EZ1.pkg

69697  drwx        4096  Dec 17 2013 14:39:21 +11:00  mnt

15499  -rw-    25009040  Dec 19 2013 18:33:34 +11:00  cat3k_caa-platform.SPA.03.03.01SE.pkg

15500  -rw-    77296448  Dec 19 2013 18:33:35 +11:00  cat3k_caa-wcm.SPA.10.1.110.0.pkg


5760-1#dir

Directory of flash:/


210082  -rwx     2097152  Dec 20 2013 14:09:57 +11:00  nvram_config

16161  drwx        4096   Oct 8 2013 16:39:24 +11:00  mnt

210090  -rwx         684  Dec 20 2013 11:04:29 +11:00  vlan.dat

193924  -rw-        1212  Dec 19 2013 18:26:41 +11:00  running-packages.conf

48483  -rw-    96355812  Dec 19 2013 18:26:39 +11:00  ct5760-base.SPA.03.03.01SE.pkg

48484  -rw-     5616316  Dec 19 2013 18:26:39 +11:00  ct5760-drivers.SPA.03.03.01SE.pkg

48485  -rw-    31611912  Dec 19 2013 18:26:39 +11:00  ct5760-infra.SPA.03.03.01SE.pkg

48486  -rw-    50224444  Dec 19 2013 18:26:39 +11:00  ct5760-iosd-ipservicesk9.SPA.150-1.EZ1.pkg

161601  -rw-    26942336  Dec 19 2013 18:26:39 +11:00  ct5760-platform.SPA.03.03.01SE.pkg

161602  -rw-    76170040  Dec 19 2013 18:26:39 +11:00  ct5760-wcm.SPA.10.1.110.0.pkg

3641335808 bytes total (3298693120 bytes free)


HTH

Rasika


**** Pls rate all useful responses ****

Actions

This Discussion

Related Content