cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
4944
Views
5
Helpful
6
Replies

%IOSXEBOOT-4-ABORT: (rp/0): Package provisioning file after a 3850 upgrading from 03.07.04 to 03.07.05

Levante86
Level 1
Level 1

Hello everyone,


i have three WS-C3850-12X48U in stack.


I performed an IOS upgrade from 03.07.04 to 03.07.05 but when the stack re-boot the first switch of the stack go into recovery mode:

switch#software install file flash; :cat3k_caa-universalk9.SPA.03.07.05$stall file flash:cat3k_caa-universalk9.SPA.03.07.05. switch 1,2,3 E.152-3.E flash:cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5 .bin
Preparing install operation ...
[1]: Copying software from active switch 1 to switches 2,3
[1]: Finished copying software to switches 2,3
[1 2 3]: Starting install operation
[1 2 3]: Expanding bundle flash:cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin
[1 2 3]: Copying package files
[1 2 3]: Package files copied
[1 2 3]: Finished expanding bundle flash:cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5.bin
[1 2 3]: Verifying and copying expanded package files to flash:
[1 2 3]: Verified and copied expanded package files to flash:
[1 2 3]: Starting compatibility checks
[1 2 3]: Finished compatibility checks
[1 2 3]: Starting application pre-installation processing
[1 2 3]: Finished application pre-installation processing
[1]: Old files list:
Removed cat3k_caa-base.SPA.03.07.04E.pkg
Removed cat3k_caa-drivers.SPA.03.07.04E.pkg
Removed cat3k_caa-infra.SPA.03.07.04E.pkg
Removed cat3k_caa-iosd-universalk9.SPA.152-3.E4.pkg
Removed cat3k_caa-platform.SPA.03.07.04E.pkg
Removed cat3k_caa-wcm.SPA.10.3.141.0.pkg
[2]: Old files list:
Removed cat3k_caa-base.SPA.03.07.04E.pkg
Removed cat3k_caa-drivers.SPA.03.07.04E.pkg
Removed cat3k_caa-infra.SPA.03.07.04E.pkg
Removed cat3k_caa-iosd-universalk9.SPA.152-3.E4.pkg
Removed cat3k_caa-platform.SPA.03.07.04E.pkg
Removed cat3k_caa-wcm.SPA.10.3.141.0.pkg
[3]: Old files list:
Removed cat3k_caa-base.SPA.03.07.04E.pkg
Removed cat3k_caa-drivers.SPA.03.07.04E.pkg
Removed cat3k_caa-infra.SPA.03.07.04E.pkg
Removed cat3k_caa-iosd-universalk9.SPA.152-3.E4.pkg
Removed cat3k_caa-platform.SPA.03.07.04E.pkg
Removed cat3k_caa-wcm.SPA.10.3.141.0.pkg
[1]: New files list:
Added cat3k_caa-base.SPA.03.07.05E.pkg
Added cat3k_caa-drivers.SPA.03.07.05E.pkg
Added cat3k_caa-infra.SPA.03.07.05E.pkg
Added cat3k_caa-iosd-universalk9.SPA.152-3.E5.pkg
Added cat3k_caa-platform.SPA.03.07.05E.pkg
Added cat3k_caa-wcm.SPA.10.3.150.0.pkg
[2]: New files list:
Added cat3k_caa-base.SPA.03.07.05E.pkg
Added cat3k_caa-drivers.SPA.03.07.05E.pkg
Added cat3k_caa-infra.SPA.03.07.05E.pkg
Added cat3k_caa-iosd-universalk9.SPA.152-3.E5.pkg
Added cat3k_caa-platform.SPA.03.07.05E.pkg
Added cat3k_caa-wcm.SPA.10.3.150.0.pkg
[3]: New files list:
Added cat3k_caa-base.SPA.03.07.05E.pkg
Added cat3k_caa-drivers.SPA.03.07.05E.pkg
Added cat3k_caa-infra.SPA.03.07.05E.pkg
Added cat3k_caa-iosd-universalk9.SPA.152-3.E5.pkg
Added cat3k_caa-platform.SPA.03.07.05E.pkg
Added cat3k_caa-wcm.SPA.10.3.150.0.pkg
[1 2 3]: Creating pending provisioning file
[1 2 3]: Finished installing software. New software will load on reboot.
[1 2 3]: Committing provisioning file

[1 2 3]: Do you want to proceed with reload? [yes/no]: y

System configuration has been modified. Save? [yes/no]: y
Building configuration...
Compressed configuration from 65790 bytes to 17460 bytes[OK]
[1 2 3]: Reloading


Apr 15 10:15:43: %STACKMGR-1-RELOAD_REQUEST: 1 stack-mgr: Received reload request for all switches, reason User requested reload
Apr 15 10:15:43: %STACKMGR-1-RELOAD: 1 stack-mgr: Reloading due to reason User requested reload
Apr 15 10:15:43: %STACKMGR-1-RELOAD: STANDBY:2 stack-mgr: Reloading due to reason User requested reload (ITATS01AS031-L-2)
Apr 15 10:15:43: %STACKMGR-1-RELOAD: MEMBER: 3 stack-mgr: Reloading due to reason User requested reload
Apr 15 10:15:44: %IOSXE-3-PLATFORM: MEMBER: 3 process sysmgr: Reset/Reload requested by [stack-manager].
Apr 15 10:15:44: %IOSXE-3-PLATFORM: 1 process sysmgr: Reset/Reload requested by [stack-manager].
Apr 15 10:15:43: %IOSXE-3-PLATFORM: STANDBY:2 process sysmgr: Reset/Reload requested by [stack-manager]. (ITATS01AS031-L-2)
ITATS01AS031-L#
<Sat Apr 15 08:15:44 2017> Message from sysmgr: Reason Code:[3] Reset Reason:Reset/Reload requested by [stack-manager]. [User requested reload]
umount: /proc/fs/nfsd: not mounted
Unmounting ng3k filesystems...
Unmounted /dev/sda3...
Warning! - some ng3k filesystems may not have unmounted cleanly...
Please stand by while rebooting the system...
Restarting system.


Booting...

Interface GE 0 link down***ERROR: PHY link is down


Getting rest of image

Reading full image into memory...Check base package header ...: done = 16384

Getting rest of image

Reading full image into memory....done

Reading full base package into memory...: done = 82000420

Bundle Image

--------------------------------------

Kernel Address : 0x5342f34c

Kernel Size : 0x3fb255/4174421

Initramfs Address : 0x5382a5a4

Initramfs Size : 0xd47c7e/13925502

Compression Format: .mzip


Bootable image at @ ram:0x5342f34c

Bootable image segment 0 address range [0x81100000, 0x820b0000] is in range [0x80180000, 0x90000000].

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 377

Loading Linux kernel with entry point 0x816734a0 ...

Bootloader: Done loading app on core_mask: 0x3f


### Launching Linux Kernel (flags = 0x5)


All packages are Digitally Signed
Starting System Services
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=4,mode=600,ptmxmode=000 0 0


FIPS(NGWC): Flash Key Check : Begin
FIPS(NGWC): Flash Key Check : End, Not Found, FIPS Mode Not Enabled


Front-end Microcode IMG MGR: found 4 microcode images for 1 device.
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_6_0
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_6_1
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_6_2
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_6_3

Front-end Microcode IMG MGR: Preparing to program device microcode...
Front-end Microcode IMG MGR: Preparing to program device[0]...594412 bytes.... Skipped[0].
Front-end Microcode IMG MGR: Preparing to program device[0]...393110 bytes.
Front-end Microcode IMG MGR: Programming device 0...rwRrrrrrrw..0%.........................................................................10%........................................................................20%..........................................................................30%........................................................................40%........................................................................50%..........................................................................60%.........................................................................70%..........................................................................80%........................................................................90%........................................................................100%
Front-end Microcode IMG MGR: Preparing to program device[0]...25166 bytes.
Front-end Microcode IMG MGR: Programming device 0...rrrrrrw..0%....10%....20%......30%...40%......50%....60%......70%...80%......90%....100%wRr!
Front-end Microcode IMG MGR: Microcode programming complete for device 0.
Front-end Microcode IMG MGR: Preparing to program device[0]...86370 bytes.
Front-end Microcode IMG MGR: Programming device 0...rwRrrrrrrw..0%................10%...............20%.................30%...............40%.................50%...............60%.................70%................80%...............90%.................100%w

Front-end Microcode IMG MGR: Microcode programming complete in 292 seconds

% Front-end Microcode IMG MGR: HW image is upgraded. MCU reset causes the switch to reload
ÿ

Booting...

Interface GE 0 link down***ERROR: PHY link is down


Getting rest of image

Reading full image into memory...Check base package header ...: done = 16384

Getting rest of image

Reading full image into memory....done

Reading full base package into memory...: done = 82000420

Bundle Image

--------------------------------------

Kernel Address : 0x5342f34c

Kernel Size : 0x3fb255/4174421

Initramfs Address : 0x5382a5a4

Initramfs Size : 0xd47c7e/13925502

Compression Format: .mzip


Bootable image at @ ram:0x5342f34c

Bootable image segment 0 address range [0x81100000, 0x820b0000] is in range [0x80180000, 0x90000000].

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 377

Loading Linux kernel with entry point 0x816734a0 ...

Bootloader: Done loading app on core_mask: 0x3f


### Launching Linux Kernel (flags = 0x5)


ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata1.00: DMA stat 0x0
ata1.00: failed command: WRITE DMA
ata1.00: cmd ca/00:01:42:d0:07/00:00:00:00:00/e0 tag 0 dma 512 out
res 00/00:00:00:00:00/00:00:00:00:00/00 Emask 0x2 (HSM violation)
ata1.00: revalidation failed (errno=-2)
ata1.00: revalidation failed (errno=-2)
ata1.00: revalidation failed (errno=-2)
Buffer I/O error on device sda6, logical block 2
Buffer I/O error on device sda, logical block 75411
Buffer I/O error on device sda, logical block 75411
Buffer I/O error on device sda, logical block 75411
Buffer I/O error on device sda, logical block 75411
Buffer I/O error on device sda, logical block 4
Buffer I/O error on device sda, logical block 5
Buffer I/O error on device sda, logical block 6
Buffer I/O error on device sda, logical block 7
Buffer I/O error on device sda, logical block 8
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector


%IOSXEBOOT-4-ABORT: (rp/0): Package provisioning file {/tmp/packages.conf} does not exist.
%IOSXEBOOT-4-ABORT: (rp/0): Package provisioning file {/tmp/packages.conf} does not exist.


Booting...cf_identify_drive: cf_waitfor(CMD_READY): timed out.

Boot bus: Failed to detect any IDE storage!


Interface GE 0 link down***ERROR: PHY link is down

flash:packages.conf: no such device

Cannot open file flash:packages.conf


The system is unable to boot automatically. The

BOOT environment variable needs to be set to a

bootable image.

switch:

And this is the "scenario" after reboot, the memeber one in provisioned/recovery not addedd to stack

switch#sh switch
Switch/Stack Mac Address : 00b0.e136.1400 - Local Mac Address
Mac persistency wait time: Indefinite
                                             H/W   Current
Switch#   Role    Mac Address     Priority Version  State
------------------------------------------------------------
 1       Member   0000.0000.0000     0      0       Provisioned         
*2       Active   00b0.e136.1400     10     V02     Ready               
 3       Member   00b0.e136.4c00     5      V02     Ready               


ITATS01AS031-L#sh version | include INSTALL
*    2 62    WS-C3850-12X48U    03.07.05E         cat3k_caa-universalk9 INSTALL
     3 62    WS-C3850-12X48U    03.07.05E         cat3k_caa-universalk9 INSTALL

No operation has solved the problem, not even the "recovery trapdoor":

switch: set IP_ADDR 192.0.2.123/255.255.255.0

switch: set DEFAULT_ROUTER 192.0.2.1

switch: ping 192.0.2.1
ping 192.0.2.1 with 32 bytes of data ...
Up 100 Mbps Full duplex (port 0) (SGMII)
Host 192.0.2.1 is alive.

switch: ping 192.0.2.1
ping 192.0.2.1 with 32 bytes of data ...
Host 192.0.2.1 is alive.

switch: emergency-install tftp://192.0.2.1/cat3k_caa-universalk9.SPA.03.07.05.E. 152-3.E5.bin
The bootflash will be erased during install operation, continue (y/n)?y
Starting emergency recovery (tftp://192.0.2.1/cat3k_caa-universalk9.SPA.03.07.05 .E.152-3.E5.bin)...
Reading full image into memory.......................done
Bundle Image
--------------------------------------
Kernel Address : 0x534315d4
Kernel Size : 0x3fb4ba/4175034
Initramfs Address : 0x5382ca90
Initramfs Size : 0xd48a11/13928977
Compression Format: .mzip

Bootable image at @ ram:0x534315d4
Bootable image segment 0 address range [0x81100000, 0x820b0000] is in range [0x8 0180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
File "sda9:cat3k_caa-recovery.bin" uncompressed and installed, entry point: 0x81 6734a0
Loading Linux kernel with entry point 0x816734a0 ...
Bootloader: Done loading app on core_mask: 0x3f

### Launching Linux Kernel (flags = 0x5)

Initiating Emergency Installation of bundle tftp://192.0.2.1/cat3k_caa-universal k9.SPA.03.07.05.E.152-3.E5.bin


Downloading bundle tftp://192.0.2.1/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E 5.bin...

Validating bundle tftp://192.0.2.1/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5 .bin...
Installing bundle tftp://192.0.2.1/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5 .bin...
Verifying bundle tftp://192.0.2.1/cat3k_caa-universalk9.SPA.03.07.05.E.152-3.E5. bin...
Package cat3k_caa-base.SPA.03.07.05E.pkg is Digitally Signed
Package cat3k_caa-drivers.SPA.03.07.05E.pkg is Digitally Signed
Package cat3k_caa-infra.SPA.03.07.05E.pkg is Digitally Signed
Package cat3k_caa-iosd-universalk9.SPA.152-3.E5.pkg is Digitally Signed
Package cat3k_caa-platform.SPA.03.07.05E.pkg is Digitally Signed
Package cat3k_caa-wcm.SPA.10.3.150.0.pkg is Digitally Signed
Preparing flash.../ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata1.00: DMA stat 0x0
ata1.00: failed command: WRITE DMA
ata1.00: cmd ca/00:08:47:0d:0c/00:00:00:00:00/e0 tag 0 dma 4096 out
res 00/00:00:00:00:00/00:00:00:00:00/00 Emask 0x2 (HSM violation) - ata1.00: revalidation failed (errno=-2) | ata1.00: revalidation failed (errno=-2) - ata1.00: revalidation failed (errno=-2) \ Buffer I/O error on device sda3, logical block 0
EXT2-fs: sda3 previous I/O error to superblock detected
Buffer I/O error on device sda3, logical block 0
EXT2-fs: sda3 previous I/O error to superblock detected
Buffer I/O error on device sda3, logical block 0
EXT2-fs: sda3 previous I/O error to superblock detected
Buffer I/O error on device sda3, logical block 0
Buffer I/O error on device sda3, logical block 0
Buffer I/O error on device sda3, logical block 1 | Buffer I/O error on device sda3, logical block 2
Buffer I/O error on device sda3, logical block 3
Buffer I/O error on device sda3, logical block 4
Buffer I/O error on device sda3, logical block 5

Flash format operation failed
Failed preparing flash - Emergency Install aborted
Restarting system.

Booting...cf_identify_drive: cf_waitfor(CMD_READY): timed out.
Boot bus: Failed to detect any IDE storage!
flash:packages.conf: no such device
Cannot open file flash:packages.conf

The system is unable to boot automatically. The
BOOT environment variable needs to be set to a
bootable image.


switch:

Anyone can help me?

regards

1 Accepted Solution

Accepted Solutions

phipse_508122
Level 1
Level 1

I had this problem yesterday, I resolved it by disconnecting the stacking cables (or switching off the other switches in the stack) and then powering on the active/primary switch, once it booted up properly I switched on the other switches and checked that everything was OK.  It has been fine ever since.

View solution in original post

6 Replies 6

Leo Laohoo
Hall of Fame
Hall of Fame

ata1.00: cmd ca/00:01:42:d0:07/00:00:00:00:00/e0 tag 0 dma 512 out
res 00/00:00:00:00:00/00:00:00:00:00/00 Emask 0x2 (HSM violation)
ata1.00: revalidation failed (errno=-2)
ata1.00: revalidation failed (errno=-2)
ata1.00: revalidation failed (errno=-2)
Buffer I/O error on device sda6, logical block 2
Buffer I/O error on device sda, logical block 75411
Buffer I/O error on device sda, logical block 75411
Buffer I/O error on device sda, logical block 75411
Buffer I/O error on device sda, logical block 75411
Buffer I/O error on device sda, logical block 4
Buffer I/O error on device sda, logical block 5
Buffer I/O error on device sda, logical block 6
Buffer I/O error on device sda, logical block 7
Buffer I/O error on device sda, logical block 8
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector
FAT: unable to read boot sector

This to me says the switch is dead.  Can you try removing the power cable (switch 1) and putting it back?

Thanks for the answer,

but of course, I tried to open the stack, and to restart the first member by removing and re-insert the power cable... any results ....

RMA the switch.

phipse_508122
Level 1
Level 1

I had this problem yesterday, I resolved it by disconnecting the stacking cables (or switching off the other switches in the stack) and then powering on the active/primary switch, once it booted up properly I switched on the other switches and checked that everything was OK.  It has been fine ever since.

Thanks for the advice, if it happens again, I will try

 

I had the same problem here is solution :

Reset switch : Hold the mode key for 2 min and switch on the power 

press enter 

you will get below option 

Command 1:   switch: flash_init

Command 2: switch: boot flash:packages.conf.00-

 

It will look like below :

 

Booting...(use DDR clock 667 MHz)
Interface GE 0 link down***ERROR: PHY link is down
The "IP_ADDR" environment variable is not set.

The system has been interrupted prior to initializing some
filesystems and loading the operating system software.
Console will be reset to 9600 baud rate, need to change terminal setting first.
The following commands will initialize the remaining filesystems,
and finish loading the operating system software:

flash_init
boot


switch:

switch:

switch: flash_init
Initializing Flash...

flashfs[7]: 0 files, 1 directories
flashfs[7]: 0 orphaned files, 0 orphaned directories
flashfs[7]: Total bytes: 6784000
flashfs[7]: Bytes used: 1024
flashfs[7]: Bytes available: 6782976
flashfs[7]: flashfs fsck took 1 seconds....done Initializing Flash.

switch: dir flash:
Directory of flash:/

32065 drwx 4096 .
2 drwx 4096 ..
32066 -rw- 2097152 nvram_config
32067 -rw- 19167872 cat3k_caa-guestshell.16.06.05.SPA.pkg
32068 -rw- 27904156 cat3k_caa-rpbase.16.06.05.SPA.pkg
32069 -rw- 336210552 cat3k_caa-rpcore.16.06.05.SPA.pkg
32070 -rw- 5051008 cat3k_caa-srdriver.16.06.05.SPA.pkg
32071 -rw- 16257660 cat3k_caa-webui.16.06.05.SPA.pkg
112228 -rw- 1236 packages.conf
32073 drwx 4096 .installer
32074 -rw- 111 bootloader_evt_handle.log
32075 drwx 4096 core
64129 drwx 4096 .prst_sync
80161 drwx 4096 .rollback_timer
88177 drwx 4096 gs_script
96193 drwx 4096 dc_profile_dir
32076 -rw- 128103 memleak.tcl
32078 -rw- 2097152 nvram_config_bkup
32079 -rw- 35 pnp-tech-time
32080 -rw- 61768 pnp-tech-discovery-summary
32081 -rw- 76 boothelper.log
32072 -rw- 0 .onreboot
32092 -rw- 83297376 cat3k_caa-base.SPA.03.06.05E.pkg
32085 -rw- 4012732 cat3k_caa-drivers.SPA.03.06.05E.pkg
32089 -rw- 33786860 cat3k_caa-infra.SPA.03.06.05E.pkg
32087 -rw- 43048256 cat3k_caa-iosd-universalk9.SPA.152-2.E5.pkg
32088 -rw- 28343180 cat3k_caa-platform.SPA.03.06.05E.pkg
32091 -rw- 1236 cat3k_caa-universalk9.SPA.03.06.05.E.152-2.E5.conf
32086 -rw- 111260480 cat3k_caa-wcm.SPA.10.2.150.0.pkg
32084 -rw- 3902 packages.conf.00-

2641031168 bytes available (773459968 bytes used)

switch: boot flash:packages.conf.00-

Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 27904156
Bundle Image
--------------------------------------
Kernel Address : 0x5377c3bc
Kernel Size : 0x365d89/3562889
Initramfs Address : 0x53ae2145
Initramfs Size : 0x16ddf57/23977815
Compression Format: mzip

Bootable image at @ ram:0x5377c3bc
Bootable image segment 0 address range [0x81100000, 0x81bffb30] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 623
Loading Linux kernel with entry point 0x816e0330 ...
Bootloader: Done loading app on core_mask: 0x3f

### Launching Linux Kernel (flags = 0x5)

%IOSXEBOOT-5c8e9d6656e9d89a8dedeae457871084-new_cksum: (rp/0): 4
%IOSXEBOOT-5c8e9d6656e9d89a8dedeae457871084-saved_cksum: (rp/0): 4

Both links down, not waiting for other switches
Switch number is 1

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: