Impossible to boot from new image in ROMMON

CSCO11305513 · ‎07-11-2012

Hi,

I have C3845 router in which we had to order new flash card (the old one had to be destroyed). Right now I'm facing two problems:

1. (workaround already found, however I'm still curious why it happens): When I try to tftpdnld new image from my desktop I always receive the same error when passing border of around 32MBs:

Receiving c3845-adventerprisek9-mz.124-22.YB8.bin from 10.10.123.114 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!.................... [TIMED OUT]

TFTP: Operation terminated.

On tftpd32 side error message are:

Connection received from 10.10.123.138 on port 15948 [11/07 15:53:02.499]

Read request for file <c3845-adventerprisek9-mz.124-22.YB8.bin>. Mode octet [11/07 15:53:02.499]

Using local port 54672 [11/07 15:53:02.500]

Ack block 0 ignored (received twice) [11/07 15:54:51.378]

TIMEOUT waiting for Ack block #65536 [11/07 15:55:33.862]

It happens as well, when I use Solarwinds, and flash size is 64MBs.

2. When I did upload the image via xmodem, and try to boot the router it says:

rommon 38 > boot flash:c3845-ipbase-mz.123-11.YZ2.bin

program load complete, entry point: 0x8000f000, size: 0xc0c0

Initializing ATA monitor library.......

program load complete, entry point: 0x80010000, size: 0xe4bed4

Error : compressed image checksum is incorrect 0xD4DA4FBF

Expected a checksum of 0x8CD1D536

*** System received a Software forced crash ***

signal= 0x17, code= 0x5, context= 0x80016c40

PC = 0x00000000, SP = 0x00000000, RA = 0x00000000

Cause Reg = 0x00000000, Status Reg = 0x00000000

This already happened for me twice for two different images - the one I uploaded via xmodem (the size of the file is exactly the sime as on my PC), and another one, smaller then 32MB, that I uploaded later on (again size matches exactly the size on my PC and transfer went well with no errors or exceptions).

Any help would be highly appreciated as I'm stuck and the router is completely dead at the moment. Regards

Reza Sharifi · ‎07-11-2012

Hi,

Have you tried a different flash card? Not all the flash cards work with Cisco devices. If you try a different flash card and still have the same issue, also try a different IOS version.

HTH

paolo bevilacqua · ‎07-11-2012

Try tftpload an image smaller than 32 MB.

Ivan Shirshin · ‎07-11-2012

Hi,

This is a known limitation in ROMMON versions before 12.4(2r)T and 12.3(11r)T02 on 2800 and 3800 routers. TFTP does not work on files >32mb in size due to that.

As for the xmodem issue, it seems the copy did not go well either due to interrupted process, or corrupted file on PC or flash HW problems on 3845.

There are 2 workarounds you can use:

1.

- Use the current "tftpdnld" to download a version of IOS that is less than 32 MB.

- Boot that IOS

- Use that IOS to copy the IOS that is greater 32 MB to the Compact Flash

- reload and boot the new IOS.

2. Find a working router with similar setup and external flash, copy the image on that flash in IOS mode on working router, then move the flash to the problem router and boot from that file system. Then in IOS mode you can check the built-in flash, format it, copy image there, etc.

Kind Regards,
Ivan

**Please grade this post if you find it useful.

Kind Regards,
Ivan

CSCO11305513 · ‎07-12-2012

Hi,

Thank you for feedback - I have already uploaded smaller image (some old version of 12.4) directly after downloading it from cisco.com, it is uploaded properly (tftpd32 logs):

Connection received from 10.10.123.138 on port 8690 [12/07 09:44:37.081]

Read request for file . Mode octet [12/07 09:44:37.081]

Using local port 55764 [12/07 09:44:37.082]

: sent 29281 blks, 14991476 bytes in 47 s. 0 blk resent [12/07 09:45:24.455]

But even then I'm unable to boot:

rommon 275 > tftpdnld

IP_ADDRESS: 10.10.123.138

IP_SUBNET_MASK: 255.255.255.0

DEFAULT_GATEWAY: 10.10.123.3

TFTP_SERVER: 10.10.123.114

TFTP_FILE: c3845-ipbase-mz.123-11.YZ2.bin

GE_PORT: Ge0/0

TFTP_MEDIA_TYPE: Copper

GE_SPEED_MODE: Auto

Invoke this command for disaster recovery only.

WARNING: all existing data in all partitions on flash will be lost!

Do you wish to continue? y/n: [n]: y

Missing MAC address for variable TFTP_MACADDR

Mac Address: 0013.60c6.c620

Initializing interface.

Interface link state up.

ARPing for 10.10.123.114

ARP reply for 10.10.123.114 received. MAC address f0:4d:a2:cc:ca:5e

Receiving c3845-ipbase-mz.123-11.YZ2.bin from 10.10.123.114 !!!!!!!!!!!!!!!!![INPUT OMMITED]!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

network link is up

MAC Registers:

mac_cfg = 008000C800020166, mac_thrsh_cfg = 0000080404040804

mac_vlantag = 0000000000000000, mac_frame_cfg = 05EE400000040200

mac_adfilter_cfg = 0000000000000F00, mac_enable = 0000000000000C11

mac_status = 0000000000000000, mac_int_mask = 0000000000000000

mac_txd_ctl = 0000000000000000, mac_eth_addr = 0000D7CFFBEE95E6

mac_fifo_ptrs = 05EE400000040200, mac_eopcnt = 0000440028282828

MAC RX is enabled RX DMA - channel 0 is enabled, channel 1 is disabled

MAC TX is enabled TX DMA - channel 0 is enabled, channel 1 is disabled

Device status = full-duplex, 1000 Mbps

Internal Driver Information:

Rx Channel 0:

dma_config0 = 0000000000080000, dma_config1 = 0000000000000000

dma_dscr_base = 0000000006077F60, dma_dscr_cnt = 0000000000000007

dma_cur_dscr_a = 000230000607F060, dma_cur_dscr_b = 0000000000000000

dma_cur_daddr = 0000070006077F90

Tx Channel 0:

dma_config0 = 0000000000080000, dma_config1 = 0000000000000000

dma_dscr_base = 0000000006077E80, dma_dscr_cnt = 0000000000000000

dma_cur_dscr_a = 800202000607E860, dma_cur_dscr_b = 00B8000000000003

dma_cur_daddr = 0000000006077EC0

Address Filter:

Promiscuous mode disabled

Entry 0 MAC Addr = 001360C6C620

Entry 1 MAC Addr = 000000000000

Entry 2 MAC Addr = 000000000000

Entry 3 MAC Addr = 000000000000

Entry 4 MAC Addr = 000000000000

Entry 5 MAC Addr = 000000000000

Entry 6 MAC Addr = 000000000000

Entry 7 MAC Addr = 000000000000

(All other entries are empty)

Statistics:

Rx Bytes 0000000000FB2062 Tx Bytes 00000000001C9935

Rx Good Packets 29307 Tx Good Packets 29284

Rx Multicast 3

Rx Broadcast 21

Rx Bad Pkt Errors 0 Tx Bad Pkt Errors 0

Rx FCS Errors 0 Tx FCS Errors 0

Rx Runt Errors 0 Tx Runt Errors 0

Rx Oversize Errors 0 Tx Oversize Errors 0

Rx Length Errors 0 Tx Collisions 0

Rx Code Errors 0 Tx Late Collisions 0

Rx Dribble Errors 0 Tx Excessive Collisions 0

Tx Abort Errors 0

---Phy registers---

Reg 0 = 1140

Reg 1 = 796D

Reg 2 = 0020

Reg 3 = 60C1

Reg 4 = 01E1

Reg 5 = C5E1

Reg 6 = 000F

Reg 7 = 2001

Reg 8 = 4A1C

Reg 9 = 0300

Reg 10 = 7C00

Reg 11 = 0000

Reg 12 = 0000

Reg 13 = 0000

Reg 14 = 0000

Reg 15 = 3000

Reg 16 = 0000

Reg 17 = 0301

Reg 18 = 0000

Reg 19 = 0000

Reg 20 = 0000

Reg 21 = 0000

Reg 22 = 0000

Reg 23 = 0000

Reg 24 = 0400

Reg 25 = FF1C

Reg 26 = 243E

Reg 27 = FFFF

Reg 28 = 148F

Reg 29 = 0757

Reg 30 = 0000

File reception completed.

Copying file c3845-ipbase-mz.123-11.YZ2.bin to flash.

program load complete, entry point: 0x8000f000, size: 0xc0c0

Initializing ATA monitor library.......

Format: All system sectors written. OK...

Format: Operation completed successfully.

Format of flash: complete

program load complete, entry point: 0x8000f000, size: 0xc0c0

Initializing ATA monitor library.......

rommon 276 > dir flash:

program load complete, entry point: 0x8000f000, size: 0xc0c0

Initializing ATA monitor library.......

Directory of flash:

2 14991476 -rw- c3845-ipbase-mz.123-11.YZ2.bin

rommon 277 > boot flash:c3845-ipbase-mz.123-11.YZ2.bin

program load complete, entry point: 0x8000f000, size: 0xc0c0

Initializing ATA monitor library.......

program load complete, entry point: 0x80010000, size: 0xe4bed4

Error : compressed image checksum is incorrect 0xD4DB3198

Expected a checksum of 0x8CD1D536

*** System received a Software forced crash ***

signal= 0x17, code= 0x5, context= 0x80016c40

PC = 0x00000000, SP = 0x00000000, RA = 0x00000000

Cause Reg = 0x00000000, Status Reg = 0x00000000

rommon 278 >

Any suggestion about what could cause this problem? I have the same situation, when I upload bigger image via xmodem - it's done properly, visible in flash with correct size, but when I try to boot I have the same error message

Error : compressed image checksum is incorrect -----------
Expected a checksum of -----------

paolo bevilacqua · ‎07-12-2012

Flash can have gone bad. Try tftpdnld with flag to boot only, no write to flash.

Peter Paluch · ‎07-12-2012

Paolo, Dariusz,

Agreed. The FLASH seems to be faulty. Exactly as Paolo suggested, use the tftpdnld -r command to download the IOS directly to the RAM and run it from there. If this works then try reformatting the FLASH from within the IOS using the format flash: command and if that works, download the IOS again to the FLASH using the ordinary copy command.

Best regards,

Peter

CSCO11305513 · ‎07-12-2012

Hi,

I did what you suggested, and then indeed it works - it boots fine, but with ancient IOS only (weights ~14MBs). I did tons of trials after this, formatting flash: etc. result is:

1. I can boot via tftpdnld -r from small image

Then:

1. I can always download any new image via copy, no errors or problems

2. I can set system to boot only from the small image, when I try to boot from any other, I receive the same error:

Error : compressed image checksum is incorrect -----------

Expected a checksum of -----------

Reason for this kind of behaviour remain mystery for me.

Peter Paluch · ‎07-12-2012

Hello Dariusz,

We have to rule out that the FLASH card is faulty. The reason you can download only a small IOS image using tftpdnld has been explained by Ivan - perhaps a ROMMON upgrade would help here.

Nevertheless, do you have any other CF card available? I strongly suggest trying a different CF card, always going through the tftpdnld -r command and formatting the card directly under IOS.

We also have to take into consideration that the DRAM modules in your router may be faulty. If the erroring memory location is at a sufficiently high address, it would manifest itself only in periods of larger memory consumption, like decompressing and running larger IOS images.

Best regards,

Peter

CSCO11305513 · ‎07-12-2012

Hi,

Problem is I don't have any other CF available card at the moment. I'll get back to the problem once I'll have possibility to troubleshoot further. Everyone - thanks for help