6500 MSFC2

Unanswered Question
Mar 15th, 2012

Hi,

Have an issue with IOS upgrade. As am running IOS I do not need bootldr; so under sh boot - it says no bootldr set

Have IOS c6sup22-jk2o3sv-mz.121-27b.E4.bin" in bootflash and s222-adventerprisek9_wan-mz.122-18.SXF11.bin on disk0

Am forcing switch to boot new IOS via command boot system disk0:s222-adventerprisek9_wan-mz.122-18.SXF11.bin

So what happens - it boots to the point where it says -  Changing console ownership to route processor

and then crashes ?? 

Have another 6500 where made it run but when you reload it - it is no booting , it gets to rommon and sits there

When you issue boot disk0:   it then boots up

I do have command in config where it says boot system disk0:s222..........  but for some reason seems not working ?

Highly appreciate any help

Thanks

Arunas

I have this problem too.
0 votes
  • 1
  • 2
  • 3
  • 4
  • 5
Average Rating: 5 (1 ratings)
arunas.usonis Thu, 03/15/2012 - 08:55

*** System received a Software forced crash ***

signal= 0x17, code= 0x41e20000, context= 0x41e45ef4

PC = 0x402d238c, Cause = 0x1820, Status Reg = 0x34018002

zabuali Thu, 03/15/2012 - 09:18

Hello Arunas,

can you please add the whole logs appearing from the time you are trying to load the image untill it goes into rommon again.

Best Regards,

Zaid

arunas.usonis Thu, 03/15/2012 - 10:46

Core-2#sh boot

BOOT variable = disk0:s222-adventerprisek9_wan-mz.122-18.SXF17b.bin,1

CONFIG_FILE variable does not exist

BOOTLDR variable =

Configuration register is 0x2102

Standby is not up.

Core-2#sh run | i boot

boot system flash disk0:s222-adventerprisek9_wan-mz.122-18.SXF17b.bin

Core-2#reload

Proceed with reload? [confirm]

*Mar 15 14:01:24: %SYS-5-RELOAD: Reload requested

*Mar 15 14:01:27: %OIR-SP-6-CONSOLE: Changing console ownership to switch processor

***

*** --- SHUTDOWN NOW ---

***

*Mar 15 14:01:30: %SYS-SP-5-RELOAD: Reload requested

*Mar 15 14:01:30: %OIR-SP-6-CONSOLE: Changing console ownership to switch processor

System Bootstrap, Version 7.1(1)

Copyright (c) 1994-2001 by cisco Systems, Inc.

c6k_sup2 processor with 131072 Kbytes of main memory

rommon 1 > boot disk0:s222-adventerprisek9_wan-mz.122-18.SXF17b.bin   (entering full name as file is not the first on disk0)

Self extracting the image... [OK]

Self decompressing the image : ################################################################################# [OK]

             Restricted Rights Legend

Use, duplication, or disclosure by the Government is

subject to restrictions as set forth in subparagraph

(c) of the Commercial Computer Software - Restricted

Rights clause at FAR sec. 52.227-19 and subparagraph

(c) (1) (ii) of the Rights in Technical Data and Computer

Software clause at DFARS sec. 252.227-7013.

           cisco Systems, Inc.

           170 West Tasman Drive

           San Jose, California 95134-1706

Cisco Internetwork Operating System Software

IOS (tm) s222_sp Software (s222_sp-ADVENTERPRISEK9_WAN-M), Version 12.2(18)SXF17b, RELEASE SOFTWARE (fc1)

Technical Support: http://www.cisco.com/techsupport

Copyright (c) 1986-2011 by cisco Systems, Inc.

Compiled Tue 15-Mar-11 18:47 by ccai

Image text-base: 0x40101040, data-base: 0x4113D680

00:00:04: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.

00:00:04: %PFREDUN-6-ACTIVE: Initializing as ACTIVE processor

00:00:07: %SYS-SP-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.

00:00:04: %SYS-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.

00:00:07: %OIR-SP-6-CONSOLE: Changing console ownership to route processor

System Bootstrap, Version 12.1(11r)E1, RELEASE SOFTWARE (fc1)

TAC Support: http://www.cisco.com/tac

Copyright (c) 2002 by cisco Systems, Inc.

Cat6k-MSFC2 platform with 131072 Kbytes of main memory

00:00:22: %SYS-SP-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.

00:00:22: %SYS-SP-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.

00:00:22: %OIR-SP-6-CONSOLE: Changing console ownership to switch processor

*** System received a Software forced crash ***

signal= 0x17, code= 0x41e20000, context= 0x41e4e294

PC = 0x402d238c, Cause = 0x1820, Status Reg = 0x34018002

rommon 2 >

glen.grant Thu, 03/15/2012 - 10:18

   Do you have enough nvram to run that new image?  That image is a "lot" bigger than the one you are replacing and probably takes more nvram . Need at least 256 meg of nvram to run the SXF train.

arunas.usonis Thu, 03/15/2012 - 10:58

Glen, I guess you were right

Is it right - am not even having 1MB of it ??

APH-Core-2-Mat#sh file systems
File Systems:

     Size(b)     Free(b)      Type  Flags  Prefixes
    64266240    12075008      disk     rw   disk0:
*          -           -     flash     rw   slot0: flash: sup-slot0:
    31981568     5195796     flash     rw   sup-bootflash:
    26247326           0    opaque     ro   sup-microcode:
           0    34330492    opaque     wo   sup-image:
      129004      123588     nvram     rw   const_nvram:
           -           -    opaque     rw   null:
           -           -    opaque     rw   system:
           -           -   network     rw   tftp:
      391160      346325     nvram     rw   nvram:
    31981568    31981568     flash     rw   bootflash:
           -           -   network     rw   rcp:
           -           -   network     rw   ftp:
           -           -    opaque     ro   cns:

arunas.usonis Thu, 03/15/2012 - 11:02

How in this case I was able to boot it manually from rommon on  another switch ?

ROM: System Bootstrap, Version 12.2(17r)S1, RELEASE SOFTWARE (fc1)
BOOTLDR: s222_rp Software (s222_rp-ADVENTERPRISEK9_WAN-M), Version 12.2(18)SXF11, RELEASE SOFTWARE (fc1)

APH-Core-2-Mat uptime is 1 day, 14 minutes
Time since APH-Core-2-Mat switched to active is 1 day, 13 minutes
System returned to ROM by  power cycle (SP by power-on)
System restarted at 17:46:38 UTC Wed Mar 14 2012
System image file is "disk0:s222-adventerprisek9_wan-mz.122-18.SXF11.bin"

391160      350513     nvram     rw   nvram:

arunas.usonis Thu, 03/15/2012 - 11:10

From the one that can boot manually:

xxx#sh module version

Mod  Port Model              Serial #    Versions

---- ---- ------------------ ----------- -------------------------------------

  1    2  WS-X6K-SUP2-2GE    SAD044909JB Hw : 2.17

                                         Fw : 7.1(1)

                                         Sw : 12.2(18)SXF11

                                         Fw1: 6.1(3)

                                         Sw1: 8.5(0.46)RFW50

          WS-F6K-MSFC2       SAD052800D7 Hw : 1.13

                                         Fw : 12.2(17r)S1

                                         Sw : 12.2(18)SXF11

          WS-F6K-PFC2        SAD061903KX Hw : 3.2

glen.grant Thu, 03/15/2012 - 11:56

  From your boot display it looks like you only have 132 meg of nvram.  Do a show version and verify .  It should look like this.

cisco WS-C6509-E (R7000) processor (revision 1.5) with 458720K/65536K bytes of memory.  ---> This shows 512 meg of nvram . Add both fields for approx. size. 

Processor board ID SMG1441N06T

SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache

zabuali Thu, 03/15/2012 - 13:57

Hello Arunas,

okay first of all as Glen said that you must be sure that the minimum requirements of the image is already there on the switch, which i can see for the latest IOS image on this supervisor is 12.2(18)SXF17b is 256M of DRAM and 64M of flash, from the "sh file systems" i can see that you have 64M of flash in disk0:

but for the DRAM as Glen explained you can check the show version.

second of all i want to make sure i understand correctly, are you collecting the outputs above from another switch?

if yes, (and you already checked with point one above) we can take the flash or disk0 from that supervisor and try it here in this supervisor.

but if this is the same supervisor and you already checked with point number one, then you need to check that you copied the IOS image correctly (verify the image using "verify /MD5 disk0:s222-adventerprisek9_wan-mz.122-18.SXF17b.bin" command) after going back to the old image to load the supervisor of course. i believe that you will see the IOS image not copied correctly, and you will have to copy it again using TFTP or FTP server.

any way what ever was your answer yes or no and you already checked with the above and it is still not working, then you will have to do the following:-

from rommon change the config register to 0x2142 using the command "confreg 0x2142", it will ask you to reset so type the command reset

- the command above will make by pass for the configuration.

the result will be on of the below:-

  1. the device will load okay with no problems, in this case this will be a bug on the software (a configuration is causing the crash)
  2. the device will not load as well, this means that the supervisor is miss-seated or there is a hardware failure on the supervisor or the chassis it self.

if the image loaded will then you will have either to know what command is causing the crash by removing it one by one (very hard i know), or to try other images.

but if the device doesn't load then first thing you can try to re-seat the supervisor, if it is also not working, then you will have to try it on another slot, otherwise if it is still not working, then you need to replace that supervisor, and finally the chassis if it still not working.

i hope my answer was well explained

have a great day,

Zaid

arunas.usonis Fri, 03/16/2012 - 03:44

Hi Glen, Zaid,

I have checked almost everything you have proposed. Situation as following:

Switch 1 -  458752K/65536K bytes of memory.

As it is in production I cannot experiment on it any more (

Switch 2 - 112640K/18432K bytes of memory - it seems you were right on DRAM, am short ..

I guess I can replace DRAM from another SUP that have spare ?

I have checked MD5 of the file on disk0 -

verify /md5 (disk0:s222-adventerprisek9_wan-mz.122-18.SXF17b.bin) = 90246feee2a679a1376c90d012272bb2

Could you please confirm if it is right comparing to Cisco given and not altered ?

Never the less - I've got another one that I can carry on my test (for another project) !

Switch 3 - 227328K/34816K bytes of memory - seems no problem with DRAM

R3#sh run | i boot

boot system flash disk0:s222-adventerprisek9_wan-mz.122-18.SXF17b.bin

1.Rebooted and got *** System received a Software forced crash ***

Booted up with old one 12.1, wr erase, deleted vland.dat and rebooted again.

Funny, but this time it gave me :

*** System received a Softwaþ  <-- what does it mean ?

System Bootstrap, Version 7.1(1)

Copyright (c) 1994-2001 by cisco Systems, Inc.

c6k_sup2 processor with 131072 Kbytes of main memory

After that it went into cointinous loop by saying - Autoboot .... ...does decompressing, tries to boot , crashes, and all again ..... !!!

2.Complete shut down. Reseated SUP and power up.

Self decompressing the image : ################################################################################# [OK]

              Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

           cisco Systems, Inc.
           170 West Tasman Drive
           San Jose, California 95134-1706

Cisco Internetwork Operating System Software
IOS (tm) s222_sp Software (s222_sp-ADVENTERPRISEK9_WAN-M), Version 12.2(18)SXF17b, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2011 by cisco Systems, Inc.
Compiled Tue 15-Mar-11 18:47 by ccai
Image text-base: 0x40101040, data-base: 0x4113CBD0

Active crashed three times, disabling auto-boot and dropping to rommon


%Software-forced reload


Breakpoint exception, CPU signal 23, PC = 0x402DF824


-Traceback= 402DF824 402DD770 408C3544 408C678C 408BA5DC 408B8DFC 4029D02C 4029D018
$0 : 00000000, AT : 41270000, v0 : 41E50000, v1 : 41190000
a0 : 437550A8, a1 : 0000FF00, a2 : 00000000, a3 : 41160000
t0 : 402D2348, t1 : 3401FF01, t2 : 402D2348, t3 : FFFF00FF
t4 : 402D2348, t5 : 00000000, t6 : 00005F07, t7 : 4388E9B8
s0 : 00000000, s1 : 41170000, s2 : 00000000, s3 : 00000000
s4 : 42760000, s5 : 00000015, s6 : 00000000, s7 : 00000000
t8 : 4387DBDC, t9 : 00000000, k0 : 828C9910, k1 : 02B56800
gp : 41270094, sp : 4388E9D8, s8 : 41010000, ra : 402DD770
EPC  : 402DF824, ErrorEPC : 5B2971C1, SREG     : 3401FF03
MDLO : 666666C7, MDHI     : 00000182, BadVaddr : 88BC43D3
CacheErr : F4840000, DErrAddr0 : 03870178, DErrAddr1 : 10060127
DATA_START : 0x4113CBD0
Cause 00000024 (Code 0x9): Breakpoint exception

Writing crashinfo to bootflash:crashinfo_20120316-064527

=== Flushing messages (06:45:27 UTC Fri Mar 16 2012) ===

Buffered messages:
Queued messages:
00:00:04: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.

00:00:04: %OIR-6-CONSOLE: Changing console ownership to switch processor

*** System received a Software forced crash ***
signal= 0x17, code= 0x41e20000, context= 0x41e4d7e4
PC = 0x402d238c, Cause = 0x1820, Status Reg = 0x34018002

System Bootstrap, Version 7.1(1)
Copyright (c) 1994-2001 by cisco Systems, Inc.
c6k_sup2 processor with 131072 Kbytes of main memory

rommon 1 >

Sad, but am getting nowhere. To be honest I've got 4x6509 for my project. Aparently they were bought on ebay

to save on money. What I had noticed that almost all of them had a lot of crash files on bootflash.

So I've got 1 more thing left to check - remove all modules and try reboot then.

Strange enough but same problem with all 4 switches ?

Looking forward for your comments

Thanks

Arunas

arunas.usonis Fri, 03/16/2012 - 04:21

Tested Switch 4 - new flash, newly loaded IOS

verify /md5 (disk0:s222-adventerprisek9_wan-mz.122-18.SXF11.bin) = 4f30995a88f861cd39c69b439574332d

DRAM - 227328K/34816K bytes of memory

R4#reload
Proceed with reload? [confirm]

21:28:28: %SYS-5-RELOAD: Reload requested
21:28:31: %OIR-SP-6-CONSOLE: Changing console ownership to switch processor

***
*** --- SHUTDOWN NOW ---
***

21:28:34: %SYS-SP-5-RELOAD: Reload requested
21:28:34: %OIR-SP-6-CONSOLE: Changing console ownership to switch processor

System Bootstrap, Version 7.1(1)
Copyright (c) 1994-2001 by cisco Systems, Inc.
c6k_sup2 processor with 131072 Kbytes of main memory

Autoboot executing command: "boot disk0:s222-adventerprisek9_wan-mz.122-18.SXF11.bin"

Self extracting the image... [OK]
Self decompressing the image : ############################################################################## [OK]

              Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

           cisco Systems, Inc.
           170 West Tasman Drive
           San Jose, California 95134-1706

Cisco Internetwork Operating System Software
IOS (tm) s222_sp Software (s222_sp-ADVENTERPRISEK9_WAN-M), Version 12.2(18)SXF11, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2007 by cisco Systems, Inc.
Compiled Fri 14-Sep-07 16:22 by kellythw
Image text-base: 0x40101040, data-base: 0x4112AA60

Active crashed three times, disabling auto-boot and dropping to rommon


%Software-forced reload


Breakpoint exception, CPU signal 23, PC = 0x402DEF44


-Traceback= 402DEF44 402DCE90 408B8A2C 408BB9DC 408AFDE0 408AE600 4029C7C8 4029C7B4
$0 : 00000000, AT : 41250000, v0 : 41E40000, v1 : 41180000
a0 : 436CDBF4, a1 : 0000FF00, a2 : 00000000, a3 : 41150000
t0 : 402D1A68, t1 : 3401FF01, t2 : 402D1A68, t3 : FFFF00FF
t4 : 402D1A68, t5 : 00000000, t6 : 000075D2, t7 : 438058E8
s0 : 00000000, s1 : 41160000, s2 : 00000000, s3 : 00000000
s4 : 00000000, s5 : 42750000, s6 : 00000000, s7 : 40FF0000
t8 : 437F6714, t9 : 00000000, k0 : 828B3080, k1 : 02B50800
gp : 4125D804, sp : 43805908, s8 : 40FF0000, ra : 402DCE90
EPC  : 402DEF44, ErrorEPC : BFC16BE4, SREG     : 3401FF03
MDLO : 666666CB, MDHI     : 00000192, BadVaddr : 7B56239E
CacheErr : 80000C40, DErrAddr0 : 027DCA58, DErrAddr1 : 01E38C70
DATA_START : 0x4112AA60
Cause 00000024 (Code 0x9): Breakpoint exception

Writing crashinfo to bootflash:crashinfo_20120316-082242

=== Flushing messages (08:22:42 UTC Fri Mar 16 2012) ===

Buffered messages:
Queued messages:
00:00:04: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.

00:00:04: %OIR-6-CONSOLE: Changing console ownership to switch processor

*** System received a Software forced crash ***
signal= 0x17, code= 0x41e10000, context= 0x41e388c4
PC = 0x402d1aac, Cause = 0x1820, Status Reg = 0x34018002

System Bootstrap, Version 7.1(1)
Copyright (c) 1994-2001 by cisco Systems, Inc.
c6k_sup2 processor with 131072 Kbytes of main memory

rommon 1 >

arunas.usonis Fri, 03/16/2012 - 05:55

I thought I nearly made it, but it seems not..

On one of discussion panels someone told that memory has to be identical on SUP and MSFC, which was different

in my case. After some work I have the following:

c6k_sup2 processor with 262144 Kbytes of main memory

Cat6k-MSFC2 platform with 262144 Kbytes of main memory

So for now am good with memory set up at least. Did reboot and got into rommon again.

Boot disk0:.....   and got crashed again ( 

Why ? I thought it should't happen this time - got upset..

----------------------------------------------------------------------------

...............

Active crashed three times, disabling auto-boot and dropping to rommon


%Software-forced reload


Breakpoint exception, CPU signal 23, PC = 0x402DEF44


-Traceback= 402DEF44 402DCE90 408B8A2C 408BB9DC 408AFDE0 408AE600 4029C7C8 4029C7B4
$0 : 00000000, AT : 41250000, v0 : 41E30000, v1 : 41180000
a0 : 4392E33C, a1 : 0000FF00, a2 : 00000000, a3 : 41150000
t0 : 402D1A68, t1 : 3401FF01, t2 : 402D1A68, t3 : FFFF00FF
t4 : 402D1A68, t5 : 00000000, t6 : 00008138, t7 : 43A65FE0
s0 : 00000000, s1 : 41160000, s2 : 00000000, s3 : 00000000
s4 : 00000000, s5 : 42750000, s6 : 00000000, s7 : 40FF0000
t8 : 43A56E0C, t9 : 00000000, k0 : 828B1960, k1 : 02B50800
gp : 4125C0E4, sp : 43A66000, s8 : 40FF0000, ra : 402DCE90
EPC  : 402DEF44, ErrorEPC : BFC16BD8, SREG     : 3401FF03
MDLO : 666666CF, MDHI     : 000001A2, BadVaddr : 27646F9E
CacheErr : D0400000, DErrAddr0 : 0292B2A0, DErrAddr1 : 03A493C0
DATA_START : 0x41129340
Cause 00000024 (Code 0x9): Breakpoint exception

Writing crashinfo to bootflash:crashinfo_20120316-091120

=== Flushing messages (09:11:20 UTC Fri Mar 16 2012) ===

Buffered messages:
Queued messages:
00:00:04: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.

00:00:04: %OIR-6-CONSOLE: Changing console ownership to switch processor

*** System received a Software forced crash ***
signal= 0x17, code= 0x41e10000, context= 0x41e371a4
PC = 0x402d1aac, Cause = 0x1820, Status Reg = 0x34018002
rommon 2 >

arunas.usonis Fri, 03/16/2012 - 06:35

Can anyone advice if reg settings have to be identical ?

R2#remote command switch show bootvar

BOOT variable = disk0:s222-adventerprisek9_wan-mz.122-18.SXF11.bin,1

CONFIG_FILE variable =

BOOTLDR variable =

Configuration register is 0x0

R2#sh boot

BOOT variable = disk0:s222-adventerprisek9_wan-mz.122-18.SXF11.bin,1

CONFIG_FILE variable =

BOOTLDR variable =

Configuration register is 0x2102

arunas.usonis Fri, 03/16/2012 - 08:23

ok, BINGO !

after register settings were made identical it works perfectly !

Am glad I made it finally

Actions

Login or Register to take actions

This Discussion

Posted March 15, 2012 at 7:41 AM
Stats:
Replies:15 Avg. Rating:5
Views:1001 Votes:0
Shares:0
Tags: No tags.

Discussions Leaderboard

Rank Username Points
1 14,997
2 8,150
3 7,725
4 7,083
5 6,723
Rank Username Points
175
84
80
55
54