Nexus 5000 NXOS Upgrade Error STP ISSU check Fail

Answered Question
Dec 16th, 2011

Nexus 5010

Goal:  Upgrade from 5.0 to 5.1

Downloaded images twice and upgrade went without error on my other 5010

# install all kickstart bootflash:n5000-uk9-kickstart.5.1.3.N1.1.bin system bootflash:n5000-uk9.5.1.3.N1.1.bin

<snip>

Images will be upgraded according to following table:

Module       Image         Running-Version             New-Version  Upg-Required

------  ----------  ----------------------  ----------------------  ------------

     1      system             5.0(2)N2(1)             5.1(3)N1(1)           yes

     1   kickstart             5.0(2)N2(1)             5.1(3)N1(1)           yes

     1        bios        v1.3.0(09/08/09)        v1.5.0(11/30/10)           yes

   111       fexth             5.0(2)N2(1)             5.1(3)N1(1)           yes

   112       fexth             5.0(2)N2(1)             5.1(3)N1(1)           yes

     1   power-seq                    v1.2                    v1.2            no

Do you want to continue with the installation (y/n)?  [n] y

Install is in progress, please wait.

Performing runtime checks.

[####################] 100% -- SUCCESS

Notifying services about the upgrade.

[#                   ]   0% -- FAIL. Return code 0x401E0065 (request was aborted by service).

Please issue "show install all failure-reason" to find the cause of the failure.

Install has failed. Return code 0x401E0065 (request was aborted by service).

Please identify the cause of the failure, and try 'install all' again.

sw11# show install all failure-reason

Service "stp" returned error: ISSU ready-to-proceed check failed - STP - Possibly Topology change detected (0x40DD0049)

sw11#

Did googling and formum searching and no hits.

Thanks

I have this problem too.
0 votes
Correct Answer by Darren Ramsey about 2 years 4 months ago

Basically this means the path to the root bridge could change during the ISSU process while the state machine is being saved and copied to the other CPU.  I have 2 5020 VPC'ed up to 2 Cat6K and see the same message.  The workaround I use it to shut down the port channel on the non-root bridge C6K.  After the ISSU is complete on both 5020, I re-enable the port-channel.  Assume that each C6K is Etherchanneled to both 5020.

Correct Answer by habadr about 2 years 4 months ago

Hi,

I do not know your topology but it looks like one of the ISSU prerequisite are not met to continue the upgrade procedure. I recommend issuing the command “show spanning-tree issu-impact” that will tell you if all ISSUE criteria’s are met.

There is a very detailed upgrade document that you can refer to at

http://www.cisco.com/en/US/partner/docs/switches/datacenter/nexus5000/sw/upgrade/513_N1_1/n5k_upgrade_downgrade_513.html

Also there is way to force the upgrade without ISSU using force , THIS IS A DISRUPTIVE UPGRADE. So you have to be very careful.

http://www.cisco.com/en/US/partner/docs/switches/datacenter/nexus5000/sw/upgrade/513_N1_1/n5k_upgrade_downgrade_513.html#wp641664

I hope this helps

Thanks

Hatim

  • 1
  • 2
  • 3
  • 4
  • 5
Average Rating: 3.8 (4 ratings)
Correct Answer
habadr Fri, 12/16/2011 - 06:59

Hi,

I do not know your topology but it looks like one of the ISSU prerequisite are not met to continue the upgrade procedure. I recommend issuing the command “show spanning-tree issu-impact” that will tell you if all ISSUE criteria’s are met.

There is a very detailed upgrade document that you can refer to at

http://www.cisco.com/en/US/partner/docs/switches/datacenter/nexus5000/sw/upgrade/513_N1_1/n5k_upgrade_downgrade_513.html

Also there is way to force the upgrade without ISSU using force , THIS IS A DISRUPTIVE UPGRADE. So you have to be very careful.

http://www.cisco.com/en/US/partner/docs/switches/datacenter/nexus5000/sw/upgrade/513_N1_1/n5k_upgrade_downgrade_513.html#wp641664

I hope this helps

Thanks

Hatim

Correct Answer
Darren Ramsey Fri, 12/16/2011 - 10:28

Basically this means the path to the root bridge could change during the ISSU process while the state machine is being saved and copied to the other CPU.  I have 2 5020 VPC'ed up to 2 Cat6K and see the same message.  The workaround I use it to shut down the port channel on the non-root bridge C6K.  After the ISSU is complete on both 5020, I re-enable the port-channel.  Assume that each C6K is Etherchanneled to both 5020.

ArrowSIVAC@arrow.com Mon, 12/19/2011 - 09:27

Resolution:

Single 10Gb link back to the 6509 was shutdown and this allowed the upgrade to complete.  As the switch firmware upgrade reflected standard outage within the upgrade window, this was no impact to what was already within scope of the upgrade.

Thanks  for your help.  I did poke around with the STP "show spanning-tree issu-impact"  and did not understand why it had an issue with the single 10Gb link.  No other switch was tiered from the 6509 directly that also has a link into the 5010.

The only other link from the 5010 to the 6509 in any form was the managment port from the 5010. That is where I assume it was causing the issue.

Thanks for the responses

gnijs Tue, 12/20/2011 - 09:02

The "show spanning-tree issu-impact" just sees that you don't have any downstream STP enabled ports. If the N5K is booted, that would cause problems as it will not be able to generate BPDU packets anymore during boot and the downstream switch would start forwarding on blocked ports, creating loops.

Basically, the N5K can only see root ports (upstream) and edge ports downstream (edge ports don't run STP, they have bpduguard enabled and don't generate BPDUs). That is why ISSU is possible: the switch just freezes its forwarding tables and the lack of BPDU generation is sure not to create troubles in the network. You cannot have any STP topology changes during booting.

My guess for your error message is that it seems that the N5K sees that your STP topology is not stable (it receives a BPDU with a TCN enabled). Booting or upgrading in a non-stable STP environment would also be dangerous, therefore your ISSU upgrade is cancelled, which seems logical.

Actions

Login or Register to take actions

This Discussion

Posted December 16, 2011 at 5:03 AM
Stats:
Replies:4 Avg. Rating:3.75
Views:1748 Votes:0
Shares:0
Tags: No tags.

Discussions Leaderboard