Cisco Support Community
cancel
Showing results for 
Search instead for 
Did you mean: 
cancel

Nexus 5000 Troubleshooting Guide

Nexus 5000 Troubleshooting Guide

Last Updated 02/07/2012

By Steven Tanti

Customer Support Engineer

Table of Contents

  1. Disclaimer

  2. Common Error Messages

1.  Disclaimer

     The error messages and solutions in this document may vary depending on the code version you are running. While the general concepts apply to all versions, slight variations in outputs and results may occur. This document is not meant to replace the use of Cisco TAC, so please do not hesitate to give Cisco a call whenever in doubt.

2.  Common Error Messages

ERROR MESSAGE:

switch#(config-if)# show interface ethernet 1/1

Ethernet1/1 is down (SFP validation failed)

switch#(config-if)# show interface status

--------------------------------------------------------------------------------

Port         Name               Status   Vlan     Duplex Speed   Type

--------------------------------------------------------------------------

Eth1/1       --                 sfpInvali 1         full   1000   1/10g

DESCRIPTION:

     The interface shows a status of ‘SFP validation failed’. The link will not come up. The link light on the nexus 5000 is typically dark (no LED).

SOLUTIONS:
  • Configure ‘speed 1000’ or ‘speed 10000

     The first, and most common, scenario is that the wrong speed is configured on the interface. For example, if you are using a 1G SFP such as the GLC-T, you will see this error message if the speed on the port is still at default 10G. To fix this case, simply configure ‘speed 1000’ on the interface. This same situation also applies for 10G SFPs if you have speed 1000 configured on the port instead of 10000.

  • Configure ‘switchport mode fex-fabric’

     The second scenario that sees this error message is that the wrong switchport mode is not configured on the interface. The only scenario which this can be true is when you are using a FET-10G SFP between your N2K and N5K. These FET-10G transceivers requires a ‘switchport mode fex-fabric’ to be configured on the interface to be validated.

  • Verify that the SFP is supported.

For a list of supported Cisco transceivers, you can use the following link:

Table 2: Cisco Nexus 5000 Series Transceiver Support Matrix

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/data_sheet_c78-461802.html

  • Make sure the SFP is seated properly.

     In rare cases, we have seen this message when the SFP is not seated properly, and was solved by unplugging the SFP and reinserting it.

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

ERROR MESSAGE:

switch# show interface fex-fabric

101   Eth1/1 Identity-Mismatch   2  N2K-C2248TP-1GE xxxxxxxxxxxxxxx

OR

switch# show interface brief

Eth1/1       1     eth fabric down   FEX identity mismatch       10G(D) 101

OR

switch# show interface Ethernet 1/1

Ethernet1/1 is down (FEX identity mismatch)

DESCRIPTION:

     The interface for the fex-fabric port shows down due to reason FEX identity mismatch. This will cause the FEX to not come online properly.

SOLUTION:

     This is usually a cabling issue, or a configuration of the wrong fex associate number on the interface. The easiest way to trace out these errors is to issue the command ‘show interface fex-fabric’

Fex Port     Port State   Uplink   Model         Serial

---------------------------------------------------------------

100   Eth1/1       Active     1   N2K-C2232PP-10GE XXXXXXXXXXX

100   Eth1/2       Active     2   N2K-C2232PP-10GE XXXXXXXXXXX

100   Eth1/3      Active     3   N2K-C2232PP-10GE XXXXXXXXXXX

100   Eth1/4       Active     4   N2K-C2232PP-10GE XXXXXXXXXXX

101   Eth1/5 Incompatible-Topology     1   N2K-C2232PP-10GE YYYYYYYYYYY

101   Eth1/6 Incompatible-Topology     2   N2K-C2232PP-10GE YYYYYYYYYYY

101   Eth1/7 Incompatible-Topology     3   N2K-C2232PP-10GE YYYYYYYYYYY

101   Eth1/8 Incompatible-Topology     4   N2K-C2232PP-10GE YYYYYYYYYYY

     From the output above, this will tell you the actual FEX that is connected to that interface, and what number FEX you have this configured as. Make sure all the serial numbers match for the specific FEX number. If your FEX is dual-homed in a VPC (active/active), you will see the message above as ‘incompatible-topology’ if a specific VPC has two different FEXs. Go onto the N5K peer and do the same serial number trace, or in other words make sure the serial numbers on switch A go to the same fex # as the ones on switch B for dual-homed fabric extenders.

Also confirm that you are using a supported FEX topology, as per the link below (page 31, Figures, 21-24):

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/C07-572829-01_Design_N5K_N2K_vPC_DG.pdf

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

ERROR MESSAGE:

switch(config-sync)# show switch-profile status

<SNIP>

Local information:

----------------

Status: Verify Failure

Error(s):

Following commands failed mutual-exclusion checks:

interface Ethernet 1/1

       Spanning-tree port type network

<SNIP>

-OR-

switch(config-if)# switchport mode trunk

Error: Command is not mutually exclusive


DESCRIPTION:

     When you are using config sync and are trying to configure an interface in conf t mode, you are unable to configure the interface because the command is not mutually exclusive. This may also arise when trying to sync a switch-profile using config sync, but it fails due to the same reason.

SOLUTION:

     Any mutual exclusive check failure, in config t or config sync mode, means that the command already exists in the other mode. In other words, if you see the error when trying to configure in conf t mode, this means the command already exists in your switch-profile config sync mode. If you see the switch-profile commit fail due to this, it is because the command already exists in conf t mode either on the local switch, or on the peer switch.  If you are not sure which switch the command exists, "show switch-profile status" will show you the status of the last commit and where it failed.  Remember that when using config sync, you may only have specific configuration in one mode at a time.

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

ERROR MESSAGE:

Nexus(config-if)# channel-group 121

port channel cannot have more than 1 members

DESCRIPTION:

     When trying to add more than one interface on a Fabric Extender into a port-channel, you get an error message that states you cannot have more than 1 member in the port-channel. This will only occur when using a 2148 FEX.

SOLUTION:

     This is a hardware limitation of the 2148 FEX. By design, you may only have one link in the port-channel as the error message says.  However, you may have this port-channel in a vPC that has another member on a second N5K and FEX. This allows you to have a total of two links in the same port-channel across the two 2148. In all other models of FEXs, we allow more than 1 member in the port-channel per fex.

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

ERROR MESSAGE:

Nexus# show monitor session 1

   session 1

---------------

description       : span1

type             : local

state             : down (Dst in wrong mode)

source intf       :

   rx           :

   tx           :

   both         :

source VLANs     :

   rx           : 208

source VSANs     :

   rx           :

destination ports : Eth1/3

Legend: f = forwarding enabled, l = learning enabled

DESCRIPTION:

     When trying to configure a SPAN on the Nexus 5000, the monitor session stays down because destination port is in the wrong mode.

SOLUTION:

     When configuring a SPAN destination, the port must be in “switchport monitor” mode. Once this is done correctly, the monitor session should change state to “Up”. Here is a configuration example:

interface Ethernet1/8

switchport monitor

speed 1000

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

ERROR MESSAGE:

More Coming Soon!

DESCRIPTION:

SOLUTION:

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Comments
Community Member

Very useful Steven. Thanks for posting.

-chris

37318
Views
23
Helpful
1
Comments