Buy or Renew
Buy or Renew
Cisco + Splunk: It’s a new day for your data. Learn more.
 
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
cancel
Start a conversation
3372
Views
0
Helpful
7
Replies

nx7000 : 10 Gbps Ethernet Module - status from Active to Disconnected

Go to solution
Rosa Ladeira
Level 1
Level 1

‎11-08-2011 05:22 AM - edited ‎03-07-2019 03:16 AM

NX 7000 was running fine.

Mod  Ports  Module-Type                      Model              Status

---  -----  -------------------------------- ------------------ ------------

1    32     10 Gbps Ethernet Module          N7K-M132XP-12      ok

5    0      Supervisor module-1X             N7K-SUP1           active *

10   48     10/100/1000 Mbps Ethernet Module N7K-M148GT-11      ok

When attaching a fiber on NX7000, 10 Gbps Ethernet Module port (eth 122/1/18), the module turned down.

It was necessary to :

conf t

attach module 1

to have it active again. All NX2000 connections went down. All backbone services stoped.

Not all, but many times, I attach a NX2000 I have had this problem.

Does anybody know what is going on ?

Thanks.

Rosa

Labels:
0 Helpful
1 Accepted Solution

Accepted Solutions

Go to solution
darren.g
Level 5
Level 5
In response to Rosa Ladeira

‎11-10-2011 01:23 PM 

Rosa Ladeira wrote:
Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:06 BRST: %MODULE-4-MOD_WARNING: Module 1 (serial: JAF1445AGRQ) reported warning due to X-bar Interface ASIC Error in device 70 (device error 0xc4600248)

That'd be the one that was worrying me.

From the look of that, the card in slot 1 has a hardware issue which may be interrmittent.

Report it to the TAC and have it RMA'd. Cards in a Nexus 7000 are hot-swappable, so your only outage time should be the time to swap cables.

Cheers.

View solution in original post

0 Helpful
7 Replies 7

Go to solution
darren.g
Level 5
Level 5

‎11-08-2011 02:16 PM 

Rosa Ladeira wrote:
NX 7000 was running fine.
Mod  Ports  Module-Type                      Model              Status
---  -----  -------------------------------- ------------------ ------------
1    32     10 Gbps Ethernet Module          N7K-M132XP-12      ok
5    0      Supervisor module-1X             N7K-SUP1           active *
10   48     10/100/1000 Mbps Ethernet Module N7K-M148GT-11      ok
When attaching a fiber on NX7000, 10 Gbps Ethernet Module port (eth 122/1/18), the module turned down.
It was necessary to :
conf t
attach module 1
to have it active again. All NX2000 connections went down. All backbone services stoped.
Not all, but many times, I attach a NX2000 I have had this problem.
Does anybody know what is going on ?
Thanks.
Rosa

Hardware or backplane issue, maybe?

How many back-side switching modules do you have in the N7K?

I'd be reporting this to Cisco - assuming you have a maintenance contract.

Cheers.

0 Helpful

Go to solution
Rosa Ladeira
Level 1
Level 1
In response to darren.g

‎11-09-2011 03:59 AM

I am migrating backbone.

By now I have 4 NX2000 attached to 7000.

I have a 2 ports TP trunk between 6509-E and 2 10G xenpak between other 6509-E.

Thanks,

Rosa

0 Helpful

Go to solution
darren.g
Level 5
Level 5
In response to Rosa Ladeira

‎11-09-2011 01:36 PM 

Rosa Ladeira wrote:
I am migrating backbone.
By now I have 4 NX2000 attached to 7000.
I have a 2 ports TP trunk between 6509-E and 2 10G xenpak between other 6509-E.
Thanks,
Rosa

No, I didn't mean how many devices you had attached - in the back side (I.E. the non-linecard side) there are the switching fabric modules - usually a minimum of 3, although when I installed my Nexus switches the newer F2 modules weren't available, so with those you can possibly get by with 1 or 2 - if you only have a couple, it's vaguely possible you're having a switching capacity issue, but I seriously doubt it.

What does the log from the Nexus say about the module going offline? You should be view the events quite a way back - by default the Nexus logs quite a bit.

Cheers.

0 Helpful

Go to solution
Rosa Ladeira
Level 1
Level 1
In response to darren.g

‎11-10-2011 06:02 AM

nx7000-wc0# sh module fabric

Xbar Ports  Module-Type                      Model              Status

---  -----  -------------------------------- ------------------ ------------

1    0      Fabric Module 1                  N7K-C7010-FAB-1    ok

2    0      Fabric Module 1                  N7K-C7010-FAB-1    ok

3    0      Fabric Module 1                  N7K-C7010-FAB-1    ok

Xbar Sw              Hw

---  --------------  ------

1    NA              1.1    

2    NA              1.1    

3    NA              1.1    

Xbar MAC-Address(es)                         Serial-Num

---  --------------------------------------  ----------

1    NA                                      JAF1443BRQR

2    NA                                      JAF1443BSGN

3    NA                                      JAF1443BMPE

* this terminal session

nx7000-wc0#

0 Helpful

Go to solution
Rosa Ladeira
Level 1
Level 1
In response to darren.g

‎11-10-2011 06:02 AM

Nov  8 08:48:51 smale-outside : 2011 Nov  8 07:48:51 BRST: %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by netadm on 192.168.14.6@pts/11

Nov  8 08:50:54 smale-outside : 2011 Nov  8 07:50:54 BRST: %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by netadm on 192.168.14.6@pts/11

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %ETHPORT-5-SPEED: Interface Ethernet1/18, operational speed changed to 10 Gbps

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/18, operational duplex mode changed to Full

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/18, operational Receive Flow Control state changed to off

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/18, operational Transmit Flow Control state changed to off

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 122 that is connected with Ethernet1/18 changed its status from Configured to Fabric Up

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Fabric Up to Connecting

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Connecting to Active

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-SPEED: Interface port-channel122, operational speed changed to 10 Gbps

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_DUPLEX: Interface port-channel122, operational duplex mode changed to Full

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel122, operational Receive Flow Control state changed to off

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel122, operational Transmit Flow Control state changed to off

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETH_PORT_CHANNEL-5-PORT_UP: port-channel122: Ethernet1/18 is up

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETH_PORT_CHANNEL-5-FOP_CHANGED: port-channel122: first operational port changed from none to Ethernet1/18

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_UP: Interface port-channel122 is up in mode Fex Fabric

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_UP: Interface Ethernet1/18 is up in mode Fex Fabric

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %MODULE-2-MOD_NOT_ALIVE: Module 1 not responding... resetting (serial: JAF1445AGRQ)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel122 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel115 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel111 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel113 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel40 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel124 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel191 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel30 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel10 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel20 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/11 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/12 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/15 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/16 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/17 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/19 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/20 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/21 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/23 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/24 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/25 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/26 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/27 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/28 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/29 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/30 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/31 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/32 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Active to Disconnected

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %FEX-2-NOHMS_ENV_FEX_OFFLINE: FEX-122 Off-line (Serial Number JAF1443AALB)

Nov  8 08:55:20 147.65.21.250 : 2011 Nov  8 07:55:00 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 115 that is connected with Ethernet1/13 changed its status from Active to Disconnected

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:03 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface Ethernet1/9 is down (Initializing)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:03 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel113 is down (No operational members)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:04 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 113 that is connected with Ethernet1/9 changed its status from Disconnected to Configured

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:04 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/2 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:04 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/4 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/1 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/3 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/5 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/6 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/7 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/8 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/9 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/10 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/13 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/14 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/18 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/22 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 113 that is connected with Ethernet1/9 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 111 that is connected with Ethernet1/10 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 115 that is connected with Ethernet1/13 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 191 that is connected with Ethernet1/14 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 124 that is connected with Ethernet1/22 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:06 BRST: %MODULE-4-MOD_WARNING: Module 1 (serial: JAF1445AGRQ) reported warning due to X-bar Interface ASIC Error in device 70 (device error 0xc4600248)

0 Helpful

Go to solution
darren.g
Level 5
Level 5
In response to Rosa Ladeira

‎11-10-2011 01:23 PM 

Rosa Ladeira wrote:
Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:06 BRST: %MODULE-4-MOD_WARNING: Module 1 (serial: JAF1445AGRQ) reported warning due to X-bar Interface ASIC Error in device 70 (device error 0xc4600248)

That'd be the one that was worrying me.

From the look of that, the card in slot 1 has a hardware issue which may be interrmittent.

Report it to the TAC and have it RMA'd. Cards in a Nexus 7000 are hot-swappable, so your only outage time should be the time to swap cables.

Cheers.

0 Helpful

Go to solution
Rosa Ladeira
Level 1
Level 1
In response to darren.g

‎11-11-2011 03:35 AM

Thanks,

Rosa

0 Helpful
Customers Also Viewed These Support Documents
Review Cisco Networking products for a $25 gift card