cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
3333
Views
0
Helpful
7
Replies

nx7000 : 10 Gbps Ethernet Module - status from Active to Disconnected

Rosa Ladeira
Level 1
Level 1

NX 7000 was running fine.

Mod  Ports  Module-Type                      Model              Status

---  -----  -------------------------------- ------------------ ------------

1    32     10 Gbps Ethernet Module          N7K-M132XP-12      ok

5    0      Supervisor module-1X             N7K-SUP1           active *

10   48     10/100/1000 Mbps Ethernet Module N7K-M148GT-11      ok

When attaching a fiber on NX7000, 10 Gbps Ethernet Module port (eth 122/1/18), the module turned down.

It was necessary to :

conf t

attach module 1

to have it active again. All NX2000 connections went down. All backbone services stoped.

Not all, but many times, I attach a NX2000 I have had this problem.

Does anybody know what is going on ?

Thanks.

Rosa

1 Accepted Solution

Accepted Solutions

Rosa Ladeira wrote:

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:06 BRST: %MODULE-4-MOD_WARNING: Module 1 (serial: JAF1445AGRQ) reported warning due to X-bar Interface ASIC Error in device 70 (device error 0xc4600248)

That'd be the one that was worrying me.

From the look of that, the card in slot 1 has a hardware issue which may be interrmittent.

Report it to the TAC and have it RMA'd. Cards in a Nexus 7000 are hot-swappable, so your only outage time should be the time to swap cables.

Cheers.

View solution in original post

7 Replies 7

darren.g
Level 5
Level 5

Rosa Ladeira wrote:

NX 7000 was running fine.

Mod  Ports  Module-Type                      Model              Status

---  -----  -------------------------------- ------------------ ------------

1    32     10 Gbps Ethernet Module          N7K-M132XP-12      ok

5    0      Supervisor module-1X             N7K-SUP1           active *

10   48     10/100/1000 Mbps Ethernet Module N7K-M148GT-11      ok

When attaching a fiber on NX7000, 10 Gbps Ethernet Module port (eth 122/1/18), the module turned down.

It was necessary to :

conf t

attach module 1

to have it active again. All NX2000 connections went down. All backbone services stoped.

Not all, but many times, I attach a NX2000 I have had this problem.

Does anybody know what is going on ?

Thanks.

Rosa

Hardware or backplane issue, maybe?

How many back-side switching modules do you have in the N7K?

I'd be reporting this to Cisco - assuming you have a maintenance contract.

Cheers.

I am migrating backbone.

By now I have 4 NX2000 attached to 7000.

I have a 2 ports TP trunk between 6509-E and 2 10G xenpak between other 6509-E.

Thanks,

Rosa

Rosa Ladeira wrote:

I am migrating backbone.

By now I have 4 NX2000 attached to 7000.

I have a 2 ports TP trunk between 6509-E and 2 10G xenpak between other 6509-E.

Thanks,

Rosa

No, I didn't mean how many devices you had attached - in the back side (I.E. the non-linecard side) there are the switching fabric modules - usually a minimum of 3, although when I installed my Nexus switches the newer F2 modules weren't available, so with those you can possibly get by with 1 or 2 - if you only have a couple, it's vaguely possible you're having a switching capacity issue, but I seriously doubt it.

What does the log from the Nexus say about the module going offline? You should be view the events quite a way back - by default the Nexus logs quite a bit.

Cheers.

nx7000-wc0# sh module fabric

Xbar Ports  Module-Type                      Model              Status

---  -----  -------------------------------- ------------------ ------------

1    0      Fabric Module 1                  N7K-C7010-FAB-1    ok

2    0      Fabric Module 1                  N7K-C7010-FAB-1    ok

3    0      Fabric Module 1                  N7K-C7010-FAB-1    ok

Xbar Sw              Hw

---  --------------  ------

1    NA              1.1    

2    NA              1.1    

3    NA              1.1    

Xbar MAC-Address(es)                         Serial-Num

---  --------------------------------------  ----------

1    NA                                      JAF1443BRQR

2    NA                                      JAF1443BSGN

3    NA                                      JAF1443BMPE

* this terminal session

nx7000-wc0#

Nov  8 08:48:51 smale-outside : 2011 Nov  8 07:48:51 BRST: %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by netadm on 192.168.14.6@pts/11

Nov  8 08:50:54 smale-outside : 2011 Nov  8 07:50:54 BRST: %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by netadm on 192.168.14.6@pts/11

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %ETHPORT-5-SPEED: Interface Ethernet1/18, operational speed changed to 10 Gbps

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/18, operational duplex mode changed to Full

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/18, operational Receive Flow Control state changed to off

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/18, operational Transmit Flow Control state changed to off

Nov  8 08:54:15 smale-outside : 2011 Nov  8 07:54:15 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 122 that is connected with Ethernet1/18 changed its status from Configured to Fabric Up

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Fabric Up to Connecting

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Connecting to Active

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-SPEED: Interface port-channel122, operational speed changed to 10 Gbps

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_DUPLEX: Interface port-channel122, operational duplex mode changed to Full

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel122, operational Receive Flow Control state changed to off

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel122, operational Transmit Flow Control state changed to off

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETH_PORT_CHANNEL-5-PORT_UP: port-channel122: Ethernet1/18 is up

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETH_PORT_CHANNEL-5-FOP_CHANGED: port-channel122: first operational port changed from none to Ethernet1/18

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_UP: Interface port-channel122 is up in mode Fex Fabric

Nov  8 08:54:17 smale-outside : 2011 Nov  8 07:54:17 BRST: %ETHPORT-5-IF_UP: Interface Ethernet1/18 is up in mode Fex Fabric

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %MODULE-2-MOD_NOT_ALIVE: Module 1 not responding... resetting (serial: JAF1445AGRQ)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel122 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel115 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel111 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel113 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel40 is down (Initializing)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel124 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel191 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel30 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel10 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel20 is down (No operational members)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/11 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/12 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/15 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/16 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/17 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/19 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/20 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/21 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/23 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/24 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/25 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/26 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/27 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/28 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/29 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/30 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/31 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/32 is down (Interface removed)

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Active to Disconnected

Nov  8 08:55:00 smale-outside : 2011 Nov  8 07:55:00 BRST: %FEX-2-NOHMS_ENV_FEX_OFFLINE: FEX-122 Off-line (Serial Number JAF1443AALB)

Nov  8 08:55:20 147.65.21.250 : 2011 Nov  8 07:55:00 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 115 that is connected with Ethernet1/13 changed its status from Active to Disconnected

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:03 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface Ethernet1/9 is down (Initializing)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:03 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel113 is down (No operational members)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:04 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 113 that is connected with Ethernet1/9 changed its status from Disconnected to Configured

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:04 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/2 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:04 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/4 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/1 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/3 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/5 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/6 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/7 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/8 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/9 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/10 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/13 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/14 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/18 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/22 is down (Interface removed)

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 113 that is connected with Ethernet1/9 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 111 that is connected with Ethernet1/10 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 115 that is connected with Ethernet1/13 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 191 that is connected with Ethernet1/14 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 124 that is connected with Ethernet1/22 changed its status from Configured to Created

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:06 BRST: %MODULE-4-MOD_WARNING: Module 1 (serial: JAF1445AGRQ) reported warning due to X-bar Interface ASIC Error in device 70 (device error 0xc4600248)

Rosa Ladeira wrote:

Nov  8 08:58:11 smale-outside : 2011 Nov  8 07:55:06 BRST: %MODULE-4-MOD_WARNING: Module 1 (serial: JAF1445AGRQ) reported warning due to X-bar Interface ASIC Error in device 70 (device error 0xc4600248)

That'd be the one that was worrying me.

From the look of that, the card in slot 1 has a hardware issue which may be interrmittent.

Report it to the TAC and have it RMA'd. Cards in a Nexus 7000 are hot-swappable, so your only outage time should be the time to swap cables.

Cheers.

Thanks,

Rosa

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: