cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
3166
Views
0
Helpful
6
Replies

Nexus-2K - Port-channel issue

gautham257
Level 1
Level 1

Hi,

I cheked my logs and found out below...

I am assuming it is a cabling issue ??? please confirm....

are there any issues with the configs???

2014 Jan 28 18:26:33  %ETHPORT-5-IF_TRUNK_DOWN: Interface Ethernet103/1/22, vlan 481 down

2014 Jan 28 18:26:33  %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet103/1/22 is down (Link failure)

2014 Jan 28 18:26:33  %ETHPORT-5-IF_TRUNK_DOWN: Interface Ethernet103/1/21, vlan 481 down

2014 Jan 28 18:26:33  %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet103/1/21 is down (Link failure)

2014 Jan 28 18:26:33  %ETHPORT-5-IF_TRUNK_DOWN: Interface Ethernet103/1/23, vlan 481 down

2014 Jan 28 18:26:33  %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet103/1/23 is down (Link failure)

2014 Jan 28 18:26:33  %ETH_PORT_CHANNEL-5-PORT_INDIVIDUAL_DOWN: individual port Ethernet103/1/22 is down

2014 Jan 28 18:26:33  %ETH_PORT_CHANNEL-5-PORT_INDIVIDUAL_DOWN: individual port Ethernet103/1/21 is down

2014 Jan 28 18:26:33  %ETH_PORT_CHANNEL-5-PORT_INDIVIDUAL_DOWN: individual port Ethernet103/1/23 is down

2014 Jan 28 18:26:33  %ETHPORT-5-IF_TRUNK_DOWN: Interface Ethernet103/1/24, vlan 481 down

2014 Jan 28 18:26:33  %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet103/1/24 is down (Link failure)

2014 Jan 28 18:26:33  %ETH_PORT_CHANNEL-5-PORT_INDIVIDUAL_DOWN: individual port Ethernet103/1/24 is down

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface Ethernet103/1/21, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface Ethernet103/1/21, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet103/1/21, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet103/1/21, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface Ethernet103/1/22, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface Ethernet103/1/22, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet103/1/22, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet103/1/22, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface Ethernet103/1/24, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface Ethernet103/1/24, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet103/1/24, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet103/1/24, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface Ethernet103/1/23, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface Ethernet103/1/23, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet103/1/23, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet103/1/23, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:46  %ETH_PORT_CHANNEL-4-PORT_INDIVIDUAL: port Ethernet103/1/21 is operationally individual

2014 Jan 28 18:26:46  %LACP-FEX103-5-LACP_SUSPEND_INDIVIDUAL: LACP port Ethernet103/1/21(0x1f660500) of port-channel port-channel220(0x160000db) not receiving any LACP BPDUs  suspe

nding (individual) port

2014 Jan 28 18:26:46  %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet103/1/21, vlan 481 up

2014 Jan 28 18:26:46  %ETHPORT-5-IF_UP: Interface Ethernet103/1/21 is up in mode trunk

2014 Jan 28 18:26:46  %ETH_PORT_CHANNEL-4-PORT_INDIVIDUAL: port Ethernet103/1/22 is operationally individual

2014 Jan 28 18:26:46  %ETH_PORT_CHANNEL-4-PORT_INDIVIDUAL: port Ethernet103/1/24 is operationally individual

2014 Jan 28 18:26:46  %LACP-FEX103-5-LACP_SUSPEND_INDIVIDUAL: LACP port Ethernet103/1/22(0x1f660540) of port-channel port-channel220(0x160000db) not receiving any LACP BPDUs  suspe

nding (individual) port

2014 Jan 28 18:26:46  %ETH_PORT_CHANNEL-4-PORT_INDIVIDUAL: port Ethernet103/1/23 is operationally individual

2014 Jan 28 18:26:46  %LACP-FEX103-5-LACP_SUSPEND_INDIVIDUAL: LACP port Ethernet103/1/24(0x1f6605c0) of port-channel port-channel220(0x160000db) not receiving any LACP BPDUs  suspe

nding (individual) port

2014 Jan 28 18:26:46  %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet103/1/22, vlan 481 up

2014 Jan 28 18:26:46  %ETHPORT-5-IF_UP: Interface Ethernet103/1/22 is up in mode trunk

2014 Jan 28 18:26:46  %LACP-FEX103-5-LACP_SUSPEND_INDIVIDUAL: LACP port Ethernet103/1/23(0x1f660580) of port-channel port-channel220(0x160000db) not receiving any LACP BPDUs  suspe

nding (individual) port

2014 Jan 28 18:26:46  %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet103/1/24, vlan 481 up

2014 Jan 28 18:26:46  %ETHPORT-5-IF_UP: Interface Ethernet103/1/24 is up in mode trunk

2014 Jan 28 18:26:46  %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet103/1/23, vlan 481 up

2014 Jan 28 18:26:46  %ETHPORT-5-IF_UP: Interface Ethernet103/1/23 is up in mode trunk

After few seconds and then i see again link failure....

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet103/1/23, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:36  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:26:36  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:26:36  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:26:36  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:26:46  %ETH_PORT_CHANNEL-4-PORT_INDIVIDUAL: port Ethernet103/1/21 is operationally individual

2014 Jan 28 18:26:46  %LACP-FEX103-5-LACP_SUSPEND_INDIVIDUAL: LACP port Ethernet103/1/21(0x1f660500) of port-channel port-channel220(0x160000db) not receiving any LACP BPDUs  suspe

nding (individual) port

2014 Jan 28 18:26:46  %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet103/1/21, vlan 481 up

2014 Jan 28 18:26:46  %ETHPORT-5-IF_UP: Interface Ethernet103/1/21 is up in mode trunk

2014 Jan 28 18:26:46  %ETH_PORT_CHANNEL-4-PORT_INDIVIDUAL: port Ethernet103/1/22 is operationally individual

2014 Jan 28 18:26:46  %ETH_PORT_CHANNEL-4-PORT_INDIVIDUAL: port Ethernet103/1/24 is operationally individual

2014 Jan 28 18:26:46  %LACP-FEX103-5-LACP_SUSPEND_INDIVIDUAL: LACP port Ethernet103/1/22(0x1f660540) of port-channel port-channel220(0x160000db) not receiving any LACP BPDUs  suspe

nding (individual) port

2014 Jan 28 18:26:46  %ETH_PORT_CHANNEL-4-PORT_INDIVIDUAL: port Ethernet103/1/23 is operationally individual

2014 Jan 28 18:26:46  %LACP-FEX103-5-LACP_SUSPEND_INDIVIDUAL: LACP port Ethernet103/1/24(0x1f6605c0) of port-channel port-channel220(0x160000db) not receiving any LACP BPDUs  suspe

nding (individual) port

2014 Jan 28 18:26:46  %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet103/1/22, vlan 481 up

2014 Jan 28 18:26:46  %ETHPORT-5-IF_UP: Interface Ethernet103/1/22 is up in mode trunk

2014 Jan 28 18:26:46  %LACP-FEX103-5-LACP_SUSPEND_INDIVIDUAL: LACP port Ethernet103/1/23(0x1f660580) of port-channel port-channel220(0x160000db) not receiving any LACP BPDUs  suspe

nding (individual) port

2014 Jan 28 18:26:46  %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet103/1/24, vlan 481 up

2014 Jan 28 18:26:46  %ETHPORT-5-IF_UP: Interface Ethernet103/1/24 is up in mode trunk

2014 Jan 28 18:26:46  %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet103/1/23, vlan 481 up

2014 Jan 28 18:26:46  %ETHPORT-5-IF_UP: Interface Ethernet103/1/23 is up in mode trunk

2014 Jan 28 18:31:00  %ETHPORT-5-IF_TRUNK_DOWN: Interface Ethernet103/1/22, vlan 481 down

2014 Jan 28 18:31:00  %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet103/1/22 is down (Link failure)

2014 Jan 28 18:31:00  %ETHPORT-5-IF_TRUNK_DOWN: Interface Ethernet103/1/21, vlan 481 down

2014 Jan 28 18:31:00  %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet103/1/21 is down (Link failure)

2014 Jan 28 18:31:00  %ETH_PORT_CHANNEL-5-PORT_INDIVIDUAL_DOWN: individual port Ethernet103/1/22 is down

2014 Jan 28 18:31:00  %ETH_PORT_CHANNEL-5-PORT_INDIVIDUAL_DOWN: individual port Ethernet103/1/21 is down

2014 Jan 28 18:31:00  %ETHPORT-5-IF_TRUNK_DOWN: Interface Ethernet103/1/24, vlan 481 down

2014 Jan 28 18:31:00  %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet103/1/24 is down (Link failure)

2014 Jan 28 18:31:00  %ETHPORT-5-IF_TRUNK_DOWN: Interface Ethernet103/1/23, vlan 481 down

2014 Jan 28 18:31:00  %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet103/1/23 is down (Link failure)

2014 Jan 28 18:31:01  %ETH_PORT_CHANNEL-5-PORT_INDIVIDUAL_DOWN: individual port Ethernet103/1/24 is down

2014 Jan 28 18:31:01  %ETH_PORT_CHANNEL-5-PORT_INDIVIDUAL_DOWN: individual port Ethernet103/1/23 is down

2014 Jan 28 18:31:03  %ETHPORT-5-SPEED: Interface Ethernet103/1/22, operational speed changed to 1 Gbps

2014 Jan 28 18:31:03  %ETHPORT-5-IF_DUPLEX: Interface Ethernet103/1/22, operational duplex mode changed to Full

2014 Jan 28 18:31:03  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet103/1/22, operational Receive Flow Control state changed to off

2014 Jan 28 18:31:03  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet103/1/22, operational Transmit Flow Control state changed to on

2014 Jan 28 18:31:03  %ETHPORT-5-SPEED: Interface Ethernet103/1/21, operational speed changed to 1 Gbps

2014 Jan 28 18:31:03  %ETHPORT-5-IF_DUPLEX: Interface Ethernet103/1/21, operational duplex mode changed to Full

2014 Jan 28 18:31:03  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet103/1/21, operational Receive Flow Control state changed to off

2014 Jan 28 18:31:03  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet103/1/21, operational Transmit Flow Control state changed to on

2014 Jan 28 18:31:03  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:31:03  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:31:03  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:31:03  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:31:03  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:31:03  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:31:03  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:31:03  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:31:04  %ETHPORT-5-SPEED: Interface Ethernet103/1/24, operational speed changed to 1 Gbps

2014 Jan 28 18:31:04  %ETHPORT-5-IF_DUPLEX: Interface Ethernet103/1/24, operational duplex mode changed to Full

2014 Jan 28 18:31:04  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet103/1/24, operational Receive Flow Control state changed to off

2014 Jan 28 18:31:04  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet103/1/24, operational Transmit Flow Control state changed to on

2014 Jan 28 18:31:04  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:31:04  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:31:04  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:31:04  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:31:04  %ETHPORT-5-SPEED: Interface Ethernet103/1/23, operational speed changed to 1 Gbps

2014 Jan 28 18:31:04  %ETHPORT-5-IF_DUPLEX: Interface Ethernet103/1/23, operational duplex mode changed to Full

2014 Jan 28 18:31:04  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet103/1/23, operational Receive Flow Control state changed to off

2014 Jan 28 18:31:04  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet103/1/23, operational Transmit Flow Control state changed to on

2014 Jan 28 18:31:04  %ETHPORT-5-SPEED: Interface port-channel220, operational speed changed to 1 Gbps

2014 Jan 28 18:31:04  %ETHPORT-5-IF_DUPLEX: Interface port-channel220, operational duplex mode changed to Full

2014 Jan 28 18:31:04  %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel220, operational Receive Flow Control state changed to off

2014 Jan 28 18:31:04  %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel220, operational Transmit Flow Control state changed to on

2014 Jan 28 18:31:13  %ETH_PORT_CHANNEL-4-PORT_INDIVIDUAL: port Ethernet103/1/22 is operationally individual

interface port-channel220

  description server-1 PO220

  switchport mode trunk

  switchport trunk allowed vlan 481

!

interface Ethernet103/1/21

  description server-1,Trunk

  switchport mode trunk

  switchport trunk allowed vlan 481

  channel-group 220 mode active

!

interface Ethernet103/1/22

description server-1,Trunk

  switchport mode trunk

  switchport trunk allowed vlan 481

  channel-group 220 mode active

!

interface Ethernet103/1/23

description server-1,Trunk

  switchport mode trunk

  switchport trunk allowed vlan 481

  channel-group 220 mode active

!

interface Ethernet103/1/24

description server-1,Trunk

  switchport mode trunk

  switchport trunk allowed vlan 481

  channel-group 220 mode active

6 Replies 6

Steve Fuller
Level 9
Level 9

Hi,

The logs are indicating that the FEX is not receiving LACPDU from the server. Check with the server team to make sure they've configured the server to use 802.3ad Link Aggregation with LACP, sometimes called 802.3ad dynamic.

If the server only supports static link aggregates, then you should reconfigure the FEX ports with the channel-group 220 mode on command.

Regards

Steve,

Thanks for the reply....

but what about "link failure" logs ??? is it layer-1 issue ??? i see it happens for every few minutes.

Hi,

What's the upstream Nexus switch? The Nexus 7000 has a feature called lacp suspend-individual enabled by default which will disable the physical interface if LACPDU are not being received.

The timings don't look exactly as I'd expect, but I'm struggling to believe that all four links are flapping due to cable issues.

Can you paste the output of show lacp summary and show lacp counters when the links are operational and when they're down? I'm interested to see how things behave once the LACP issues are resolved.

Regards


steve,

upstream switches are 6500

sh lacp internal event-history interface ethernet 103/1/21 (same events all interfaces)

961) FSM: Transition at 91384 usecs after Tue Jan 28 21:51:01 2014

    Previous state: [LACP_ST_INDIVIDUAL_OR_DEFAULT]

    Triggered event: [LACP_EV_LACP_DOWN_OR_PORT_DOWN]

    Next state: [LACP_ST_PORT_IS_DOWN_OR_LACP_IS_DISABLED]

962) FSM: Transition at 831748 usecs after Tue Jan 28 21:51:03 2014

    Previous state: [LACP_ST_PORT_IS_DOWN_OR_LACP_IS_DISABLED]

    Triggered event: [LACP_EV_LACP_ENABLED_AND_PORT_UP]

    Next state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

963) FSM: Transition at 833933 usecs after Tue Jan 28 21:51:10 2014

    Previous state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

    Triggered event: [LACP_EV_RECEIVE_PARTNER_PDU_TIMED_OUT]

    Next state: [FSM_ST_NO_CHANGE]

964) FSM: Transition at 835331 usecs after Tue Jan 28 21:51:13 2014

    Previous state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

    Triggered event: [LACP_EV_RECEIVE_PARTNER_PDU_TIMED_OUT]

    Next state: [FSM_ST_NO_CHANGE]

965) FSM: Transition at 839080 usecs after Tue Jan 28 21:51:13 2014

    Previous state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

    Triggered event: [LACP_EV_RECEIVE_PARTNER_PDU_TIMED_OUT_II_INDIVIDUAL]

    Next state: [LACP_ST_INDIVIDUAL_OR_DEFAULT]

966) FSM: Transition at 877255 usecs after Tue Jan 28 21:51:13 2014

    Previous state: [LACP_ST_INDIVIDUAL_OR_DEFAULT]

    Triggered event: [LACP_EV_LACP_DOWN_OR_PORT_DOWN]

    Next state: [LACP_ST_PORT_IS_DOWN_OR_LACP_IS_DISABLED]

967) FSM: Transition at 611935 usecs after Tue Jan 28 21:51:16 2014

    Previous state: [LACP_ST_PORT_IS_DOWN_OR_LACP_IS_DISABLED]

    Triggered event: [LACP_EV_LACP_ENABLED_AND_PORT_UP]

    Next state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

968) FSM: Transition at 621134 usecs after Tue Jan 28 21:51:23 2014

    Previous state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

    Triggered event: [LACP_EV_RECEIVE_PARTNER_PDU_TIMED_OUT]

    Next state: [FSM_ST_NO_CHANGE]

969) FSM: Transition at 621797 usecs after Tue Jan 28 21:51:26 2014

    Previous state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

    Triggered event: [LACP_EV_RECEIVE_PARTNER_PDU_TIMED_OUT]

    Next state: [FSM_ST_NO_CHANGE]

970) FSM: Transition at 625566 usecs after Tue Jan 28 21:51:26 2014

    Previous state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

    Triggered event: [LACP_EV_RECEIVE_PARTNER_PDU_TIMED_OUT_II_INDIVIDUAL]

    Next state: [LACP_ST_INDIVIDUAL_OR_DEFAULT]

971) FSM: Transition at 554343 usecs after Tue Jan 28 21:51:33 2014

    Previous state: [LACP_ST_INDIVIDUAL_OR_DEFAULT]

    Triggered event: [LACP_EV_LACP_DOWN_OR_PORT_DOWN]

    Next state: [LACP_ST_PORT_IS_DOWN_OR_LACP_IS_DISABLED]

972) FSM: Transition at 410321 usecs after Tue Jan 28 21:51:36 2014

    Previous state: [LACP_ST_PORT_IS_DOWN_OR_LACP_IS_DISABLED]

    Triggered event: [LACP_EV_LACP_ENABLED_AND_PORT_UP]

    Next state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

973) FSM: Transition at 411144 usecs after Tue Jan 28 21:51:43 2014

    Previous state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

    Triggered event: [LACP_EV_RECEIVE_PARTNER_PDU_TIMED_OUT]

    Next state: [FSM_ST_NO_CHANGE]

974) FSM: Transition at 411807 usecs after Tue Jan 28 21:51:46 2014

    Previous state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

    Triggered event: [LACP_EV_RECEIVE_PARTNER_PDU_TIMED_OUT]

    Next state: [FSM_ST_NO_CHANGE]

975) FSM: Transition at 415566 usecs after Tue Jan 28 21:51:46 2014

    Previous state: [LACP_ST_DETACHED_LAG_NOT_DETERMINED]

    Triggered event: [LACP_EV_RECEIVE_PARTNER_PDU_TIMED_OUT_II_INDIVIDUAL]

    Next state: [LACP_ST_INDIVIDUAL_OR_DEFAULT]

Nexus-5K-A# sh lacp counters interface port-channel 220


                    LACPDUs         Marker      Marker Response    LACPDUs

Port              Sent   Recv     Sent   Recv     Sent   Recv      Pkts Err

---------------------------------------------------------------------

port-channel220

Ethernet103/1/21   64793  0        0      0        0      0        0     

Ethernet103/1/22   106791 60       0      0        0      0        0     

Ethernet103/1/23   106773 60       0      0        0      0        0  

Nexus-5K-A# sh lacp neighbor interface port-channel 220


Flags:  S - Device is sending Slow LACPDUs F - Device is sending Fast LACPDUs

        A - Device is in Active mode       P - Device is in Passive mode

port-channel220 neighbors

Partner's information

            Partner                Partner                     Partner

Port        System ID              Port Number     Age         Flags

Eth103/1/21 0,0-0-0-0-0-0          0x0             0           SP

            LACP Partner           Partner                     Partner

            Port Priority          Oper Key                    Port State

            0                      0x0                         0x0

Partner's information

            Partner                Partner                     Partner

Port        System ID              Port Number     Age         Flags

Eth103/1/22 0,0-0-0-0-0-0          0x0             533198      SP

            LACP Partner           Partner                     Partner

            Port Priority          Oper Key                    Port State

            0                      0x0                         0x0

Partner's information

            Partner                Partner                     Partner

Port        System ID              Port Number     Age         Flags

Eth103/1/23 0,0-0-0-0-0-0          0x0             533198      SP

            LACP Partner           Partner                     Partner

            Port Priority          Oper Key                    Port State

            0                      0x0                         0x0

Partner's information

            Partner                Partner                     Partner

Port        System ID              Port Number     Age         Flags

Eth103/1/24 0,0-0-0-0-0-0          0x0             533197      SP

            LACP Partner           Partner                     Partner

            Port Priority          Oper Key                    Port State

            0                      0x0                         0x0

The number of received LACPDU is 0 (103/1/21) or 60 (1/22 and 1/23) and so much less than it should be. I would resolve this issue first by either getting the server to run IEEE 802.3ad with LACP or to change the interface settings on the FEX to use channel-group 220 mode on.

If the interfaces are still changing state after correcting this we can then look to see what else it might be.

Regards

Steve

What I saw as I walked up to the cabinet. All four connections were lit solid. All four went out at the same time. I checked all connections to make sure they were all seated correctly, both at the cabinet and at the idf, and they were. I watched the connections at the back of the cabinet for almost 4 minutes before they all went out again. I then watched at the switches and after about a minute at that point the links went down for approx. 3 seconds then came back on all at the same time.

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: