07-24-2012 04:50 AM - edited 03-07-2019 07:56 AM
Hi, We have problem with one of our 3750 stack switch, stack connection between switch 2 & 3 is now down and not comming up even after replacing stack cable with new one. Please let me know if you have got any ideas. below output for your reference:
------------------ show switch detail ------------------
Current
Switch# Role Mac Address Priority State
--------------------------------------------------------
*1 Master 000f.f7f4.ce00 10 Ready
2 Member 000f.2425.cf00 1 Ready
3 Member 000f.f7f4.fe00 5 Ready
Stack Port Status Neighbors
Switch# Port 1 Port 2 Port 1 Port 2
--------------------------------------------------------
1 Ok Ok 2 3
2 Down Ok None None
3 Ok Down 1 None
------------------ show process cpu ------------------
CPU utilization for five seconds: 48%/0%; one minute: 8%; five minutes: 6%
------------------ show process memory ------------------
Total: 101589748, Used: 36344516, Free: 65245232
------------------ show logging ------------------
020489: .Jul 23 10:56:55: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state DOWN
020490: .Jul 23 10:57:54: %XDR-6-XDRIPCNOTIFY: Fatal IPC error occurred for peer in slot 2. Message not sent due to timeout. Disabling linecard
-Traceback= AFC798 21B434 BB9394 BBD6B0 BBDDDC BD04B8 908064 8FE62C
020491: .Jul 23 11:11:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 1, class 21, max_msg 8, total throttled 0
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5C8 24F7C0 908064 8FE62C
020492: .Jul 23 11:14:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 3, class 21, max_msg 8, total throttled 1
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5AC 24F7C0 908064 8FE62C
020493: .Jul 23 11:17:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 3, class 21, max_msg 8, total throttled 3
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5AC 24F7C0 908064 8FE62C
020494: .Jul 23 11:20:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 3, class 21, max_msg 8, total throttled 5
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5AC 24F7C0 908064 8FE62C
020495: .Jul 23 11:23:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 3, class 21, max_msg 8, total throttled 7
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5AC 24F7C0 908064 8FE62C
020496: .Jul 23 11:24:13: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state UP
Jul 23 11:05:23: TODO: Haven't heard from th RP. Disable (Data_Center_1-2)
020497: .Jul 23 11:24:13: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state DOWN
020498: .Jul 23 11:24:13: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state UP
Jul 23 14:19:47: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 5, class 20, max_msg 4, total throttled 0 (Data_Center_1-2)
-Traceback= AFC798 576DA8 4F8AA4 4FC004 908064 8FE62C (Data_Center_1-2)
Jul 23 15:00:09: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 5, class 20, max_msg 4, total throttled 3 (Data_Center_1-2)
-Traceback= AFC798 576DA8 4F8AA4 4FC004 908064 8FE62C (Data_Center_1-2)
020499: .Jul 23 15:05:11: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/11 by vty1 (10.52.30.50)
020500: .Jul 23 15:05:14: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/12 by vty1 (10.52.30.50)
020501: .Jul 23 15:05:19: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/13 by vty1 (10.52.30.50)
020502: .Jul 23 15:05:25: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/15 by vty1 (10.52.30.50)
020503: .Jul 23 15:05:28: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/16 by vty1 (10.52.30.50)
020504: .Jul 23 15:09:56: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/24 by vty1 (10.52.30.50)
020505: .Jul 24 05:52:08: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state DOWN
020506: .Jul 24 05:52:09: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state UP
020507: .Jul 24 05:52:10: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state DOWN
020508: .Jul 24 05:52:10: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state UP
All switches are running 12.2(25)SEE2 version. and switch is live from 1 year, 36 weeks. I cannot able to reboot the switch as production servers are online. Please let suggest if you got any ways to resolve this problem without reboot.
Regards
Chandu
07-24-2012 04:56 AM
Hi Chandra,
try to invert the ends of the cable
Alessio
07-24-2012 04:59 AM
Hi Alessio, Appriciate your response. But we have tried that one and that didn't resolve this issue.
07-24-2012 05:05 AM
Chandu,
Can you replace or check the cable between
SWITCH 1 PORT 1 and SWITCH 2 PORT 2
Regards,
Alex.
Please rate useful posts.
07-24-2012 05:07 AM
Alex, thank you for your response:
SWITCH 1 PORT 1 and SWITCH 2 PORT 2 is good.
SWITCH 2 PORT 1 and SWITCH 3 PORT 2 is having poblem. we tried with new cable as well its not comming up.
07-24-2012 05:14 AM
07-24-2012 05:29 AM
Alessio, Reboot and upgrade is my last option left. that bugs doesnt seems best match to this condition. any other ideas are really appriciated.
07-24-2012 05:43 AM
Did you try to better tighten the screws?
In this doc, half way you find some case quite similar to yours
Alessio
07-24-2012 04:07 PM
Hmmmm ...
Don't want to be the bearer of bad news here ...
I believe you have TWO (2) issues here.
Firstly, there's a strong possibility that you are running a buggy IOS. I mean, 12.2(25)SEE??? I wouldn't touch that version with a ten-mile-pole.
Secondly, there's a strong possibility that your switches have a hardware defect that affects the stacking module. Please see attachment.
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: