Buy or Renew
Buy or Renew
Cisco + Splunk: It’s a new day for your data. Learn more.
 
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
cancel
Start a conversation
1855
Views
0
Helpful
13
Replies

Switch 2 was removed from stack unexpectedly and again joined stack

jatinder sharma
Level 1
Level 1

‎04-08-2015 08:00 PM - edited ‎03-05-2019 01:11 AM

Hello,

we have 2  switches in stack, last night switch 2 was removed from stack and got rebooted and again it got back in stack.

Switch -2 entered  into the provisioned mode for certain span of time. snap shot is attached .

Apr  9 02:36:25.266 IST: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state DOWN
Apr  9 02:36:25.837 IST: %STACKMGR-4-SWITCH_REMOVED: Switch 2 has been REMOVED from the stack
Apr  9 02:36:27.850 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/1, changed state to down
Apr  9 02:36:27.850 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/3, changed state to down
Apr  9 02:36:27.850 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/4, changed state to down
Apr  9 02:36:27.850 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/5, changed state to down
Apr  9 02:36:28.857 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/1, changed state to down
Apr  9 02:36:28.857 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/3, changed state to down
Apr  9 02:36:28.857 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/4, changed state to down
Apr  9 02:36:28.857 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/5, changed state to down
Apr  9 02:48:37.111 IST: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state UP
Apr  9 02:49:08.048 IST: %STACKMGR-4-SWITCH_ADDED: Switch 2 has been ADDED to the stack
Apr  9 02:49:20.170 IST: %STACKMGR-5-SWITCH_READY: Switch 2 is READY
Apr  9 02:49:20.170 IST: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 2 has changed to state DOWN
Apr  9 02:49:20.170 IST: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state UP
*Mar  1 00:01:02.738: %STACKMGR-4-SWITCH_ADDED: Switch 1 has been ADDED to the stack (Switch-2)
*Mar  1 00:01:02.738: %STACKMGR-4-SWITCH_ADDED: Switch 2 has been ADDED to the stack (Switch-2)
*Mar  1 00:01:07.024: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan (Switch-2)
*Apr  9 02:49:18.979 IST: %SYS-6-CLOCKUPDATE: System clock has been updated from 21:19:18 UTC Wed Apr 8 2015 to 02:49:18 IST Thu Apr 9 2015, configured from console by console. (Cochin-GMSC-SWTCH-2)
*Apr  9 02:49:19.382 IST: %SYS-5-CONFIG_I: Configured from memory by console (Cochin-GMSC-SWTCH-2)
*Apr  9 02:49:19.482 IST: %STACKMGR-5-SWITCH_READY: Switch 1 is READY (Cochin-GMSC-SWTCH-2)
*Apr  9 02:49:19.818 IST: %STACKMGR-5-MASTER_READY: Master Switch 1 is READY (Cochin-GMSC-SWTCH-2)
*Apr  9 02:49:20.053 IST: %STACKMGR-5-SWITCH_READY: Switch 2 is READY (Cochin-GMSC-SWTCH-2)
*Apr  9 02:49:20.178 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface Loopback99, changed state to up (Cochin-GMSC-SWTCH-2)
*Apr  9 02:49:20.178 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface Loopback999, changed state to up (Cochin-GMSC-SWTCH-2)
*Apr  9 02:49:20.321 IST: %SYS-5-RESTART: System restarted -- (Cochin-GMSC-SWTCH-2)
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2) (Cochin-GMSC-SWTCH-2)
Copyright (c) 1986-2008 by Cisco Systems, Inc. (Cochin-GMSC-SWTCH-2)
Compiled Thu 01-May-08 15:00 by antonino (Cochin-GMSC-SWTCH-2)
Apr  9 02:49:24.222 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/1, changed state to up
Apr  9 02:49:24.264 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/3, changed state to up
Apr  9 02:49:24.281 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/4, changed state to up
Apr  9 02:49:24.314 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/5, changed state to up
Apr  9 02:49:25.228 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/1, changed state to up
Apr  9 02:49:25.270 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/3, changed state to up
Apr  9 02:49:25.287 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/4, changed state to up
Apr  9 02:49:25.321 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/5, changed state to up
Apr  9 02:49:39.959 IST: %PLATFORM-6-MODULE_INSERTED: TwinGig Converter module inserted in slot 1 in Switch 2 (Cochin-GMSC-SWTCH-2)
Apr  9 02:49:42.106 IST: %PLATFORM-6-MODULE_INSERTED: TwinGig Converter module inserted in slot 2 in Switch 2 (Cochin-GMSC-SWTCH-2)

 

Switch 02
---------
Switch Uptime                   : 5 hours, 38 minutes
Base ethernet MAC Address       : 00:23:04:19:9A:00
Motherboard assembly number     : 73-10313-11
Motherboard serial number       : FDO12320AH4
Model revision number           : A0
Motherboard revision number     : A0
Model number                    : WS-C3750E-24TD-SD
Daughterboard assembly number   : 800-28590-01
Daughterboard serial number     : FDO123305QU
System serial number            : FDO1234V07K
Top assembly part number        : 800-28443-01
Top assembly revision number    : A0
Version ID                      : V01
CLEI Code Number                : COMVC00ARA

Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2)
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Thu 01-May-08 15:00 by antonino
Image text-base: 0x00003000, data-base: 0x02000000

 

Please help to find reason behind this unexpected reboot.

 

Regards

Jatinder

 

 

 

Labels:
Preview file
39 KB
0 Helpful
13 Replies 13

Leo Laohoo
Hall of Fame
Hall of Fame

‎04-08-2015 10:03 PM

Post the complete output to the command "sh version".

0 Helpful

jatinder sharma
Level 1
Level 1
In response to Leo Laohoo

‎04-09-2015 12:43 AM

sh ver
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2)
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Thu 01-May-08 15:00 by antonino
Image text-base: 0x00003000, data-base: 0x02000000

ROM: Bootstrap program is C3750E boot loader
BOOTLDR: C3750E Boot Loader (C3750E-HBOOT-M) Version 12.2(35r)SE1, RELEASE SOFTWARE (fc2)

Cochin-GMSC-SWTCH uptime is 11 weeks, 1 day, 11 hours, 30 minutes
System returned to ROM by power-on
System restarted at 01:41:48 IST Wed Jan 21 2015
System image file is "flash:c3750e-universalk9-mz.122-44.SE2/c3750e-universalk9-mz.122-44.SE2.bin"


This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

License Level: ipbase
License Type: Permanent
Next reload license Level: ipbase

cisco WS-C3750E-24TD (PowerPC405) processor (revision A0) with 0K/16376K bytes of memory.
Processor board ID FDO1234V07J
Last reset from power-on
3 Virtual Ethernet interfaces
1 FastEthernet interface
56 Gigabit Ethernet interfaces
4 Ten Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.

512K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address       : 00:22:BE:95:35:80
Motherboard assembly number     : 73-10313-11
Motherboard serial number       : FDO12340H8F
Model revision number           : A0
Motherboard revision number     : A0
Model number                    : WS-C3750E-24TD-SD
Daughterboard assembly number   : 800-28590-01
Daughterboard serial number     : FDO123305LA
System serial number            : FDO1234V07J
Top Assembly Part Number        : 800-28443-01
Top Assembly Revision Number    : A0
Version ID                      : V01
CLEI Code Number                : COMVC00ARA
Hardware Board Revision Number  : 0x01


Switch Ports Model              SW Version            SW Image
------ ----- -----              ----------            ----------
*    1 30    WS-C3750E-24TD     12.2(44)SE2           C3750E-UNIVERSALK9-M
     2 30    WS-C3750E-24TD     12.2(44)SE2           C3750E-UNIVERSALK9-M


Switch 02
---------
Switch Uptime                   : 10 hours, 24 minutes
Base ethernet MAC Address       : 00:23:04:19:9A:00
Motherboard assembly number     : 73-10313-11
Motherboard serial number       : FDO12320AH4
Model revision number           : A0
Motherboard revision number     : A0
Model number                    : WS-C3750E-24TD-SD
Daughterboard assembly number   : 800-28590-01
Daughterboard serial number     : FDO123305QU
System serial number            : FDO1234V07K
Top assembly part number        : 800-28443-01
Top assembly revision number    : A0
Version ID                      : V01
CLEI Code Number                : COMVC00ARA
License Level                   : ipbase
License Type                    : Permanent
Next reboot licensing Level     : ipbase


Configuration register is 0xF

0 Helpful

Leo Laohoo
Hall of Fame
Hall of Fame
In response to jatinder sharma

‎04-09-2015 04:25 AM

Ok, now post the output to the command "dir flash2:"

0 Helpful

jatinder sharma
Level 1
Level 1
In response to Leo Laohoo

‎04-09-2015 05:23 AM

Hello LEO

#dir flash2:
Directory of flash2:/

    2  -rwx        1938   Apr 7 2015 08:11:36 +05:30  private-config.text
    3  -rwx         676   Mar 1 1993 05:31:03 +05:30  vlan.dat
    4  -rwx        4120   Apr 7 2015 08:11:37 +05:30  multiple-fs
    5  drwx         512   Mar 1 1993 05:36:07 +05:30  c3750e-universalk9-mz.122-44.SE2
  394  -rwx       14007   Apr 7 2015 08:11:36 +05:30  config.text

57409536 bytes total (31059456 bytes free)


H#dir flash1:
Directory of flash:/

    2  -rwx        4120   Apr 7 2015 08:11:36 +05:30  multiple-fs
    3  -rwx        1938   Apr 7 2015 08:11:36 +05:30  private-config.text
  395  -rwx       14007   Apr 7 2015 08:11:35 +05:30  config.text
    5  drwx         512   Mar 1 1993 05:36:22 +05:30  c3750e-universalk9-mz.122-44.SE2
  394  -rwx         676   Mar 1 1993 05:31:06 +05:30  vlan.dat

57409536 bytes total (31059456 bytes free)

 

what can be the reason for unexpected reboot , it has happened twice with this switch

 

0 Helpful

Leo Laohoo
Hall of Fame
Hall of Fame
In response to jatinder sharma

‎04-09-2015 05:43 AM

Ok, no crash logs.  

 

3750E/X have removable PS.  Can you please check the power cable connected to switch #2 is secure and the PS is secure in it's slot. 

 

3750E/X PS has two PS slots.  You can try moving the PS from one slot to another.

0 Helpful

jatinder sharma
Level 1
Level 1
In response to Leo Laohoo

‎04-09-2015 06:05 AM

Hi Leo,

 

we are going to check same , is there any issue in power cable and power source ? it is has single PS.

can we also suspect any issue in hardware of switch ? is there any mechanism to verify  hardware of switch ?

 

Regards 

0 Helpful

Leo Laohoo
Hall of Fame
Hall of Fame
In response to jatinder sharma

‎04-09-2015 04:47 PM

There's another thing you could try:  

 

session 2

sh version

 

Post the output to the output to the command "sh version".

0 Helpful

jatinder sharma
Level 1
Level 1
In response to Leo Laohoo

‎04-09-2015 09:54 PM

what is use of session 2 command ,is this service impacting command

 

 

 

sh ver
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2)
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Thu 01-May-08 15:00 by antonino
Image text-base: 0x00003000, data-base: 0x02000000

ROM: Bootstrap program is C3750E boot loader
BOOTLDR: C3750E Boot Loader (C3750E-HBOOT-M) Version 12.2(35r)SE1, RELEASE SOFTWARE (fc2)

******* uptime is 11 weeks, 2 days, 8 hours, 40 minutes
System returned to ROM by power-on
System restarted at 01:41:48 IST Wed Jan 21 2015
System image file is "flash:c3750e-universalk9-mz.122-44.SE2/c3750e-universalk9-mz.122-44.SE2.bin"


This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

License Level: ipbase
License Type: Permanent
Next reload license Level: ipbase

cisco WS-C3750E-24TD (PowerPC405) processor (revision A0) with 0K/16376K bytes of memory.
Processor board ID FDO1234V07J
Last reset from power-on
3 Virtual Ethernet interfaces
1 FastEthernet interface
56 Gigabit Ethernet interfaces
4 Ten Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.

512K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address       : 00:22:BE:95:35:80
Motherboard assembly number     : 73-10313-11
Motherboard serial number       : FDO12340H8F
Model revision number           : A0
Motherboard revision number     : A0
Model number                    : WS-C3750E-24TD-SD
Daughterboard assembly number   : 800-28590-01
Daughterboard serial number     : FDO123305LA
System serial number            : FDO1234V07J
Top Assembly Part Number        : 800-28443-01
Top Assembly Revision Number    : A0
Version ID                      : V01
CLEI Code Number                : COMVC00ARA
Hardware Board Revision Number  : 0x01


Switch Ports Model              SW Version            SW Image
------ ----- -----              ----------            ----------
*    1 30    WS-C3750E-24TD     12.2(44)SE2           C3750E-UNIVERSALK9-M
     2 30    WS-C3750E-24TD     12.2(44)SE2           C3750E-UNIVERSALK9-M


Switch 02
---------
Switch Uptime                   : 1 day, 7 hours, 35 minutes
Base ethernet MAC Address       : 00:23:04:19:9A:00
Motherboard assembly number     : 73-10313-11
Motherboard serial number       : FDO12320AH4
Model revision number           : A0
Motherboard revision number     : A0
Model number                    : WS-C3750E-24TD-SD
Daughterboard assembly number   : 800-28590-01
Daughterboard serial number     : FDO123305QU
System serial number            : FDO1234V07K
Top assembly part number        : 800-28443-01
Top assembly revision number    : A0
Version ID                      : V01
CLEI Code Number                : COMVC00ARA
License Level                   : ipbase
License Type                    : Permanent
Next reboot licensing Level     : ipbase


Configuration register is 0xF

0 Helpful

Leo Laohoo
Hall of Fame
Hall of Fame
In response to jatinder sharma

‎04-09-2015 10:09 PM 

what is use of session 2 command ,is this service impacting command

No it's not a service impacting command as long as you do the commands stated.  The command "session 2" is like physically consoling into the 2nd switch.  

0 Helpful

jatinder sharma
Level 1
Level 1
In response to Leo Laohoo

‎04-09-2015 10:42 PM

Hello Leo,

find below output of Switch 2

 

sh version
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2)
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Thu 01-May-08 15:00 by antonino
Image text-base: 0x00003000, data-base: 0x02000000

ROM: Bootstrap program is C3750E boot loader
BOOTLDR: C3750E Boot Loader (C3750E-HBOOT-M) Version 12.2(35r)SE1, RELEASE SOFTWARE (fc2)

Cochin-GMSC-SWTCH-2 uptime is 1 day, 8 hours, 23 minutes
System returned to ROM by power-on
System restarted at 02:48:06 IST Thu Apr 9 2015
System image file is "flash:c3750e-universalk9-mz.122-44.SE2/c3750e-universalk9-mz.122-44.SE2.bin"


This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

License Level: ipbase
License Type: Permanent
Next reload license Level: ipbase

cisco WS-C3750E-24TD (PowerPC405) processor (revision A0) with 0K/16376K bytes of memory.
Processor board ID FDO1234V07K
Last reset from power-on
3 Virtual Ethernet interfaces
1 FastEthernet interface
56 Gigabit Ethernet interfaces
4 Ten Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.

512K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address       : 00:23:04:19:9A:00
Motherboard assembly number     : 73-10313-11
Motherboard serial number       : FDO12320AH4
Model revision number           : A0
Motherboard revision number     : A0
Model number                    : WS-C3750E-24TD-SD
Daughterboard assembly number   : 800-28590-01
Daughterboard serial number     : FDO123305QU
System serial number            : FDO1234V07K
Top Assembly Part Number        : 800-28443-01
Top Assembly Revision Number    : A0
Version ID                      : V01
CLEI Code Number                : COMVC00ARA
Hardware Board Revision Number  : 0x01

Configuration register is 0xF

 

0 Helpful

Leo Laohoo
Hall of Fame
Hall of Fame
In response to jatinder sharma

‎04-09-2015 11:00 PM 

Cochin-GMSC-SWTCH-2 uptime is 1 day, 8 hours, 23 minutes
System returned to ROM by power-on
System restarted at 02:48:06 IST Thu Apr 9 2015

As confirmed by the output, Switch 2 had a power restart.

0 Helpful

jatinder sharma
Level 1
Level 1
In response to Leo Laohoo

‎04-09-2015 11:24 PM

we have checked and verified and there was no issue related to power because some more devices are connected on same power source those were not affected.. so we are suspecting is there any issue in hardware of switch...

0 Helpful

Madhukrishnan Gopinathan Nair
Level 7
Level 7
In response to jatinder sharma

‎04-12-2015 09:41 AM

Hi could please share the output of 

 

sh stacks

 

Thanks,

Madhu.

0 Helpful
Customers Also Viewed These Support Documents
Review Cisco Networking for a $25 gift card