Re: 9124 switches that just reboot

mattkauffmann · ‎03-06-2009

I have a couple of 9124's that I thought had flapping ISL's but it turns out they just every now and again reboot. I did a sho system reset-reason and this is the output:

----- reset reason for Supervisor-module 1 (from Supervisor in slot 1) ---

1) No time

Reason: Unknown

Service:

Version: 3.3(1c)

2) No time

Reason: Unknown

Service:

Version: 3.3(1c)

3) No time

Reason: Unknown

Service:

Version: 3.3(1c)

4) At 924338 usecs after Mon Dec 15 10:10:31 2008

Reason: Reset due to upgrade

Service:

Version: 3.1(2)

Not very helpful. It seems to happen very quickly, no host admins have noticed but this is not cool.

Michael Brown · ‎03-06-2009

Look in the NVRAM log...this is a log that is kept across reboots.

On the command line:

show log nvram

You can use the show version command to see how long the system has been up. The NVRAM log should have some information on whats happening with the box.

Post any messages that pertain to the reboot and we can investigate.

-Mike

mattkauffmann · ‎03-06-2009

Mike,

o.k. not much of a smoking gun in nvram.

2009 Mar 6 09:07:52 c9124ageng2 %PLATFORM-2-PS_OK: Power supply 1 ok (Serial number PAC11100MWN)

2009 Mar 6 09:07:52 c9124ageng2 %PLATFORM-2-PS_FANOK: Fan in Power supply 1 ok

2009 Mar 6 09:07:52 c9124ageng2 %PLATFORM-2-PS_OK: Power supply 2 ok (Serial number PAC10340LFF)

2009 Mar 6 09:07:52 c9124ageng2 %PLATFORM-2-PS_FANOK: Fan in Power supply 2 ok

2009 Mar 6 09:07:52 c9124ageng2 %PLATFORM-2-FAN_OK: Fan module ok

sho version (minus copyright chunder)

Software

BIOS: version 1.0.12

kickstart: version 3.3(1c)

system: version 3.3(1c)

BIOS compile time: 09/10/07

kickstart image file is: bootflash:/m9100-s2ek9-kickstart-mz.3.3.1c.bin

kickstart compile time: 5/23/2008 19:00:00 [06/19/2008 23:29:52]

system image file is: bootflash:/m9100-s2ek9-mz.3.3.1c.bin

system compile time: 5/23/2008 19:00:00 [06/19/2008 23:51:10]

Hardware

cisco MDS 9124 ("1/2/4 Gbps FC/Supervisor-2")

Motorola, ppc8541 (e500) with 515032 kB of memory.

Processor Board ID JAE11065J76

bootflash: 250368 kB

c9124ageng2 kernel uptime is 0 days 3 hours 58 minute(s) 25 second(s)

Last reset

Reason: Unknown

System version: 3.3(1c)

Service:

Not much there.

Michael Brown · ‎03-07-2009

Agreed...not much to go on. Is is possible that the power source they are attached to is flapping? Strange to see more than 1...if it was a hardware issue, be strange to see it on multiple boxes.

When I get back in the office on Monday I will look for more logs we can use to investigate this further.

- Mike

mattkauffmann · ‎03-07-2009

Well dirty power is something that could be in play here but I have 2 of these in the same rack. Would seem odd they don't both have the issue at the same time. Is there any logging for the power supplys. I'd need that info for the facilities guys.