Error receiving SCP response forgetting the switching mode

rdauman24pb · ‎06-24-2010

Hello,

I have been having issues with standby supervisor reloads on multiple access switches all running 12.2(33)SXI1. I have ruled out hardware (since this occurs on multiple switches, although have replaced the SUP32 on one switch to no difference) and am looking for other causes.

Whenever the standby supervisor reloads, I see the following messages in the log (same for the 4-5 switches for which I have seen this condition):

Jun 23 10:57:04.648 EDT: %PFREDUN-SP-7-KPA_WARN: RF KPA messages have not been heard for 135 seconds
Jun 23 10:57:31.640 EDT: %PFREDUN-SP-7-KPA_WARN: RF KPA messages have not been heard for 162 seconds
Jun 23 10:57:40.852 EDT: %SNMP-5-MODULETRAP: Module 6 [Down] Trap

I have also seen some strange diagostic event messages (show diagnostic events):

                             . SP-RP Ping Test skipped. Reason(s): RP CPU is b
                             usy (87% util).
06/23 12:44:53.478 E [6]    diag_get_bus_swt_mode(): Error receiving SCP resp
                             onse forgetting the switching mode
06/23 12:45:08.490 E [6]    diag_asic_read_reg16[6/1/42]: set_get_asic_regs()
                              failed (get)
06/23 12:45:08.494 E [6]    queryHyperionSynched[6]: diag_asic_read_reg16 fai
                             led

06/23 12:45:23.494 E [6]    diag_get_bus_swt_mode(): Error receiving SCP resp
                             onse forgetting the switching mode
06/23 12:45:38.502 E [6]    diag_asic_read_reg16[6/1/42]: set_get_asic_regs()
                              failed (get)
06/23 12:45:38.510 E [6]    queryHyperionSynched[6]: diag_asic_read_reg16 fai

I understand that the RF KPA messages indicate that the Active supervisor has not heard from the Standby and so has reboot it - this is normal procedure. I am at a loss as to why this is happening. I see from the diagnostic messages that the RP is at a pretty high CPU level, but I also understand hitting 100% can be normal. I am curious, though, about the "Error receiving SCP response forgetting the switching mode" message because that seems atypical and could help lead me to what is causing these unexpected reboots.

Any help would be greatly appreciated!

Thank you.

Robert Dauman

mveselyint · ‎09-15-2010

Hello Robert,

I am currently facing the same issue. How did you manege the standby SUP reload?I am currenly running SXI4 with the same issue you described.

Thank for a reply

Martin

rdauman24pb · ‎10-25-2010

Hello Martin,

Thanks for the reply!

I am still facing the issue, unfortunately. I believe something on the network is causing this - just haven't figured out what yet.

If you have had any luck I would appreciate hearing about it.

Thank you.

Rob

mveselyint · ‎10-25-2010

Hello Rob,

nice to her you. I am currently facing the same issue you mentioned on the Cisco Support forum.

Although you mentioned you meet this issue in the SXI3, I wonder that we meet this failure in the latest SW SXI4a.

All we currently know is that it is not HW related, but could be SW related or traffic related ( or combination of both)..

Cisco TAC has reported us it is not a know bug. What features do you use on the affected Cat 6500 with this strange behaviour ??

Thank you

Martin

rdauman24pb · ‎10-25-2010

Hello Martin,

I am running the following code:

Cisco IOS Software, s3223_rp Software (s3223_rp-IPSERVICESK9_WAN-M), Version 12.2(33)SXI1, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2009 by Cisco Systems, Inc.
Compiled Fri 27-Mar-09 11:40 by prod_rel_team

ROM: System Bootstrap, Version 12.2(17r)SX3, RELEASE SOFTWARE (fc1)

and the following modules:

--- ----- -------------------------------------- ------------------ -----------
1   48 48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF
2   48 48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF
3   48 48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF
4   48 48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF
5    3 Supervisor Engine 32 10GE (Active)     WS-SUP32-10GE-3B
6    3 Supervisor Engine 32 10GE (Hot)        WS-SUP32-10GE-3B
7   48 48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF
8   48 48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF
9   48 48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF

I agree with you that this seems to be software or traffic related.....I did not see any issues on my switches for about 3 months after installing them and then noticed this issue. Are you using Cisco IP phones? What about Cisco Wireless?

Thanks,

Rob