RSP4 Slave Halted or with problems

[jharo]

I have a Router 7513 with 2 RSP4. We have suffered a recent problem the last week with one of our RSP4 (the slave) this card doesnt respond and apparently has stop. We were receiving an error from the slave card when we try to access to it or when some action like a write command was executed the error made mention to:

% Cannot communicate boot variable to slave

using the support page of cisco a similar problem is found in old versions of IOS´s for which we made an upgrade to 12.1(19)E1 even when we had a 121-10.E8 version then we have rebooted the entire cisco to see if it solve the problem but nothing happened. After this we cannot acces to the Slave RSP4 even by console we just dont get response from the card. In the master card we receive this message:

%PARSER-3-BADSUBCMD: Unrecognized subcommand 0 in interface command 'media-type' and

%RSP-4-SLAVENOTUPDATED: Slave configuration not updated for nvram:startup-config.

constantly I check this information with the Output Interpreter and there is no data about the first message and for the other one they recommend activate auto-sync which is it but the error persist.

I appreciate your help

Best regards.

[donewald]

If your slave is in a halted state (show version will tell you if this is the case) then you'll not be able to communicate with the Slave RSP. You need to find out why the slave is halting. If possible back out the primary RSP and let the slave boot alone to see if there is a SW or HW issue. Post the logs of the crash of the slave to this alias and someone will be able to guide you on this issue.

Regards,

Don

[jharo]

Thanks for your answer Don. Defintely the Slave is halted its showed in the show ver. I tried to reload only the slave from the master using the command #slave reload after i receive the following logs:

Aug 2 11:16:52: %RSP-4-SLAVETIME: Last Reload time on the slave may show wrong values

Aug 2 11:16:52: %RSP-4-SLAVETIME: Time taken to reboot on the slave may show wrong values

Aug 2 11:16:52: %RSP-3-SLAVECHANGE: Slave changed state from Slave to Non-participant

Aug 2 11:16:55: %RSP-3-SLAVECHANGE: Slave changed state from Non-participant to Slave

Aug 2 11:16:55: %SYS-3-CPUHOG: Task ran for 2972 msec (71/64), process = Microcode Loader, PC = 40451D3C.

-Traceback= 40451D44 40452840 4044FC20 403ABA84 403ABA70

Aug 2 11:16:58: %SYS-5-CONFIG_I: Configured from console by jharo on vty0 (200.31.103.73)

Aug 2 11:17:00: %RSP-3-SLAVECHANGE: Slave changed state from Slave to Non-participant

Aug 2 11:17:03: %RSP-3-SLAVECHANGE: Slave changed state from Non-participant to Slave

Aug 2 11:17:09: %RSP-3-SLAVECHANGE: Slave changed state from Slave to Non-participant

Aug 2 11:17:11: %RSP-3-SLAVECHANGE: Slave changed state from Non-participant to Slave

Aug 2 11:17:12: %SYS-3-CPUHOG: Task ran for 2972 msec (64/53), process = Microcode Loader, PC = 40451D3C.

-Traceback= 40451D44 40452AB8 40456A64 404506A0 40450A78 40450ED8 4044FC7C 403ABA84 403ABA70

Aug 2 11:17:48: %DBUS-3-SW_NOTRDY: DBUS software not ready after dbus_slot_enable(), elapsed 13056, status 0x0

-Traceback= 40451DC4 40452FFC 40466EA4 404591BC 403ABA84 403ABA70

Aug 2 11:17:49: %SYS-3-CPUHOG: Task ran for 14468 msec (53/35), process = OIR Handler, PC = 40458FC0.

-Traceback= 40458FC8 403ABA84 403ABA70

After this I dont receive more messages from slave card.

[donewald]

As I stated before try to pull the primary RSP (best if you can put the slave in the primary slot for testing) and boot it. The slave (without RPR configured) will only boot the bootloader and wait. If in the primary position I think you'd get more meaningful logs to show you if you have a SW or HW issue. The CPU HOG from the OIR process is ultimately what halts your RSP but still the cause it not known.

If you have a test router I would recommend pulling the slave RSP and testing in that as to not effect service to your router during the above mentioned test.

Hope this helps you,

Don

[jharo]

I cannot disconnect my Master RSP because the router is in production and I dont have a test router. Can I remove a RSP Card without turn off the router entirely I mean if is it hot swap? In this case i can remove the Slave card and re-insert to see for more logs or a solution.

Tx

[donewald]

You cannot remove your primary RSP without interuption. Since you don't have a test router possibly, due to your failed RSP, you can try my suggestion during a maintinance window at your site to test this secondary RSP. When you do get a chance to do this I would cold start the router (i.e. Power off) then replace the cards and power it back up. You should quickly know if your secondary RSP is the issue.

Hope this helps,

Don