%IPC-SP-5-WATERMARK

belchezron · ‎03-19-2009

We are receiving these error messages continuosly on 2 of our 6509-E running

12.2(17d)SXB7.

Mar 19 11:32:34.941: %IPC-SP-5-WATERMARK: 801 messages pending in xmt for the port CHKPT:STANDBY SP(2050000.B) seat 2050000

Mar 19 11:39:05.760: %IPC-SP-5-WATERMARK: 801 messages pending in xmt for the port CHKPT:STANDBY SP(2050000.B) seat 2050000

Mar 19 11:40:05.849: %IPC-SP-5-WATERMARK: 801 messages pending in xmt for the port CHKPT:STANDBY SP(2050000.B) seat 2050000

Mar 19 14:59:44.850: %IPC-SP-5-WATERMARK: 801 messages pending in xmt for the port CHKPT:STANDBY SP(2050000.B) seat 2050000

Mar 19 15:03:31.236: %IPC-SP-5-WATERMARK: 801 messages pending in xmt for the port CHKPT:STANDBY SP(2050000.B) seat 2050000

Mar 19 15:23:22.280: %IPC-SP-5-WATERMARK: 801 messages pending in xmt for the port CHKPT:STANDBY SP(2050000.B) seat 2050000

Cisco Error Message Decoder explanation:

Error Message %IPC-5-WATERMARK:[dec] messages pending in [hex] for the port [chars]

[hex].[hex]

Explanation A particular IPC port is overused. An application is not draining packets quickly, which suggests that the CPU might be busy. [dec] is the number of messages pending in the IPC to be processed by the application. [chars] is the IPC port name. The first [hex] is the IPC port number, the second [hex] is the IPC seat number, and the third [hex] is the IPC index.

Recommended Action Reduce the traffic on this port to a minimal level. If the error message recurs, upgrade the system software to a release containing a fix for Cisco bug ID CSCdw74873 (watermark messages appear continuously with no traffic).

My question: According to Cisco recommended action, reduce the traffic on this port, How will I know what port is affected based on the error logs?

Also, I've looked on bug toolkit and cannot find a direct match if this is a bug for the software we got and the error message we've got. Please advise how to fix this?

belchezron · ‎03-19-2009

It seems like were seeing bug CSCdw74873 here. However, I cannot reduce the traffic on this port as I cannot tell which port based on the error message.

According to the note on the bug details, this bug is just a cosmetic in nature. The problem was with the ipc counters only. The buffers were not really pending.

New question: Can someone please point me to commands/documentation that will prove this is just a cosmetic bug to the customer please.

Mohamad Qayoom · ‎03-19-2009

You can find some information here:

http://supportwiki.cisco.com/ViewWiki/index.php/The_%3FIPC-SP-5-WATERMARK%3F_error_message_is_received_in_Catalyst_6500_series_switch_that_runs_the_Cisco_IOS_system_software

Regards,

Mohamad

antogninis · ‎04-21-2013

The link is not available.

I have the same issue.

I see much traffic at interlink in VSS platform.

The excesive traffic can be for a bug?

Regards.

Santiago

InayathUlla Sharieff · ‎04-21-2013

Hi Belchezron,

Based on the data you are hitting the following bug :

CSCdw74873

 http://tools.cisco.com/Support/BugToolKit/search/getBugDetails.do?method=fetchBugDetails&bugId=CSCdw74873

IPC-SP-5-WATERMARK messages, with some number of messages pending, might
display continuously. This is a cosmetic defect with the messages
pending counter. There are no messages pending.
 
Note that this bug is just a cosmetic in nature. The problem was with
the ipc counters only. The buffers were not really pending.                                                           


Action Plan:
- upgrade the software to the latest version.

HTH
Regards
Inayath

namt · ‎06-18-2015

I had the same issue on 3850 with the following IOS

Switch Ports Model SW Version SW Image Mode

------ ----- ----- ---------- ---------- ----

1 56 WS-C3850-48P 03.02.02.SE cat3k_caa-universalk9 INSTALL

2 56 WS-C3850-48P 03.02.02.SE cat3k_caa-universalk9 INSTALL

3 56 WS-C3850-48P 03.02.02.SE cat3k_caa-universalk9 INSTALL

Jun 17 17:30:40.149: %IPC-5-WATERMARK: 3598 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

Jun 17 17:31:14.158: %IPC-5-WATERMARK: 3599 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

Jun 17 17:31:50.161: %IPC-5-WATERMARK: 3597 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

Jun 17 17:32:23.967: %IPC-5-WATERMARK: 3599 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

Jun 17 17:32:58.158: %IPC-5-WATERMARK: 3597 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

Jun 17 17:33:33.970: %IPC-5-WATERMARK: 3597 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

Jun 17 17:34:08.159: %IPC-5-WATERMARK: 3598 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

Jun 17 17:34:43.970: %IPC-5-WATERMARK: 3599 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

Jun 17 17:35:18.159: %IPC-5-WATERMARK: 3597 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

Jun 17 17:35:53.970: %IPC-5-WATERMARK: 3597 messages pending in xmt for the port (11900B00.4) from source seat 10900100,

I upgraded to the latest Stable Release 3.3.5.SE

Switch#software install file flash:cat3k_caa-universalk9.SPA.03.03.05.SE.150-1.EZ5.bin switch 1-3

Switch#reload

This cleared all the %IPC-5-WATERMARK.