High CPU Utilization

paltel · ‎05-08-2003

We have a high cpu utilization problem on our Internet 7206 router. Here is the output of sh proc cpu:

CPU utilization for five seconds: 93%/92%; one minute: 93%; five minutes: 92%

As you can see, the high CPU utilization is caused by interrupts (92%).

We don't have any atm or voice ports on the router.

Anyone can help in troubleshooting this problem?

Georg Pauwen · ‎05-08-2003

Hello,

check out this page:

http://www.cisco.com/warp/customer/63/highcpu.html

paltel · ‎05-08-2003

Thank you, but this doc didn't help me.

Does anyone have any specific suggestion?

Thanks,

p.larkin · ‎05-08-2003

Give us `sh processes cpu` output.

paltel · ‎05-09-2003

Here it is:

ROUTER#sh proc cpu

CPU utilization for five seconds: 92%/91%; one minute: 89%; five minutes: 88%

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

1 138848 259462 535 0.00% 0.00% 0.00% 0 Load Meter

2 1540 397 3879 0.08% 0.12% 0.04% 2 Virtual Exec

3 3625100 222318 16305 0.00% 0.06% 0.05% 0 Check heaps

4 0 1 0 0.00% 0.00% 0.00% 0 Chunk Manager

5 419640 243656 1722 0.00% 0.00% 0.00% 0 Pool Manager

6 0 2 0 0.00% 0.00% 0.00% 0 Timers

7 22992 43953 523 0.00% 0.00% 0.00% 0 Serial Backgroun

8 37392 258015 144 0.00% 0.00% 0.00% 0 ALARM_TRIGGER_SC

9 134308 1287224 104 0.00% 0.00% 0.00% 0 EnvMon

10 0 1 0 0.00% 0.00% 0.00% 0 OIR Handler

11 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager

12 160256 1287224 124 0.00% 0.00% 0.00% 0 IPC Periodic Tim

13 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Manager

14 1928028 1559534 1236 0.00% 0.03% 0.02% 0 ARP Input

15 103564 299561 345 0.00% 0.00% 0.00% 0 HC Counter Timer

16 76 981 77 0.00% 0.00% 0.00% 0 DDR Timers

17 0 2 0 0.00% 0.00% 0.00% 0 Dialer event

18 12 2 6000 0.00% 0.00% 0.00% 0 Entity MIB API

19 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect

20 4 5 800 0.00% 0.00% 0.00% 0 Critical Bkgnd

21 2258744 1091852 2068 0.16% 0.03% 0.01% 0 Net Background

22 11212 13647 821 0.00% 0.00% 0.00% 0 Logger

23 2203948 1287215 1712 0.16% 0.12% 0.12% 0 TTY Background

24 8701552 1301113 6687 0.00% 0.01% 0.00% 0 Per-Second Jobs

25 0 1 0 0.00% 0.00% 0.00% 0 Inode Table Dest

26 0 1 0 0.00% 0.00% 0.00% 0 Inode Table Refr

27 0 1 0 0.00% 0.00% 0.00% 0 CSP Timer

28 0 2 0 0.00% 0.00% 0.00% 0 Hawkeye Backgrou

29 0 1 0 0.00% 0.00% 0.00% 0 SONET alarm time

30 0 2 0 0.00% 0.00% 0.00% 0 VNM DSPRM MAIN

31 0 1 0 0.00% 0.00% 0.00% 0 CES Line Conditi

32 0 2 0 0.00% 0.00% 0.00% 0 Flash MIB Update

33 4 2 2000 0.00% 0.00% 0.00% 0 ATM OAM Input

34 0 2 0 0.00% 0.00% 0.00% 0 ATM OAM TIMER

35 96 64 1500 0.00% 0.00% 0.00% 0 TurboACL

36 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R

37 72863832 25471680 2860 0.24% 0.20% 0.17% 0 IP Input

38 2180512 806592 2703 0.00% 0.03% 0.04% 0 CDP Protocol

39 0 2 0 0.00% 0.00% 0.00% 0 PASVC create VA

40 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps Mana

41 0 1 0 0.00% 0.00% 0.00% 0 PPP IP Add Route

42 1635844 39356 41565 0.00% 0.01% 0.00% 0 IP Background

43 0 1 0 0.00% 0.00% 0.00% 0 SNMP Timers

44 54068 21832 2476 0.00% 0.00% 0.00% 0 Adj Manager

45 293388 174530 1681 0.00% 0.04% 0.02% 0 CEF process

46 0 1 0 0.00% 0.00% 0.00% 0 HTTP Timer

47 134196 166308 806 0.00% 0.00% 0.00% 0 TCP Timer

48 620 137 4525 0.00% 0.00% 0.00% 0 TCP Protocols

49 0 1 0 0.00% 0.00% 0.00% 0 Probe Input

50 0 1 0 0.00% 0.00% 0.00% 0 RARP Input

51 0 1 0 0.00% 0.00% 0.00% 0 Socket Timers

52 24 31 774 0.00% 0.00% 0.00% 0 DHCPD Receive

53 4372944 21694 201573 0.00% 0.00% 0.00% 0 IP Cache Ager

54 0 1 0 0.00% 0.00% 0.00% 0 COPS

55 0 1 0 0.00% 0.00% 0.00% 0 PAD InCall

56 0 2 0 0.00% 0.00% 0.00% 0 X.25 Background

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

57 0 2 0 0.00% 0.00% 0.00% 0 gk process

59 172600 1287234 134 0.00% 0.00% 0.00% 0 Net Serv Timer

60 4 1 4000 0.00% 0.00% 0.00% 0 Router Autoconf

61 0 1 0 0.00% 0.00% 0.00% 0 TSP

62 4 1 4000 0.00% 0.00% 0.00% 0 QOS_MODULE_MAIN

63 0 1 0 0.00% 0.00% 0.00% 0 CCVPM_HTSP

64 0 1 0 0.00% 0.00% 0.00% 0 CCVPM_R2

65 0 1 0 0.00% 0.00% 0.00% 0 CCSWVOICE

66 0 2 0 0.00% 0.00% 0.00% 0 Background Loade

67 0 1 0 0.00% 0.00% 0.00% 0 sssapp

68 4 2 2000 0.00% 0.00% 0.00% 0 Proxy Session Ap

69 9340 129738 71 0.00% 0.00% 0.00% 0 RMON Recycle Pro

70 0 2 0 0.00% 0.00% 0.00% 0 RMON Deferred Se

71 0 1 0 0.00% 0.00% 0.00% 0 SYSMGT Events

72 0 1 0 0.00% 0.00% 0.00% 0 RMON Packets

73 37320 129318 288 0.00% 0.00% 0.00% 0 BUSYOUT SCAN

74 186520 1271719 146 0.00% 0.00% 0.00% 0 trunk conditioni

75 0 1 0 0.00% 0.00% 0.00% 0 trunk conditioni

76 561316 1771880 316 0.00% 0.00% 0.00% 0 Net Input

77 665884 259465 2566 0.00% 0.00% 0.00% 0 Compute load avg

78 1332332 30406 43818 0.00% 0.01% 0.00% 0 Per-minute Jobs

79 0 2 0 0.00% 0.00% 0.00% 0 CC-API_VCM

80 2207176 12568446 175 0.16% 0.04% 0.01% 0 CCPROXY_CT

81 1708 4010 425 0.00% 0.00% 0.00% 0 CEF Scanner

82 1174868 1805316 650 0.00% 0.01% 0.00% 0 Standby (HSRP)

83 0 2 0 0.00% 0.00% 0.00% 0 IP Flow Backgrou

84 770216 1261027 610 0.00% 0.00% 0.00% 0 FR LMI

85 1385620 12712239 108 0.00% 0.00% 0.00% 0 FR Broadcast Out

86 33540 40970 818 0.00% 0.00% 0.00% 0 FR ARP

87 8448 65067 129 0.00% 0.00% 0.00% 0 FR TUNNEL

88 2152 21686 99 0.00% 0.00% 0.00% 0 FR FRAGMENTATION

89 0 1 0 0.00% 0.00% 0.00% 0 FRF9 manager

90 0 1 0 0.00% 0.00% 0.00% 0 FRF9 timed event

91 11968068 42056536 284 0.08% 0.05% 0.06% 0 traffic_shape

93 8 31 258 0.00% 0.00% 0.00% 0 TCP Listener

94 845772 445859 1896 0.00% 0.00% 0.00% 0 IP SNMP

95 242736 223277 1087 0.00% 0.00% 0.00% 0 PDU DISPATCHER

96 1241048 224676 5523 0.00% 0.00% 0.00% 0 SNMP ENGINE

97 0 1 0 0.00% 0.00% 0.00% 0 SNMP ConfCopyPro

98 0 1 0 0.00% 0.00% 0.00% 0 SNMP Traps

99 221640 1304805 169 0.00% 0.00% 0.00% 0 NTP

100 0 1 0 0.00% 0.00% 0.00% 0 xcpa-driver

101 2000 10844 184 0.00% 0.00% 0.00% 0 DHCPD Timer

102 24576 367134 66 0.00% 0.00% 0.00% 0 DHCPD Database

103 3208848 6182466 519 0.00% 0.02% 0.01% 0 BGP Router

104 864000 642904 1343 0.00% 0.00% 0.00% 0 BGP I/O

105 5590156 94657 59057 0.00% 0.11% 0.10% 0 BGP Scanner

107 8088 59279 136 0.00% 0.00% 0.00% 0 BGP Open

Georg Pauwen · ‎05-09-2003

Hello,

here are the suggestions from the output interpreter:

An inappropriate switching path is configured on the router. If you have a

Cisco 7000 or Cisco 7500 series router, try improving its performance by

using the 'ip route-cache {path}' command (path can be cef, distributed, or

cbus, depending on the platform). If there are access lists linked to

interfaces or if ip accounting is turned on, configure NetFlow switching

using the 'ip route-cache flow' command.

- The CPU is performing memory alignment corrections. If there are

%ALIGN-3-CORRECT messages logged, then the high CPU utilization is caused by

memory alignment corrections. Capture the output of the 'show align' command,

decode the tracebacks and search for a bug in your version of IOS.

- The router is overloaded with traffic. Use the 'show interfaces' command and

paste into Output Interpreter to determine which interface is overloaded

- There maybe a bug in the version of IOS running on the router. Check the Bug Navigator

for a bug that reports similar symptoms in a similar environment.