What is acceptable for CPU on a 3750

Unanswered Question
Aug 24th, 2010

Hello,

I have two stacked 3750s running PowerPC405. These are the switches we use for the Cisco Call Manager system. From 8am to 8pm they average about 64 % CPU utilization. We are getting ready to get into peak season and our call volume could increase another 50 % in the next weeks.

I would say that 70-80% of the traffic is local to the stack, so I dont think there is much I can do there, and its all L2 traffic. What is the next step up after the 3750 for a rack switch? What will give me 3-5 years of life if my traffic patterns increase annually at about 20-30%.

Or perhaps I dont need to worry at all. Can switches like the 3750 run fine at 70 %??

Thanks for all advice and help,

Pedro

I have this problem too.
0 votes
  • 1
  • 2
  • 3
  • 4
  • 5
Overall Rating: 0 (0 ratings)
Loading.
podhillo Tue, 08/24/2010 - 04:59

Hi,

Can you post the 'show proc cpu history' command output?

Regards,

podhillo

pener1963 Tue, 08/24/2010 - 05:04

Here it is:

cab8sw1-hvn-3750g#sh proc cpu history

    111111111     11111          11111    11111          33333
    1111333339999900000888889999955555999900000999999999922222
100
90
80
70
60
50
40
30                                                      *****
20                              *****                   *****
10 **********************************************************
   0....5....1....1....2....2....3....3....4....4....5....5....
             0    5    0    5    0    5    0    5    0    5
               CPU% per second (last 60 seconds)
    1
    0111111111111111111111111111111111111131111111111111111111
    0231122112132122113121123312221222121582133223434211221423
100 *
90 *
80 *
70 *
60 *
50 *
40 #                                     *
30 #                                     *
20 #                                    **
10 ##########################################################
   0....5....1....1....2....2....3....3....4....4....5....5....
             0    5    0    5    0    5    0    5    0    5
               CPU% per minute (last 60 minutes)
              * = maximum CPU%   # = average CPU%
        11 1  1111 11 1      11    11    11 111 1   1 111   11 1 111   11
    9999009099000090090999999009999009999009000909990900099900909000999009
    9999009099000090090999999009999009999009000909990900099900909000999009
100 **********************************************************************
90 **********************************************************************
80 **********************************************************************
70 *************#########************************************************
60 *************##########***********************************************
50 ************###########***********************************************
40 ************###########***********************************************
30 ************############**********************************************
20 ***********#############**********************************************
10 ######################################################################
   0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
             0    5    0    5    0    5    0    5    0    5    0    5    0
                   CPU% per hour (last 72 hours)
                  * = maximum CPU%   # = average CPU%


Calls on the system will start coming in in next half hour...

Thanks

pener1963 Tue, 08/24/2010 - 05:22

Here you go. As you can see. We are running at about 36 % right now. In another hour or so we will be at 60 %:

CPU utilization for five seconds: 36%/19%; one minute: 38%; five minutes: 34%
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  68    47910665 747340934         64  2.55%  1.54%  1.45%   0 Fifo Error Detec
145    50708751 412043982        123  2.39%  1.20%  1.22%   0 Hulc LED Process
216   113070567 708428295        159  1.91%  1.68%  1.67%   0 Spanning Tree
107   131976740  29309343       4502  0.95%  1.08%  1.01%   0 hpm counter proc
  65    47121681 363069557        129  0.79%  1.56%  1.64%   0 RedEarth Tx Mana
102         597        93       6419  0.63%  0.50%  0.15%   1 SSH Process
203     6198515  10162068        609  0.63%  0.13%  0.09%   0 CDP Protocol
  72     7239073  25243203        286  0.47%  0.06%  0.05%   0 hrpc <- response
  84     6403851 418423702         15  0.47%  0.20%  0.24%   0 HLFM address lea
  37     6194454    240153      25793  0.47%  0.05%  0.00%   0 Per-minute Jobs
165    20703628  14102125       1468  0.31%  0.33%  0.28%   0 PI MATM Aging Pr
  83     2108280   6132602        343  0.15%  0.02%  0.00%   0 HRPC hlfm reques
153    54952781   2831434      19408  0.15%  0.31%  0.38%   0 HQM Stack Proces
154    17686349  11322928       1561  0.15%  0.15%  0.15%   0 HRPC qos request
  35      113986  14102409          8  0.15%  0.01%  0.00%   0 TTY Background
131     1445523  70451242         20  0.15%  0.04%  0.04%   0 Hulc Storm Contr
176      625223   5576819        112  0.15%  0.01%  0.00%   0 DTP Protocol
  36     4486432  14115736        317  0.15%  0.13%  0.12%   0 Per-Second Jobs
209     1340188   4926476        272  0.15%  0.04%  0.01%   0 IP Input
  86     1578039 420667931          3  0.15%  0.05%  0.05%   0 HLFM address ret
  21       79974  14102483          5  0.00%  0.00%  0.00%   0 IPC Deferred Por
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  20           0        34          0  0.00%  0.00%  0.00%   0 IPC Managed Time
  23           0         1          0  0.00%  0.00%  0.00%   0 IPC Session Serv
  19       88143  14102490          6  0.00%  0.00%  0.00%   0 IPC Periodic Tim
  18         438    122484          3  0.00%  0.00%  0.00%   0 DHCPD Timer
  22       54092   1174342         46  0.00%  0.00%  0.00%   0 IPC Seat Manager
  27           0         1          0  0.00%  0.00%  0.00%   0 License IPC stat
  17         573    237063          2  0.00%  0.00%  0.00%   0 IPC Dynamic Cach
  29       88307  14102418          6  0.00%  0.00%  0.00%   0 GraphIt
  30           0         2          0  0.00%  0.00%  0.00%   0 XML Proxy Client
  24         117         4      29250  0.00%  0.00%  0.00%   0 PrstVbl
  16           0         1          0  0.00%  0.00%  0.00%   0 IFS Agent Manage
  33          24        56        428  0.00%  0.00%  0.00%   0 IDB Work
  15         642     12034         53  0.00%  0.00%  0.00%   0 EEM ED Syslog
  25      115154  14102477          8  0.00%  0.00%  0.00%   0 Dynamic ARP Insp
  26           0         1          0  0.00%  0.00%  0.00%   0 ARP Snoop
  28           0         1          0  0.00%  0.00%  0.00%   0 License IPC serv
  38          25        50        500  0.00%  0.00%  0.00%   0 IF-MGR control p
  39          60      4984         12  0.00%  0.00%  0.00%   0 IF-MGR event pro
  40           0         4          0  0.00%  0.00%  0.00%   0 IP Admission HA
  41     3932698   2832888       1388  0.00%  0.05%  0.06%   0 Compute load avg
  42           0         1          0  0.00%  0.00%  0.00%   0 AggMgr Process
  31           0         1          0  0.00%  0.00%  0.00%   0 Critical Bkgnd
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  44     2466490   4244020        581  0.00%  0.01%  0.00%   0 HC Counter Timer
  45           0         1          0  0.00%  0.00%  0.00%   0 SFF8472
  46      488709 281495981          1  0.00%  0.02%  0.00%   0 DownWhenLooped
  47           0         1          0  0.00%  0.00%  0.00%   0 HRPC hdwl reques
  32      903640  27035944         33  0.00%  0.05%  0.04%   0 Net Background
  49           0         3          0  0.00%  0.00%  0.00%   0 HRPC lpip reques
  34         802     14256         56  0.00%  0.00%  0.00%   0 Logger
  51         134        83       1614  0.00%  0.00%  0.00%   0 HRPC Multi-FS Sy
  52         101       105        961  0.00%  0.00%  0.00%   0 HULC multifs pro
  53           0         1          0  0.00%  0.00%  0.00%   0 Hulc Warm Upgrad
  14         177       147       1204  0.00%  0.00%  0.00%   0 Entity MIB API
  55           0         2          0  0.00%  0.00%  0.00%   0 MIRAGE RBCP Moni
  56           0         1          0  0.00%  0.00%  0.00%   0 Hulc EEM Process
  57      564207   2657442        212  0.00%  0.00%  0.00%   0 EEM ED ND
  58           0        59          0  0.00%  0.00%  0.00%   0 EEM ED Identity
  59           0       117          0  0.00%  0.00%  0.00%   0 EEM ED MAT
  11           0         2          0  0.00%  0.00%  0.00%   0 AAA_SERVER_DEADT
  43          17      5019          3  0.00%  0.00%  0.00%   0 Transport Port A
  62           0         1          0  0.00%  0.00%  0.00%   0 HRPC hsm request
  63         117        32       3656  0.00%  0.00%  0.00%   0 Stack Mgr
  64        1693        79      21430  0.00%  0.00%  0.00%   0 Stack Mgr Notifi
  10           0         1          0  0.00%  0.00%  0.00%   0 CEF MIB API

Nagaraja Thanthry Tue, 08/24/2010 - 05:35

Hello,

As long as the CPU does not exceed 90%, you should be fine. However, 60% CPU

with traffic means that you are forcing the switch to process significant

amount of traffic at the CPU level instead of at hardware level. Have you

configured "no ip route-cache" under the interface vlan configurations? Can

you post the output of "show interface stats" as well?

Regards,

NT

pener1963 Tue, 08/24/2010 - 05:41

The command no ip route-cache has not been placed on the vlan interfaces. Can you explain this command? Here is the output you asked for:

cab8sw1-hvn-3750g#sh int stats
Vlan1
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor         18       7218          0          0
             Route cache          0          0          0          0
                   Total         18       7218          0          0
Vlan221
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor     750110   54508293    1246058  293230628
             Route cache     176866   26950675          0          0
                   Total     926976   81458968    1246058  293230628
Vlan232
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      28106    8961420        125       8000
             Route cache          0          0          0          0
                   Total      28106    8961420        125       8000
Vlan233
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      83338   21406731      56520    3617280
             Route cache          0          0          0          0
                   Total      83338   21406731      56520    3617280
Vlan234
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor       3161     667170      43354    2774656

cab8sw1-hvn-3750g#sh int stats
Vlan1
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor         18       7218          0          0
             Route cache          0          0          0          0
                   Total         18       7218          0          0
Vlan221
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor     750118   54509101    1246065  293232644
             Route cache     176868   26950823          0          0
                   Total     926986   81459924    1246065  293232644
Vlan232
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      28106    8961420        125       8000
             Route cache          0          0          0          0
                   Total      28106    8961420        125       8000
Vlan233
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      83338   21406731      56520    3617280
             Route cache          0          0          0          0
                   Total      83338   21406731      56520    3617280
Vlan234
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor       3161     667170      43356    2774784
             Route cache          0          0         37       4882
                   Total       3161     667170      43393    2779666
Vlan235
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor          0          0       2517     161088
             Route cache          0          0          0          0
                   Total          0          0       2517     161088
Vlan236
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      33537    9744952       2969     190016
             Route cache          0          0          7        735
                   Total      33537    9744952       2976     190751
Vlan237
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor          0          0       2612     167168
             Route cache          0          0          0          0
                   Total          0          0       2612     167168
Vlan238
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      33572    9746430       2968     189952
             Route cache          0          0         56       7607
                   Total      33572    9746430       3024     197559
Vlan239
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor     122127   11704930     122126   12193360
             Route cache          0          0          0          0
                   Total     122127   11704930     122126   12193360
Vlan241
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      54698   10556940      26720    1710080
             Route cache          0          0          0          0
                   Total      54698   10556940      26720    1710080
Vlan242
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      28075    8951500        125       8000
             Route cache          0          0          0          0
                   Total      28075    8951500        125       8000
Vlan243
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor        286      17160        286      18304
             Route cache       6695     704204          0          0
                   Total       6981     721364        286      18304
Vlan244
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      50287   11623000       2990     191360
             Route cache          0          0          0          0
                   Total      50287   11623000       2990     191360
Vlan245
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      32521    1951260      32498    2079872
             Route cache          0          0          1        218
                   Total      32521    1951260      32499    2080090
Vlan246
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      45337    2737217     109053    6979810
             Route cache          0          0         19       4101
                   Total      45337    2737217     109072    6983911
Vlan248
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor        342      22248        338      23468
             Route cache          7        706          0          0
                   Total        349      22954        338      23468
Vlan249
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor        250      15000        250      16000
             Route cache          0          0          0          0
                   Total        250      15000        250      16000
Vlan250
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor       1025      65939        670      42956
             Route cache          0          0          0          0
                   Total       1025      65939        670      42956
Vlan251
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      59357    3655682      56637    3624844
             Route cache      23440   13126330          7        518
                   Total      82797   16782012      56644    3625362
Vlan252
          Switching path    Pkts In   Chars In   Pkts Out  Chars Out
               Processor      79324    4860702      63469    4062130
             Route cache     131308   72621423          4       1510
                   Total     210632   77482125      63473    4063640

Nagaraja Thanthry Tue, 08/24/2010 - 05:47

Hello,

The command "ip route-cache" enables the switch to use hardware forwarding

path for forwarding traffic. Initially, when the switch starts forwarding

traffic, based on the common packets, it will build a hardware forwarding

table (FIB). This will contain information regarding the outgoing interface

for most common destinations. So, then onwards when the switch encounters

similar packets, it will just forward the packet based on the FIB and not

lookup the routing table (which should be done by the processor). FIB based

forwarding will be faster and will have lower effect on the CPU.

In your output, I see that the majority of the packets are processed by the

CPU. What kind of traffic are you forwarding in the switch? Do you have

significant amount of multicast traffic? Have you enabled multicast routing?

Regards,

NT

pener1963 Tue, 08/24/2010 - 05:55

The switch is being used by Cisco Call Manager and so I would say the majority of the traffic is UDP voice traffic.There are several hundreds of  peoples calls going through this switch.

Does that answer your question?

Nagaraja Thanthry Tue, 08/24/2010 - 06:29

Hello,

Mostly, the VoIP traffic is unicast. So, I don't think it should be punted

to CPU. Can you post the output of "show proc cpu" again when the CPU is

60%?

Regards,

NT

pener1963 Tue, 08/24/2010 - 07:00

Here are some more commands:

cab8sw1-hvn-3750g#sh processes cpu sorted

Load for five secs: 41%/19%; one minute: 41%; five minutes: 44%

Time source is NTP, 08:56:50.918 edt Tue Aug 24 2010

CPU utilization for five seconds: 41%/19%; one minute: 41%; five minutes: 44%

PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process

145    50919314 412202639        123  3.35%  3.04%  3.28%   0 Hulc LED Process

  68    48094675 747612000         64  3.19%  3.31%  3.36%   0 Fifo Error Detec

  65    47275200 363210324        130  2.71%  2.56%  2.31%   0 RedEarth Tx Mana

216   113187411 708794614        159  1.27%  1.80%  1.80%   0 Spanning Tree

107   132072958  29321083       4504  1.27%  1.29%  1.31%   0 hpm counter proc

265     1970408  63443161         31  0.63%  0.29%  0.23%   0 LACP Protocol

  37     6198225    240250      25799  0.63%  0.07%  0.01%   0 Per-minute Jobs

cab8sw1-hvn-3750g#show controllers cpu-interface
Load for five secs: 41%/22%; one minute: 41%; five minutes: 44%
Time source is NTP, 08:57:56.174 edt Tue Aug 24 2010
ASIC    Rxbiterr   Rxunder    Fwdctfix   Txbuflos   Rxbufloc   Rxbufdrain
-------------------------------------------------------------------------
ASIC0     0          0          0          0          0          0
ASIC1     0          0          0          0          0          0
ASIC2     0          0          0          0          0          0
ASIC3     0          0          0          0          0          0
ASIC4     0          0          0          0          0          0
ASIC5     0          0          0          0          0          0
ASIC6     0          0          0          0          0          0
ASIC7     0          0          0          0          0          0
ASIC8     0          0          0          0          0          0
ASIC9     0          0          0          0          0          0
ASICA     0          0          0          0          0          0
ASICB     0          0          0          0          0          0
ASICC     0          0          0          0          0          0

HOL Fix Counts
--------------
No Fixes:          0 Added:          0 In Use:          0 Both:          0

CPU Heartbeat Statistics

Tx Success Tx Fail    1st Thr    2nd Thr    Unthr      RetryCtMax
---------- ---------- ---------- ---------- ---------- ----------
282687671          0          0          0          0          1

Rx Delay
         0          1          2          3          4
---------- ---------- ---------- ---------- ----------
282687671          0          0          0          0

AddlDelay AdvanceCnt
---------- ----------
         0          0

Rx Retries by RetryCount
         0          1          2          3          4          5          6
---------- ---------- ---------- ---------- ---------- ---------- ----------
282687671          0          0          0          0          0          0

         7          8          9
---------- ---------- ----------
         0          0          0

AddlRetry
----------
         0


cpu-queue-frames  retrieved  dropped    invalid    hol-block  stray
----------------- ---------- ---------- ---------- ---------- ----------
rpc               261959736  0          0          0          0
stp               704052372  0          0          0          0
ipc               15539440   0          0          0          0
routing protocol  59085362   0          0          0          0
L2 protocol       4815070    0          0          0          0
remote console    44572      0          0          0          0
sw forwarding     500457     0          0          0          0
host              4713784    0          0          0          0
broadcast         44035071   0          0          0          0
cbt-to-spt        0          0          0          0          0
igmp snooping     10750264   0          0          0          0
icmp              381051063  0          0          0          0
logging           0          0          0          0          0
rpf-fail          0          0          0          0          0
dstats            0          0          0          0          0
cpu heartbeat     282687677  0          0          0          0

cpu-queue         static inuse static added
----------------- ------------ ------------
rpc               0            0
stp               0            0
ipc               0            0
routing protocol  0            0
L2 protocol       0            0
remote console    0            0
sw forwarding     0            0
host              0            0
broadcast         0            0
cbt-to-spt        0            0
igmp snooping     0            0
icmp              0            0
logging           0            0
rpf-fail          0            0
dstats            0            0
cpu heartbeat     0            0

Supervisor ASIC receive-queue parameters
----------------------------------------
queue 0 maxrecevsize 7E0 pakhead 473B1D0 paktail 4714164
queue 1 maxrecevsize 7E0 pakhead 47EB2E0 paktail 5784060
queue 2 maxrecevsize 7E0 pakhead 479C35C paktail 479BFC0
queue 3 maxrecevsize 7E0 pakhead 4B6E29C paktail 4B64EA0
queue 4 maxrecevsize 7E0 pakhead 47FB324 paktail 47FB6C0
queue 5 maxrecevsize 7E0 pakhead 58ED320 paktail 4B4CC3C
queue 6 maxrecevsize 7E0 pakhead 59064DC paktail 4B5E84C
queue 7 maxrecevsize 7E0 pakhead 58840C0 paktail 588EA64
queue 8 maxrecevsize 7E0 pakhead 4B070D0 paktail 589CA2C
queue 9 maxrecevsize 7E0 pakhead 49BDB30 paktail 49BDB30
queue A maxrecevsize 7E0 pakhead 49B3804 paktail 49B4DAC
queue B maxrecevsize 7E0 pakhead 59191B4 paktail 4B6FF7C
queue C maxrecevsize 7E0 pakhead 5835B38 paktail 49CDC74
queue D maxrecevsize 7E0 pakhead 582D51C paktail 49BD794
queue E maxrecevsize 0 pakhead 0 paktail 0
queue F maxrecevsize 7E0 pakhead 49AAFE0 paktail 580F8F0
Supervisor ASIC exception status
--------------------------------
Receive overrun    00000000   Transmit overrun 00000000
FrameSignatureErr  00000000   MicInitialize    00000000
BadFrameErr        00000000   LenExceededErr   00000000
BadJumboSegments   00000000

Supervisor ASIC Mic Registers
------------------------------
MicDirectPollInfo               80000200
MicIndicationsReceived          00000000
MicInterruptsReceived           00000000
MicPcsInfo                      0000011F
MicPlbMasterConfiguration       00000000
MicRxFifosAvailable             00000800
MicRxFifosReady                 0000B7FF
MicTimeOutPeriod:       FrameTOPeriod: 00000EA6 DirectTOPeriod: 00004000
MicTransmFramesCopied           00000003
MicTxFifosAvailable             00001FFF
MicConfiguration:       Conf flag: 00000110     Interrupt Flag: 0000000A
MicReceiveFifoAssignmen Queue 0 - 7: 00000000   Queue 8 - 15:00000000
MicReceiveFramesReady:  FrameAvailable: 00000801        frameAvaiMask: 00000000
MicException:
        Exception_flag  00000000
        Message-1       00000000
        Message-2       00000000
        Message-3       00000000
MicIntRxFifo:
        ReadPtr         00000810        WritePtr        00000810
        WHeadPtr        00000810        TxFifoDepth     C0000800
MicIntTxFifo:
        ReadPtr         00000E68        WritePtr        00000E68
        WHeadPtr        00000E68        TxFifoDepth     C0000800
MicDecodeInfo:
Fifo0:  address:        03FF4000 asic_num:      00000100
Fifo1:  address:        03FF4400 asic_num:      00000101
MicTransmitFifoInfo:
Fifo0:   StartPtrs:     066C9000        ReadPtr:        066C9598
        WritePtrs:      066C9598        Fifo_Flag:      8A800800
        Weights:        001E001E
Fifo1:   StartPtrs:     06427400        ReadPtr:        06427538
        WritePtrs:      06427538        Fifo_Flag:      89800400
        Weights:        000A000A
MicReceiveFifoInfo:
Fifo0:  StartPtr:       066DD000        ReadPtr:        066DD230
        WritePtrs:      066DD290        Fifo_Flag:      8B000FA0
        writeHeaderPtr: 066DD290
Fifo1:  StartPtr:       069B9800        ReadPtr:        069B9B78
        WritePtrs:      069B9B78        Fifo_Flag:      89800400
        writeHeaderPtr: 069B9B78
Fifo2:  StartPtr:       06972000        ReadPtr:        06972388
        WritePtrs:      06972388        Fifo_Flag:      89800400
        writeHeaderPtr: 06972388
Fifo3:  StartPtr:       06BCE800        ReadPtr:        06BCEB18
        WritePtrs:      06BCEB18        Fifo_Flag:      89800400
        writeHeaderPtr: 06BCEB18
Fifo4:  StartPtr:       06A01000        ReadPtr:        06A012F8
        WritePtrs:      06A012F8        Fifo_Flag:      89800400
        writeHeaderPtr: 06A012F8
Fifo5:  StartPtr:       06B3DE00        ReadPtr:        06B3DEE0
        WritePtrs:      06B3DEE0        Fifo_Flag:      88800200
        writeHeaderPtr: 06B3DEE0
Fifo6:  StartPtr:       06B84C00        ReadPtr:        06B84F48
        WritePtrs:      06B84F48        Fifo_Flag:      89800400
        writeHeaderPtr: 06B84F48
Fifo7:  StartPtr:       06AAD800        ReadPtr:        06AAD9F0
        WritePtrs:      06AAD9F0        Fifo_Flag:      89800400
        writeHeaderPtr: 06AAD9F0
Fifo8:  StartPtr:       06B17E00        ReadPtr:        06B17E88
        WritePtrs:      06B17E88        Fifo_Flag:      88800200
        writeHeaderPtr: 06B17E88
Fifo9:  StartPtr:       066DB4D8        ReadPtr:        066DB4D8
        WritePtrs:      066DB4D8        Fifo_Flag:      82800008
        writeHeaderPtr: 066DB4D8
Fifo10: StartPtr:       06A4A800        ReadPtr:        06A4A9C0
        WritePtrs:      06A4A9C0        Fifo_Flag:      88800200
        writeHeaderPtr: 06A4A9C0
Fifo11: StartPtr:       066C8F00        ReadPtr:        066C8F68
        WritePtrs:      066C8F68        Fifo_Flag:      86400000
        writeHeaderPtr: 066C8F68
Fifo12: StartPtr:       06A77800        ReadPtr:        06A77B00
        WritePtrs:      06A77800        Fifo_Flag:      89000100
        writeHeaderPtr: 06A77800
Fifo13: StartPtr:       066DCE80        ReadPtr:        066DCE80
        WritePtrs:      066DCE80        Fifo_Flag:      86800080
        writeHeaderPtr: 066DCE80
Fifo14: StartPtr:       00000000        ReadPtr:        00000000
        WritePtrs:      00000000        Fifo_Flag:      00800000
        writeHeaderPtr: 00000000
Fifo15: StartPtr:       064272C0        ReadPtr:        064272C0
        WritePtrs:      064272C0        Fifo_Flag:      84800020
        writeHeaderPtr: 064272C0

===========================================================
Complete Board Id:0x4011
===========================================================

cab8sw1-hvn-3750g#sh ip traffic
Load for five secs: 40%/19%; one minute: 41%; five minutes: 43%
Time source is NTP, 08:58:45.667 edt Tue Aug 24 2010

IP statistics:
  Rcvd:  5622808 total, 5621556 local destination
         2 format errors, 1 checksum errors, 498 bad hop count
         0 unknown protocol, 752 not a gateway
         0 security failures, 0 bad options, 3111 with options
  Opts:  0 end, 0 nop, 0 basic security, 0 loose source route
         0 timestamp, 0 extended security, 0 record route
         0 stream ID, 0 strict source route, 3111 alert, 0 cipso, 0 ump
         0 other
  Frags: 0 reassembled, 0 timeouts, 0 couldn't reassemble
         0 fragmented, 0 couldn't fragment
  Bcast: 1387766 received, 0 sent
  Mcast: 0 received, 0 sent
  Sent:  6180487 generated, 3608566432 forwarded
  Drop:  25 encapsulation failed, 0 unresolved, 1257 no adjacency
         0 no route, 0 unicast RPF, 0 forced drop
         0 options denied, 0 source IP address zero

ICMP statistics:
  Rcvd: 0 format errors, 0 checksum errors, 17 redirects, 87 unreachable
        569356 echo, 95 echo reply, 0 mask requests, 0 mask replies, 0 quench
        0 parameter, 0 timestamp, 0 info request, 0 other
        0 irdp solicitations, 0 irdp advertisements
  Sent: 7 redirects, 30550 unreachable, 139 echo, 569356 echo reply
        0 mask requests, 0 mask replies, 0 quench, 0 timestamp
        0 info reply, 91709 time exceeded, 0 parameter problem
        0 irdp solicitations, 0 irdp advertisements

TCP statistics:
  Rcvd: 2355287 total, 156 checksum errors, 7254 no port
  Sent: 4189000 total

UDP statistics:
  Rcvd: 2696550 total, 2 checksum errors, 315910 no port
  Sent: 1299754 total, 0 forwarded broadcasts

BGP statistics:
  Rcvd: 0 total, 0 opens, 0 notifications, 0 updates
        0 keepalives, 0 route-refresh, 0 unrecognized
  Sent: 0 total, 0 opens, 0 notifications, 0 updates
        0 keepalives, 0 route-refresh

EIGRP-IPv4 statistics:
  Rcvd: 0 total
  Sent: 0 total

PIMv2 statistics: Sent/Received
  Total: 0/0, 0 checksum errors, 0 format errors
  Registers: 0/0 (0 non-rp, 0 non-sm-group), Register Stops: 0/0,  Hellos: 0/0
  Join/Prunes: 0/0, Asserts: 0/0, grafts: 0/0
  Bootstraps: 0/0, Candidate_RP_Advertisements: 0/0
  State-Refresh: 0/0

IGMP statistics: Sent/Received
  Total: 0/0, Format errors: 0/0, Checksum errors: 0/0
  Host Queries: 0/0, Host Reports: 0/0, Host Leaves: 0/0
  DVMRP: 0/0, PIM: 0/0

OSPF statistics:
  Rcvd: 0 total, 0 checksum errors
        0 hello, 0 database desc, 0 link state req
        0 link state updates, 0 link state acks

  Sent: 0 total
        0 hello, 0 database desc, 0 link state req
        0 link state updates, 0 link state acks

ARP statistics:
  Rcvd: 623988 requests, 98441 replies, 7 reverse, 0 other
  Sent: 251070 requests, 651876 replies (0 proxy), 0 reverse
  Drop due to input queue full: 0

Hope this helps.

podhillo Tue, 08/24/2010 - 05:45

Hi

Nagaraja is correct as long as you do not breach 90% every think should be fine on a 3750 stack. But do keep a eye in the ### hashes in the show proc cpu history because that is the actual average cpu usage and that should not be a constant 90+.
Hope this helps.
Regards,
podhillo
Pavol Golis Tue, 08/24/2010 - 05:35

Your interrupt level is unusually high, meaning you have a lot of CPU processed traffic.

please provide following output so we can understand whats that traffic about:

1) terminal exec prompt timestamp

2) show controllers cpu-interface

    show ip traffic

3) wait 60 seconds

4) show controllers cpu-interface

   show ip traffic

Actions

This Discussion