cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1202
Views
0
Helpful
2
Replies

Nexus 5596 high cpu utilization caused by igmp

Oleg Volkov
Spotlight
Spotlight
Dear Sirs!
I have two Nexus 5596 and four extenders.
It switches work in vPC domain and make inter-vlan routing (I use vrrp)
But I see cpu utilization about 80%, and igmp process always 20-40%.
What happens?
Thanks!
PS:
You can see some output from console below
-----------------------------------------------------------------------------------------

sh proc cpu sort

PID    Runtime(ms)  Invoked   uSecs  1Sec    Process
-----  -----------  --------  -----  ------  -----------
 3653          149        32   4662   37.7%  igmp
 3487          324      2894    112   24.5%  netstack
 3302      4551745  55180315     82   10.4%  bcm_usd
 3298    845763549  2147483647    201    2.8%  carmelusd
 3205    249194324  151947505   1640    0.9%  pfma
 3425    103960826  425708442    244    0.9%  snmpd
 3431    474973668  573502953    828    0.9%  statsclient
    1       171657   3058895     56    0.0%  init
    2            3       294     10    0.0%  kthreadd
    3          822    173391      4    0.0%  migration/0
    4       677799  91599719      7    0.0%  ksoftirqd/0
    5       149181   3946534     37    0.0%  watchdog/0
    6          721    146473      4    0.0%  migration/1

 
 
 
      Interface  VR IpVersion Pri   Time Pre State   VR IP addr
---------------------------------------------------------------
         Vlan17  17   IPV4    254    1 s  Y  Master   10.50.17.1
         Vlan52  52   IPV4    254    1 s  Y  Master    10.52.0.1
         Vlan54  54   IPV4    254    1 s  Y  Master    10.54.0.1
         Vlan55  55   IPV4    100    1 s  Y  Master    10.55.0.1
         Vlan56  56   IPV4    100    1 s  Y  Master    10.56.0.1
         Vlan57  57   IPV4    100    1 s  Y  Master    10.57.0.1
         Vlan58  58   IPV4    100    1 s  Y  Master    10.58.0.1
         Vlan59  59   IPV4    100    1 s  Y  Master   10.50.20.1
         Vlan75  75   IPV4    100    1 s  Y  Master    10.75.0.1
        Vlan147 147   IPV4    100    1 s  Y  Master    10.50.0.1
        Vlan148 148   IPV4    100    1 s  Y  Master 192.168.50.1
        Vlan149 149   IPV4    100    1 s  Y  Master   10.50.0.17
        Vlan151 151   IPV4    254    1 s  Y  Master    10.50.1.1
        Vlan152 152   IPV4    254    1 s  Y  Master    10.50.2.1
        Vlan155 152   IPV4    254    1 s  Y  Master    10.50.4.1
        Vlan158 158   IPV4    100    1 s  Y  Master    10.50.8.1
        Vlan159 159   IPV4    100    1 s  Y  Master    10.50.9.1
        Vlan160 160   IPV4    100    1 s  Y  Master   10.50.10.1
        Vlan161 161   IPV4    254    1 s  Y  Master  10.0.255.20
        Vlan164  64   IPV4    254    1 s  Y  Master    10.64.0.1
        Vlan208 208   IPV4    100    1 s  Y  Master   10.208.0.1
        Vlan452   1   IPV4    100    1 s  Y  Master   10.10.2.65
        Vlan453   2   IPV4    100    1 s  Y  Master   10.10.2.97
        Vlan511  11   IPV4    100    1 s  Y  Master    10.51.1.1
        Vlan512  12   IPV4    100    1 s  Y  Master    10.51.2.1
        Vlan513  13   IPV4    254    1 s  Y  Master    10.51.3.1
        Vlan515 155   IPV4    254    1 s  Y  Master    10.51.5.1
        Vlan516   6   IPV4    254    1 s  Y  Master    10.51.6.1
        Vlan549  49   IPV4    254    1 s  Y  Master   10.50.49.1
 
 
Cisco Nexus Operating System (NX-OS) Software
Copyright (c) 2002-2013, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained herein are owned by
other third parties and are used and distributed under license.
Some parts of this software are covered under the GNU Public
License. A copy of the license is available at
 
Software
  BIOS:      version 3.6.0
  loader:    version N/A
  kickstart: version 6.0(2)N2(2)
  system:    version 6.0(2)N2(2)
  Power Sequencer Firmware:
             Module 1: version v5.0
             Module 2: version v1.0
             Module 3: version v1.0
             Module 4: version v1.0
  Microcontroller Firmware:        version v1.0.0.2
  SFP uC:    Module 1: v1.0.0.0
  QSFP uC:   Module not detected
  BIOS compile time:       05/09/2012
  kickstart image file is: bootflash:///n5000-uk9-kickstart.6.0.2.N2.2.bin
  kickstart compile time:  10/4/2013 12:00:00 [10/05/2013 00:04:23]
  system image file is:    bootflash:///n5000-uk9.6.0.2.N2.2.bin
  system compile time:     10/4/2013 12:00:00 [10/05/2013 02:23:49]
 
 
Hardware
  cisco Nexus 5596 Chassis ("O2 48X10GE/Modular Supervisor")
  Intel(R) Xeon(R) CPU         with 8253856 kB of memory.
  Processor Board ID FOC17193DMC
 
  Device name: ZES-CSW01
  bootflash:    1966080 kB
 
Kernel uptime is 147 day(s), 3 hour(s), 12 minute(s), 1 second(s)
 
Last reset at 943083 usecs after  Fri Mar 28 19:17:56 2014
 
  Reason: Reset Requested by CLI command reload
  System version: 6.0(2)N2(2)
  Service:
 
plugin
  Core Plugin, Ethernet Plugin
  
  
sh proc cpu history
 
    728787897789278788988889877787887788888778785787888887788998
    990718147971840530522573995537524274343994609082422009306150
100                   #                                       #
 90        #  ##      #  ####     #   #           #         ###
 80 # ##########  ##################  ##########  # ###### #####
 70 # ########## ############################### ###############
 60 # ########## ###############################################
 50 # ########## ###############################################
 40 # ########## ###############################################
 30 ############################################################
 20 ############################################################
 10 ############################################################
    0....5....1....1....2....2....3....3....4....4....5....5....
              0    5    0    5    0    5    0    5    0    5
 
               CPU% per second (last 60 seconds)
                      # = average CPU%
 
 
      1   1               11  111           1           111 111
    990999099999999999999900990009999999999909999999999900090009
    590714089999367785898900710007897643877904446728563400080008
100 ****  ****** ************ ********  *****   ** ***  ********
 90 **********************##**##************************##***##*
 80 ########################**#############################**###
 70 ############################################################
 60 ############################################################
 50 ############################################################
 40 ############################################################
 30 ############################################################
 20 ############################################################
 10 ############################################################
    0....5....1....1....2....2....3....3....4....4....5....5....
              0    5    0    5    0    5    0    5    0    5
 
               CPU% per minute (last 60 minutes)
              * = maximum CPU%   # = average CPU%
 
 
    1111111111111111111111111111111111111        111111111111111111111111111
    000000000000000000000000000000000000099999999000000000000000000000000000
    000000000000000000000000000000000000097689768000000000000000000000000000
100 ************************************************************************
 90 ************************************************************************
 80 #####################*************************###############***********
 70 ######################************************##########################
 60 #####################################*********##########################
 50 #####################################********###########################
 40 #####################################********###########################
 30 #####################################********###########################
 20 ########################################################################
 10 ########################################################################
    0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
              0    5    0    5    0    5    0    5    0    5    0    5    0
 
                   CPU% per hour (last 72 hours)
                  * = maximum CPU%   # = average CPU%
--------------------------------------------------------------------------

Helping seriously ill children, all together. All information about this, is posted on my blog
2 Replies 2

Reza Sharifi
Hall of Fame
Hall of Fame

Hi,

Do you have multicast configured.  It appears that igmp is eating up 37.7%  of your CPU.

Open a TAC ticket with Cisco, so they can help you resolve the issue.

HTH

 

HI

Yes, I configure vrrp and eigrp - this protocol use multicast

alsow I use igmp snooping and pim.

Can I change VRRP to work as unicast?

 

--------------------------------------------------------------------------

Helping seriously ill children, all together. All information about this, is posted on my blog
Review Cisco Networking products for a $25 gift card