Hulc LED Process

Unanswered Question
Mar 9th, 2009

Hi All,..

I saw in my switch there is a hig processor CPU in PID 110, could you please advice me what it is? and how to solve this?

Device type : WS-C3560G-48PS

-----------------------------------------

Switch#sh proc cpu sor

CPU utilization for five seconds: 23%/0%; one minute: 22%; five minutes: 21%

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

110 11990607 1436516 8347 15.97% 15.83% 15.84% 0 Hulc LED Process

-----------------------------------------

Thanks

I have this problem too.
5 votes
  • 1
  • 2
  • 3
  • 4
  • 5
Overall Rating: 5 (2 ratings)
Loading.
Yudong Wu Tue, 03/10/2009 - 21:24

Hulc LED Process is a process responsible for link status detection.

If there is SFP port in use, it might be a little bit high.

You can check if you hit the following bug.

CSCsi78581 Hulc LED Process uses 10-15% CPU on Catalyst 3750/3560.

wim_depauw Wed, 06/17/2009 - 02:58

Hi,

We have a similar problem on a 2960 with SFP ports.

Is this bug only related to 3750/3560 or also to 2960 ? I can't find a bug on the bug toolkit...

Our CPU is running around 25 - 30 % so we would like to decrease it if possible.

Do you know a workaround ?

gr

Yudong Wu Wed, 06/17/2009 - 08:16

That bug is not related to 2960.

I tested 2960 in the lab. If it is 2960 with PoE, Hulc LED process will use about 15% CPU.

In general, it is normal for 2960 to have cpu usage around 15-40%.

If you don't have any performance issue, you can ignore this.

Paolo Bevilacqua Fri, 02/12/2010 - 13:00

CSCsi78581 lists this fixed in in 12.2(44)SE only, when it will be fixed in other newer versions ?

I have it on 48 ports 2960 thta can ony run 12.2(50) and higher.

Paolo Bevilacqua Mon, 02/22/2010 - 00:44

On one of the 2960-48 that suffer this, I've loaded for a try 12.2(52)SE

Hulc LED remained the same, but general CPU utilli went up actually with "REP LSL" ?!?.

CPU utilization for five seconds: 34%/0%; one minute: 30%; five minutes: 29%
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
114     9582762   1518651       6310 15.65% 15.40% 15.50%   0 Hulc LED Process

96        1834       108      16981  5.11%  0.41%  0.08%   1 SSH Process
238      192955     73776       2615  3.35%  0.63%  0.40%   0 SNMP ENGINE
236       78907    133133        592  2.07%  0.31%  0.17%   0 IP SNMP
183     4008328 164163844         24  1.27%  7.01%  7.28%   0 REP LSL Hello PP

Can't Cisco fix this ?

dancandea Wed, 05/04/2011 - 05:37

disable not-connected ports and you'll see a drop in the cpu usage for this process

w951duu Mon, 06/20/2011 - 12:37

I shut down the SPF ports not in use and saw CPU drop by a minimum of 20% on all of my 2960S-POE switches:

George Ageraniotis Sun, 09/18/2011 - 18:03

Hi,

After disable two SFP ports in 2960 the "Hulc LED process" dropped to 6.23%. Before it was 15.65%!!

leolaohoo,

    

     This IOS (58) isn't consuming a lot of memory?

Leo Laohoo Sun, 09/18/2011 - 18:08

I've got news for you George, STAY AWAY from IOS level 15.0.  Across the board, it's got a memory leak issue WITHOUT any configs.

I'm currently using 12.2(58)SE1 and I have no issue. 

SSCH1NDLER Mon, 01/16/2012 - 05:09

Hi,

i've got the same problem. We have two 3560x 48P running IOS 12.2(58)SE2 and the HULC LED process takes over 15% cpu load.

For what this process is responsable?

    3333333333333333333333333344444444443333344444333333333333

    7766663333344444888889999922222555557777700000999988888888

100

90

80

70

60

50                                *****

40 ******          ******************************************

30 **********************************************************

20 **********************************************************

10 **********************************************************

   0....5....1....1....2....2....3....3....4....4....5....5....

             0    5    0    5    0    5    0    5    0    5

               CPU% per second (last 60 seconds)

    4444445444444444444444444444444444444444444444444444444444

    5533537321232332633343242222223322445244332224325233535342

100

90

80

70

60       *

50 **  * *         *                   *           *   * *

40 ##########################################################

30 ##########################################################

20 ##########################################################

10 ##########################################################

   0....5....1....1....2....2....3....3....4....4....5....5....

             0    5    0    5    0    5    0    5    0    5

               CPU% per minute (last 60 minutes)

              * = maximum CPU%   # = average CPU%

     1       1                 1     1111                       1

    7068757780566565576559785560556660000566555666976756656774670765667657

    3032391000910845988349359340222180000048268309429544494069810073970443

100  *       *           *     *     ****                       *

90  *       *           * *   *     ****         *             *

80  * *    **       *   * *   *     ****         *  *      *   *

70 ** ** ****       **  ***   *    *****  *     *****     ** ***** ***  *

60 *******************  **** **  ******* ** ********* ****** ***** **** *

50 **********************************************************************

40 ######################################################################

30 ######################################################################

20 ######################################################################

10 ######################################################################

   0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.

             0    5    0    5    0    5    0    5    0    5    0    5    0

                   CPU% per hour (last 72 hours)

                  * = maximum CPU%   # = average CPU%

3560-x#sh processes cpu sorted 5min

CPU utilization for five seconds: 35%/0%; one minute: 35%; five minutes: 38%

PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process

129  1769580351 396248960       4465 15.97% 15.39% 14.11%   0 Hulc LED Process

  60  1017745522 191907631       5303  8.62%  7.60%  7.13%   0 RedEarth Tx Mana

211  1379704348  90033624      15324  0.15%  1.23%  5.45%   0 REP LSL Hello PP

  59   266213943 266690463        998  2.23%  1.93%  1.92%   0 RedEarth I2C dri

  97   394926822  33075411      11940  1.59%  1.55%  1.54%   0 hpm counter proc

Mike Clites Fri, 04/20/2012 - 12:58

I have the same issue as ssch1ndler does; exact same code revision but my usage for this particular process sits at 20% even after turning off the 4 gi1/1 - 4 ports.

Anyone know if a newer version of the code has fixed this high cpu process?

Thank you

Paolo Bevilacqua Fri, 04/20/2012 - 14:01

I have fought this matter with the TAC for quite a long time, they were adamant:

no fix is possible (hard to believe, I know) and one has to keep it as it is.

IBMBHARTISO Fri, 04/17/2015 - 06:00

Cisco Team,

I have facing HULC LED process cpu high utilization on Cisco 3560 device

Kindly see this issue Coz We have a lot of 3560 devices .

 

CPU utilization for five seconds: 45%/27%; one minute: 77%; five minutes: 81%
 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
 112    92636289  11819413       7837 10.22% 12.50% 12.82%   0 Hulc LED Process
 162         572       149       3838  0.79%  0.47%  0.12%   1 SSH Process
  34      243793      9957      24484  0.63%  0.06%  0.01%   0 Per-minute Jobs
   4      759941     69775      10891  0.47%  0.08%  0.06%   0 Check heaps
 167      908721   2401823        378  0.31%  0.25%  0.17%   0 IP Input
  49      108374  27272839          3  0.15%  0.03%  0.00%   0 Fifo Error Detec
  82     2985986    581464       5135  0.15%  0.17%  0.24%   0 hpm counter proc
  21       59657    581607        102  0.15%  0.02%  0.00%   0 IPC Deferred Por
 121      113837    235117        484  0.15%  0.02%  0.00%   0 HRPC qos request
 120      929926    117568       7909  0.15%  0.13%  0.12%   0 HQM Stack Proces
  10           0         1          0  0.00%  0.00%  0.00%   0 CEF MIB API
   9      677969   2742900        247  0.00%  0.09%  0.09%   0 ARP Input
   8           0         1          0  0.00%  0.00%  0.00%   0 Crash writer
  11           0         2          0  0.00%  0.00%  0.00%   0 AAA_SERVER_DEADT
  12           0         2          0  0.00%  0.00%  0.00%   0 AAA high-capacit
   7        2729     68702         39  0.00%  0.00%  0.00%   0 Net Input
  17          25      9815          2  0.00%  0.00%  0.00%   0 IPC Dynamic Cach
  18           0         1          0  0.00%  0.00%  0.00%   0 IPC Zone Manager
   6           0         2          0  0.00%  0.00%  0.00%   0 Timers
  13           0         1          0  0.00%  0.00%  0.00%   0 Policy Manager
  14          16         5       3200  0.00%  0.00%  0.00%   0 Entity MIB API

Paolo Bevilacqua Tue, 04/28/2015 - 15:01

Read my answer above:

I have fought this matter with the TAC for quite a long time, they were adamant:

no fix is possible (hard to believe, I know) and one has to keep it as it is.

TEOH SU KEONG Thu, 05/07/2015 - 02:13

Hi,

I have few 2960XR-48FPD-I switch which is also facing high HULC LED process.

roughly about 26% all the time.

Running on version 15.0(2)EX5

So i just want to confirm there is no known fix version?

Will it cause any performance issue?

Thanks.

Paolo Bevilacqua Thu, 05/07/2015 - 13:21

This thread is about older models. Since your is much newer, you should try opening a case anyway to see what is Cisco response.

Heba Elsherbiny Tue, 08/04/2015 - 02:19

Hi , i have this issue now with C2960S-UNIVERSALK9-M), c2960s-universalk9-mz.150-2.SE4

support team opened TAC with cisco and recommended to upgrade to 15.0(2)SE8

 

problem is i can only upgrade to 15.0(2)SE6 >>> do you know if this version will fix the issue ?

Jorge Luis Cove... Wed, 02/04/2015 - 11:17

I had the same issue with 3750stack with IOS 15.0(2)SE5.  But the bug CSCsi78581  does not hit with this IOS. Do you know if there is another bug for 15.x?

Paolo Bevilacqua Thu, 05/07/2015 - 13:19

The fact that the version list for the bug doesn't include your version does not mean is not there, as your report demonstrate.

Leo Laohoo Thu, 05/07/2015 - 16:01

Hey Paolo!

 

You're back!  Hope you're doing well.  Some of us have been wondering what ever happened to you.

Leo Laohoo Thu, 05/07/2015 - 16:04
I had the same issue with 3750stack with IOS 15.0(2)SE5.  But the bug CSCsi78581  does not hit with this IOS. Do you know if there is another bug for 15.x?

The most stable IOS for the 3560/3750 series of switches has always been 12.2(55)SE-train.  Try 12.2(55)SE10.  Any other IOS version is just plain garbage.

vasanth77 Wed, 08/17/2016 - 03:32

Hi Leo,

I got high cpu utilization for a long time on the same switch which is running C2960 Software (C2960-LANBASEK9-M), Version 15.0(2)SE6

I need to run the same 15.x IOs.

can you please suggest the IOS which is not affected by bug CSCsi78581.

SW5#show processes cpu | ex 0.00
CPU utilization for five seconds: 82%/33%; one minute: 82%; five minutes: 87%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
45 9315208 52503688 177 1.75% 1.45% 1.51% 0 Net Input
53 6268876 386239552 16 0.47% 0.12% 0.10% 0 DownWhenLooped
69 12859754 187938145 68 0.15% 0.07% 0.11% 0 RedEarth Tx Mana
74 67204962 956595118 70 0.63% 0.43% 0.36% 0 Fifo Error Detec
105 16480672 20214830 815 0.31% 0.37% 0.36% 0 hpm counter proc
133 83973414 504307953 166 32.90% 33.47% 33.88% 0 Hulc LED Process
142 33521049 4039068 8299 0.31% 0.17% 0.16% 0 HQM Stack Proces
165 9395187 201949573 46 0.79% 0.30% 0.30% 0 UDLD
183 385 229 1681 0.15% 0.01% 0.01% 1 Virtual Exec
201 29114634 35845034 812 0.15% 0.16% 0.15% 0 Spanning Tree
223 41728709 42681366 977 4.15% 4.05% 4.80% 0 IGMPSN
230 32514585 44302472 733 0.47% 0.46% 0.60% 0 Marvell wk-a Pow

SW5#show version
Cisco IOS Software, C2960 Software (C2960-LANBASEK9-M), Version 15.0(2)SE6, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2014 by Cisco Systems, Inc.
Compiled Wed 09-Apr-14 03:40 by prod_rel_team

ROM: Bootstrap program is C2960 boot loader
BOOTLDR: C2960 Boot Loader (C2960-HBOOT-M) Version 15.0(2r)EZ1, RELEASE SOFTWARE (fc2)

LPTRIST07S005 uptime is 33 weeks, 2 days, 23 hours, 17 minutes
System returned to ROM by power-on

Thanks in advance

Kevin P Sheahan Thu, 12/19/2013 - 19:08

I'm on 15.2(1)E1 .. already tried all other 15.x code releases but am running into bugs preventing proper ISE install. ISE functions perform very well in 15.2(1)E1 ... but this process is beating up the switch until it crashes. This is amazingly frustrating considering the amount of time I've put into finding good code for ISE, and when I find it there's another bug that prevents use.

I tried to fall back to 12.2(58)SE2 and ran into a bug affecting voice in a bad way.. ISE dACL function was also jacked in that code under certain conditions.

I like ISE, think it's a great technology but I cannot seem to complete a wired implementation with 2960S switches... I need to find some decent code!

Kind Regards,

Kevin Sheahan, CCIE # 41349

Askar Abdrakhmanov Wed, 10/28/2015 - 20:47

Hi Leo

I have the same issue with C2960S (C2960S-UNIVERSALK9-M), Version 12.2(55)SE5

 think this problem would be in any ios  whatever version of ios you use...

Actions

This Discussion