cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
4052
Views
0
Helpful
16
Replies

CSCsi78581 - Hulc LED Process has even higher CPU (20%) running "fixed" version 15.2(2)E

bcoverstone
Level 1
Level 1

A known good fix for the CPU issue was listed as version 15.2(2)E.

However, I have found that this version has even a higher CPU usage of 20% than the original bug indicated at 15%.

Does anyone know a fix for this?

16 Replies 16

stansellc
Level 1
Level 1

Experiencing this with 12.2(55)SE9 as well.

Same here, version 15.0(2)SE7 on my 3750X stacks.

For me, only seem to be seeing this on my 48 port switch stacks....  I have multiple 24 port 3750X switch stacks at the same IOS version, and not seeing this issue.  Cisco, any help with this one?

Our issue was resolved by VLAN pruning.  We had a VLAN that was bleeding over the trunk that wasn't being used on that switch.  If the VLAN wasn't in use we removed it.  The culprit was a scanning tool on the network that shouldn't have been scanning that far into our network.

Thanks stansellc!  We are full layer 3 in our network closets, so we don't have trunks between the closets and our distribution switches...  However, we do have a VLAN that is built on the switch that isn't in use, and is currently down due to no interfaces being configured on that VLAN.  I'll try removing that VLAN and SVI from the stack to see if that helps.  I'll report back with results.

No luck in my case...  I removed the one SVI that we had on the switch for a VLAN that we weren't using.  Still seeing the HULC LED process using 20% of the CPU steadily...

We found out a security device probing the network and was actually causing the problem.  When we shut down the VLAN and to solve the problem at the time.  We put it VLAN back on the trunk (months later) the issue hasn't returned.

Pruning won't help here, I only have 3 VLANs, and they are all in use.  There isn't any scanners running.  Besides, even if there was a scanner running, why would it cause the CPU to jump to 20%?

 

Even at night when there is very little traffic, the CPU sits at 20%.

 

I found that if I unplug everything, the CPU slowly goes down.  It's as if this process takes .5% of the CPU per port that is plugged in.  If you completely fill the switch, you'll have about 25% CPU usage.

superflybry
Level 1
Level 1

I see this too on version 15.2(1)E1. CPU sits at around 40% average with the hulc led process using 20% then whenever the 'crypto sw pk pro' process invokes (which I believe is related to SSH key regen - we are running ssh) it adds a further 50% to cpu. This leaves very little overhead for any additional processes. Given that the ssh key regens every hour or so, we are seeing regular 'spikes' even when switch is idle. Even though Cisco says that this shouldn't affect traffic, we have users regularly complaining about momentary loss of voip calls (not a complete drop).

This is on WS-C3750X-48P-L in a stack. Have the same version on the 24 port version but cpu is about half what we see on 48 port.

I've been told by TAC to downgrade to v15.0.2-SE-8 but looking through this forum someone has said that they are experiencing the same on 15.0.2-SE-7 so not sure if that is going to work.

Yep, this problem still persists for us as well...  Still only on the 48 Port Stacks, not the 24 Port ones for some reason...  I'm still running 15.0(2)SE7 on mine.  Would be great if Cisco could figure this one out.  Unfortunately the locations in which I have these 48 port 3750X stacks are critical areas in our hospital...  CPU runs consistently at around 50-55%, with spikes up into the 90s from time to time...

** Update ** Having gone through config's we realised that the switches experiencing spikes were configured with sshv1 and 2. When we changed this to SSHv2 only the spikes disappeared!

 

So from what I can see, this platform has issues with SSH when both version 1 and 2 are enabled..

i.e. sh ip ssh  and see if version 1.99 is in effect.

 

I've added a couple of screenshots showing show cpu history for both switches. On the 72 hour readout we applied version 2 24hrs previous and you can see that although the cpu is still on average 40percent (which is normal), the spikes disappeared.

Can't believe Cisco haven't picked that up??

 

 

I took a look at this on mine, and I only have ssh v2 running...  Bummer!!  Still no luck for me, HULC_LED process still consistently using ~20% of the CPU...

Yeah HULC_LED will still run at 20 percent but I am not getting the 'spikes' that I was before. I don't think it's every going to be any lower actually.

 

Cool, gotcha...  Ya, I have never seen too much spiking, just the big chunk of CPU for the LED process...  Mine stays pretty steady at around 20%...  Very surprised that Cisco hasn't figured this one out yet, especially seeing that this is not seen on the same version 24 port version of these switches...  Would be nice to get this fixed...

naeschlimann
Level 1
Level 1

Hello,

 

We have the same problem with IOS 15.0(2)SE7 (3750x-48p) with regular spikes at 90-100% causing Network crashes.

 

Can anyone recommend a version where this bug is fixed ?

 

Thank you.