08-31-2008 01:44 AM
Dear All
Our HUM application ahs crashed by itself, the following two processes are down and I try to restart them manually they don't come back up:
ProcessName ProcessState ProcessId ProcessRC ProcessSigNo ProcessStartTime ProcessStopTime
3. UPMDbMonitor Administrator has shut down this server 0 15 0 8/31/2008 11:53:24 AM 8/31/2008 11:56:39 AM
4. UPMProcess Administrator has shut down this server 0 15 0 8/31/2008 11:53:24 AM 8/31/2008 11:56:24 AM
All the HUM portlets read:
"Unable to get Database Connection. Either UPMDbEngine process is down or Connection Pool is exhausted."
How to proceed with this issue?
CiscoWorks Common Services 3.1.1
Health and Utilization Monitor 1.0.0
Regards
Farrukh
Solved! Go to Solution.
09-07-2008 08:08 AM
This command will only reinitialize the HUM data. None of the other apps will be affected.
08-31-2008 01:52 AM
08-31-2008 09:53 AM
Please post your UPMDbMonitor.log.
09-01-2008 01:01 AM
Thank you for your help. I tried to locate this file but its virtually empty with only this in it:
++++++++++++++++++++++++++++++++++++++++++++++++++++++++
UPMDbMonitor {Sun Aug 31 11:53:24 2008} Running DbMonitor version 2.1
Regards
Farrukh
09-01-2008 04:08 AM
Please post a list of services and their startup parameters as well as the list of contents under NMSROOT/databases/up and the output of netstat -a -n -o -b.
09-01-2008 04:58 AM
09-01-2008 06:47 PM
You did not include the service startup parameters. Based on the rest of the rest of the output, everything looks okay. Therefore< I need to see the service startup parameters.
09-01-2008 07:03 PM
Sorry for my stupidity, but how can I capture the service startup parameters? I'm assuming you want the status Manual/Automatic/Disabled thing available in services.msc
Regards
Farrukh
09-02-2008 04:05 AM
A screenshot of the services control panel will do.
09-03-2008 12:58 AM
09-03-2008 04:23 AM
This looks fine, and since there is no errors in the DbMonitor log, I cannot say what the problem with the database is. Typically, issues like this are either a problem with the database password, or the database is corrupted. This could also be an issue caused by a DLL conflict, but we typically see the CmfDbMonitor process also go down. However, if you have multiple copies of libeay32.dll and ssleay32.dll on the system (especially in C:\WINDOWS or C:\WINDOWS\system32), this can cause crashes in the DbMonitor processes.
If you rule out the DLL problem, and what to look at the other possible causes, you could first try resetting the HUM DB password:
NMSROOT\bin\perl NMSROOT\bin\dbpasswd.pl dsn=upm
If that does not work, you could try reinitializing the HUM database:
NMSROOT\bin\perl NMSROOT\bin\dbRestoreOrig.pl dsn=upm dmprefix=UPM
Of you could contact the TAC to have them walk you through enabling DbMonitor debugging.
09-07-2008 03:49 AM
Thank you for your help. I did a search for these two DLLs on the CiscoWorks server, and I found both in the following locations:
C:\hp\hpsmh\bin
C:\Program Files\CSCOpx\bin
They are not present in the Windows directory etc. File size of both the above locations are same.
I also tried to reset the HUM DB password, but the same issue persists. In fact now there is a new issue, the UPM process have gone down completely. The HUM DB process available in windows service manager is also stopped now, I can't start it from either Windows or CiscoWork Process Manager (UPM processes). Please find attached new pdshow.
Please le me know how to proceed with this now. We are seriously doubting HUM's stability to monitor our network now. If it can't stay up itself, we don't except it to tell us the availablity of our network devices :)
Regards
Farrukh
09-07-2008 07:02 AM
Now it appears the database is corrupt. If you have a good LMS backup, you can restore from that. Else, you will need to reinitialize the UPM database:
NMSROOT\bin\perl NMSROOT\bin\dbRestoreOrig.pl dsn=upm dmprefix=UPM
09-07-2008 08:05 AM
Thank you for your reply. Will this affect only the HUM component or all? I really don't care about the HUM data right now and am willing to restore a 20-25 day old backup, but I want all th RME/DFM/CM data to stay there, is that possible?
Thanks
Farrukh
09-07-2008 08:08 AM
This command will only reinitialize the HUM data. None of the other apps will be affected.
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: