Cisco Support Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Community Member

LMS 3.0 troubleshooting

Hi,

I was wondering if anyone else has had the following problem when trying the task of clicking "Device Troubleshooting" under Device Center. I get the following error

CWA025: Could not launch the workflow.

CWA engine may not be running.

Restart the daemon manager of the server:On Windows: 1. Enter net stop crmdmgtd 2. Enter net start crmdmgtd On Solaris: 1. Enter /etc/init.d/dmgtd stop 2. Enter /etc/init.d/dmgtd start If the problem persists, contact the CiscoWorks server administrator.

I have tried restarting this service but to no avail. I also am unable to query my device's to get an Inventory Update, after several hours I get a timeout error. I can use CiscoView successfully so my SNMP settings are correct. Any ideas ?

Regards

Simon

31 REPLIES
Cisco Employee

Re: LMS 3.0 troubleshooting

What version of LMS is this? On what platform?

Community Member

Re: LMS 3.0 troubleshooting

Its is LMS 3.0 on Windows 2003 Server

Cisco Employee

Re: LMS 3.0 troubleshooting

Try reinitializing the opsxml database with the following command:

NMSROOT\bin\perl NMSROOT\bin\dbRestoreOrig.pl dsn=opsxml dmprefix=Opsxml npwd=cisco

Then see if you're able to start the workflow.

Community Member

Re: LMS 3.0 troubleshooting

Hi, have tried this and still encountering the same issue. Have you got any other ideas as to why the workflow is not starting ?

Simon

Cisco Employee

Re: LMS 3.0 troubleshooting

Enable CWA debugging under CWA > Admin > Log Level Settings. Then reproduce the problem, and post the CWA.log and the NMSROOT\objects\wfengine\Program\OpsXml.log and Datastore.log.

Community Member

Re: LMS 3.0 troubleshooting

The opsXML file is dated 25th march, so there are no entries, the last is

OpsXML Server Starting at Tue Mar 25 15:54:52 2008

Datastore.log again the last entry is the 25th March

DataStore Exited @ Tue Mar 25 15:28:02 2008

DataStore Started @ Tue Mar 25 15:34:03 2008

DataStore Exited @ Tue Mar 25 15:49:29 2008

DataStore Started @ Tue Mar 25 15:54:59 2008

I have checked the server has the correct date and time

Cisco Employee

Re: LMS 3.0 troubleshooting

Please post the output of the pdshow command.

Community Member

Re: LMS 3.0 troubleshooting

Please find pdshow attached

Cisco Employee

Re: LMS 3.0 troubleshooting

Shutdown dmgtd, and send the list of running processes.

Community Member

Re: LMS 3.0 troubleshooting

Sorry do you want me to do a

net stop crmdmgtd

and then do a pdshow again ?

Cisco Employee

Re: LMS 3.0 troubleshooting

No, I want you to do a net stop crmdmgtd, then send me the list of all processes running on the server. Pdshow will not work with dmgtd shutdown, but I care about Windows processes at this point.

Community Member

Re: LMS 3.0 troubleshooting

Here is the output of tasklist from Windows Resource Kit

Cisco Employee

Re: LMS 3.0 troubleshooting

Interestingly enough, one of my Windows servers was exhibiting the same problem. It turns out my wfengine processes had died, but pdshow reported OpsXMLRuntime was still running. Restarting OpsXMLRuntime fixed it for me. Restart dmgtd, and see if the workflow starts to work. If not, post a new process list and pdshow output now that dmgtd is running.

Community Member

Re: LMS 3.0 troubleshooting

After a restart of dmgtd here is the pdshow and tasklist

Cisco Employee

Re: LMS 3.0 troubleshooting

All of the necessary processes are running. With CWA and CWA engine debuggign still enabled, are there any new updates in the DataStore.log and OpsXML.log?

Community Member

Re: LMS 3.0 troubleshooting

Thankyou, that was the problem with Workflow, which is now working However I assumed this problem with workflow was the reason that I was unable to successfully able to complete a Inventory Update of a device. I have again tried to update the inventory and after several hours the job times out. I receive the message "Timed out. Make sure that ICServer is running" under the Job Results Description. I can use CiscoView to view the device, so I know SNMP is working correctly. Thanks

Cisco Employee

Re: LMS 3.0 troubleshooting

Please post the IC_Server.log.

Community Member

Re: LMS 3.0 troubleshooting

IC_Server log, copied the final 3 pages

Cisco Employee

Re: LMS 3.0 troubleshooting

I assume device 192.168.21.23 is your problem device. If that is the case, it appears there is an SNMP credential issue with this device in DCR. Other than that, I don't see any errors.

Community Member

Re: LMS 3.0 troubleshooting

On closer inspection it appears none of my devices are having the "Update Inventory" function work. This is my Devl test area and need to prove it working before rolling into Prod

Cisco Employee

Re: LMS 3.0 troubleshooting

Enable ICServer Inventory collection and job debugging under RME > Admin > System Preferences > Loglevel Settings, then run another inventory job. Post the new IC_Server.log as well as the log from the job directory under NMSROOT\files\rme\jobs\ICServer.

Community Member

Re: LMS 3.0 troubleshooting

Hi, Please find files requested.

Cisco Employee

Re: LMS 3.0 troubleshooting

Something appears to be deadlocking ICServer. But I can't see what that is since debugging was not enabled when it happened. It won't respond to any requests again until you restart it.

So, restart ICServer with "pdterm ICServer" followed by "pdexec ICServer". Then, keep debugging on, and run jobs until the job times out. Then post the new IC_Server.log.

If the problem still cannot be ascertained, you will need to open a service request with TAC so that ICServer can be run manually so a full thread dump can be captured.

Community Member

Re: LMS 3.0 troubleshooting

O.K pdterm functions completed and logs attached. Thanks

Cisco Employee

Re: LMS 3.0 troubleshooting

I don't see what could be causing the deadlock. Please post ICServer.log.

Community Member

Re: LMS 3.0 troubleshooting

Please find un-edited version

Cisco Employee

Re: LMS 3.0 troubleshooting

This is the IC_Server.log. I need to see the ICServer.log.

Community Member

Re: LMS 3.0 troubleshooting

Oh sorry, here we go

Cisco Employee

Re: LMS 3.0 troubleshooting

This explains why inventory is not working, but I'm not sure how this could have happened. It looks like your installation failed or was corrupted. At least two key files are damaged. Since it doesn't sound like this ever worked, I recommend you uninstall LMS, then reinstall it from scratch.

245
Views
12
Helpful
31
Replies
CreatePlease to create content