Upgrading from Ciscoworks 2.6 to 3.2 Database error

Derek McCormick · ‎07-16-2010

Hi,

I am upgrading from Ciscoworks 2.6 to 3.2. When i run the eval.exe file, it runs to a point where it attempts to backup the current version. After about 10GB, it gets a cfm fail and tells me to look in the backup log. .In the log, there is a fatal error message saying

ERROR(1055): Fatal error: Database engine 'dfmFhEng' could not be started on database 'dfmFhDb' in Bulk mode

Has anyone seen this before?

Attached are the install log and the backup log

Thanks,
Derek

Joe Clarke · ‎07-16-2010

It could be that the DFM Fault History database ic corrupt. Check this document on database troubleshooting for more details:

https://supportforums.cisco.com/docs/DOC-8796

You may either need to reinitialize the database transaction log, or the database itself. Then you can try the upgrade again.

Derek McCormick · ‎07-20-2010

The info you provided was very helpful. I had to reinitialize the dfmEPM, dfmINV and the dfmFh databases.

I am still not out of the woods however, when I run a self test I get the following:

Server Info

generated Mon Jul 19 18:40:18 2010

Table of Contents

PASS	backup.pl
FAIL	database.pl
PASS	mem.exe
PASS	network.pl
PASS	odbc.pl
PASS	platform.pl
PASS	snmp.pl

backup.pl

PASS the backup script is installed

go to top

database.pl

FAIL Self Test Fail to query cmf.DbVersion, Error: Database server not found (DBD: login failed)

Self Test Fail to query cmf.SYSTABLE, Error: Database server not found (DBD: login failed)

go to top

mem.exe

PASS 2146902016 bytes of physical ram and 3600957440 bytes total page file size

go to top

network.pl

PASS lookup of loopback address succeeded

go to top

odbc.pl

PASS Recommended DLL versions found.

go to top

platform.pl

PASS supported platform : 'ServerNT'

go to top

snmp.pl

PASS CWSNMP.DLL and cwwsnmp32.dll found in correct place

go to top

When I attempt to go into the device manager I get, if I try and do a device discovery I also get the same message. I have checked the processes. I originally tried to start the DCR server manually, but now it reports as being up since today. Are there any log files I should look at? I attempted to run a system report and it reports – no records. I get the following error:

{CmfDbMonitor}: Cannot connect to cmf database, please contact your systems administrator

Any help appreciated.

Cheers,

Derek

Joe Clarke · ‎07-20-2010

It looks like the LMS 3.2 upgrade may have failed. Post the output of the pdshow command.

Systems Integration · ‎07-21-2010

D:\Program Files\CSCOpx\bin>pdshow

ERROR: connect to dmgtd process on "127.0.0.1" on port 42340 failed:

Derek McCormick · ‎07-21-2010

Here you go

D:\Program Files\CSCOpx>pdshow | more
        Process= UPMDbEngine
        State = Program started - No mgt msgs received
        Pid    = 304
        RC     = 0
        Signo = 0
        Start = 7/21/2010 9:38:51 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = Application started by administrator request.

        Process= UPMDbMonitor
        State = Running normally
        Pid    = 6408
        RC     = 0
        Signo = 0
        Start = 7/21/2010 9:38:55 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = DbMonitor Running Normally.

        Process= Tomcat
        State = Program started - No mgt msgs received
        Pid    = 8352
        RC     = 0
        Signo = 0
        Start = 7/21/2010 9:38:59 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = Application started by administrator request.

        Process= TomcatMonitor
        State = Running normally
        Pid    = 12796
        RC     = 0
        Signo = 0
        Start = 7/21/2010 9:51:59 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = Tomcat Server up

        Process= Apache
        State = Program started - No mgt msgs received
        Pid    = 5316
        RC     = 0
        Signo = 0
        Start = 7/21/2010 9:52:32 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = Application started by administrator request.

        Process= RMEDbEngine
        State = Program started - No mgt msgs received
        Pid    = 1012
        RC     = 0
        Signo = 0
        Start = 7/21/2010 9:46:14 AM
        Stop   = Not applicable
    Core   = Not applicable
Info   = Application started by administrator request.

Process= Proxy
State = Program started - No mgt msgs received
Pid    = 5424
RC     = 0
Signo = 0
Start = 7/21/2010 9:46:18 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= ProcSysBus
State = Program started - No mgt msgs received
Pid    = 7504
RC     = 0
Signo = 0
Start = 7/21/2010 9:46:23 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.

Process= OpsxmlDbEngine
State = Program started - No mgt msgs received
Pid    = 10968
RC     = 0
Signo = 0
Start = 7/21/2010 9:46:31 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.

Process= OpsXMLRuntime
State = Program started - No mgt msgs received
Pid    = 11316
RC     = 0
Signo = 0
Start = 7/21/2010 9:46:38 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.

Process= CWAPublisher
State = Program started - No mgt msgs received
Pid    = 7924
RC     = 0
Signo = 0
Start = 7/21/2010 9:46:42 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= NameServer
State = Program started - No mgt msgs received
Pid    = 11972
RC     = 0
Signo = 0
Start = 7/21/2010 9:46:46 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Auto Generated Reply

Process= EDS
State = Running normally
Pid    = 1352
RC     = 0
Signo = 0
Start = 7/21/2010 9:46:50 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Initialization complete

Process= LicenseServer
State = Program started - No mgt msgs received
Pid    = 9324
RC     = 0
Signo = 0
Start = 7/21/2010 9:46:58 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= IpmDbEngine
State = Program started - No mgt msgs received
Pid    = 10712
RC     = 0
Signo = 0
Start = 7/21/2010 9:47:03 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.

Process= INVDbEngine
State = Program started - No mgt msgs received
Pid    = 3972
RC     = 0
Signo = 0
Start = 7/21/2010 9:47:12 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.

Process= FHPurgeTask
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= FHDbEngine
State = Program started - No mgt msgs received
Pid    = 8312
RC     = 0
Signo = 0
Start = 7/21/2010 9:47:18 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.

Process= ESS
State = Program started - No mgt msgs received
Pid    = 9020
RC     = 0
Signo = 0
Start = 7/21/2010 9:47:22 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= EssMonitor
State = Running normally
Pid    = 7176
RC     = 0
Signo = 0
Start = 7/21/2010 9:47:26 AM
Stop   = Not applicable
Core   = Not applicable
Info   = ESS is fully up now !

Process= EventFramework
State = Program started - No mgt msgs received
Pid    = 6612
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:02 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= PMServer
State = Running normally
Pid    = 8384
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:02 AM
Stop   = Not applicable
Core   = Not applicable
Info   = PMServer is up and running

Process= SyslogCollector
State = Program started - No mgt msgs received
Pid    = 1300
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:06 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= EPMDbEngine
State = Program started - No mgt msgs received
Pid    = 9952
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:10 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.

Process= EPMServer
State = Program started - No mgt msgs received
Pid    = 8200
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:15 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= FHServer
State = Running normally
Pid    = 12720
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:19 AM
Stop   = Not applicable
Core   = Not applicable
Info   = FHServer started.

Process= diskWatcher
State = Running normally
Pid    = 12800
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:19 AM
Stop   = Not applicable
Core   = Not applicable
Info   = diskWatcher initialized OK.

Process= DFMMultiProcLogger
State = Program started - No mgt msgs received
Pid    = 8232
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:19 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= DFMLogServer
State = Program started - No mgt msgs received
Pid    = 448
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:19 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= DFMCTMStartup
State = Administrator has shut down this server
Pid    = 0
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:19 AM
Stop   = 7/21/2010 9:59:14 AM
Core   = Not applicable
Info   = Server started by admin request

Process= DfmBroker
State = Program started - No mgt msgs received
Pid    = 4220
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:20 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= DfmServer
State = Running normally
Pid    = 12528
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:24 AM
Stop   = Not applicable
Core   = Not applicable
Info   = DfmServer initialized OK.

Process= DfmServer1
State = Running normally
Pid    = 12816
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:25 AM
Stop   = Not applicable
Core   = Not applicable
Info   = DfmServer1 initialized OK.

Process= DCRDevicePoll
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= CSSCPServer
State = Program started - No mgt msgs received
Pid    = 9656
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:25 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= CSRegistryServer
State = Running normally
Pid    = 11488
RC     = 0
Signo = 0
Start = 7/21/2010 9:48:25 AM
Stop   = Not applicable
Core   = Not applicable
Info   = CSRegistryServer is running in other process

Process= CSDiscovery
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= CmfDbEngine
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= CmfDbMonitor
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= DCRServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= CMFOGSServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= CampusOGSServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= EssentialsDM
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= ConfigMgmtServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= ICServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= RMEOGSServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= PMCOGSServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= TISServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= DFMOGSServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= InventoryCollector
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= Interactor
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= InventoryCollector1
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= Interactor1
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= NOSServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= PTMServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= UPMProcess
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,
Process= EDS-GCF
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= jrm
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= 1301
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= 1303
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= 1304
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= 1306
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= CTMJrmServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= ChangeAudit
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= SyslogAnalyzer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= DataPurge
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= IPMProcess
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= IPMOGSServer
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= TISDiscoveryJobCreate
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= ANIDbEngine
State = Program started - No mgt msgs received
Pid    = 1496
RC     = 0
Signo = 0
Start = 7/21/2010 9:51:51 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.

Process= ANIServer
State = Running with busy flag set
Pid    = 5972
RC     = 0
Signo = 0
Start = 7/21/2010 9:51:55 AM
Stop   = Not applicable
Core   = Not applicable
Info   = ANIServer started.

Process= UTMajorAcquisition
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= MACUHIC
State = Running normally
Pid    = 7632
RC     = 0
Signo = 0
Start = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Started.

Process= UTLITE
State = Running normally
Pid    = 5592
RC     = 0
Signo = 0
Start = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Started.

Process= UTManager
State = Never started
Pid    = 0
RC     = 0
Signo = 0
Start = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,

Process= VNMServer
State = Program started - No mgt msgs received
Pid    = 9312
RC     = 0
Signo = 0
Start = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= WlseUHIC
State = Running normally
Pid    = 14304
RC     = 0
Signo = 0
Start = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Started.

Process= AdapterServer1
State = Program started - No mgt msgs received
Pid    = 5012
RC     = 0
Signo = 0
Start = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

Process= AdapterServer
State = Program started - No mgt msgs received
Pid    = 9580
RC     = 0
Signo = 0
Start = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request

--

--
-- More --

Joe Clarke · ‎07-21-2010

Follow the instructions in the document https://supportforums.cisco.com/docs/DOC-8796 to perform transaction log recovery on the cmf database. Hopefully that is all that's required here. If that does not work, it could be that the cmf database is corrupt. Check the Event Viewer for errors.