Upgrading from Ciscoworks 2.6 to 3.2 Database error

Unanswered Question
Jul 16th, 2010
User Badges:

Hi,


I am upgrading from Ciscoworks 2.6 to 3.2. When i run the eval.exe file, it runs to a point where it attempts to backup the current version. After about 10GB, it gets a cfm fail and tells me to look in the backup log. .In the log, there is a fatal error message saying


ERROR(1055): Fatal error: Database engine 'dfmFhEng' could not be started on database 'dfmFhDb' in Bulk mode


Has anyone seen this before?


Attached are the install log and the backup log


Thanks,
Derek

  • 1
  • 2
  • 3
  • 4
  • 5
Overall Rating: 0 (0 ratings)
Loading.
Joe Clarke Fri, 07/16/2010 - 08:41
User Badges:
  • Cisco Employee,
  • Hall of Fame,

    Founding Member

It could be that the DFM Fault History database ic corrupt.  Check this document on database troubleshooting for more details:


https://supportforums.cisco.com/docs/DOC-8796


You may either need to reinitialize the database transaction log, or the database itself.  Then you can try the upgrade again.

Derek McCormick Tue, 07/20/2010 - 01:48
User Badges:


v\:* {behavior:url(#default#VML);} o\:* {behavior:url(#default#VML);} w\:* {behavior:url(#default#VML);} .shape {behavior:url(#default#VML);} /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:""; mso-padding-alt:0cm 5.4pt 0cm 5.4pt; mso-para-margin:0cm; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:11.0pt; font-family:"Calibri","sans-serif"; mso-ascii-font-family:Calibri; mso-ascii-theme-font:minor-latin; mso-fareast-font-family:"Times New Roman"; mso-fareast-theme-font:minor-fareast; mso-hansi-font-family:Calibri; mso-hansi-theme-font:minor-latin; mso-bidi-font-family:"Times New Roman"; mso-bidi-theme-font:minor-bidi;}

/* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:""; mso-padding-alt:0cm 5.4pt 0cm 5.4pt; mso-para-margin:0cm; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:11.0pt; font-family:"Calibri","sans-serif"; mso-ascii-font-family:Calibri; mso-ascii-theme-font:minor-latin; mso-fareast-font-family:"Times New Roman"; mso-fareast-theme-font:minor-fareast; mso-hansi-font-family:Calibri; mso-hansi-theme-font:minor-latin; mso-bidi-font-family:"Times New Roman"; mso-bidi-theme-font:minor-bidi;}

The info you provided was very helpful. I had to reinitialize the dfmEPM, dfmINV and the dfmFh databases.

I am still not out of the woods however, when I run a self test I get the following:


Server Info

generated Mon Jul 19 18:40:18 2010

Table of Contents

PASS

backup.pl

FAIL

database.pl

PASS

mem.exe

PASS

network.pl

PASS

odbc.pl

PASS

platform.pl

PASS

snmp.pl


backup.pl

PASS    the backup script is installed

go to top


database.pl

FAIL    Self Test Fail to query cmf.DbVersion, Error: Database server not found (DBD: login failed)

        Self Test Fail to query cmf.SYSTABLE, Error: Database server not found (DBD: login failed)

go to top


mem.exe

PASS    2146902016 bytes of physical ram and 3600957440 bytes total page file size

go to top


network.pl

PASS    lookup of loopback address succeeded

go to top


odbc.pl

PASS    Recommended DLL versions found.

go to top


platform.pl

PASS    supported platform : 'ServerNT'

go to top


snmp.pl

PASS    CWSNMP.DLL and cwwsnmp32.dll found in correct place

go to top

When I attempt to go into the device manager I get, if I try and do a device discovery I also get the same message. I have checked the processes. I originally tried to start the DCR server manually, but now it reports as being up since today.  Are there any log files I should look at? I attempted to run a system report  and it reports – no records. I get the following error:


{CmfDbMonitor}: Cannot connect to cmf database, please contact your systems administrator

Any help appreciated.


Cheers,

Derek


Joe Clarke Tue, 07/20/2010 - 11:26
User Badges:
  • Cisco Employee,
  • Hall of Fame,

    Founding Member

It looks like the LMS 3.2 upgrade may have failed.  Post the output of the pdshow command.

Systems Integration Wed, 07/21/2010 - 01:40
User Badges:

/* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:""; mso-padding-alt:0cm 5.4pt 0cm 5.4pt; mso-para-margin:0cm; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:11.0pt; font-family:"Calibri","sans-serif"; mso-ascii-font-family:Calibri; mso-ascii-theme-font:minor-latin; mso-fareast-font-family:"Times New Roman"; mso-fareast-theme-font:minor-fareast; mso-hansi-font-family:Calibri; mso-hansi-theme-font:minor-latin; mso-bidi-font-family:"Times New Roman"; mso-bidi-theme-font:minor-bidi;}

D:\Program Files\CSCOpx\bin>pdshow

ERROR: connect to dmgtd process on "127.0.0.1" on port 42340 failed:

Derek McCormick Wed, 07/21/2010 - 03:00
User Badges:

Here you go


D:\Program Files\CSCOpx>pdshow | more
        Process= UPMDbEngine
        State  = Program started - No mgt msgs received
        Pid    = 304
        RC     = 0
        Signo  = 0
        Start  = 7/21/2010 9:38:51 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = Application started by administrator request.


        Process= UPMDbMonitor
        State  = Running normally
        Pid    = 6408
        RC     = 0
        Signo  = 0
        Start  = 7/21/2010 9:38:55 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = DbMonitor Running Normally.


        Process= Tomcat
        State  = Program started - No mgt msgs received
        Pid    = 8352
        RC     = 0
        Signo  = 0
        Start  = 7/21/2010 9:38:59 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = Application started by administrator request.


        Process= TomcatMonitor
        State  = Running normally
        Pid    = 12796
        RC     = 0
        Signo  = 0
        Start  = 7/21/2010 9:51:59 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = Tomcat Server up


        Process= Apache
        State  = Program started - No mgt msgs received
        Pid    = 5316
        RC     = 0
        Signo  = 0
        Start  = 7/21/2010 9:52:32 AM
        Stop   = Not applicable
        Core   = Not applicable
        Info   = Application started by administrator request.


        Process= RMEDbEngine
        State  = Program started - No mgt msgs received
        Pid    = 1012
        RC     = 0
        Signo  = 0
        Start  = 7/21/2010 9:46:14 AM
        Stop   = Not applicable
    Core   = Not applicable
Info   = Application started by administrator request.


Process= Proxy
State  = Program started - No mgt msgs received
Pid    = 5424
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:46:18 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= ProcSysBus
State  = Program started - No mgt msgs received
Pid    = 7504
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:46:23 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.


Process= OpsxmlDbEngine
State  = Program started - No mgt msgs received
Pid    = 10968
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:46:31 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.


Process= OpsXMLRuntime
State  = Program started - No mgt msgs received
Pid    = 11316
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:46:38 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.


Process= CWAPublisher
State  = Program started - No mgt msgs received
Pid    = 7924
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:46:42 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= NameServer
State  = Program started - No mgt msgs received
Pid    = 11972
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:46:46 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Auto Generated Reply


Process= EDS
State  = Running normally
Pid    = 1352
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:46:50 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Initialization complete


Process= LicenseServer
State  = Program started - No mgt msgs received
Pid    = 9324
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:46:58 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= IpmDbEngine
State  = Program started - No mgt msgs received
Pid    = 10712
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:47:03 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.


Process= INVDbEngine
State  = Program started - No mgt msgs received
Pid    = 3972
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:47:12 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.


Process= FHPurgeTask
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= FHDbEngine
State  = Program started - No mgt msgs received
Pid    = 8312
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:47:18 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.


Process= ESS
State  = Program started - No mgt msgs received
Pid    = 9020
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:47:22 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= EssMonitor
State  = Running normally
Pid    = 7176
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:47:26 AM
Stop   = Not applicable
Core   = Not applicable
Info   = ESS is fully up now !


Process= EventFramework
State  = Program started - No mgt msgs received
Pid    = 6612
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:02 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= PMServer
State  = Running normally
Pid    = 8384
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:02 AM
Stop   = Not applicable
Core   = Not applicable
Info   = PMServer is up and running


Process= SyslogCollector
State  = Program started - No mgt msgs received
Pid    = 1300
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:06 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= EPMDbEngine
State  = Program started - No mgt msgs received
Pid    = 9952
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:10 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.


Process= EPMServer
State  = Program started - No mgt msgs received
Pid    = 8200
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:15 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= FHServer
State  = Running normally
Pid    = 12720
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:19 AM
Stop   = Not applicable
Core   = Not applicable
Info   = FHServer started.


Process= diskWatcher
State  = Running normally
Pid    = 12800
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:19 AM
Stop   = Not applicable
Core   = Not applicable
Info   = diskWatcher initialized OK.


Process= DFMMultiProcLogger
State  = Program started - No mgt msgs received
Pid    = 8232
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:19 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= DFMLogServer
State  = Program started - No mgt msgs received
Pid    = 448
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:19 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= DFMCTMStartup
State  = Administrator has shut down this server
Pid    = 0
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:19 AM
Stop   = 7/21/2010 9:59:14 AM
Core   = Not applicable
Info   = Server started by admin request


Process= DfmBroker
State  = Program started - No mgt msgs received
Pid    = 4220
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:20 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= DfmServer
State  = Running normally
Pid    = 12528
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:24 AM
Stop   = Not applicable
Core   = Not applicable
Info   = DfmServer initialized OK.


Process= DfmServer1
State  = Running normally
Pid    = 12816
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:25 AM
Stop   = Not applicable
Core   = Not applicable
Info   = DfmServer1 initialized OK.


Process= DCRDevicePoll
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= CSSCPServer
State  = Program started - No mgt msgs received
Pid    = 9656
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:25 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= CSRegistryServer
State  = Running normally
Pid    = 11488
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:48:25 AM
Stop   = Not applicable
Core   = Not applicable
Info   = CSRegistryServer is running in other process


Process= CSDiscovery
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= CmfDbEngine
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= CmfDbMonitor
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= DCRServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= CMFOGSServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= CampusOGSServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= EssentialsDM
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= ConfigMgmtServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= ICServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= RMEOGSServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= PMCOGSServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= TISServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= DFMOGSServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= InventoryCollector
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= Interactor
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= InventoryCollector1
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= Interactor1
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= NOSServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= PTMServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= UPMProcess
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,
Process= EDS-GCF
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= jrm
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= 1301
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= 1303
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= 1304
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= 1306
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= CTMJrmServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= ChangeAudit
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= SyslogAnalyzer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= DataPurge
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= IPMProcess
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= IPMOGSServer
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= TISDiscoveryJobCreate
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= ANIDbEngine
State  = Program started - No mgt msgs received
Pid    = 1496
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:51:51 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Application started by administrator request.


Process= ANIServer
State  = Running with busy flag set
Pid    = 5972
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:51:55 AM
Stop   = Not applicable
Core   = Not applicable
Info   = ANIServer started.


Process= UTMajorAcquisition
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= MACUHIC
State  = Running normally
Pid    = 7632
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Started.


Process= UTLITE
State  = Running normally
Pid    = 5592
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Started.


Process= UTManager
State  = Never started
Pid    = 0
RC     = 0
Signo  = 0
Start  = N/A
Stop   = Not applicable
Core   = Not applicable
Info   = Not applicable,


Process= VNMServer
State  = Program started - No mgt msgs received
Pid    = 9312
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= WlseUHIC
State  = Running normally
Pid    = 14304
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Started.


Process= AdapterServer1
State  = Program started - No mgt msgs received
Pid    = 5012
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request


Process= AdapterServer
State  = Program started - No mgt msgs received
Pid    = 9580
RC     = 0
Signo  = 0
Start  = 7/21/2010 9:51:59 AM
Stop   = Not applicable
Core   = Not applicable
Info   = Server started by admin request




--




  --
-- More  --

Joe Clarke Wed, 07/21/2010 - 20:57
User Badges:
  • Cisco Employee,
  • Hall of Fame,

    Founding Member

Follow the instructions in the document https://supportforums.cisco.com/docs/DOC-8796 to perform transaction log recovery on the cmf database.  Hopefully that is all that's required here.  If that does not work, it could be that the cmf database is corrupt.  Check the Event Viewer for errors.

Actions

This Discussion