Please confirm the status of the CAR essential services. Under Serviceability pages (In the upper right dropdown on the Administration pages):
System> Service Parameters> Cisco CallManager service
CDR Enabled Flag
CDR Log Calls with zero duration flag
Call Diagnostics Enabled
System-->Enterprise Parameters-->CDR Parameters
CDR File Time Interval: 1
Cluster ID: StandAloneCluster
Tools -> Feature Services
Cisco SOAP - CDRonDemand Service (This should be running on the First Node only)
Cisco CAR Web Service (Again, First Node only)
Tools -> Network services
Cisco CDR Repository Manager (this one should be running on the First Node only)
Cisco CDR Agent (these should be running on all the call processing nodes)
Cisco CAR Scheduler (this should be running on the First Node only)
If all the above services are running okay, then, as a first step, can you please try this:-
Disable the "CDR Enabled Flag" parameter in all the servers in your cluster.
Restart the "Cisco CDR Agent" service in all the servers in your cluster.
Restart the "Cisco CDR Repository Manager" service in the publisher server.
Restart the "Cisco Database Layer Monitor" service in all the servers in your cluster.
Enable again the "CDR Enabled Flag" parameter in all the servers in your cluster.
If the above steps don't address the issue, One possibility for this error could be that the loader is failing to load the records into CAR tables. One would need the following information (screenshots, outputs of show commands, output of 'run sql' queries', traces and logs) to figure out what's going on:-
Please enable the following trace levels in the Publisher (Cisco Unified CallManager Serviceability->Trace->Configuration) :
Cisco CAR Scheduler (trace level: Debug)
Cisco CAR Web Service (trace level: Debug)
Cisco CDR Agent (trace level: Debug)
Cisco CDR Repository Manager (trace level: Debug)
/* Set max No. of files to 200. Set Max. file size to 2M. */
Make sure CDR Load is not disabled in CAR and there is a checkmark on "continously load 24/7"; set the "Load CDR & CMR" Time, Loading interval and Duration to be the moment you perform this test:
System->Scheduler->CDR Load(you will need to restart CAR Scheduler service to make the changes effective)
Restart the following services (Cisco Unified CallManager Serviceability->Tools->Control Center - Feature/Network Services:
Cisco CAR Scheduler
Cisco CAR Web Service
Cisco CDR Repository Manager
Cisco CDR Agent
Recreate the issue (i.e. try searching for the records) and note down the exact time you performed the search and what extension you searched for.
Next, after 15 to 30 minutes, use the RTMT tool to collect the following logs files. This will show us all the process of loading the cdr files to the CAR tool (from preserve to processed folder).