Cisco Support Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Announcements

Welcome to Cisco Support Community. We would love to have your feedback.

For an introduction to the new site, click here. And see here for current known issues.

New Member

MSE stopped responding - Oracle DB doesn't shutdown

I assume we hit bug CSCud77760 on customer's MSE VA.

I tried to shutdown services but Oracle DB hasn't shutdown. I found there are lots of oracle processes running one of them is utilizing one core to 100%. If I try to connect to Oracle DB to shutdown it manually sqlplus / AS SYSDBA hangs connecting to DB (it's probably the step where scripts got frozen). Only sqlplus -prelim AS SYSDBA is possible to perform oradebug commands.

I'm not Oracle expert to find in dump/traces what process to kill to unlock DB and perform gracefull shutdown. Could someone give me advice how to shutdown the DB without breaking it down? I can eventually upload hanganalyze and systemstate dump but it's a big.

6 REPLIES
Hall of Fame Super Silver

Your better off opening a TAC

Your better off opening a TAC case for that, as I would snapshot the VM and restart it, if its locked up.  You have enough resources for the vMSE?

-Scott
*** Please rate helpful posts ***
New Member

No resource issue because

No resource issue because this is not pushed to production yet....out of 1000 AP's only 10 are synced to MSE. TAC case has been sitting for more than a month. Weekly I get an email with some log request.

I went ahead and did a fresh install on another VM machine. Also upgraded code. No issues for last month. BUT I do not have HA enabled so not sure how much is HA is causing Oracle issues.

 

New Member

I have been baby sitting MSE

I have been baby sitting MSE for months. Similar issue.

Every time I open TAC case....depending on the engineer they tend to wander around. Luckily I have all the notes from previous case variations that help them to narrow down the scope.

Yes, open a TAC case and pass your findings and ask them to focus on this bug first.

Initially I thought it was HA pair causing the issue but later realized this got to be a bug.

Upgraded the code to 7.6.x and seems to be stable now. I will update this link if this happens again.

New Member

As there were no useful

As there were no useful answer for 2 days I started to find Oracle DB specialist in sw. devel. division of our company. He advised over the phone try to kill process what utilizes CPU but another process started utilizing CPU. Therefore I shared him connection to the system he looked at some process information. He told that Oracle is probably in state when it's going down but for some reason it cannot there is no other way then kill it and I didn't worry because Oracle is really resilient. He killed process called Oracle "something" manager - all Oracle processes went down immediately. Then he started Oracle it recovered DB from transaction log. We verified DB was absolutely OK. Then I just applied CSCud77760 workaround setting, shutdown DB and started MSE.

It was resolved just in 20 minutes what is unattainable with TAC as probably everybody who is in regular connection with it can confirm ;-)

New Member

Here is my experience..MSE

Here is my experience..MSE issues kept happening after applying workaround.  This was not one time deal.

Sometimes reboot works and sometimes had to call TAC and they always tend to fiddle around Oracle DB aspect.

So keep the note ready before you forget what you did earlier. :-)

*** Please rate the post if you find it useful ***

New Member

Just note you were right it

Just note you were right it happened again. It took about 6 month...

I'm waiting if it happens again soon... ;-)

381
Views
5
Helpful
6
Replies
CreatePlease login to create content