Interesting...
The tunnel might go down due to the end of the (isakmp) SA lifetime and a idle traffic condition on this tunnel.
You may also want to configure both peer to mutually sending keep alive just to generate traffic.
When the down time occurs, what bring's the tunnel up again? and what's the frequency of this event?
HTH