You may want to google G.114
This outlines the basic IP layer connectivity for VoIP.
Generally - less than 20-30ms of jitter and < 100 ms of delay will be optimal. You may not have problem above this, but it's going towards the areas that cause bad quality.
'show call active voice brief' and hitting the little green ? twice quickly are good indicators of these things.