Is it possible your voicemail number associated with the VM button overlaps other extensions/dn's on the CCM? For example, if your VM button dials 5111, but there is a 51112 configured on CCM, this could cause a delay like this because CCM is waiting to see if another digit is coming.