If you don't have a split mac address model, it will take longer for the phone to authenticate, associate and roam to the second AP.
Perhaps you can try disabling un used channels on the IP phone so it does not need to scan all the channels, only the ones on use. But still will need to go through an entire process of authentication to the new AP and the associace.
