that is quite possible. you have communication in both directions after all. in order to have end-to-end guaranteed quality of your voice service you do need end-to-end QoS. Check your QoS config and look for errors on your physical interfaces.
BR,
Stoyan
