Make sure you can access the ntp device on port 123, see if you can telnet to that port on that device. Also, try removing the ntp, set the clock mnaually to the ntp server as close as possible and then re-add the ntp server, wait few hours and see if it synchronizes.
Chris
