The proper way of doing this is through DNS, your clients should be looking for the DNS name of the server not the IP.
Check your DNS server and see what IPs are resolving for the arp madness hosts and then adjust them.
Otherwise, check to see if there are static etc\hosts entries.
c:\WINDOWS\system32\drivers\etc\hosts
CCIE 26175
www.techsnips.com