From ISP2 if you could acess 99 websites with less than 3 seconds, that indicates there is no issues with the network traffic between ISP2 and your site. And thus rest of the wesbite should also have to work properly...
So for the 1 website, please check the application/ website if its configured or installed properly or not.