DO you have port fast enabled on the switch ports that are connected to the clients off the server ?
By enabling this the ports directly connected will not perform spanning tree calculation , the takes approx 40 seconds , You only want to configure this on ports attached to PC's or server , never ports attached to other switches or routers.