Quick question from a networking newbie about best practices - if I have a number of 1U rack mounted servers, say 24 or 48, each with multiple Ethernet ports, e.g 4 - RJ45 ports for each of primary data, redundant data, console / management, KVM in this example, would it be best to cable each same port type of all the servers to a different edge switch or leaf, eg all primary data go to switch 1, all redundant data go to switch 2, etc or is it acceptable to take same port types from the servers and 'spread' them to different switches?
For example servers # 1 through 6 primary data are connected to switch 1, servers # 7 through 12 to switch 2, etc. This would ultimately mean that a particular switch could contain more than one Ethernet cable from a particular server, for example might be cabled up with primary data, redundant data, KVM in different RJ45 ports, of course.
Thinking through this, I guess it makes tracing cables in case of faults developing much more complicated, but there might be advantages in cabling lay-out depending on how switches and servers are laid out in the cabinet. All switch ports are addressable, I guess, so there's no reason from a data flow viewpoint? There might be slightly better failsafe properties - if switch 3 was used for all console / management went down then all console / management would fail?
A colleague of mine said that there might be advantages in balancing and network traffic performance. I have not heard of this aspect, and couldn't find any info so far referring to it.
I'd appreciate any comments, or links to info on this.
Thank you very much, and have a great New Year