My server team has deployed several servers for VMWare use. There is one NIC dedicated for backup, one for vmotion, one for management, 2 for Prd traffic, 2 for iSCSI (netapps). The 2 for prd and 2 for iSCSI are etherchanneled together to a 3750 switch.
All seems to be working fine except one "glitch."
When I unplug both PRD cables, I can no longer ping the vmotion or iSCSI NICs, which IMO, makes no sense. I can ping them local on the same subnet, but no layer 3. I've went into the VMWare mgmt console and I have reason to believe the default gateway is screwed up, but I'm no VM expert so I'm not sure how complex the config is. Has anyone seen this? There are default gateways for svc console...vmkernel, etc.
I'm assuming that each Ethernet connection to your VMware servers belongs to a different subnet here (which is the scenario I've come across when working on a large bank's network).
You need routing tables on your VMware servers. You see, since your servers have multiple network connections. Assuming that your servers' default gateway point to the PRD connections, when you ping your server's vmotion connection, the server will try to respond to the ICMP packet by sending the echo-reply to its default gateway through its PRD connection, which is down, so it'll discard the packet.
What you need to do is create either multiple default gateways (one for each VMware connection/subnet). If you have a specific out-of-band management subnet where your vmotion connection will originate from, you can simply create specific static routes for that subnet on the VMware server pointing to the VMotion connection.
It sounds to me like you have the vmotion nic associated with the wrong virtual switch maybe. You have 7 nics total plugged into the host right? Are the two for prod traffic in an etherchannel are trunk ports to the server?
Make sure the vmotion nic is bound to a virtual switch that's not part of that prod switch, same witht he iscsi, make sure those nics have a separate virtual switch.
Also on those etherchannel ports, make sure you use the same load balancing on the vmware server as you are on the switch.
Thanks. Right now the etherchannel works fine in terms of failover between links. The problem is with both links in one EC are unplugged all other links go down (layer 3). The problem is definitely the default gateways. I'm not too familiar with VMWare so I can't comment much on the vmkernel default gateway, NIC gateways, etc. The server guys are saying it's not designed that way b/c there are 4 virtual switches being used. From a networking 101 standpoint, I'd really be surprised that a NIC on one subnet can bring down another when unplugged.
Can anyone help? Maybe even offline to walk me through the VI Client?
Hi everyone, I would like to thank you in advance for any help you can provide a newcomer like myself!
Im studying the 100-105 book by Odom and am currently on the topic of Port security. I purchased a used 2960 and I'm trying to follow a...
While deploying a number of 18xx/2802/3802 model access points (APs), which run AP-COS as their operating platform. It can be observed on some occasions that while many of their access points were able to join the fabric WLC withou...
I am going to design and build an LAN network under a tunnel underground with long distance between the switches.
I will have 2 Catalyst switches and 8 Industrial IE3000, and they will be connected with fiber.
For now I am planning on use Layer-2 s...