cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
707
Views
0
Helpful
1
Replies

UCS c240-m4 direct attached to storage with VIC1227/1225

azfar_raza
Level 1
Level 1

Hi All,

Before I put down my weird problem, I would like to ask if direct attaching storage using twinax cables with VIC1227 or 1225 (10GbE) is supported or not?
                              
We are trying to "Direct Attach" NetApp FAS3240 (cdot 8.3.1) with cisco UCS c240-m4 VIC1227 (mlom, slot 7) and 1225 (slot 4) using twinax SFP-H10GB-CU3M. We have installed xenserver 6.5 on the server and given ip addresses to one port on xenserver (xenbr3) and one port on FAS3240 (node 1 port e1b)           
                              
Even though the links are up we cannot reach either side. Pinging from NetApp shows network unreachable and looking at packet traces from Xen side we do see communications of this sort:
                              
19:56:21.618481 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:21.618505 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
19:56:22.619069 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:22.619090 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
19:56:23.620037 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:23.620048 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
19:56:24.621109 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:24.621136 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
019:56:25.621729 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 192.168.25.140 tell 192.168.25.130, length 46
19:56:25.621749 ARP, Ethernet (len 6), IPv4 (len 4), Reply 192.168.25.140 is-at e8:65:49:73:93:b9 (oui Unknown), length 28
                              
                              
192.168.25.130 is NetApp      
192.168.25.140 is cisco ucs

ifconfig on ucs:              
xenbr0    Link encap:Ethernet  HWaddr 78:BA:F9:CB:4E:B9
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:711 errors:0 dropped:566 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:39816 (38.8 KiB)  TX bytes:0 (0.0 

xenbr1    Link encap:Ethernet  HWaddr 78:BA:F9:CB:4E:BA
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0   TX bytes:0 (0.0 

xenbr3    Link encap:Ethernet  HWaddr E8:65:49:73:93:B9
          inet addr:192.168.25.140  Bcast:192.168.25.255  Mask:255.255.255.0
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:774 errors:0 dropped:396 overruns:0 frame:0
          TX packets:1654 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:43600 (42.5 KiB)  TX bytes:73276 (71.5 KiB)
 

On Storage:

node1> ifconfig e1b
e1b: flags=0x1f0c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
        inet 192.168.25.130 netmask 0xffffff00 broadcast 192.168.25.255 noddns DATA
        ether 90:e2:ba:2f:9e:21 (auto-10g_twinax-fd-up) flowcontrol full
node1> ifstat e1b

-- interface  e1b  (1 hour, 47 minutes, 39 seconds) --

RECEIVE
 Frames/second:       0  | Bytes/second:        0  | Errors/minute:       0
 Discards/minute:     0  | Total frames:     1997  | Total bytes:       963k
 Total errors:        0  | Total discards:      0  | Multi/broadcast:  1232
 No buffers:          0  | Non-primary u/c:     0  | L2 terminate:        0
 Tag drop:         1997  | Vlan tag drop:       0  | Vlan untag drop:     0
 Vlan forwards:       0  | CRC errors:          0  | Runt frames:         0
 Fragment:            0  | Long frames:         0  | Jabber:              0
 Error symbol:        0  | Illegal symbol:      0  | Bus overruns:        0
 Queue drop:          0  | Xon:                 0  | Xoff:                0
 Jumbo:               0  | JMBuf RxFrames:      0  | JMBuf DrvCopy:       0
TRANSMIT
 Frames/second:       0  | Bytes/second:        0  | Errors/minute:       0
 Discards/minute:     0  | Total frames:      136  | Total bytes:      5712
 Total errors:        0  | Total discards:      0  | Multi/broadcast:   136
 Queue overflows:     0  | No buffers:          0  | Xon:                 0
 Xoff:                0  | Jumbo:               0  | TSO non-TCP drop:    0
 Split hdr drop:      0  | Pktlen:              0  | Timeout:             0
 Timeout1:            0  | Stray Cluster Pk:    0
DEVICE
 Rx MBuf Sz:  Large (3k)
LINK_INFO
 Current state:       up | Up to downs:         2  | Speed:           10000m
 Duplex:            full | Flowcontrol:       full

 

Looks like the server and the filer initiate the communication and exchange the MAC addresses but then stop, ICMP is not blocked and we have also tried to access the ip addresses through other protocols. We can see from interface statistics on both sides that the bytes (probably broadcast arp requests only) are flowing in.

 

Any help would be appreciated.

 

Regards,

Azfar

1 Reply 1

jmperez01
Level 1
Level 1

You could configure or solve this problem ?, I have the same problem, help me please

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: