02-13-2014 05:00 AM - edited 03-04-2019 02:25 AM
Hello,
Just came accross with strange problem
In above scenairo I am not able see my blades on WWN on MDS 9148 switch where I can see WWN on Nexus 5548
Please help me to troubleshoot this issue
Regards,
Amit Vyas
Solved! Go to Solution.
02-13-2014 12:15 PM
Hi Amit
What are the flogi showing up going over fc 1/29 and 1/30 ?
Your problem is clear: it's a routing issue ? how can a initiator pwwn eg. in VSAN 100 decide, on which port he should go Northbound ?
The solution:
Create 2 additional VSAN's, e.g. 102 and 103; 100/101 will be used to reach N5k, 102/103 to reach MDS; you of course need 2 additional vhba's, one in 102, resp 103.
Hopefully you have done your zoning with device-alias (enhanced); then this change will be easy.
Another ugly solution would be to use static ping groups, which is hardly used, a management and scalabilty nightmare, and therefore not recommended.
Good luck
Walter.
02-13-2014 05:55 AM
I assume UCS is in FC NPV mode ?
Did you configure the MDS in NPIV mode ?
are FC ports on the UCS in the proper VSAN ? eg. are the FC links from UCS to MDS up ?
Give us from each fabric interconnects the output of the following NX-OS commands: "show npv status"
And on the N5k, and MDS "show flogi database"
02-13-2014 11:10 AM
Hi,
Please find my response below for the questions you have asked
I assume UCS is in FC NPV mode ? - Yes
Did you configure the MDS in NPIV mode ? - Yes
are FC ports on the UCS in the proper VSAN ? eg. are the FC links from UCS to MDS up ? - Yes, Links are UP on UCSM
Give us from each fabric interconnects the output of the following NX-OS commands: "show npv status" - Result below
Switch-A(nxos)# show npv status
npiv is enabled
disruptive load balancing is disabled
External Interfaces:
====================
Interface: fc1/31, VSAN: 100, FCID: 0xa40020, State: Up
Interface: fc1/32, VSAN: 100, FCID: 0xa40000, State: Up
Interface: fc2/15, VSAN: 100, FCID: 0x180100, State: Up
Interface: fc2/16, VSAN: 100, FCID: 0x180300, State: Up
Number of External Interfaces: 4
Server Interfaces:
==================
Interface: vfc2995, VSAN: 100, State: Up
Interface: vfc3001, VSAN: 100, State: Up
Interface: vfc3003, VSAN: 100, State: Up
Interface: vfc3005, VSAN: 100, State: Up
Interface: vfc3007, VSAN: 100, State: Up
Interface: vfc3009, VSAN: 100, State: Up
Interface: vfc3011, VSAN: 100, State: Up
Interface: vfc3013, VSAN: 100, State: Up
Interface: vfc3015, VSAN: 100, State: Up
Interface: vfc3017, VSAN: 100, State: Up
Interface: vfc3167, VSAN: 100, State: Up
Interface: vfc3191, VSAN: 100, State: Up
Interface: vfc3213, VSAN: 100, State: Up
Interface: vfc3237, VSAN: 100, State: Up
Interface: vfc3283, VSAN: 100, State: Up
Interface: vfc3307, VSAN: 100, State: Up
Interface: vfc3331, VSAN: 100, State: Up
Interface: vfc3353, VSAN: 100, State: Up
Interface: vfc3375, VSAN: 100, State: Up
Interface: vfc3397, VSAN: 100, State: Up
Interface: vfc3441, VSAN: 100, State: Up
Interface: vfc3463, VSAN: 100, State: Up
Interface: vfc3485, VSAN: 100, State: Up
Interface: vfc3507, VSAN: 100, State: Up
Interface: vfc3529, VSAN: 100, State: Up
Interface: vfc3551, VSAN: 100, State: Up
Interface: vfc3573, VSAN: 100, State: Up
Interface: vfc3595, VSAN: 100, State: Up
Interface: vfc3617, VSAN: 100, State: Up
Interface: vfc3639, VSAN: 100, State: Up
Interface: vfc3661, VSAN: 100, State: Up
Interface: vfc3683, VSAN: 100, State: Up
Interface: vfc3705, VSAN: 100, State: Up
Interface: vfc3727, VSAN: 100, State: Up
Interface: vfc3749, VSAN: 100, State: Up
Interface: vfc3771, VSAN: 100, State: Up
Interface: vfc3793, VSAN: 100, State: Up
Interface: vfc3841, VSAN: 100, State: Up
Number of Server Interfaces: 38
Switch-A(nxos)#
-----------------------------------------------------------------------------
Switch-B(nxos)# show npv status
npiv is enabled
disruptive load balancing is disabled
External Interfaces:
====================
Interface: fc1/31, VSAN: 101, FCID: 0x3c0000, State: Up
Interface: fc1/32, VSAN: 101, FCID: 0x3c0020, State: Up
Interface: fc2/15, VSAN: 101, FCID: 0x0c0200, State: Up
Interface: fc2/16, VSAN: 101, FCID: 0x0c0300, State: Up
Number of External Interfaces: 4
Server Interfaces:
==================
Interface: vfc2996, VSAN: 101, State: Up
Interface: vfc3002, VSAN: 101, State: Up
Interface: vfc3004, VSAN: 101, State: Up
Interface: vfc3006, VSAN: 101, State: Up
Interface: vfc3008, VSAN: 101, State: Up
Interface: vfc3010, VSAN: 101, State: Up
Interface: vfc3012, VSAN: 101, State: Up
Interface: vfc3014, VSAN: 101, State: Up
Interface: vfc3016, VSAN: 101, State: Up
Interface: vfc3018, VSAN: 101, State: Up
Interface: vfc3168, VSAN: 101, State: Up
Interface: vfc3192, VSAN: 101, State: Up
Interface: vfc3214, VSAN: 101, State: Up
Interface: vfc3238, VSAN: 101, State: Up
Interface: vfc3284, VSAN: 101, State: Up
Interface: vfc3308, VSAN: 101, State: Up
Interface: vfc3332, VSAN: 101, State: Up
Interface: vfc3354, VSAN: 101, State: Up
Interface: vfc3376, VSAN: 101, State: Up
Interface: vfc3398, VSAN: 101, State: Up
Interface: vfc3442, VSAN: 101, State: Up
Interface: vfc3464, VSAN: 101, State: Up
Interface: vfc3486, VSAN: 101, State: Up
Interface: vfc3508, VSAN: 101, State: Up
Interface: vfc3530, VSAN: 101, State: Up
Interface: vfc3552, VSAN: 101, State: Up
Interface: vfc3574, VSAN: 101, State: Up
Interface: vfc3596, VSAN: 101, State: Up
Interface: vfc3618, VSAN: 101, State: Up
Interface: vfc3640, VSAN: 101, State: Up
Interface: vfc3662, VSAN: 101, State: Up
Interface: vfc3684, VSAN: 101, State: Up
Interface: vfc3706, VSAN: 101, State: Up
Interface: vfc3728, VSAN: 101, State: Up
Interface: vfc3750, VSAN: 101, State: Up
Interface: vfc3772, VSAN: 101, State: Up
Interface: vfc3794, VSAN: 101, State: Up
Interface: vfc3842, VSAN: 101, State: Up
Number of Server Interfaces: 38
Switch-B(nxos)#
And on the N5k, and MDS "show flogi database" - Result Below
MDS-9148-SW1# show flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
fc1/1 100 0x180000 50:06:01:60:3e:e0:5a:27 50:06:01:60:be:e0:5a:27
fc1/2 100 0x180200 50:06:01:69:3e:e0:5a:27 50:06:01:60:be:e0:5a:27
fc1/3 100 0x180100 20:4f:54:7f:ee:a0:97:c0 20:c8:54:7f:ee:a0:97:c1
fc1/4 100 0x180300 20:50:54:7f:ee:a0:97:c0 20:c8:54:7f:ee:a0:97:c1
Total number of flogi = 4.
-------------------------------------------------------------------------------------------------------------------------------------------------------------
MDS-9148-SW2# show flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
fc1/1 101 0x0c0000 50:06:01:68:3e:e0:5a:27 50:06:01:60:be:e0:5a:27
fc1/2 101 0x0c0100 50:06:01:61:3e:e0:5a:27 50:06:01:60:be:e0:5a:27
fc1/3 101 0x0c0200 20:4f:54:7f:ee:a0:9a:80 20:c9:54:7f:ee:a0:9a:81
fc1/4 101 0x0c0300 20:50:54:7f:ee:a0:9a:80 20:c9:54:7f:ee:a0:9a:81
Total number of flogi = 4.
-------------------------------------------------------------------------------------------------------------------------------------------------------------
N5K-Primary_SW# show flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
fc1/29 100 0xa40001 20:00:00:25:b5:00:00:1f 20:00:00:25:b5:00:00:7e
fc1/29 100 0xa40004 20:00:00:25:b5:00:00:7c 20:00:00:25:b5:00:00:5c
fc1/29 100 0xa40006 20:00:00:25:b5:00:00:7a 20:00:00:25:b5:00:00:4a
fc1/29 100 0xa40009 20:00:00:25:b5:00:00:48 20:00:00:25:b5:00:00:38
fc1/29 100 0xa4000a 20:00:00:25:b5:00:00:67 20:00:00:25:b5:00:00:57
fc1/29 100 0xa4000c 20:00:00:25:b5:00:00:26 20:00:00:25:b5:00:00:16
fc1/29 100 0xa40012 20:00:00:25:b5:00:00:02 20:00:00:25:b5:00:00:6b
fc1/29 100 0xa40013 20:00:00:25:b5:00:00:41 20:00:00:25:b5:00:00:2f
fc1/29 100 0xa40020 20:1f:54:7f:ee:a0:97:c0 20:64:54:7f:ee:a0:97:c1
fc1/29 100 0xa40021 20:00:00:25:b5:00:00:7f 20:00:00:25:b5:00:00:5e
fc1/29 100 0xa40023 20:00:00:25:b5:00:00:5d 20:00:00:25:b5:00:00:0e
fc1/29 100 0xa40024 20:00:00:25:b5:00:00:1d 20:00:00:25:b5:00:00:5f
fc1/29 100 0xa40026 20:00:00:25:b5:00:00:0b 20:00:00:25:b5:00:00:1b
fc1/29 100 0xa40028 20:00:00:25:b5:00:00:59 20:00:00:25:b5:00:00:49
fc1/29 100 0xa4002a 20:00:00:25:b5:00:00:18 20:00:00:25:b5:00:00:08
fc1/29 100 0xa4002b 20:00:00:25:b5:00:00:37 20:00:00:25:b5:00:00:27
fc1/29 100 0xa4002e 20:00:00:25:b5:00:00:15 20:00:00:25:b5:00:00:05
fc1/29 100 0xa4002f 20:00:00:25:b5:00:00:34 20:00:00:25:b5:00:00:24
fc1/29 100 0xa40031 20:00:00:25:b5:00:00:72 20:00:00:25:b5:00:00:4c
fc1/29 100 0xa40032 20:00:00:25:b5:00:00:32 20:00:00:25:b5:00:00:22
fc1/30 100 0xa40000 20:20:54:7f:ee:a0:97:c0 20:64:54:7f:ee:a0:97:c1
fc1/30 100 0xa40002 20:00:00:25:b5:00:00:1e 20:00:00:25:b5:00:00:6d
fc1/30 100 0xa40003 20:00:00:25:b5:00:00:3d 20:00:00:25:b5:00:00:6e
fc1/30 100 0xa40005 20:00:00:25:b5:00:00:4b 20:00:00:25:b5:00:00:2b
fc1/30 100 0xa40007 20:00:00:25:b5:00:00:1a 20:00:00:25:b5:00:00:79
fc1/30 100 0xa40008 20:00:00:25:b5:00:00:29 20:00:00:25:b5:00:00:19
fc1/30 100 0xa4000b 20:00:00:25:b5:00:00:07 20:00:00:25:b5:00:00:76
fc1/30 100 0xa4000d 20:00:00:25:b5:00:00:45 20:00:00:25:b5:00:00:35
fc1/30 100 0xa4000e 20:00:00:25:b5:00:00:64 20:00:00:25:b5:00:00:54
fc1/30 100 0xa4000f 20:00:00:25:b5:00:00:04 20:00:00:25:b5:00:00:73
fc1/30 100 0xa40011 20:00:00:25:b5:00:00:52 20:00:00:25:b5:00:00:3c
fc1/30 100 0xa40022 20:00:00:25:b5:00:00:2e 20:00:00:25:b5:00:00:7d
fc1/30 100 0xa40025 20:00:00:25:b5:00:00:0c 20:00:00:25:b5:00:00:1c
fc1/30 100 0xa40027 20:00:00:25:b5:00:00:2a 20:00:00:25:b5:00:00:3a
fc1/30 100 0xa40029 20:00:00:25:b5:00:00:78 20:00:00:25:b5:00:00:68
fc1/30 100 0xa4002c 20:00:00:25:b5:00:00:56 20:00:00:25:b5:00:00:46
fc1/30 100 0xa4002d 20:00:00:25:b5:00:00:75 20:00:00:25:b5:00:00:65
fc1/30 100 0xa40030 20:00:00:25:b5:00:00:53 20:00:00:25:b5:00:00:43
fc1/30 100 0xa40033 20:00:00:25:b5:00:00:61 20:00:00:25:b5:00:00:5b
fc1/31 100 0xa400ef 50:06:01:60:3e:a0:13:d5 50:06:01:60:be:a0:13:d5
fc1/32 100 0xa401ef 50:06:01:68:3e:a0:13:d5 50:06:01:60:be:a0:13:d5
Total number of flogi = 41.
N5K-Primary_SW#
-------------------------------------------------------------------------------------------------------------------------------------------------------------
N5K-Secondary_SW# show flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
fc1/29 101 0x3c0000 20:1f:54:7f:ee:a0:9a:80 20:65:54:7f:ee:a0:9a:81
fc1/29 101 0x3c0002 20:00:00:25:b5:00:00:4e 20:00:00:25:b5:00:00:7d
fc1/29 101 0x3c0003 20:00:00:25:b5:00:00:4d 20:00:00:25:b5:00:00:0e
fc1/29 101 0x3c0005 20:00:00:25:b5:00:00:2c 20:00:00:25:b5:00:00:1c
fc1/29 101 0x3c0008 20:00:00:25:b5:00:00:69 20:00:00:25:b5:00:00:49
fc1/29 101 0x3c000a 20:00:00:25:b5:00:00:28 20:00:00:25:b5:00:00:08
fc1/29 101 0x3c000b 20:00:00:25:b5:00:00:47 20:00:00:25:b5:00:00:27
fc1/29 101 0x3c000e 20:00:00:25:b5:00:00:25 20:00:00:25:b5:00:00:05
fc1/29 101 0x3c000f 20:00:00:25:b5:00:00:44 20:00:00:25:b5:00:00:24
fc1/29 101 0x3c0010 20:00:00:25:b5:00:00:63 20:00:00:25:b5:00:00:43
fc1/29 101 0x3c0012 20:00:00:25:b5:00:00:42 20:00:00:25:b5:00:00:22
fc1/29 101 0x3c0021 20:00:00:25:b5:00:00:0f 20:00:00:25:b5:00:00:7e
fc1/29 101 0x3c0022 20:00:00:25:b5:00:00:3e 20:00:00:25:b5:00:00:6d
fc1/29 101 0x3c0024 20:00:00:25:b5:00:00:6c 20:00:00:25:b5:00:00:5c
fc1/29 101 0x3c0026 20:00:00:25:b5:00:00:6a 20:00:00:25:b5:00:00:4a
fc1/29 101 0x3c0027 20:00:00:25:b5:00:00:0a 20:00:00:25:b5:00:00:79
fc1/29 101 0x3c0029 20:00:00:25:b5:00:00:58 20:00:00:25:b5:00:00:38
fc1/29 101 0x3c002c 20:00:00:25:b5:00:00:36 20:00:00:25:b5:00:00:16
fc1/29 101 0x3c002e 20:00:00:25:b5:00:00:74 20:00:00:25:b5:00:00:54
fc1/29 101 0x3c0033 20:00:00:25:b5:00:00:51 20:00:00:25:b5:00:00:2f
fc1/30 101 0x3c0001 20:00:00:25:b5:00:00:6f 20:00:00:25:b5:00:00:5e
fc1/30 101 0x3c0004 20:00:00:25:b5:00:00:0d 20:00:00:25:b5:00:00:5f
fc1/30 101 0x3c0006 20:00:00:25:b5:00:00:3b 20:00:00:25:b5:00:00:1b
fc1/30 101 0x3c0007 20:00:00:25:b5:00:00:5a 20:00:00:25:b5:00:00:3a
fc1/30 101 0x3c0009 20:00:00:25:b5:00:00:09 20:00:00:25:b5:00:00:68
fc1/30 101 0x3c000c 20:00:00:25:b5:00:00:66 20:00:00:25:b5:00:00:46
fc1/30 101 0x3c000d 20:00:00:25:b5:00:00:06 20:00:00:25:b5:00:00:65
fc1/30 101 0x3c0011 20:00:00:25:b5:00:00:03 20:00:00:25:b5:00:00:4c
fc1/30 101 0x3c0013 20:00:00:25:b5:00:00:71 20:00:00:25:b5:00:00:5b
fc1/30 101 0x3c0020 20:20:54:7f:ee:a0:9a:80 20:65:54:7f:ee:a0:9a:81
fc1/30 101 0x3c0023 20:00:00:25:b5:00:00:2d 20:00:00:25:b5:00:00:6e
fc1/30 101 0x3c0025 20:00:00:25:b5:00:00:7b 20:00:00:25:b5:00:00:2b
fc1/30 101 0x3c0028 20:00:00:25:b5:00:00:39 20:00:00:25:b5:00:00:19
fc1/30 101 0x3c002a 20:00:00:25:b5:00:00:77 20:00:00:25:b5:00:00:57
fc1/30 101 0x3c002b 20:00:00:25:b5:00:00:17 20:00:00:25:b5:00:00:76
fc1/30 101 0x3c002d 20:00:00:25:b5:00:00:55 20:00:00:25:b5:00:00:35
fc1/30 101 0x3c002f 20:00:00:25:b5:00:00:14 20:00:00:25:b5:00:00:73
fc1/30 101 0x3c0031 20:00:00:25:b5:00:00:62 20:00:00:25:b5:00:00:3c
fc1/30 101 0x3c0032 20:00:00:25:b5:00:00:12 20:00:00:25:b5:00:00:6b
fc1/31 101 0x3c00ef 50:06:01:61:3e:a0:13:d5 50:06:01:60:be:a0:13:d5
fc1/32 101 0x3c01ef 50:06:01:69:3e:a0:13:d5 50:06:01:60:be:a0:13:d5
Total number of flogi = 41.
N5K-Secondary_SW#
02-13-2014 12:15 PM
Hi Amit
What are the flogi showing up going over fc 1/29 and 1/30 ?
Your problem is clear: it's a routing issue ? how can a initiator pwwn eg. in VSAN 100 decide, on which port he should go Northbound ?
The solution:
Create 2 additional VSAN's, e.g. 102 and 103; 100/101 will be used to reach N5k, 102/103 to reach MDS; you of course need 2 additional vhba's, one in 102, resp 103.
Hopefully you have done your zoning with device-alias (enhanced); then this change will be easy.
Another ugly solution would be to use static ping groups, which is hardly used, a management and scalabilty nightmare, and therefore not recommended.
Good luck
Walter.
02-13-2014 01:06 PM
Hi Walter,
Thanks for your reply
I did the same thing what you have mentioned, while doing the troubleshooting I also thought the same the hwo initiator will decide on which port traffic has to be sent
Thanks once again for your reply it really cleared the doubt
Regards,
Amit Vyas
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: