Dell Networking VXLAN Hardware Gateway with NSX 6.3.7 & NSX 6.4.4
Article ID: 321271
Updated On:
Products
Issue/Introduction
This article contains information on products that are qualified with VMware NSX for vSphere 6.3.7 & 6.4.4 for the purpose of hardware gateway. In addition, the article contains information and the configuration required on the switch and information on how to engage the Dell support team.
Disclaimer: The partner product referenced in this article is a software module that is developed and supported by a partner. Use of this product is also governed by the end user license agreement of the partner. You must obtain from the partner the application, support, and licensing for using this product. For more information, see Dell Support.
Environment
VMware NSX for vSphere 6.4.x
Resolution
Supported Hardware Platforms
S4200-ON
S4200-ON is a high-density 10/25/40/50/100 GbE ToR switch with forty ports of 10GbE (SFP+), two ports of 40 GbE (QSFP+), and six ports of 100GbE (QSFP28)
There are two variants of S4200-ON:
- S4248FB-ON: with deep-buffering only
- S4248FBL-ON: with deep-buffering and additional TCAM for expanded FIB and ACL tables and flow
S5200-ON
S5200-ON is a high-density 10/25/40/50/100 GbE ToR switch with up to 48 or 96 ports of 25GbE/100GbE or 32 ports of 100GbE
There are three variants of S5200-ON:
- S5296F-ON: 96-port 25GbE and 8-port 100GbE with 3.2Tbps of Line-Rate
- S5248F-ON: 48-port 25GbE, 4-port 100GbE and 2-port QSFP28-DD(2x100GbE) with 2.0Tbps of Line-Rate
- S5232F-ON: 32-port 100GbE and 2-port 10GbE with 3.2Tbps of Line-Rate
Z9264F-ON
Z9264F-ON is a high-density 10/25/40/50/100 GbE ToR switch with up to 64 ports of 40/100GbE or 128 ports of 10/25/40/50GbE.
Fabric delivers line-rate performance of 6.4Tbps
Z9100-ON
Z9100-ON is a high-density 10/25/40/50/100GbE fixed switch. with choice of up to 32 ports of 100GbE, 64 ports of 50GbE, 32 ports of 40GbE, 128 ports of 25GbE or 128 + 2 ports of 10GbE.
Fabric delivers line-rate performance of 6.4Tbps
DELL switches are the industry’s latest data center networking solution empowering organizations to deploy modern workloads and applications designed for the open networking era. These switches are purpose-built for applications in high-performance data center and computing environments.
DELL switches provide customers unbiased approach to Network Virtualization by supporting 3rd party OS. The validated OS 10 supports both network centric virtualization method (VRF-lite) and Hypervisor centric virtualization method (VXLAN). Leveraging a non-blocking switching architecture, DELL products deliver line-rate L2 and L3 forwarding capacity to maximize network performance.
Supported Software
Refer to the VMware Compatibility Guide for supported switch software versions.
Version of the VMware Product
NSX for vSphere 6.3.7 and NSX 6.4.4
For more information, see the VMware Product Interoperability Matrixes.
Steps to download and install the product on VMware Products
The software comes pre-loaded on the hardware. Contact Dell Networking Support for assistance if needed.
Support Information
Troubleshooting (Logs, Procedures and Techniques)
Configuration
Standalone:
nve
source-interface loopback1
!
controller ovsdb
ip 172.20.1.11 port 6640 ssl
In addition, use this configuration in each access port (to the physical devices):
interface ethernet1/1/13:3
no shutdown
switchport mode trunk
flowcontrol receive on
nve-controller
Debug command:
OS10# show ovsdb-tables
ACL table
_uuid acl_entries acl_fault_status acl_name
----- ----------- ---------------- --------
ACL_entry table
_uuid acle_fault_status action dest_ip dest_mac dest_mask dest_port_max dest_port_min direction ethertype icmp_code icmp_type protocol sequence source_ip source_mac source_mask source_port_max source_port_min tcp_flags tcp_flags_mask
----- ----------------- ------ ------- -------- --------- ------------- ------------- --------- --------- --------- --------- -------- -------- --------- ---------- ----------- --------------- --------------- --------- --------------
Arp_Sources_Local table
_uuid locator src_mac
----- ------- -------
Arp_Sources_Remote table
_uuid locator src_mac
----- ------- -------
Global table
_uuid managers switches
------------------------------------ ------------------------------------------------------------------------------------------------------------------ --------------------------------------
86a92524-####-####-####-b21e095ea0be [05199828-####-####-####-ba2e0125f8be, 2b57efd3-####-####-####-916b470a7655, f7af6890-####-####-####-69542e8bb89c] [f701607f-####-####-####-eebf4af05c25]
Logical_Binding_Stats table
_uuid bytes_from_local bytes_to_local packets_from_local packets_to_local
----- ---------------- -------------- ------------------ ----------------
Logical_Router table
LR_fault_status _uuid acl_binding description name static_routes switch_binding
--------------- ----- ----------- ----------- ---- ------------- --------------
Logical_Switch table
_uuid description name tunnel_key
------------------------------------ ----------- -------------------------------------- ----------
66042eeb-8c25-4be0-a93e-0c2667b0c890 "" "483d8df8-77b3-3405-81e8-fe4247f02d86" 10009
Manager table
_uuid inactivity_probe is_connected max_backoff other_config status target
------------------------------------ ---------------- ------------ ----------- ------------ ------------------------------------------ ------------------------
05199828-####-####-####-ba2e0125f8be [] true 8000 {} {sec_since_connect="162147", state=ACTIVE} "ssl:10.16.140.172:6640"
f7af6890-####-####-####-69542e8bb89c [] true 8000 {} {sec_since_connect="162147", state=ACTIVE} "ssl:10.16.140.173:6640"
2b57efd3-####-####-####-916b470a7655 [] true 8000 {} {sec_since_connect="162149", state=ACTIVE} "ssl:10.16.140.171:6640"
Mcast_Macs_Local table
MAC _uuid ipaddr locator_set logical_switch
----------- ------------------------------------ --------- ------------------------------------ ------------------------------------
unknown-dst 61f5abf7-####-####-####-1629a230ac0b "1.1.1.1" b49138e7-5027-4f09-b481-6921bb97ffec 66042eeb-8c25-4be0-a93e-0c2667b0c890
Mcast_Macs_Remote table
MAC _uuid ipaddr locator_set logical_switch
----------- ------------------------------------ ------ ------------------------------------ ------------------------------------
unknown-dst 79c14db5-####-####-####-4cf2f6079cfa "" 90ef037c-####-####-####-990eb25bec67 66042eeb-####-####-####-0c2667b0c890
Physical_Locator table
_uuid dst_ip encapsulation_type
------------------------------------ --------- ------------------
308a7995-####-####-####-364e4c4f8b3e "1.#.#.#" "vxlan_over_ipv4"
4107d0a7-####-####-####-dfed52469014 "2.#.#.#" "vxlan_over_ipv4"
Physical_Locator_Set table
_uuid locators
------------------------------------ --------------------------------------
90ef037c-####-####-####-990eb25bec67 [4107d0a7-####-####-####-dfed52469014]
b49138e7-####-####-####-6921bb97ffec [308a7995-####-####-####-364e4c4f8b3e]
Physical_Port table
_uuid acl_bindings description name port_fault_status vlan_bindings vlan_stats
------------------------------------ ------------ ----------- --------------- ----------------- ----------------------------------------- ----------
686c842d-####-####-####-b956ee99f1b4 {} "" "ethernet1/1/2" [] {20=66042eeb-####-####-####-0c2667b0c890} {}
Physical_Switch table
_uuid description management_ips name ports switch_fault_status tunnel_ips tunnels
------------------------------------ ----------- -------------- --------- -------------------------------------- ------------------- ----------- --------------------------------------
f701607f-####-####-####-eebf4af05c25 "" [] "1.1.1.1" [686c842d-####-####-####-b956ee99f1b4] [] ["1.#.#.#"] [1768a4ca-####-####-####-2e149a8e4f9a]
Tunnel table
_uuid bfd_config_local bfd_config_remote bfd_params bfd_status local remote
------------------------------------ ------------------------------------------------------- ------------------------------------------------------- ------------------------------------------------------ ---------- ------------------------------------ ------------------------------------
1768a4ca-####-####-####-2e149a8e4f9a {bfd_dst_ip="1.#.#.#, bfd_dst_mac="00:23:20:##:##:##"} {bfd_dst_ip="2.#.#.#", bfd_dst_mac="00:50:56:##:##:##"} {enable="true", forwarding_if_rx="true", min_rx="301"} {} 308a7995-####-####-####-364e4c4f8b3e 4107d0a7-####-####-####-dfed52469014
Ucast_Macs_Local table
MAC _uuid ipaddr locator logical_switch
--- ----- ------ ------- --------------
Ucast_Macs_Remote table
MAC _uuid ipaddr locator logical_switch
--- ----- ------ ------- --------------
OS10#
Logs when ovsdb session is up with NSX:
<165>1 2019-02-20T21:19:56.278755+00:00 OS10 dn_app_vtep - - - Node.1-Unit.1:PRI [event], %OVSDB_CTRLR_SESSION_CONNECTED: Controller session 172.20.1.11 is connected
Note: This indicates that the VTEP is connected to NSX and ovsdb session is up with NSX.
Logs when BFD tunnel is up:
<165>1 2019-02-20T20:50:42.048481+00:00 OS10 dn_app_bfd 652 - - Node.1-Unit.1:PRI [event], Dell EMC (OS10) %BFD_STATE_CHANGE: Session state to Up for neighbor #.#.#.3 on interface virtual-network0 VRF:default
Note: This indicates tunnel is up with the replicator.
NVE Controller show command:
OS10# show nve controller
Management IP : 10.16.140.49/16 Switch IP on Management Interface
Gateway IP : 50.10.2.2 Hardware VTEP IP on Source Loopback Interface
Max Backoff : 8000
Configured Controller : 172.20.1.11:6640 ssl (connected) Configured Controller IP
Controller Cluster
IP Port Protocol Connected State Max-Backoff
172.20.1.11 6640 ssl true ACTIVE 8000
172.20.1.12 6640 ssl true ACTIVE 8000
172.20.1.13 6640 ssl true ACTIVE 8000
NVE Controller Ports
ethernet1/1/55:3 Baremetal Server Ports
VXLAN show command to check Replicator Status:
OS10# show nve replicators
BFD Status: Enabled
Replicators State
-----------------------
172.20.1.21 Up
172.20.1.22 Up
Show command to check logical network to port mapping:
OS10# show virtual-network
Codes: DP - MAC-learn Dataplane, CP - MAC-learn Controlplane, UUD - Unknown-Unicast-Drop
Virtual Network: 0
Members:
Virtual Network: 6000
Members:
VLAN 2: ethernet1/1/55:3 Port Vlan binding for VNiD
VxLAN Virtual Network Identifier: 6000 VNiD
Source Interface: loopback1(50.10.2.2)
Remote-VTEPs (flood-list): 172.20.1.22(CP), Active Replicator for the Virtual Network
Show command to check local and remote macs:
OS10# show mac address-table virtual-network local
Virtual-Network VlanId MAC Address Type Interface/Remote-VTEP
--------------------------------------------------------------------------------------------------------------
6000 2 b0:d2:f0:##:##:## dynamic Ethernet 1/1/55:3
OS10# show mac address-table virtual-network remote
Virtual-Network VlanId MAC Address Type Interface/Remote-VTEP
-----------------------------------------------------------------------------------------------------------------
6000 b0:d2:f0:##:##:## dynamic VxLAN(172.20.2.1)
Show Command for BFD tunnel status to replicator:
OS10# show bfd neighbors
* - Active session role
------------------------------------------------------------------------------------------------------------------------------------------------
LocalAddr RemoteAddr Interface State RxInt TxInt Mult VRF Clients
-----------------------------------------------------------------------------------------------------------------------------------------------
* 50.10.2.2 172.20.1.21 virtual-network0 up 300 300 3 default vxlan
* 50.10.2.2 172.20.1.22 virtual-network0 up 300 300 3 default vxlan
Link to downloads site
The Dell software comes pre-loaded on the hardware switch. For upgrades, you must have a valid service contract. For more information to download the code, see Dell Customer Support.
Support Process
To create a support case, see TechDirect.
SLA
Depends on the service contract of the hardware. Use the service tag on the switch to open a support case.
Escalation Process
While opening a case a priority can be defined, P0,P1 or P2. Cases that cannot be resolved in a reasonable time are escalated by technical support. Please contact the case owner for escalation.
Contact information
Dell Support
Disclaimer: VMware is not responsible for the reliability of any data, opinions, advice, or statements made on third-party websites. Inclusion of such links does not imply that VMware endorses, recommends, or accepts any responsibility for the content of such sites.
Feedback
