Bare Metal Edge with Mellanox NIC experiences BGP flapping

Products

• VMware NSX Networking

Issue/Introduction

Symptoms:

• NSX 3.2.x/4.x
• Bare Metal Edge with Mellanox ConnectX-4 or ConnectX-5 NICs
• BGP flapping is observed
• Data plane service on the Edge crashes /var/log/syslog

2023-08-09T02:46:02.699Z NSX 4547 - [nsx@6876 comp="nsx-edge" subcomp="node-mgmt" username="root" level="WARNING" eventFeatureName="infrastructure_service" eventType="edge_service_status_changed" eventSev="warning" eventState="On"] The service dataplane changed from STARTED to CRASHED.

• On the Edge /var/dump has a datapath core file with a name similar to core.dp-fp

Environment

VMware NSX-T Data Center 3.x
VMware NSX-T Data Center 4.x
VMware NSX-T Data Center

Cause

This issue occurs due to a failure during packet processing by the NIC driver.

Resolution

This is a known issue impacting NSX-T Bare Metal Edges.

Workaround:
There is no workaround.

Resolution:

Fixed in NSX 4.1.2.2 and 3.2.4