NSX Federation Edge Nodes not communcating on RTEP network

Products

• VMware NSX

Issue/Introduction

Edge nodes are unable to communicate with other site edge nodes via the RTEP network. 

 

Environment

NSX Federation with version NSX-T 3.2.x / NSX 4.x

Cause

This is an NSX Control plane issue, there is a discrepancy between CCP L3 data and Pigeon data.  This issue can be triggered under certain RTEP configuration operations which caused edge RTEP interfaces to have no default route configured. 

Resolution

Restarting the control plane on 3 manager nodes will resolve the issue. 

Steps:

1. Log in to each NSX manager node using the "admin" user
2. run the following CLI command:

>restart service controller

 

Additional Information

The issue can be verified by entering RTEP VRF, running "get forwarding" and then checking the output.