BFD to BGP neighbors may go down after the restart of data path service

Products

• VMware NSX

Issue/Introduction

 BFD to BGP neighbors remain down. Some connected routes are missing in non-default VRFs. BFD down will bring down BGP therefore impact routing.

 

 

Environment

VMware NSX-T Data Center 3.2.4 and earlier
VMware NSX 4.1.x and earlier

 

Cause

The restart of the data path service may induce this error condition, since it involves the deletion and recreation of the interface added within the Linux namespace for frr's consumption.

If this "ifindex" is missing, following message will be found in NSX edge /var/log/syslog file. 

ROUTING [nsx@6876 comp="nsx-edge" subcomp="nsxa" s2comp="routing" level="ERROR" errorCode="EDG####"] FIB update 16 error: update ###.###.###.###/28 add - ifindex 104 not found

In addition to above log entries,the output of following command shows some missing routes (especially connected routes) in the forwarding section. 

'get logical-router <UUID>'

Resolution

Workaround:

1. Login to NSX T edge as user 'admin'
2. Restart local-controller.

• restart service local-controller

Note:  The restarting local-controller may not cause impact to data plane forwarding still recommendation is that running the procedure should be considered during the maintenance window.

Solution: 

Upgrade NSX version to 

• VMware NSX-T Data Center 3.2.5
• VMware NSX 4.2.0

Additional Information