NSX edge node application crash and edge failover due to segmentation fault

Products

• VMware NSX

Issue/Introduction

• Alarm triggered in NSX UI

"Application on NSX node <edge-node-name> has crashed. The number of core files found is 1. Collect the Support Bundle including core dump files and contact VMware Support team."

• Traffic is dropped resulting in Edge failover.
• Dataplane service crashes and generates a core dump on the edge node in /var/log/core/
• In the edge logs: 

/var/log/syslog

[TIMESTAMP] <edge-node-name> NSX 1462776 - [nsx@6876 comp="nsx-edge" subcomp="node-mgmt" username="root" level="WARNING"] Core file generated: /var/log/core/core.dp-fp.gz

• In the edge logs:

/var/log/kern.log

[TIMESTAMP] <edge-node-name> kernel - - - [1049734.071875] grsec: Segmentation fault occurred at 0000000000000004 in /opt/vmware/nsx-edge/sbin/datapathd[dp-fp:1:9044] uid/euid:0/0 gid/egid:124/124, parent /opt/vmware/edge/dpd/entrypoint.sh[entrypoint.sh:8784] uid/euid:0/0 gid/egid:124/124

Environment

VMware NSX-T Data Center 3.x

VMware NSX 4.x

Cause

This issue occurs due to memory buffer corruption which can lead to an invalid edge interface or port.  This can cause the edge datapath to crash during input packet processing.

Resolution

This issue is resolved in VMware NSX 4.2, available at Broadcom downloads.

If you are having difficulty finding and downloading software, please review the Download Broadcom products and software KB.