File system corruption for NSX Edge causes loss of network for NSX managed virtual machines

Products

• VMware NSX

Issue/Introduction

Virtual machines connectivity from outside of NSX environment depends on NSX edges. 

Environment

VMware NSX 

Cause

NSX Edge functioning may get affected due to unhealthy underlying storage condition.

The unhealthy storage at ESX host level will result into NSX Edge file system corruption

File System Corruption: When the file system is corrupted, Manager appliance OS might choose to mount it as read-only to prevent further damage.
 

Resolution

To fix the issue, repair the NSX Edge file system through following steps

If possible, take a backup before proceeding.

Performing the following file system repair steps will only fix the OS file system and not repair any corruption which may have occurred to the NSX edge.

Any corruption may lead to other issues in the future.

1. Connect to the console of the NSX Edge appliance

2. Reboot the system

3. When the GRUB boot menu appears, press the left SHIFT or ESC key quickly.

Note: If you wait too long and the boot sequence does not pause, you must reboot the system again

Keep the cursor on the Ubuntu selection

4. Press e to edit the selected option

5. Enter the user name (root) and the GRUB password for root (not the same as the appliance user root).
 
6. Search for the line starting with linux

At the end of this line, add fsck.mode=force fsck.repair=yes and press F10 to boot with these options. This should bring up the prompt to login with the appliance root user credentials. If not, continue to step J.

7. Press Control-X to boot.

The healthy NSX edge will restore network connectivity for the virtual machines connectivity.