Unable to exit Transport Node Maintenance Mode in VMware NSX 4.x

Products

• VMware NSX

Issue/Introduction

• Following a recent upgrade of VMware NSX to 4.x
• or Greenfield NSX installation of 4.x
• Entering NSX maintenance mode on ESXi Host Transport node was successful. 
• Exit NSX Maintenance Mode for ESXi Host Transport node failed with the following:
  
  Transport Node Errors

Transport Node Maintenance Mode Config: Host ########-####-####-####-############ replied error code 8754 for TN maintenance mode setting, state: DISABLED., retries: 0

• Setting NSX maintenance mode via nsx-cli failed with the error: Command not found

  esxi-host>set maintenance-mode
  % Command not found: set maintenance-mode
  
  esxi-host> set maintenance-mode enable
  % Command not found: set maintenance-mode enable
  
  esxi-host> set maintenance-mode disable
  % Command not found: set maintenance-mode disable

• Log lines similar to the below are encountered in /var/log/nsx-syslog.log

  Er(179) nsx-opsagent[803500]: NSX 803500 - [nsx@6876 comp="nsx-esx" subcomp="opsagent" s2comp="nsxa" tid="804047" level="ERROR" errorCode="MPA42011"] [PersistMmodeCfgToFile] Failed to open maintenance mode config file [/etc/vmware/nsxa/host_config_mmode.bin]: Operation not permitted
  Er(179) nsx-opsagent[803500]: NSX 803500 - [nsx@6876 comp="nsx-esx" subcomp="opsagent" s2comp="nsxa" tid="804047" level="ERROR" errorCode="MPA41024"] Execution of cmd [/opt/vmware/nsx-cli/bin/scripts/nsxcli --cmd "set maintenance-mode enabled"] failed with return code [2] and reply [% Command not found: set maintenance-mode enabled

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.

Environment

VMware NSX 4.1.2.3
VMware NSX 4.2.x

Cause

This is due to the missing nsx-cli command to set maintenance-mode

Resolution

This is a known issue impacting VMware NSX.

Workaround: 

If exiting Maintenance Mode fails, use the SYNC button from the Out Of Sync Error that should appear for the same ESXi Host Transport node.