vSAN Host Maintenance Mode is in sync with vSAN Node Decommission State

Products

• VMware vSAN

Issue/Introduction

This article explains the health check- whether the host's maintenance mode is in sync with vSAN node decommission state.

Environment

VMware vSAN 8.x
VMware vSAN 7.x

Resolution

What does the check - Host Maintenance Mode is in sync with vSAN Node Decommission State do?

Once the vSAN host is in vSAN decommission state, it doesn't accept any new object creation, and all components on the host will be absent until it is back. When the host in the vSAN cluster is in maintenance mode, it is expected that this host is in vSAN decommission state. When the host exits maintenance mode, the host should not be in vSAN decommission state. This health check verifies the 2 states are in sync.

What does it mean when it is in an error state?

If a host is in maintenance mode using any of the vSAN options but is not in vSAN decommission state, or a host exits maintenance mode but is still in vSAN decommission state, the check triggers a warning message.

 

What action can be performed to resolve this?

If a host is decommissioned but the host is not in maintenance mode, do the following:

1. Identify the relevant host as per the Skyline Health alarm. Make sure to use the host where "vSAN Node in Decommission State" is "Yes".
2. Place the same host into maintenance mode with No Action by doing the following:
   Right-click the host > select Maintenance Mode > No Action
3. Then exit the maintenance mode right after.

This will reset the vSAN decommission status and make it consistent with the vSphere maintenance mode.

 

In some cases, this can occur to multiple vSAN hosts at the same time. This will cause vCenter, and potentially other VMs to become inaccessible. In that case you can perform the same steps via command line.

 

1. Running esxcli vsan cluster get will show output similar to below:
2. 
3. To check if the host is in maintenance mode run: esxcli system maintenanceMode get
4. 
5. If you have similar output the vSAN is in decommissioned state, but the ESXi host is NOT in maintenance mode.
6. First check if there are running virtual machines on the host: esxcli vm process list. If there are any virtual machines powered on, they will need to be powered off or the host will not enter maintenance mode.
7. You can use the commands to attempt to power them off safely: esxcli vm process kill -w <world_id> -t soft or vim-cmd vmsvc/power.shutdown <vm id>
8. Then run this command to place the ESXi host in maintenance mode with the vSAN option for no data migration: esxcli system maintenanceMode set -e true -m noAction
9. Once the prompt returns the host should be in maintenance mode then you can run this command: esxcli system maintenanceMode set -e false
10. Perform these steps on any other hosts where vSAN is decommissioned, but the host is not in maintenance mode.

Additional Information

vSAN ホストにおけるメンテナンスモードと廃止状態の同期 (320832)