Failed add rack causing SDDC Manager inventory discrepancy

Products

• VMware Cloud Foundation

Issue/Introduction

Symptoms:

• Adding rack fails after host discovery is completed and time sync fails with "host no longer exists" error message.
• "at com.vmware.vrack.vrm.timesync.tasks.UpdateEsxiTimeTask.execute(UpdateEsxiTimeTask.java:54)
  <host name> no longer exists in the rack "

Environment

VMware Cloud Foundation 2.3.x

Resolution

• Do not remove hosts from rack while add rack operation is in progress

Workaround:
To clean up follow the below workaround :- 

1. curl -i -k -X DELETE https://localhost:8443/vrm-ui/api/1.0/prm-service/hosts/<host name>
2. curl -i -k -X DELETE https://localhost:8443/vrm-ui/api/1.0/prm-service/hosts/<host name>
3. Delete the entries from timesync table for the hosts
4. Delete the entries from the tables in Cassandra (evosddcbringup schema) for the tables esxihostconfigbybringup, esxihostconfig for the hosts in question
5. Restart HMS out of band
6. Restart VRM
7. Retry failed add rack workflow