After SDDC Manager is rebooted, several “Queued” tasks appear in the vCenter Server task bar, indicating “Creating Workload Domain” and/or “Commissioning Host(s) to VMware Cloud Foundation.”

Products

• VMware SDDC Manager
• VMware vCenter Server

Issue/Introduction

• When SDDC Manager is rebooted, events such as the following may appear in the vCenter Server Task Bar
• SDDC Manager may have been recently updated.

• The tasks will eventually time out and fail.
• Rebooting the vCenter Server causes the tasks to be cancelled.
• In the vCenter Server journalctl -xe logs, events similar to the following may be observed:
  
  [YYYY-MM-DDTHH:MM:SS.######] [vim.event.TaskEvent] [info] [[email protected]] [] [########] [Task: Creating Workload Domain]
  
  
• However, no references to these tasks are found when reviewing the /var/log/vmware/vpxd/vpxd.log on vCenter.
• In SDDC Manager, the /var/log/vmware/vcf/operationsmanager/operationsmanager.log may contain entries similar to the following:
  
  YYYY-MM-DDTHH:MM:SS.######] WARN  [vcf_om,################,####] [c.v.v.t.services.TaskPublisher,om-scheduler-1] Failed to check for leftover tasks
com.vmware.vim.binding.vmodl.fault.ManagedObjectNotFound: The object 'vim.Task:task-#####' has already been deleted or has not been completely created

Environment

VMware Cloud Foundation 5.2.x
vCenter Server 8.x 

Cause

Old or stale tasks remain in SDDC Manager, and upon reboot of SDDC Manager, these tasks reinitialize but eventually fail or time out as they are no longer relevant.

Resolution

Contact Broadcom Support for assistance in resolving the issue