SDDC Manger is stuck on ACTIVATING status .

Products

• VMware SDDC Manager

Issue/Introduction

After deploying a new SDDC Manager we see the status of the Management domain, cluster and hosts are stuck on ACTIVATING status.

 

Environment

VCF 5.1.1

Cause

• There was  failed task on the SDDC manager for "unable  to download the personality file from the vCenter server".
• vCenter server was unable to download the image, As it was still using the old URL on LCM patch store.
• This caused the domain manger server to be in not active state 

SDDC Manager : <SDDC-FQDN>
+-------------------------+-------------+
|          Stage          |    Status   |
+-------------------------+-------------+
| Management Domain State | Not Started |

• Logs snippets 

  • YYYY-MM-DDTHH:MM:SS.MSEC+0000 DEBUG [vcf_om,68a3791ce06140f250fb74d2b######,023e] [c.v.v.c.service.ResourceCacheService,om-exec-29] Parent domain 14e120a7-1999-4194-a1f3-c1db76##### of vcenter {} doesn't exist inthe inventory cache. Skip adding this vcenter to the cache.
    YYYY-MM-DDTHH:MM:SS.MSEC+0000 DEBUG [vcf_om,68a3791ce06140f250fb742B######,023e] [c.v.v.c.service.ResourceCacheService,om-exec-29] Cluster 76c392eb-8ae8-4cff-a378-832be####### is in ACTIVATING status and it's not
     ACTIVE. Skip adding this resource to the inventory.
    YYYY-MM-DDTHH:MM:SS.MSEC+0000 INFO  [vcf_om,68a3791ce06140f250fb74d2b######,023e] [c.v.v.c.service.ResourceCacheService,om-exec-29] Loading isConfigRealized checks for changed resources and refresh failed checks..

Resolution

• vCenter URL were changed from the LCM using the article, Error: A general system error occurred: Failed to download VIB(s): Error: HTTP Error Code: 403, vLCM fails to download the ESXi patches and images from online repositories.
• Updated the correct URL on the SDDC to have the online depot, "Depot connection has issues. Depot Invalid User Credential", SDDC fails to download the updates from online repositories
• Reran the personality file download and the state of the management domain changed from "Activating " to "Active".

 

 

Additional Information

• Check the following points when a Management domain is in ACTIVATING status.
• Troubleshooting Tips:
  
  
  • The status is shown as "Activating" during adding or configuring objects.
  • Ensure that all the services on the SDDC Manager instance are running.
  • Ensure that there are no failed tasks related to workload domains with errors.
  • Ensure that there are no failed tasks related to the ESXi hosts with errors.
  • Ensure that there are no failed tasks related to the clusters with errors.
  • Ensure that there are no failed tasks related to the edge clusters with errors.
  • Ensure that there are no failed/ongoing upgrades.
• To check the status of service. 
  • /opt/vmware/sddc-support/sos --services-health --domain-name ALL