VCF Management Services Cluster Bootstrap Fails Due to Firewall Port Blockage
search cancel

VCF Management Services Cluster Bootstrap Fails Due to Firewall Port Blockage

book

Article ID: 452212

calendar_today

Updated On:

Products

VMware SDDC Manager / VCF Installer

Issue/Introduction

During the VMware Cloud Foundation (VCF) 9.1 deployment, the installer may fail at the "Management Services Installation" phase.

This article provides troubleshooting steps for identifying and resolving network connectivity issues that cause this failure.

 

Ref the Log Snippet :

 

  • Log Location: /var/log/vmware/vcf/domainmanager/domainmanager.log

xxxx-xx-xxTxx:05:04.361+0000 ERROR [vcf_dm,xxxxxxxxxxxx] [c.v.v.v.s.f.VspComponentService,dm-exec-13]  VSP task with id xxxxxxxxxxxxxx
dq2u (Staging VSP component of type: vcf-fleet-depot and version: 9.1.0.0400.25570105) failed with status : FAILED. Task result: null

xxxx-xx-xxTxx:05:04.361+0000 ERROR [vcf_dm,xxxxxxxxxxxx] [c.v.v.v.s.f.VspComponentService,dm-exec-13]  Could not stage component with type: vcf-fleet-depot, version: 9.1.0.0400.25570105, location: https://Hostname(vmsa)/vmware/vcf/bundle/xxxxxx-xxxx-xxxx-

xxxx-xxxxx/xxxxxx-xxxx-xxxx-xxx/vcf-fleet-depot-9.1.0.0400.25570105.tgz

xxxx-xx-xxTxx:05:04.366+0000 ERROR [vcf_dm,xxxxxxxxxxxx] [c.v.e.s.o.model.error.ErrorFactory,dm-exec-13]  [9T5DF7] PUBLIC_STAGE_VSP_COMPONENT_

FAILED Failed to stage component: "URL Connectivity Check Precheck. Status: FAILED The URL for component package is not reachable: https://Hostname(vmsa)/vmware/vcf/bundle/xxxxxx-xxxx-xxxx-xxxx-xxxxx/xxxxxx-xxxx-xxxx-xxxx-xxxxx/vcf-fleet-depot-9.1.0.0400.25570105.tgz. Please verify the URL and network connectivity. [VCFMS-PRECHECK-URL-001]. Please check the component package URL and try again. Check if there are any firewall rules that may block access to this URL. I
f the issue persists, contact support."


com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Failed to stage component: "URL Connectivity Check Precheck. Status: FAILED The URL for component package is not reachable: https://Hostname(vmsa)/vmware/vcf/bundle/xxxxxx-xxxx-xxxx-xxxx-xxxxx/xxxxxx-xxxx-xxxx-xxxx-xxxxx/vcf-fleet-depot-9.1.0.0400.25570105.tgz. Please verify the URL and network connectivity. [VCFMS-PRECHECK-URL-001]. Please check the component package URL and try again. Check if there are
 any firewall rules that may block access to this URL. If the issue persists, contact support."
        at com.vmware.vcf.vsp.services.fleetlcm.VspComponentService.stageAndInstallComponent(VspComponentService.java:162)
        at com.vmware.vcf.vsp.services.fds.DeployFdsComponentsAction.execute(DeployFdsComponentsAction.java:143)
        at com.vmware.vcf.vsp.services.fds.DeployFdsComponentsAction.execute(DeployFdsComponentsAction.java:46)
        at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionState.invoke(FsmActionState.java:66)
        at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionPlugin.invoke(FsmActionPlugin.java:161)
        at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionPlugin.invoke(FsmActionPlugin.java:147)
        at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.invokeMethod(ProcessingTaskSubscriber.java:401)
        at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.processTask(ProcessingTaskSubscriber.java:515)
        at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.accept(ProcessingTaskSubscriber.java:128)
        at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.base/java.lang.reflect.Method.invoke(Method.java:580)
        at com.google.common.eventbus.Subscriber.invokeSubscriberMethod(Subscriber.java:85)
        at com.google.common.eventbus.Subscriber.lambda$dispatchEvent$0(Subscriber.java:71)
        at com.vmware.vcf.common.tracing.TraceRunnable.run(TraceRunnable.java:63)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
xxxx-xx-xxTxx:05:04.401+0000 DEBUG [vcf_dm,xxxxxxxxxxxx] [c.v.e.s.o.c.ProcessingTaskSubscriber,dm-exec-13]  Collected the following errors for
 task with name DeployFdsComponentsAction and ID xxxxxxxxxxxxx: [ExecutionError [errorCode=null, errorResponse=LocalizableErrorResponse(messageBundle=com.vmware.evo.sddc.common.services.sddcmanagermessages)]]
xxxx-xx-xxTxx:05:04.414+0000 DEBUG [vcf_dm,xxxxxxxxx] [c.v.e.s.o.c.ProcessingTaskSubscriber,dm-exec-47]  Invoking task DeployFdsComponentsAction.UNDO, Plugin: VspServicesPlugin, ParamBuilder null, Input map: {componentImage=fleetDepotComponentImage, sddcSpec=sddcSpec}, Id: xxxxxxxxxxxxxxxx

Environment

  • VMware Cloud Foundation 9.1

  • VCF Operations / VCF Management Services (VMSP)

Cause

Firewall rules or network Layer-3 boundaries are blocking bidirectional communication on TCP ports 443 and 5480 between the SDDC Manager appliance, the VMSP Bootstrap VM, and the management infrastructure.

The VMSP bootstrap process requires these ports for health checks and API communication.

 

Resolution

  • Identify Bootstrap VM

    • IP: Review /var/log/vmware/vcf/domainmanager/domainmanager.log to find the IP address assigned to the temporary Bootstrap VM.

  • Verify Port Connectivity: Run the following commands from the SDDC Manager (SSH) to test connectivity to the Bootstrap VM:
    • nc -zv <Bootstrap_VM_IP> 5480

    • curl -v -k https://<Bootstrap_VM_IP>:5480/health

  • Update Firewall Rules: Ensure that TCP ports 443 and 5480 are permitted bi-directionally across any firewalls or network segments between the SDDC Manager and the management network.

  • Retry Deployment: Once connectivity is confirmed, restart the deployment task from the SDDC Manager UI.

Additional Information

  • Error Reference: PUBLIC_VSP_CLUSTER_BOOTSTRAP_FAILED_DETAILED

Powered by Wolken Software