Bootstrap VCF Services Platform task error - "Failed to bootstrap VCF services runtime" - while upgrading VCF 9.0.2 to 9.1.0.4

Products

• VMware SDDC Manager / VCF Installer

Issue/Introduction

• When attempting to deploy VCF Management Components during upgrade to VMware Cloud Foundation 9.1, the task fails:

Message: Failed to bootstrap VCF services runtime

Remediation Message:

Reference Token: ####

Cause: java.lang.StringIndexOutOfBoundsException: Range [-1, 0) out of bounds for length 0 Range [-1, 0) out of bounds for length 0

• The following vSphere task is observed:

Task Name: Clone virtual machine

Status: Invalid value ' ' specified for property varoot-password

• The password provided for the varoot user is more than 32 characters.

Environment

VCF 9.1.x

Cause

This issue occurs because passwords used do not meet the requirements.

Example: vrauser password being too long.

Resolution

1. Ensure that the passwords which were set for 9.1 meet the below requirements:

Default Password Requirements for VCF Components

2. Once the passwords used have been corrected to conform to requirements, retry the deployment.

3. The deployment is now expected to succeed.

If you are unable to update the passwords via the UI, you can use the following steps to manually update the manifest:

1. SSH to the SDDC Manager/Installer VM
2. Execute the below command to to enable internal vault access
   
   echo vcf.vault.http-access=true >> /etc/vmware/vcf/domainmanager/application.properties && systemctl restart domainmanager
   
   
3. Identify the task ID (from UI/domainmanager.log) and extract the json
   
   curl -X GET http://localhost/domainmanager/internal/vault/<task id> | json_pp > /tmp/workflow.json
   
   Sample:
   
   curl -X GET http://localhost/domainmanager/internal/vault/########-####-####-####-######fe06ac | json_pp > /tmp/workflow.json

Task ID is captured from the domainmanager.log
   
   
4. Use vi editor to manually edit /tmp/workflow.json to update the passwords to meet the requirements.
5. Import the updated JSON
   
   curl -H 'Content-Type:text/plain' -X PUT http://localhost/domainmanager/internal/vault/<task id> -d @/tmp/workflow.json
   
   
6. Restart the domainmanager service on SDDC
   
   systemctl restart domainmanager
   
   
7. Cleanup the partially deployed bootstrap VM
   
   
   1. Log in to vCenter server via vSphere Client
   2. Identify the bootstrap VM and delete the machine
      
      
      1. Navigate to the VMs and Templates tab under inventory
      2. Expand the folder vcf-management-services
      3. right click and power off the bootstrap VM and delete
         
         
8. Log in to VCF Operations UI/VCF Installer UI and restart the task