The sos --upgrade-unassigned-host command fails with error [One or more bundle require download for the unmanaged ESX host update/upgrade] in VMware Cloud Foundation

Products

• VMware Cloud Foundation

Issue/Introduction

Symptoms:

• The Esxi Host base image is ESXi 6.0.
• You see messages similar to the following when running the /opt/vmware/sddc-support/sos --upgrade-unassigned-host command on the SDDC Manager Controller VM:

+-----+------+-----------+----------------+---------------+-----------------+
| SL# | NODE | Rack Name |  Domain Name   |  Base Version | Current Version |
+-----+------+-----------+----------------+---------------+-----------------+
|  1  | R1N1 |  AAA-VCF  |      MGMT      | 6.0.0-4600944 |  6.5.0-7967591  |
|  2  | R1N2 |  AAA-VCF  |      MGMT      | 6.0.0-4600944 |  6.5.0-7967591  |
|  3  | R1N0 |  ATC-VCF  |      MGMT      | 6.0.0-4600944 |  6.5.0-7967591  |
|  4  | R1N3 |  AAA-VCF  |      MGMT      | 6.0.0-4600944 |  6.5.0-7967591  |
|  5  | R1N5 |  AAA-VCF  | - UNASSIGNED - | 6.0.0-4600944 |  6.0.0-4600944  |
|  6  | R1N4 |  AAA-VCF  | - UNASSIGNED - | 6.0.0-4600944 |  6.0.0-4600944  |
|  7  | R1N7 |  AAA-VCF  | - UNASSIGNED - | 6.0.0-4600944 |  6.0.0-4600944  |
|  8  | R1N6 |  AAA-VCF  | - UNASSIGNED - | 6.0.0-4600944 |  6.0.0-4600944  |
+-----+------+-----------+----------------+---------------+-----------------+

Note: The Esxi Hosts Base Version is 6.0.0-#####

 

• You see messages similar to the following after selecting a 6.0 node to upgrade

"status": 424,
"message": "UPGRADE_BUNDLE_DOWNLOAD_REQUIRED; One or more bundle require download for the unmanaged ESX host update/upgrade",

Note: The preceding excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.​

Environment

VMware Cloud Foundation 2.3.x

Cause

The sos --upgrade-unassigned-host command is not supported to upgrade ESXi host from a 6.0 version to a 6.5 version.

Resolution

This is a known issue affecting VMware Cloud Foundation 2.3.x There is currently no resolution.

Workaround:

1. ssh to the SDDC Manager Controller VM and run the following command to the get the BMC credentials for ESXi Hosts .  

/home/vrack/bin/get-bmc-passwords

2. Decommission the nodes that you cannot be upgraded using the steps in the VMware Cloud Foundation 2.3 Admin Guide 
3. Re-image the decommissioned nodes using VIA. See Image Individual Server in the VIA User's Guide.
4. Add the decommissioned nodes back to the Rack.  See "Add a Previously Decommissioned Host to a Physical Rack" in the  VMware Cloud Foundation 2.3 Admin Guide  .

Notes:

• Before Decommissioning the nodes make a note of the ESXi Host's BMC IP address and credentials.
• The esxi host root account password after its gets decommissioned will change to  D3c0mm1ss10n3d!
• After upgrading to 2.3, VMware Cloud Foundation does not manage OOB ports and the /home/vrack/bin/lookup-passwords command will not retrieve OOB passwords. The /home/vrack/bin/get-bmc-passwords command can retrieve the passwords after the upgrade, but not after the rack containing the hosts has been decommissioned.