VCF 9.0.x Deployment fails with VCF Installer 9.0.x with error - NSX install image validation failed for NSX Version
search cancel

VCF 9.0.x Deployment fails with VCF Installer 9.0.x with error - NSX install image validation failed for NSX Version

book

Article ID: 414456

calendar_today

Updated On:

Products

VMware Cloud Foundation

Issue/Introduction

  • VCF 9.0.x deployment using VCF installer 9.0.x failed at vSphere configuration stage

  • VCF 9.0.x Installer returns error, "Unable to fetch Workflow Options" when hitting the DEPLOY button.



  • A similar error in VCF Installer UI: 
    Validate NSX Install Image is Available                 Validate NSX Install Image is Available

NSX install image validation failed for NSX Version - 9.0.1.0.24952111 Remediation: Please download NSX install image with Version - 9.0.1.0.24952111 Reference Token: J####E
  • VCF 9.0.x. Installer, and workflow failed at the "Generate NSX Input Data" task with the following error: 
    Product NSX_T_MANAGER install image not found for version 9.0.x.0.24952111.
Remediation: Ensure that the install image for product NSX_T_MANAGER with version 9.0.x.0.24952111 is downloaded and available

  • A similar error is found in /var/log/vmware/vcf/domainmanager/domainmanager.log in VCF Installer 
    DEBUG [vcf_dm,6######################9,b102] [c.v.e.s.o.d.OrchestratorDissemblers,http-nio-127.0.0.1-7200-exec-2]  The processing context being built is {"processingStateId":"ac10####-####-####-####-########0000","processingStateName":"VcfInstallerValidation_onFirstStart","refId":"VcfInstallerValidation_onFirstStart____0__","executionId":"86ba####-####-####-####-########5eb7","sddcId":"mgmt","status":"INITIALIZED",

     

  • A similar error is found in /var/log/vmware/vcf/domainmanager/domainmanager.log in VCF Installer

    2026-01-23T17:29:50.263+0000 DEBUG [vcf_dm,6973b00cb2346061d9ba43413b1cab40,4b4c] [c.v.e.s.e.h.LocalizableRuntimeExceptionHandler,http-nio-127.0.0.1-7200-exec-2]  Handler Error Response: {"errorCode":"WORKFLOW_OPTIONS_ERROR","arguments":[],"message":"Unable to fetch Workflow Options.","remediationMessage":"The requested operation could not be performed at the moment, please try again later. For details check logs.","causes":[{"type":"java.lang.IllegalArgumentException","message":"VMwareProductVersion can not be null or empty"}],"referenceToken":"TES6TR"}

Environment

VCF Installer 9.0.0
VCF Installer 9.0.1
VCF Installer 9.0.2

Cause

This is a known issue and is resolved in a future VCF Installer release.

Resolution

VCF Installer Version Target VCF Release: 9.0.2 Target VCF Release: 9.0.1 Target VCF Release: 9.0.0
9.0.2 No additional steps required Download the 9.0.2 NSX and vCenter bundle + 9.0.1 bundles Download the 9.0.2 NSX-T and vCenter bundle + 9.0.0 bundles
9.0.1 Not Supported Run fix_manifest.sh with vcfManifestNew901.json on the VCF Installer Run fix_manifest.sh with vcfManifestNew900.json on the VCF Installer
9.0.0 Not Supported Not Supported Run fix_manifest.sh with vcfManifestNew900.json

Workaround #1

This workaround is effective only when applied to the VCF installer prior to initiating a new VCF deployment. If a deployment has already been started, apply Workaround #1 first, then proceed to Workaround #2.

Download both fix_manifest.sh and the corresponding manifest vcfManifestNew## file attached to this article. 

  1. Using a file transfer utility, upload both files to the VCF Installer appliance.

  2. SSH to the VCF Installer (or SDDC Manager depending on the scenario)

  3. Elevate to root:
    su

  4. Navigate to the location of the uploaded files and update the file permissions:
    chmod +x fix_manifest.sh

  5. Run the following command:
    /fix_manifest.sh '<admin-local-password>' vcfManifestNew###.json

Workaround #2

  1. SSH into the SDDC manager appliance with vcf user and then elevate to root with su.

  2. Record the "execution_ID"  in the SDDC Manager's /var/log/vcf/domainmanager/domainmanager.log.

    Example:

    2026-02-02T20:36:08.507+0000 INFO  [vcf_dm,69810ab878823e334f223275a5a59b60,afa7] [c.v.v.l.a.a.ActivityLoggingInterceptor,http-nio-127.0.0.1-7200-exec-3]  {"username":null,"timestamp":"2026-02-        02T20:36:08.507Z","clientIP":"127.0.0.1","userAgent":"Apache-HttpClient/5.3.1 (Java/17.0.16)","api":"/domainmanager/workflows/<execution_ID>","httpMethod":"GET","httpStatus":200,"operation":"Get a workflow with a specific UUID","remoteIP":"127.0.0.1","duration":87}
    2026-02-02T20:37:09.497+0000 INFO  [vcf_dm,69810af555033fbde90ff865ae8415a9,cebc] [c.v.v.l.a.a.ActivityLoggingInterceptor,http-nio-127.0.0.1-7200-exec-8] {"username":null,"timestamp":"2026-02-02T20:37:09.497Z","clientIP":"127.0.0.1","userAgent":"Apache-HttpClient/5.3.1 
    (Java/17.0.16)","api":"/domainmanager/workflows/<execution_ID>","httpMethod":"GET","httpStatus":200,"operation":"Get a workflow with a specific UUID","remoteIP":"127.0.0.1","duration":77}
    2026-02-02T20:37:52.434+0000 ERROR [vcf_dm,69810a30403e01d677399c6c2cfeb1a9,7602] [c.v.e.s.o.model.error.ErrorFactory,dm-exec-8]  [T8320E] NSXT_INSTALL_IMAGE_VALIDATION_FAILED NSX install image validation failed for NSX Version - 9.0.2.0.25150386
    com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: NSX install image validation failed for NSX Version - 9.0.2.0.25150386
            at com.vmware.vcf.clustermanager.fsm.actions.ValidateNsxtInstallImage.execute(ValidateNsxtInstallImage.java:105)
            at com.vmware.vcf.clustermanager.fsm.actions.ValidateNsxtInstallImage.execute(ValidateNsxtInstallImage.java:38)
            at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionState.invoke(FsmActionState.java:66)      

  3. Enable domainmanager vault access and cycle the domainmanager service. 

    echo vcf.vault.http-access=true >> /etc/vmware/vcf/domainmanager/application.properties && systemctl restart domainmanager

  4. Run the following command to dump the workflow json.

    curl -X GET http://localhost/domainmanager/internal/vault/<execution ID identified from domainmanager.log> | json_pp > /tmp/workflow.json

    Sample:

    curl -X GET http://localhost/domainmanager/internal/vault/86ba####-####-####-####-########5eb7 | json_pp > /tmp/workflow.json

  5. Edit /tmp/workflow.json file and edit the line,"initSddcGreenfield____1__addViWithPolicyNsxt____4__NsxtAddViHeader____8__vcfCompliantNsxtVersion"

    vi /tmp/workflow.json

    Example for 9.0.1

    "initSddcGreenfield____1__addViWithPolicyNsxt____4__NsxtAddViHeader____8__vcfCompliantNsxtVersion" : "9.0.1.0.24952111",

  6. Update the modified workflow.json in VCF Installer

    curl -H 'Content-Type:text/plain' -X PUT http://localhost/domainmanager/internal/vault/86ba####-####-####-####-########5eb7 -d @/tmp/workflow.json

  7. Retry the failed run from the VCF Installer UI

    POST SUCCESSFUL DEPLOYMENT

  8. SSH into the SDDC manager appliance with vcf user and then elevate to root with su.

  9. Truncate the manifest file to remove the custom manifest file. 

    psql -h localhost -U postgres -d lcm -c "truncate manifest"

Attachments

vcfManifestNew900.json get_app
vcfManifestNew901.json get_app
fix_manifest.sh get_app
Powered by Wolken Software