SDDC - Unable to update NSX,vCenter or ESXi in one workload domain
search cancel

SDDC - Unable to update NSX,vCenter or ESXi in one workload domain

book

Article ID: 400590

calendar_today

Updated On:

Products

VMware SDDC Manager / VCF Installer

Issue/Introduction

  • During Plan Patching - Error: 
    "Saving domain target version failed. Validation failures occurred while trying to save the target version: Domain WLD1 or some of its components are not in active state"
  • /var/log/vmware/sddc-support/lcm/lcm-debug.log

    MM-DD-YYYY HH:MM:SS [DEBUG]: NSX_T_MANAGER Upgrade Bundle identified: {'id': 'xxxxxxxx-xxxxxxx-xxxxxx-xxxxxx', 'downloadStatus': 'PENDING', 'toVersion': '4.2.3.0.0-24866349', 'fromVersion': '4.2.1.0.0-24304122', 'component': 'NSX_T_MANAGER'}

    MM-DD-YYYY HH:MM:SS [INFO]: Starting bundle availability logic

    MM-DD-YYYY HH:MM:SS [INFO]: Printing Current Versions Detected.

    MM-DD-YYYY HH:MM:SS [INFO]: Checking Status of Products

    MM-DD-YYYY HH:MM:SS [DEBUG]: Component NSX_T_MANAGER has status ERROR

    MM-DD-YYYY HH:MM:SS [DEBUG]: Component VCENTER has status ACTIVE

    MM-DD-YYYY HH:MM:SS [DEBUG]: Component ESX_HOST has status ACTIVE

 

Environment

SDDC 5.2.x

Cause

1. Host entry in "ERROR" status:  

  /usr/pgsql/13/bin/psql -U postgres -h localhost -d platform

  select id, name, status from host where status != 'ACTIVE';

   id                                   name                                            status

│ #########-######### │ ####-esx##.####.###     │ ###.##.##.#### │ 8.0.3-24674464 │ ERROR  │ f      │ ###.##.##.#### │ \N

2. NSX-T entry is in "ERROR" status in the SDDC database

   platform=# select id, status from nsxt where status != 'ACTIVE';

idStatus 
xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxxERROR

Resolution

 
  • Take snapshot for SDDC Manager
  • connect to ssh session of SDDC with root account
  • connect to database with below command
    • psql -h localhost -U postgres -d platform

  • validate the ID which is in error state
    • select id, status from host where status!='ACTIVE';
    • select id, status from nsxt where status!='ACTIVE';
  • Update the status to ACTIVE
    • UPDATE host set status = 'ACTIVE' where id = '<Host-ID>'; 
    • UPDATE nsxt SET status='ACTIVE' where id='xxxx-xxxx-xxxx-xxxx';
    • \q
  • Validate the nsx patching without any errors