Error code: LCMVSPHERECONFIG1000095 at stage 6 while upgrading VCF Automation

Products

• VCF Automation

Issue/Introduction

• When upgrading from VMware Aria Automation 8.18.1 to VCF Automation 9.0.2, the process may fail during Stage 6 in the Fleet Manager. We will see the error code LCMVSPHERECONFIG1000095: Failed to create services platform cluster in the UI.

  
  
  

• In the /var/log/vrlcm/vmsp_bootstrap_xxxxx.log on the Fleet Manager, you may observe the following error:

  >>> INIT0002 - Initializing bootstrap machine
  Loaded image: vmware/docker-registry:2.8.3
  xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
  docker: Error response from daemon: failed to set up container networking: driver failed programming external connectivity on endpoint package-registry (xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx): Unable to enable DNAT rule: (iptables failed: iptables --wait -t nat -A DOCKER -p tcp -d 0/0 --dport 5000 -j DNAT --to-destination xx.xx.xx.xx ! -i docker0: Warning: Extension DNAT revision 0 not supported, missing kernel module?
  iptables v1.8.9 (nf_tables): RULE_APPEND failed (No such file or directory): rule in chain DOCKER
  (exit status 4))

Environment

VCF Automation 9.x

Cause

The upgrade fails because the Fleet Management appliance kernel has not loaded the necessary modules required for Docker container networking (DNAT rules). Without these modules, the bootstrap machine cannot be initialized.

Resolution

To resolve this issue, you must reboot the Fleet Management appliance to ensure all kernel modules are properly loaded:

1. Take a non memory snapshot of Fleet Management appliance.

2. Reboot the Fleet Management appliance by going to Fleet Management > Lifecycle > VCF Management > Settings > Reboot system from VCF Operations UI.

3. After the appliance has restarted, log back into the VCF Operations UI using an admin account.

4. Navigate to Fleet Management > Lifecycle > VCF Management > Tasks and Retry the failed upgrade request.