HCX Bulk VM Migration fails with error “InterconnectServiceConfigJob failed.”
search cancel

HCX Bulk VM Migration fails with error “InterconnectServiceConfigJob failed.”

book

Article ID: 415563

calendar_today

Updated On:

Products

VMware HCX

Issue/Introduction

  • Bulk migration of virtual machines failed with the error "InterconnectServiceConfigJob failed." 
  • Checked the /common/logs/admin/app.log
    2025-10-16 04:40:33.500 UTC [InterconnectService_SvcThread-46273, SM:servicemesh-####, IX:####-####-####-####-####, J:a7f0dabc, , TxId: TxId: d94141d1-f7e3-458e-a005-f3d2ae6e3431] WARN  c.v.v.h.s.i.GenerateAndPostConfiguration- Failed to post the config using VIX for the appliance ####. Retrying the operation.
    java.lang.RuntimeException: Failed to upload file to guest @ /tmp/newConfig.proto for vm ###### due to InvalidState/TaskInProgress fault.
            at com.vmware.vchs.hybridity.adapters.vcenter.GuestOperationsFacet.uploadFile(GuestOperationsFacet.java:500)
            at com.vmware.vchs.hybridity.service.interconnect.GenerateAndPostConfiguration.publishConfigViaVIX(GenerateAndPostConfiguration.java:530)
            at com.vmware.vchs.hybridity.service.interconnect.GenerateAndPostConfiguration.doPostConfigVIX(GenerateAndPostConfiguration.java:400)
            at com.vmware.vchs.hybridity.service.interconnect.GenerateAndPostConfiguration.handleState(GenerateAndPostConfiguration.java:174)
            at com.vmware.vchs.hybridity.service.interconnect.AbstractInterconnectJob.run(AbstractInterconnectJob.java:217)
            at com.vmware.vchs.hybridity.messaging.LoggingJobWrapper.run(LoggingJobWrapper.java:41)
            at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
            at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
            at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
            at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
            at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
            at java.base/java.lang.Thread.run(Thread.java:829)
  • Affected appliance status is reported as "CONFIGURATION_FAILED"
    2025-10-16 04:40:33.485 UTC [InterconnectService_SvcThread-46273, SM:servicemesh-####-####-####-####-####, IX:####-####-####-####-####, J:a7f0dabc, , TxId: TxId: d94141d1-f7e3-458e-a005-f3d2ae6e3431] INFO  AbstractInterconnectJob- updateAppliance - appliance id ####-####-####-####-#### data {"cmpId":"####-####-####-####-####","moref":"vm-#####","c
    onfig":{"cert":"-----BEGIN "applianceName":"SM-########IX-IX-R1","applianceType":"HCX-WAN-IX","serviceMeshId":"servicemesh-####-####-####-####-####","cpuReservation":0,"peerAppliances":["####-####-####-####-####"],

    "applianceStatus":{"state":"CONFIGURATION_FAILED","detailedMessage":"Failed applying appliance configuration. Reason: Failed to upload file to guest @ /tmp/newConfig.proto for vm SM-########IX-IX-R1 due to InvalidState/TaskInProgress fault."},"applianceVersion":{"build":24449347,"major":4,"minor":11,"patch":0,"revision":"0"},"computeProfileId":"####-####-####-####-####","memoryReservation":0,"uplinkProfileDetails":[{"ip":["##.##.##.##"],"tags":["management","replication","uplink"],"uplinkProfileId":"network-####-####-####-####-####","uplinkProfileName":"########"}]}

Environment

VMware HCX

Cause

This issue can be caused by various reasons. One of the probable causes is a connectivity issue between the HCX Manager and IX appliance.

Resolution

If you encounter this issue, contact Broadcom Support: Broadcom Support Portal

Please upload the following information while raising the SR

  1. HCX manager logs along with database. (source and destination)
  2. IX logs (source and destination)