Service Mesh deployment fails with "Error: Operation timeout in state POST_CONFIG_VIX"
search cancel

Service Mesh deployment fails with "Error: Operation timeout in state POST_CONFIG_VIX"

book

Article ID: 424228

calendar_today

Updated On:

Products

VMware HCX

Issue/Introduction

  • The following error message is displayed in the HCX UI under Infrastructure > Interconnect > Service Mesh > MORE (View Tasks):
    ApplianceLifecycleJob Failed. Reason: Interconnect Service Workflow GenerateAndPostConfig failed. Error: Operation timeout in state POST_CONFIG_VIX

  • The following errors are observed in the HCX Manager log file /common/logs/admin/app.log:
    <Timestamp> [InterconnectService_SvcThread-294, Ent: HybridityAdmin, , TxId: <TxId>] ERROR c.v.v.h.a.hbr.HbrServerInstance- Error running request as communication to HBR server <IP> failed
    <Timestamp> [InterconnectService_SvcThread-294, Ent: HybridityAdmin, , TxId: <TxId>] ERROR c.v.v.h.s.i.ThumbprintExchanger- Error exchanging thumbprints for appliance from HBR Server: <UUID>
    com.vmware.vchs.hybridity.adapters.hbr.fault.HbrConnectionException: Error connecting to HBR server <IP>:8123. Reason: ConnectTimeoutException
            at com.vmware.vchs.hybridity.adapters.hbr.HbrConnection.executeRequest(HbrConnection.java:171)
            at com.vmware.vchs.hybridity.adapters.hbr.HbrSessionManager.loginBySSLThumbprint(HbrSessionManager.java:16)
            at com.vmware.vchs.hybridity.adapters.hbr.HbrServerInstance.login(HbrServerInstance.java:696)
            at com.vmware.vchs.hybridity.adapters.hbr.HbrAdapterFactory.setHbrInstance(HbrAdapterFactory.java:20)
            at com.vmware.vchs.hybridity.adapters.hbr.HbrAdapterFactory.getHbrServerInstance(HbrAdapterFactory.java:27)
            at com.vmware.vchs.hybridity.adapters.unified.hbr.UnifiedVrAdapterFactory.getHbrServerInstance(UnifiedVrAdapterFactory.java:62)
            at com.vmware.vchs.hybridity.adapters.unified.hbr.UnifiedVrAdapterFactory.setHbrInstance(UnifiedVrAdapterFactory.java:37)
            at com.vmware.vchs.hybridity.adapters.unified.hbr.UnifiedVrAdapterFactory.getUnifiedServerInstance(UnifiedVrAdapterFactory.java:50)
            at com.vmware.vchs.hybridity.service.interconnect.ThumbprintExchanger.getUnifiedVrServerInstance(ThumbprintExchanger.java:901)
            at com.vmware.vchs.hybridity.service.interconnect.ThumbprintExchanger.doExchangeThumbprint(ThumbprintExchanger.java:287)
            at com.vmware.vchs.hybridity.service.interconnect.ThumbprintExchanger.run(ThumbprintExchanger.java:87)
            at com.vmware.vchs.hybridity.messaging.LoggingJobWrapper.run(LoggingJobWrapper.java:41)
            at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
            at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
            at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
            at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
            at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
            at java.base/java.lang.Thread.run(Thread.java:829)
    <Timestamp> [InterconnectService_SvcThread-294, Ent: HybridityAdmin, , TxId: <TxId>] ERROR c.v.v.h.s.i.ThumbprintExchanger- ThumbprintExchanger Job: (<JobID>) encountered error
    java.lang.RuntimeException: ["Error connecting to HBR server <IP>:8123. Reason: ConnectTimeoutException"]
            at com.vmware.vchs.hybridity.service.interconnect.ThumbprintExchanger.doExchangeThumbprint(ThumbprintExchanger.java:319)
            at com.vmware.vchs.hybridity.service.interconnect.ThumbprintExchanger.run(ThumbprintExchanger.java:87)
            at com.vmware.vchs.hybridity.messaging.LoggingJobWrapper.run(LoggingJobWrapper.java:41)
            at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
            at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
            at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
            at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
            at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
            at java.base/java.lang.Thread.run(Thread.java:829)

Environment

VMware HCX

Cause

This issue is caused by a lack of network connectivity between the HCX Manager and the HCX-IX appliance. In the example above, the connection from the HCX Manager to the HCX-IX on TCP port 8123 is failing.

Resolution

To resolve this issue, verify the network configuration between the HCX Manager and the HCX-IX to ensure proper connectivity. Please refer to VMware Ports and Protocols for the required ports and protocols.