HCX: Bulk Migration failure with Error "Storage not accessible error observed"

Products

• VMware HCX

Issue/Introduction

• HCX Bulk or RAV migration fails with the following error in the HCX migration UI: "Storage not accessible error observed"

• The following events are observed in /common/logs/admin/app.log


2024-02-11 15:39:20.751 UTC [InterconnectService_SvcThread-7, Ent: HybridityAdmin, , TxId: ########-####-####-####-############] ERROR c.v.v.h.s.i.ThumbprintExchanger- ThumbprintExchanger Job: (########-####-####-####-############) encountered error
org.codehaus.jettison.json.JSONException: JSONObject["networks"] not found. 
        at org.codehaus.jettison.json.JSONObject.get(JSONObject.java:369)
        at org.codehaus.jettison.json.JSONObject.getJSONArray(JSONObject.java:445)

• The target IX appliance HBR logs, located in /var/log/vmware/hbrsrv.log, display the following events:

2024-02-11T18:08:17.401Z info hbrsrv[06299] [Originator@6876 sub=Main groupID=VRID-#######-####-###### opID=###-########]    [1] Code set to: Storage was not accessible.

 

Cause

This issue happens due to partial cleanup of service mesh or service mesh fleet appliances which results in stale entries of fleet appliances.

Resolution

This issue is resolved in VMware HCX 4.9.0 or later versions, available at Broadcom downloads.
If you are having difficulty finding and downloading software, please review the Download Broadcom products and software KB.

Additional Information

Impact/Risks:

• The HCX Bulk or RAV forward migrations will fail.
• There is no impact to HCX Bulk or RAV reverse migration.
• There is no impact to HCX vMotion migrations.
• There is no impact to workload VM datapath connectivity via network extension.