This document is created as a reference to identify and remediate a known issue with VMware HCX Connector or Cloud Manager after reverting a VM snapshot, which is the recommended procedure in the unlikely event that an upgrade fails.
Symptoms:
Reverting a VM snapshot of an HCX Connector or Cloud Manager may cause the system to go out of sync with HCX Service. Any attempt to upgrade the systems will hang.
The exceptions below can be seen frequently in the app-engine logs:
2021-11-13 03:26:09.660 UTC [RemotingService_SvcThread-84, Ent: HybridityAdmin, , TxId: d383cb8c-acae-####-####-########02a] INFO c.v.vchs.hybridity.messaging.JobDao- job df037f3c-714c-####-####-########564 not found or no permission to access it 2021-11-13 03:26:09.663 UTC [RemotingService_SvcThread-84, Ent: HybridityAdmin, , TxId: d383cb8c-acae-####-####-########02a] WARN c.v.vchs.hybridity.messaging.Job- Unable to fill job from JSON {}:{"rowCount":0,"rows":[]} org.codehaus.jettison.json.JSONException: JSONObject["enterprise"] not found. at org.codehaus.jettison.json.JSONObject.get(JSONObject.java:369) at org.codehaus.jettison.json.JSONObject.getString(JSONObject.java:496) at com.vmware.vchs.hybridity.messaging.Job.ctxFromJson(Job.java:677) at com.vmware.vchs.hybridity.messaging.Job.fillJobFromJSON(Job.java:490)