Aria Automation 8.18.1 VM reconcile event is not getting triggering and VM status is Missing after vMotion.

Products

• VMware Aria Suite

Issue/Introduction

• After a Cross vCenter vMotion of VMs, Deployments resources are appearing as missing and reconcile event is not getting triggered even if event broker config maps contain the correct event types Troubleshooting Aria Automation reconciliation of vMotion migrated VM's
  
  
• vMotion across vCenter from A to B but migration status is not showing on custom properties of VM, Status of VM is Missing with vCenter A and discovered VM on new vCenter B. 

Environment

Aria Automation 8.18.1

Cause

 Load Balancing of the polling between the Aria Automation Nodes. In some cases the minimum threshold for accounts to poll can be 0 and in such a case, if an account is not doesn't get polled from other nodes, it will never be picked up.

Resolution

Issue will be fixed on Aria Automation 8.18.1 PATCH 3 

Workaround for the issue : 

The properties need to be added inside the JAVA_OPTS environment variable inside provisioning-service-app deployment in k8s, Setting these properties will stop the load balancing for 6 months. 

1. Take a snapshot or valid backup of Aria Automation Nodes.
2. Edit the Provisioning-service-app deployment with following command : 
   
   kubectl edit deployments -n prelude provisioning-service-app
   
   
3. Append the following properties Inside the JAVA_OPTS environment variables : 
   
   -Debs.connect.upstream.service.unavailability.threshold=200
-Debs.connect.node.availability.check.initialDelay=P180D
-Debs.connect.node.availability.check.interval=P180D 
   
   
4.  verify all the provisioning-service-app pods are in 1/1 running state with command :
   
   kubectl get pods -n prelude --selector=app=provisioning-service-app

Note: 
In Some Cases vSphere account lost connection with Aria Automation the polling can be interrupted and the account will have to be validated and saved, to resume the polling.

Need to apply the Workaround steps again if you apply the PATCH or Upgrade Aria Automation.