Unable to activate Application Monitoring High Availability (HA) - Timeout Error

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

When trying to activate Application Monitoring HA, the process failed with the following Error:  "Failed to activate due to timeout"

Because of this failure, the Cloud Proxy objects also cannot be removed from the Cloud Proxy Collector Group.


The following exception can be seen in the casa log of the Primary node.

Log path: /storage/vcops/log/casa/casa.log 

Exception:
####-##-##T##:##:## WARN [exec-18]casa.exception.CasaControllerExceptionHandler:273 - general runtime exception
java.util.ConcurrentModificationException: null
at java.util.HashMap.computeIfAbsent(Unknown Source) ~[?:?]
at com.vmware.vcops.casa.messaging.Messages.popMessage(Messages.java:47) ~[classes/:?]
at com.vmware.vcops.casa.messaging.HttpMessagingService.popMessagesForRecipient(HttpMessagingService.java:112) ~[classes/:?]
at com.vmware.vcops.casa.messaging.HttpMessagingController.getMessages(HttpMessagingController.java:61) ~[classes/:?]
at com.vmware.vcops.casa.messaging.HttpMessagingController$$FastClassBySpringCGLIB$$25f04c02.invoke(<generated>) ~[classes/:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.26.jar:5.3.26]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) ~[spring-aop-5.3.26.jar:5.3.26]

Environment

Aria Operations 8.16

Aria Operations 8.17

Cause

Aria Operations cluster CASA was not able to send the task to the Cloud Proxy CASA.  

 

Resolution

• SSH into the Primary node.
• Restart the CASA service with the following command:
  • systemctl vmware-casa restart
• Once the casa service was restarted, the Application Monitoring HA is successfully activated.