Aria Operations 8.x Cluster fails to start with the status "Waiting for Analytics".

Products

• VMware Aria Suite

Issue/Introduction

Symptoms:

After performing a disaster recovery operations or a cluster-wide reboot of vRealize Operations, you see these symptoms:

 

• Aria Operations Administrator interface (https://<Aria_Operations_FQDN/IP_Address>/admin) may report the status message:
  
  Waiting for Analytics
   
• Aria Operations Administrator interface (https://<Aria_Operations_FQDN/IP_Address>/admin) displays that nodes are not coming online:
   
• In the Aria Operations Primary or Primary Replica node's ntp logs (located at: /var/log/), you may observe:
  
  ntpd[9764]: no reply; clock not set
  ntpd[9798]: ntpd exiting on signal 15
   
• In the Aria Operations Primary or Primary Replica node's analytics-wrapper.log (located at: /storage/log/vcops/logs/), you may observe:
  
  INFO | jvm 1 | YYYY/MM/DD <time> | >>> AnalyticsMain.run failed with error: IllegalStateException: time difference between servers is 37110 ms. It is greater than 30000 ms. Unable to operate, terminating...
  
  </time>

Note: The time difference between servers will be unique to the time drift between the Aria Operation nodes.

Environment

Aria Operations 8.x
vRealize Operations 8.x

Cause

This issue occurs due to NTP time drift between the Aria Operations 8.x nodes.

Resolution

1. Ensure all NTP servers configured for use with the Aria Operations nodes (Analytics and Cloud Proxies) are accessible.
2. Update the ntp.conf file (located in /etc/) with new NTP server(s) in each Aria Operations node if the original NTP servers are no longer available.

 

Additional Information

For more information, consult Configure NTP on Aria Operations Appliances.