VIP for Aria Operations for Logs is in Unavailable status.
search cancel

VIP for Aria Operations for Logs is in Unavailable status.

book

Article ID: 398042

calendar_today

Updated On:

Products

VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

  • Integrated Load Balancer VIP for Aria Operations for Logs is in 'Unavailable' state.                                                                                                               
  • Below are the errors that are seen in /storage/core/loginsight/var/runtime.log:
    [YYYY-MM-DD 11:02:46.274+0000] ["Indexer-5-Commit-Timer"/##.##.##.## INFO] [com.vmware.loginsight.indexing.Indexer] [Added 25 messages to index. Bucket #####-####-####]
    [YYYY-MM-DD 11:02:46.466+0000] ["LoadBalancerStateUpdaterScheduler-thread-1"/##.##.##.## INFO] [com.vmware.loginsight.election.cassandra.PullBasedLeaderElection] [Group has no leader, attempt to become leader, Group: LoadBalancer, ParticipantId: #####-####-####]
    [YYYY-MM-DD 11:02:46.468+0000] ["LoadBalancerStateUpdaterScheduler-thread-1"/##.##.##.## INFO] [com.vmware.loginsight.election.cassandra.PullBasedLeaderElection] [Failed to acquire leadership, perhaps another became the leader meanwhile, Group: LoadBalancer, ParticipantId: #####-####-####]
    [YYYY-MM-DD 11:02:46.964+0000] ["Catalina-utility-2"/##.##.##.## INFO] [com.vmware.loginsight.cassandra.CassandraDSL] [Table scan: select session_id from tomcat_sessions limit 1000000]
    [YYYY-MM-DD 11:02:47.470+0000] ["LoadBalancerStateUpdaterScheduler-thread-2"/##.##.##.## INFO] [com.vmware.loginsight.election.cassandra.PullBasedLeaderElection] [Group has no leader, attempt to become leader, Group: LoadBalancer, ParticipantId: #####-####-####]
    [YYYY-MM-DD 11:02:47.472+0000] ["LoadBalancerStateUpdaterScheduler-thread-2"/##.##.##.## INFO] [com.vmware.loginsight.election.cassandra.PullBasedLeaderElection] [Failed to acquire leadership, perhaps another became the leader meanwhile, Group: LoadBalancer, ParticipantId: #####-####-####]

Environment

Aria Operations for Logs 8.18.3

Cause

  • If the NTP server is unavailable for an extended period, this can cause a time drift of several seconds and the cluster to become unstable.
  • Aria Operations for Logs nodes will not be able to elect a leader which causes the configuration of VIP to fail

Resolution

We need to clear up the leaders table and manually set node as leader.

  1. This requires Database modifications on the nodes.
  2. To proceed further, please raise a Support ticket with Broadcom and mention the KB article: 398042 in the description of the SR.