VMware Aria Operations for Networks Databus streaming data is not sent to endpoints
search cancel

VMware Aria Operations for Networks Databus streaming data is not sent to endpoints

book

Article ID: 387335

calendar_today

Updated On:

Products

VMware Aria Operations for Networks

Issue/Introduction

VMware Aria Operations for Networks Databus streaming data is not sent to endpoints.

Users will see no streaming data from databus is sent to the subscriber endpoint

In platform node logs located at location var/log/arkin/restapilayer/latest.log below warnings can been seen:

 

2025-01-01T04:09:47.157Z INFO consumer.internals.AbstractCoordinator idle-consumer-heartbeat-exec-6 joinGroupIfNeeded:455 [Consumer clientId=sse-bulk-event-reader, groupId=##08b9c-###5e-43f7-8c96-####b694c7a] Join group failed with org.apache.kafka.common.errors.MemberIdRequiredException: The group member needs to have a valid member id before actually entering a consumer group
2025-01-01T04:09:47.158Z INFO consumer.internals.AbstractCoordinator idle-consumer-heartbeat-exec-6 sendJoinGroupRequest:552 [Consumer clientId=sse-bulk-event-reader, groupId=##08b9c-###5e-43f7-8c96-####b694c7a] (Re-)joining group

2025-01-01T04:09:49.435Z INFO vnera.restapilayer.SubscriptionV2Processor subscription-v2-processor-timer acquireLease:1628 Trying to acquire lease. programId=####e5508-cecf-####-8634-####36c815ac, leaseKey=SubscriptionProcessorV2
2025-01-01T04:09:49.441Z WARN vnera.restapilayer.IpDomainWatcher subscription-processor-timer acquireLease:133 Failed trying to acquire lease. programId=ce65####-18d2-####-b2f6-#####a3f3677, leaseKey=com.vnera.restapilayer.IpDomainWatcher

2025-01-01T04:09:49.445Z WARN vnera.restapilayer.SubscriptionV2Processor subscription-v2-processor-timer acquireLease:1632 Failed trying to acquire lease. programId=####e5508-cecf-####-8634-####36c815ac, leaseKey=SubscriptionProcessorV2
2025-01-01T04:09:49.446Z INFO vnera.restapilayer.SubscriptionV2Processor_1 subscription-v2-processor-timer run:1662 Skipping as lease in not acquired SubscriptionProcessorV2 bd0e###-cecf-###-8634-e5bd36c#####

2025-01-01T04:09:49.473Z INFO intent.sdwan.LinkMeteringThresholdEvaluator link-metering-threshold-evaluator acquireLease:267 Trying to acquire lease. programId=###c09-135b-42b1-b8ef-#####45efa1a, leaseKey=LinkMeteringThresholdEvaluator
2025-01-01T04:09:49.481Z WARN intent.sdwan.LinkMeteringThresholdEvaluator link-metering-threshold-evaluator acquireLease:271 Failed trying to acquire lease. programId=###c09-135b-42b1-b8ef-#####45efa1a, leaseKey=LinkMeteringThresholdEvaluator
2025-01-01T04:09:49.481Z INFO intent.sdwan.LinkMeteringThresholdEvaluator_1 link-metering-threshold-evaluator run:148 Skipping as lease in not acquired LinkMeteringThresholdEvaluator ###c09-135b-42b1-b8ef-#####45efa1a

Environment

VMware vRealize Network Insight 6.9
Aria Operations for Networks 6.10.0
Aria Operations for Networks 6.11.0
Aria Operations for Networks 6.12.0
Aria Operations for Networks 6.12.1
Aria Operations for Networks 6.13.0
Aria Operations for Networks 6.14.0

Cause


The coordinator is not aware of this member and typically occurs in Kafka when a consumer fails to join or rejoin a consumer group due to an issue with rebalancing.

This often happens when a consumer subscription either gets disconnected or is unable to join the group due to a change in the group membership or an ongoing rebalance.

Resolution

If we see above errors then below can be performed :

1. The Databus service which is a Kafka consumer needs to restart. See commands below:

./run_all.sh sudo systemctl stop databus-gateway.service 

./run_all.sh sudo systemctl start databus-gateway.service

2. Post restarting this service. It would join the consumer group freshly and starts reading.

3. If restarts doesn't solve the problem then the only option available it to delete the databus subscription, restart the Data bus service and then create subscription again.

  1. To delete databus subscriber refer to below API 
    https://developer.broadcom.com/xapis/vmware-aria-operations-for-networks-api/6.14.0/api/ni/settings/databus/subscribers/subscriptionId/delete/index

  2. To restart databus see commands under Step1 above.

  3. To Create databus subscriber refer to below API 
    https://developer.broadcom.com/xapis/vmware-aria-operations-for-networks-api/6.14.0/api/ni/settings/databus/subscribers/post/index

 

 

Powered by Wolken Software