Error during sendForwardData: Timed out attempting to update an entry in the partitioned region. Partitioned Region name = /FORWARD_DATA_REGION

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

This article describes the resolution for the FORWARD_DATA_REGION timed out error in Aria Operations logs, which causes data collection failures and system instability.

Symptoms:

• Data collection stops despite active adapters.
• Logs in /storage/log/vcops/log/analytics-*.log show "Error during sendForwardData: Timed out attempting to update an entry in the partitioned region.  Partitioned Region name = /FORWARD_DATA_REGION"
• Aria Operations cluster appears online, but objects and metrics do not progress.

Environment

• VMware Aria Operations 8.x

Cause

One or more nodes are not responding properly within the clustered Gemfire communication between collectors and analytics nodes.  This may be due to issues with the ESXi host on which the nodes are running.

Resolution

To resolve this issue, perform the following steps:

1. Bring the Aria Operations cluster offline.
2. Ensure all data nodes are on stable ESXi hosts
3. Bring the cluster back online.
4. Monitor analytics logs for re-occurrence.

For assistance with cluster sizing or persistent performance issues, Contact Broadcom Support (https://knowledge.broadcom.com/external/article/206567/contact-broadcom-support.html)

Additional Information

To be updated on potential product defect fixes, subscribe to this article (https://knowledge.broadcom.com/external/article/275360)