GemFire: Automating the Rebalance of Partitioned Regions

Products

• VMware Tanzu Gemfire

Issue/Introduction

How can I avoid having to worry about whether my Partitioned Region data is balanced across the various cache servers? It seems when I am imbalanced, more issues occur which destabilize the distributed system.

Environment

Product Version: Any
OS: Any

Resolution

We have a feature in Gemfire to automate the rebalance process. This can be especially useful when using many session type regions that come and go.   

Our documentation describes this in more detail so this KB article aims to highlight the related documentation:
 

• https://techdocs.broadcom.com/us/en/vmware-tanzu/data-solutions/tanzu-gemfire/10-2/gf/developing-partitioned_regions-automated_rebalance.html

You can configure how frequently to run a rebalance and, using that schedule, you can determine if a rebalance is necessary or not based on if the data is already relatively balanced when using the configured criteria.

This is certainly worth considering to keep the data within Gemfire balanced, thus preventing many issues that can occur with load and resource exhaustion if all clients are attempting to access some subset of the servers due to any data imbalance.

Another technique that requires more consideration is to determine whether it would make more sense to balance all of your partitioned regions by bucket count versus data size. Please read the related KB article below to determine which options may work best for your use case:
 

• https://knowledge.broadcom.com/external/article/294439/how-to-rebalance-your-partitioned-region.html