"Cloud File System xxxxxxxxxx is in critical state. This might result in downtime. Contact support. Cloud file system xxxxxxxxxx is unavailable" error on VMware Live Cyber Recovery UI

Products

• VMware Live Recovery
• VMware Cloud Flex Storage

Issue/Introduction

Symptoms:

• The below error appears on the VLCR UI console
  
  

• The VMs hosted on Flex Storage NFS datastores may get restarted.

• The cloud file system may show critical and unavailable.

Environment

VMware Live Cyber Recovery 7.27.5.0

VMware Cloud flex storage.

Cause

• The VMCFS system continuously interacts with the logging system. However, due to accessibility issues with the logging system, log uploads were incomplete, resulting in a backlog. Although the logging issue was resolved, the backend instance experienced delays during cache refresh and due to the backlog exceeding the throughput capacity of the volume storing logs and statistics. This led to system performance degradation, causing multiple services to crash and ultimately resulting in replication failures.

Resolution

• If the above symptoms and issue match, please contact Broadcom Support to investigate the issue.