Aria Operations triggered an alert regarding file space used on an NSX Manager node: "File Systems|/|Used - Management Node - File System usage of manager node is more than 70 percent"
search cancel

Aria Operations triggered an alert regarding file space used on an NSX Manager node: "File Systems|/|Used - Management Node - File System usage of manager node is more than 70 percent"

book

Article ID: 396906

calendar_today

Updated On:

Products

VMware NSX

Issue/Introduction

There are no filesystem or space usage alarms present in NSX Manager but Aria Operations is configured and is alerting about 70% usage. 

Refer to the Aria Operations documentation about its default NSX-related alerts at Alerts in NSX, which has out-of-the-box alerts for NSX file system usage at 70, 75, and 85 percent.

If there are no similar alerts in NSX Manager, then in most cases there isn't actually any underlying issue that needs addressing and the threshold to trigger the 70% alert in Aria Operations may just need to be adjusted higher. There are some things to be aware of when assessing the situation:

  • On the NSX Manager appliance, the "/" partition is what's generally mentioned in the alerts, but a lot of what is still below "/" is mapped to separate areas for storing logs, upgrade packages, log bundles, and so forth. Note, for example, how in the below screenshot from a lab environment (usage lower than normal for production), the /dev/sda2 filesystem mounted to "/" is 11G total where there are various partitions like /var/log with significantly more total space.
  • Though it may be the case that an alarm is referring to hitting 70% of the 11G available in "/", a similar alarm may also be present when the usage refers to /var/log or another filesystem that isn't consuming "/" space. 

Environment

VMware NSX
VMware NSX-T Data Center

Cause

The 70% filesystem usage threshold to trigger an alert in Aria Operations is lower than the common 80% usage alert level for NSX Manager nodes. It is not uncommon for NSX Manager appliances to have the "/" (/dev/sda2) filesystem exceed 70% even when the NSX Manager is functioning normally and performing standard log rotation functions. 

Resolution

Check for any abnormalities in NSX Manager to ensure that space is available. If NSX Manager is running normally and there are no alarms in NSX related to diskspace or filesystem usage, then all that should need to be done is to raise the alarm threshold in Aria Operations to 80%. 

If filesystem usage appears to be too high or growing too quickly and a case will be opened with Broadcom NSX Support for analysis/troubleshooting, please collect the following to provide on the case:

  • NSX Manager log bundles
  • Text of any error messages seen in NSX GUI or command lines pertinent to the investigation

 

Additional Information

Powered by Wolken Software