After NSX upgrade Manager logs spammed with FILE_INTEGRITY_CHECK_FAILED

Products

• VMware NSX Networking
• VMware NSX

Issue/Introduction

• After NSX upgrade /var/log/syslog on the Manager is spammed with file integrity logs similar to this example
  
  <DATE>T11:01:00.962Z <HOSTNAME> NSX 1522474 - [nsx@6876 comp="nsx-manager" subcomp="integrity-checker" username="root" level="WARNING"] [FILE_INTEGRITY_CHECK_FAILED] Reason : REGULAR FILE DELETED, Name : "/opt/vmware/nsx-ui-service-old/policy-ui/default-app-alb-onprem-profiles-health-monitor-profiles-health-monitor-profiles-module-app-alb-onpre-####-########.js"
• No issue is observed except excessive logging

Environment

VMware NSX-T 3.x
VMware NSX 4.2.x

Cause

Files in the directory /opt/vmware/nsx-ui-service-old may change or be removed during upgrade, this directory should not be monitored by the File Integrity checker.

Resolution

This is a known issue impacting VMware NSX.

File integrity checker compares files on the system to its known baseline.
To workaround this issue, a new baseline can be created.

Please run the following commands on all 3 Managers:

1. ssh as root user to the NSX Manager appliance
2. Create the new baseline (it may take some time):

   # /opt/vmware/integrity-checker/bin/integrity_checker.py -f baseline

3. Manually run the integrity checker to confirm the logging has stopped 

   # /opt/vmware/integrity-checker/bin/integrity_checker.py -f check   
   # tail -f /var/log/vmware/integrity_checker.log - it will show 'Status : OK' (last line)