1 minute data is lagging behind

Products

• Network Flow Analysis

Issue/Introduction

Harvester data is falling behind.

However, no files are getting backlogged in \ReaperInput, there are no built up old files in \Harvesterwork. Deleting old *.NTA files from \Harvesterarchive and restarting the Harvester service has no effect on the delays.

What else could cause the harvester to fall behind?

Environment

NFA - 24.3.x

Cause

Debug was left turned on in the Harvester service.

Resolution

Looking at the harvester-wrapper.log file, they could see that the file was growing so fast that it was rolling over every few minutes.

They noticed debug logging was set to true probably for some previous case.

In harvester.properties :

database.ini.path=DBUsers/ReporterAnalyzer.ini

enableDebugLogging=false

enableQueryLogging=false

enableTraceLogging=false

harvester.pathlatency.enabled=false

After setting these debug values to false the lag problem resolved.