The Wavefront Data ingestion rate chart shows a brief gap in reporting.

Products

• Wavefront by VMware

Issue/Introduction

Symptoms:
The data ingestion rate chart on the Wavefront system usage dashboard shows a broken dotted line for the ~collector.*points.reported metric. The duration typically lasts for approximately 2 to 5 minutes.

Resolution

The `~collector.points.*` metrics are synthetic counter metrics provided by Wavefront to monitor the ingestion rate. 
Should the collector points rate stop reporting for a period of 2 to 5 minutes, then resume reporting at the previous rate, this indicates that there was a failover to another mirror.

It is expected behavior to see the `~collector.points.*` metric reporting gap when there is a failover to another mirror.

Additional Information

These failover events can be manually triggered by the operations team during routine maintenance or upgrades to the cluster. Wavefront also has built in logic that detects the optimal healthy mirror based on many infrastructure metrics and switches the cluster to the most healthy mirror when necessary.

Impact/Risks:
There is no data loss or blocked ingestion, and no impact to the performance of the Wavefront cluster during this time. The break in reporting is merely due to an internal metrics aggregator feature that aggregates the data points across all collectors.