High Volume of Warnings/Errors for Alert Evaluations

Products

• VMware Tanzu Platform - Hub

Issue/Introduction

A high volume of warnings and errors related to alert evaluation is observed in the logs. The system attempts to process alerts for policies that either no longer exist or are inaccessible, resulting in thousands of log entries that can obscure other critical system health signals and potentially impact processing performance.

Examples: graphql-rest-provider-service: Hub Policy Alert Evaluation Failures

• WARN: Skipping processing - Alert evaluation failed for policyId <uuid>

  • This happens for many different policy IDs, continuously

• ERROR: Hub policy not found for id: <uuid> orgId: 69d9b5a3-... --

  • Policies are being evaluated that no longer exist in the system
  • This suggests policies are being triggered via Kafka events but the referenced policies have been deleted or are not accessible. This is a high-volume, ongoing issue.

Resolution

This will be fixed in an upcoming Tanzu Hub release.