Negative values observed in cc.requests.outstanding.gauge after enabling PUMA

Products

• VMware Tanzu Platform - Cloud Foundry

Issue/Introduction

After migrating Cloud Controller from Single-Process to Multi-Process Mode (PUMA) the customer can notice negative values on metric requests.outstanding.gauge as observed in the below screenshot.

Cause

Metric cc.requests.outstanding is deprecated, metric cc.requests.outstanding.gauge is valid but doesn't work with PUMA. The values showed by these 2 metrics are not accurate when PUMA is enabled.

Resolution

After enabling Single-Process to Multi-Process Mode (PUMA) on Cloud Controller, enable Prometheus metrics and monitor metric cc_requests_outstanding_total.