MGMT services fail predictably, restarting mgmt agents only return it for a moment if at all.

Products

• VMware vSphere ESXi

Issue/Introduction

Host goes "Not Responding" and unable to successfully launch Host UI, even after restarting Management agents.

Environment

VCSA 8.x

ESXi 8.x

vSphere Replication 8.x

Cause

As documented in KBs:

ESXI Hosts enters "not responding" state after adding it to vCenter

vSphere Replication sending large number of HTTPS requests to envoy proxy causing hostd to crash

YYYY-MM-DDThh:mm:ss.yyyZ In(166) envoy[2575675]: "YYYY-MM-DDThh:mm:ss.zzzZ warning envoy[2576079] [Originator@6876 sub=filter] [Tags: "ConnectionId":"4418"] remote https connections exceed max allowed: 128"

YYYY-MM-DDThh:mm:ss.yyyZ In(166) envoy[2575675]: "YYYY-MM-DDThh:mm:ss.zzzZ warning envoy[2576079] [Originator@6876 sub=filter] [Tags: "ConnectionId":"4418"] closing connection TCP<111.222.333.444:54260, 111.222.333.555:443>"

YYYY-MM-DDThh:mm:ss.yyyZ In(166) envoy[2575675]: "YYYY-MM-DDThh:mm:ss.zzzZ info envoy[2576079] [Originator@6876 sub=connection] [Tags: "ConnectionId":"4418"] remote address:111.222.333.444:54260,TLS_error:|268435588:SSL routines:OPENSSL_internal:CLIENTHE>

YYYY-MM-DDThh:mm:ss.yyyZ In(166) envoy[2575675]: "YYYY-MM-DDThh:mm:ss.zzzZ warning envoy[2576079] [Originator@6876 sub=filter] [Tags: "ConnectionId":"4419"] remote https connections exceed max allowed: 128"

 

Resolution

This issue has been fixed in vSphere Replication 9.0.1 | 25 JUN 2024 | Build 24037980 | Download

This can be verified by temporarily stopping the hms service on the vSphere Replication appliance.

Follow the workarounds listed in the above KBs, or upgrade the vSphere Replication appliance as noted.