nsxcli -c get managersWed Sep 24 2025 UTC 03:05:44.948- 10.#.#.21 Standby (NSX-RPC)- 10.#.#.22 Standby (NSX-RPC)- 10.#.#.23 Standby (NSX-RPC) *
nsxcli -c get controllersWed Sep 24 2025 UTC 03:05:55.941 Controller IP Port SSL Status Is Physical Master Session State Controller FQDN Failure Reason 10.#.#.23 1235 enabled disconnected true down NA NA 10.#.#.22 1235 enabled not used false null NA NA 10.#.#.21 1235 enabled not used false null NA NA
ESXI Host logs:
var/run/log/nsx-syslog.log
2025-09-24T02:46:40.770Z Wa(180) nsx-proxy[2101991]: NSX 21####1 - [nsx@6876 comp="nsx-esx" subcomp="nsx-proxy" s2comp="nsx-net" tid="2102015" level="WARNING"] Certificate validation: couldn't find SHA256 digest 'ddec1##########6e6fb43d############5d4' in local trust store2025-09-24T02:46:40.770Z Er(179) nsx-proxy[2101991]: NSX 21####1 - [nsx@6876 comp="nsx-esx" subcomp="nsx-proxy" s2comp="nsx-net" tid="2102015" level="ERROR" errorCode="NET1111"] Certificate validation failed: 18-self signed certificate
2025-09-24T02:46:40.017Z In(182) nsx-opsagent[2102367]: NSX 21###67 - [nsx@6876 comp="nsx-esx" subcomp="mpa-client" tid="21###30" level="INFO"] [AlarmsProvider] MsgHandler : Invalid stub for Master APH2025-09-24T02:46:40.017Z In(182) nsx-opsagent[2102367]: NSX 21###67 - [nsx@6876 comp="nsx-esx" subcomp="mpa-client" tid="21###30" level="INFO"] [AlarmsProvider] SendRequest: Failed to send msg Master APH, Publish, type (com.vmware.nsx.monitoring.CollectorMpMsg), correlationId (), trackingIdStr (624####-####-####-3fa3-########a1e0), ret (-1)
NSX Manager logs:
/var/log# less syslog
2025-09-24T02:50:00.327Z Manager01 NSX 99086 SYSTEM [nsx@6876 comp="nsx-manager" level="WARNING" subcomp="manager"] getStub: client 3ebe####-####-####-####-####da43afc5, application HealthCheck, java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException: Channel ClientChannel(vmware.nsx.healthcheck.HealthCheckHostService, 277a####-####-####-####-####df349f77) is closed before stream was opened due to Status(code=UNKNOWN, msg=Closed by remote service)2025-09-24T02:50:00.327Z Manager01 NSX 99086 MONITORING [nsx@6876 comp="nsx-manager" errorCode="MP150008" level="ERROR" subcomp="manager"] Error in sending requestMsg to transportNode:3ebe####-####-####-####-####da43afc5, requestId(roundId): left: 6053##########91230#012right: 125##########6217085#012, errInfo:Unable to reach client 3ebe####-####-####-####-####da43afc5, application HealthCheck
VMware NSX
Certificate Validation between the Transport Node and Managers failed due to Expired Certificates
1.Check the certificate host-cert.pem.
#cd /etc/vmware/nsx/
#ls
Sample output:
appliance-info.xml host-cert.pem host-privkey.pem netopa.xml openssl-proxy.cnf
controller-info.xml host-cfg.xml mpa-txn nsx-proxy.xml
2.Copy the original file to backup
cp host-cert.pem host-cert.pem.bak
3.Delete the original pem file.
#rm host-cert.pem
4. Restart proxy service - this should recreate new host-cert.pem file.
# /etc/init.d/nsx-proxy restart
5.verify the new pem file and check the validity
Host# openssl x509 -startdate -enddate -noout -in /etc/vmware/nsx/host-cert.pem
6. Do a manual resync of certificates using below commands for all three manager nodes (OR refer work around in KB: 389595)
push host-certificate <manager-IP-FQDN> username <username> thumbprint <cert-api-thumbprint-of-manager> password <password>
sync-aph-certificates <manager-IP-FQDN> username <username> thumbprint <cert-api-thumbprint-of-manager> password <password>
7. Check the Transport Nodes status in the NSX UI