NSX upgrade precheck error NSX Edge detects pool members are DOWN

Products

• VMware NSX

Issue/Introduction

NSX upgrade precheck shows following error 

Error message

"The load balancer ####-####-###-###-#/### status is down"

 

 

Environment

VMware NSX 

Cause

Unhealthy state of pool members

Resolution

Consult the load balancer pool to determine which members are down by invoking the NSX CLI command

get load-balancer <lb-uuid> pool <pool-uuid> status

API

GET '/policy/api/infra/lb-service/<lb-service-id>/lb-pools/detailed-status'

if DOWN or UNKNOWN is reported, verify the pool member.

Perform following actions

1. Check network connectivity from the load balancer to the impacted pool members. 
2. Validate application health of each pool member.
3. Validate the health of each pool member using the configured monitor

Validate the network connectivity, remediate the issue by rebooting the pool member or make the edge node enter maintenance mode then exit maintenance mode.

Additional Information

You can confirm the docker status using the below command to check all the containers' status including the LB container running time using the below command from NSX Edge's root bash shell :

docker ps

Example :

root@edge:~# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
9564####bd78 nsx-edge-frr:current "/opt/vmware/edge/fr…" 12 days ago Up 12 days service_frr
d102####036c nsx-edge-base:current "/bin/sleep infinity" 12 days ago Up 12 days 22/tcp plr_sr
476f####67bb nsx-edge-mdproxy:current "/opt/vmware/edge/md…" 12 days ago Up 12 days service_md_proxy
abcb####8c91 nsx-edge-base:current "/bin/sleep infinity" 12 days ago Up 12 days 22/tcp mdproxy
a681####9352 nsx-edge-dhcp:current "/opt/vmware/edge/dh…" 12 days ago Up 12 days service_dhcp
044c####82dc nsx-edge-mdproxy:current "/opt/vmware/edge/md…" 12 days ago Up 12 days service_md_agent
c957####f87b nsx-edge-dispatcher:current "/opt/vmware/edge/lb…" 12 days ago Up 12 days service_dispatcher
5451####63ef nsx-edge-datapath:current "/opt/vmware/edge/dp…" 12 days ago Up 12 days service_datapath
1071####ab35 nsx-edge-nsxa:current "/opt/vmware/edge/ns…" 12 days ago Up 12 days service_nsxa