Aria Operations for Logs unable to add Load Balancer IP with error ""IP address not available. It is already held by another host in the network""

Products

• VCF Operations/Automation (formerly VMware Aria Suite)

Issue/Introduction

• Existing Integrated Load Balancer IP (ILB) was deleted. 
• When trying to re-add the same ILB, the operation failed with the following error:
    "IP address not available. It is already held by another host in the network"
• ARP table shows the IP is pointing to the MAC address of one of the worker node.
• Deleting ARP cache from all the nodes did not fix the issue.

Environment

Aria Operations for Logs 8.x

Cause

ILB config did not get released from one of the worker node and still being referenced.

Resolution

• Add the ILB on the worker node that has the MAC address associated with the ILB in the ARP result. Follow this document to enable ILB
• ILB is added successfully.

Additional Information

• When an ILB is added to the cluster, an entry is added to the cluster database.
• Prior to removing the ILB, ILB was showing as Unavailable, not connected.
• Due to this reason, when the ILB is deleted from the Primary node, because of the inconsistency, the ILB may not have been cleanly removed from all the database record, hence some record still existed.  
• To fix this issue, we added the ILB back into the node that is still referencing the existing ILB FQDN.