Error: "Unable to deploy network" when powering on vApp/VM

Products

• VMware Cloud Director
• VMware vCloud NFV

Issue/Introduction

• Error stack includes "com.vmware.vcloud.net.InadequateNetworkBackingException: Network Pool assigned to this VDC does not have any more available networks."

• The network pool indicates there is consumption when all VMs in this OvDC are powered off. 

Environment

VCD 10.3, 10.4, 10.5, 10.6

NFV 3.2

Cause

This is caused by stale database entries in the network_backing table of the vCloud Director database.

Resolution

1. Take a backup of the vCloud Director database using Back Up the Embedded Database of Your VMware Cloud Director Appliance

2. Check the Network Pool assigned to this OvDC from the vCD Provider UI.

3. Query network_pool to grab the id for this network pool.

        select * from network_pool where name='network_pool_name';

4. Query real_network_backing with the network_pool id.

        select * from real_network_backing where rnet_id in (select id from real_network where pool_id='network_pool id');

5. Query the network_backing with the network_pool id.

        select * from network_backing where pool_id='network_pool id';

6. Update the network_backing to set the rnet_id to null. This will release the pool consumption to 0 to allow us to deploy networks for this vapp.
   UPDATE network_backing set rnet_id=NULL where pool_id='network_pool id';

7. Re-attempt VM power On. 

8. If you run in to the following error: 

         - ERROR: duplicate key value violates unique constraint "uq_rnet_backing_dvpg_moref"

      Detail: Key (vc_id, dvpg_moref)=(########-####-####-####-############, dvportgroup-#) already exists.

1. 1. Identify duplicate entry:

           SELECT * FROM real_network_backing WHERE dvpg_moref = 'dvportgroup-from-error';

   2. Remove the Conflicting entry:

           DELETE FROM real_network_backing WHERE id = '<REDACTED_ID_FROM_PRIOR_STEP>';


Additional Information

• If DELETE statement fails to another key constraint, you will need to find out if this network was shared, more investigation is needed.

• If this is a Telco environment, ensure that the OVF is created correctly.

  • In some cases, the OVF may be looking for a Network Pool backed network when in fact, the backing should be Portgroup.