Error: "Provider VDC Values show as N/A in the UI" after an inventory clean

Products

• VMware Cloud Director
• VMware Telco Cloud Platform

Issue/Introduction

• Upon completion of an inventory clean in VMware Cloud Director, Storage Containers appear empty and Storage Profile values are displayed as N/A in the user interface.

Environment

• VCD: 10.x
• TCP: 3, 4.x, 4.0.1, 5.x, 5.0. 5.0.1, 5.0.2

Cause

• This issue exists because the AsyncEventProcessingManagementCoordinatorJob job hasn't run in a while.
• This job is part of the overall PropertyCollectorReader process and plays an integral part in sending information about objects in vCenter down to VCD.

Resolution

• Take backups of the VCD database and take snapshots of the VCD Appliances in vCenter.
• Set failover mode to Manual:
  • curl -k -X POST -H "Accept: application/json" -u "root" "https://localhost:5480/api/1.0.0/nodes/failover/manual"
• Stop any further tasks from being accepted by the system and allow those that are running to complete.
• Run this on all Appliances:
  • /opt/vmware/vcloud-director/bin/cell-management-tool cell -i \cat /var/run/vmware-vcd-cell.pid` -t --quiesce true`
• Check the status of the current running jobs:
  • /opt/vmware/vcloud-director/bin/cell-management-tool cell -i \cat /var/run/vmware-vcd-cell.pid` -tt`
• Once all of the jobs have finished, shut down the VCD service on all Appliances:
  • /opt/vmware/vcloud-director/bin/cell-management-tool cell -i \cat /var/run/vmware-vcd-cell.pid` --shutdown`
• SSH into your Primary Appliance as root and elevate to Postgres, then drop into the vcloud database:
  • sudo -i -u postgres psql -d vcloud
• Paste in these queries to clear the activity queues:
  • truncate table scheduled_activity_jobs; truncate table activity_pc_queue; truncate table activity_pc_event_queue; truncate table fifo_activity_queue; truncate table task_activity_queue; truncate table vc_activity_queue;
• Exit from psql:
  • \q
• Exit from the postgres user:
  • exit
• Restart the vmware-vcd service on all Appliances:
  • service vmware-vcd start
• Tail the cell.log on all Appliances to ensure the Appliance is rebooted successfully:
  • tail -f /opt/vmware/vcloud-director/logs/cell.log
• Login to your Provider URL and navigate to vsphere-resources > vCenters and perform a reconnect and refresh on all attached vCenters.
• Revisit the Provider VDC Storage view.