Symptoms:
ERROR | stats-activity-pool-26468 | StatsFeederCollectorActivity | [Activity Execution] Error retrieving performance stats from VC ########-####-####-####-########f67a in monitoring mode CASSANDRA - Handle: urn:uuid:########-####-####-####-########81fd, Current Phase: StatsFeederCollectorActivity$StatsFeederCollectorPhase | activity=(com.vmware.vcloud.metrics.statsfeeder.StatsFeederCollectorActivity,urn:uuid:########-####-####-####-########81fd)
(vmodl.fault.InvalidArgument) {
faultCause = null,
faultMessage = null,
invalidProperty = entity
DEBUG | pool-jetty-81560 | VmManagerImpl | Could not retrieve status for VM TestVM2 from the inventory
WARN | pool-jetty-81560 | RclServiceImpl | Cannot retrieve inventory record for VM TestVM2 | requestId=########-####-####-####-########6cc7,request=GET https://vcd.example.com/api/vApp/vm-########-####-####-####-########7a5d,requestTime=171234355545,remoteAddress=123.123.123.123:12345,userAgent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 39.0.0-alpha
com.vmware.ssdc.library.exceptions.InventoryObjectNotFoundException: Could not find object with moref "vm-1234" and VC ID "########-####-####-####-########f67a" in inventory category "VirtualMachine".
This issue occurs due to a stale virtual machine in Cloud Director which do not exists in vCenter. When the stats couldn't be retrieved for the stale VM, the statsfeeder component in VCD which is responsible for collecting metrics for all the VMs errors out as seen in the log entries.
To resolve this issue,