Symptoms:
- VM tasks are slow or stall out.
- /opt/vmware/vcloud-director/logs/vcloud-container-debug.log may show messages similar to:
2023-01-15 10:41:19,542 | WARN | vim-proxy-activity-pool-68 | PowerOnVmActivity | [Activity Execution] Timed out while waiting for VMs [[vcId=<VC_UUID>, moref=vm-372331]] status to change to powered on in the inventory cache. Waited 120 seconds for the VMs status to change to powered on. ...
- /opt/vmware/vcloud-director/logs/jms-debug.log may show messages similar to:
2023-01-30 11:24:54,390 | DEBUG | org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@38a1c423) | ServerConsumerImpl | ServerConsumerImpl [id=0, filter=null, binding=LocalQueueBinding [address=VC_LISTENER_SEPA_1, queue=QueueImpl[name=<LISTENER_UUID>, postOffice=PostOfficeImpl [server=ActiveMQServerImpl::name=randomBroker9345], temp=true]@ce6fedc, filter=null, name=<LISTENER_UUID>, clusterName=<CLUSTER_UUID>]] is busy for the lack of credits. Current credits = -64433 Can't receive reference Reference[240455]:NON-RELIABLE:LargeServerMessage[messageID=240455,durable=false,userID=<USER_UUID>,priority=4, timestamp=Mon Jan 30 11:24:54 EST 2023,expiration=Mon Jan 30 11:25:24 EST 2023, durable=false, address=VC_LISTENER_SEPA_1, properties=TypedProperties[__AMQ_CID=<AMQ_UUID>,_AMQ_ROUTING_TYPE=0,_AMQ_LARGE_SIZE=600115]]@324502783 |.