Scan entity task fails on multiple hosts in vCenter server with error "There are error during the scan operation. Check the events and log for detail."

Products

• VMware vCenter Server

Issue/Introduction

Scanning the hosts against baselines from "Updates" tab fails with the following error:

"There are error during the scan operation. Check the events and log for detail."

/var/log/vmware/vmware-updatemgr/vum-server/vmware-vum-server.log shows following errors:

####-##-##T##:##:29.060+02:00 warning vmware-vum-server[####] [Originator@6876 sub=HttpConnectionPool-000000] Failed to get pooled connection; <cs p:#######, TCP:example.esxi.com:80>, (null), duration: 2msec, N7Vmacore4Http13HttpExceptionE(HTTP error response: Conflict)
--> [context]##################################[/context]
####-##-##T##:##:29.061+02:00 info vmware-vum-server[33842] [Originator@6876 sub=IO.Http] Set user agent error; state: 1, (null), N7Vmacore4Http13HttpExceptionE(HTTP error response: Conflict)
-->

........

####-##-##T##:##:18.151+02:00 info vmware-vum-server[####] [Originator@6876 sub=VciScanTask.ScanTask{17}] [vciTaskBase 1372]
SerializeToVimFault fault:
--> (integrity.fault.ScanFailure) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>,
--> reason = <unset>
--> msg = ""
--> }
--> Converted fault:
--> (vim.fault.ExtendedFault) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>,
--> faultTypeId = "com.vmware.vcIntegrity.ScanFailure",
--> data = (vim.KeyValue) [
--> (vim.KeyValue) {
--> key = "faultCause",
--> value = ""
--> },
--> (vim.KeyValue) {
--> key = "faultMessage",
--> value = ""
--> },
--> (vim.KeyValue) {
--> key = "reason",
--> value = ""
--> }
--> ]"

Environment

VMware vCenter Server 8.x

VMware vCenter Server 7.x

Cause

This issue happens due to connectivity issues between vCenter and ESXi hosts.

Resolution

Engage your network team to verify the connectivity between vCenter and ESXi hosts on TCP ports 443, 80 and 9084.

If required, packet captures can be obtained via commands below (These commands should be run before running a "Scan Entity" task on ESXi) :

ESXi: 

pktcap-uw --vmk vmk0 -o /vmfs/volumes/datastore/capture_esxi.pcap

vCenter:

tcpdump -i eth0 host <x.x.x.x> -w /tmp/capture_vc.pcap

If no issues are found or any further assistance is needed, please open a support request with Broadcom.