Attempting to update ESXi hosts from vCenter Lifecycle Manager fails with "Host cannot download files from VMware vSphere Lifecycle Manager patch store. Check the network connectivity and firewall setup, and check esxupdate logs for details."
The ESXi esxupdate.log shows '[Errno 104] Connection reset by peer' during the download of metadata zip files
2024-07-31T14:26:19Z In(14) esxupdate[25786092]: Downloading https://vCenter.domain.com:9087/vum/repository/hostupdate/ESXi-7.0-Addon-cumulative_metadata.zip to /tmp/tmpasa9_g8c
2024-07-31T14:26:22Z Wa(12) esxupdate[25786092]: Download failed: <urlopen error [Errno 104] Connection reset by peer>, 9 retry left...
2024-07-31T14:26:25Z Wa(12) esxupdate[25786092]: Download failed: <urlopen error [Errno 104] Connection reset by peer>, 8 retry left...
2024-07-31T14:26:28Z Wa(12) esxupdate[25786092]: Download failed: <urlopen error [Errno 104] Connection reset by peer>, 7 retry left...
2024-07-31T14:26:31Z Wa(12) esxupdate[25786092]: Download failed: <urlopen error [Errno 104] Connection reset by peer>, 6 retry left...
2024-07-31T14:26:34Z Wa(12) esxupdate[25786092]: Download failed: <urlopen error [Errno 104] Connection reset by peer>, 5 retry left...
2024-07-31T14:26:37Z Wa(12) esxupdate[25786092]: Download failed: <urlopen error [Errno 104] Connection reset by peer>, 4 retry left...
2024-07-31T14:26:40Z Wa(12) esxupdate[25786092]: Download failed: <urlopen error [Errno 104] Connection reset by peer>, 3 retry left...
2024-07-31T14:26:43Z Wa(12) esxupdate[25786092]: Download failed: <urlopen error [Errno 104] Connection reset by peer>, 2 retry left...
2024-07-31T14:26:46Z Wa(12) esxupdate[25786092]: Download failed: <urlopen error [Errno 104] Connection reset by peer>, 1 retry left...
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: An esxupdate error exception was caught:
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: Traceback (most recent call last):
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/urllib/request.py", line 1354, in do_open
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/http/client.py", line 1259, in request
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/http/client.py", line 1305, in _send_request
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/http/client.py", line 1254, in endheaders
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/http/client.py", line 1014, in _send_output
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/http/client.py", line 954, in send
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/http/client.py", line 1428, in connect
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/ssl.py", line 500, in wrap_socket
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/ssl.py", line 1073, in _create
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/ssl.py", line 1342, in do_handshake
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: ConnectionResetError: [Errno 104] Connection reset by peer
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: During handling of the above exception, another exception occurred:
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: Traceback (most recent call last):
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Downloader.py", line 360, in _getfromurl
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: self._retry(self._download_to_file, self.options['retry'])
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Downloader.py", line 224, in _retry
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: _checkRetry(retry, retries, e)
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Downloader.py", line 208, in _checkRetry
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: raise exception
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Downloader.py", line 214, in _retry
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: return func()
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Downloader.py", line 330, in _download_to_file
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: robj = self._urlopen(self.url)
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Downloader.py", line 198, in _urlopen
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: return opener.open(url, timeout=self.options['timeout'])
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/urllib/request.py", line 525, in open
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/urllib/request.py", line 542, in _open
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/urllib/request.py", line 502, in _call_chain
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/urllib/request.py", line 1397, in https_open
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/urllib/request.py", line 1357, in do_open
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: urllib.error.URLError: <urlopen error [Errno 104] Connection reset by peer>
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: During handling of the above exception, another exception occurred:
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: Traceback (most recent call last):
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 113, in DownloadMetadatas
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: mfile = d.Get()
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Downloader.py", line 461, in Get
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: return self._getfromurl()
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Downloader.py", line 362, in _getfromurl
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: raise DownloaderError(self.url, self.local, str(e))
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: vmware.esximage.Downloader.DownloaderError: ('https://vCenter.domain.com:9087/vum/repository/hostupdate/ESXi-7.0-Addon-cumulative_metadata.zip', '/tmp/tmpasa9_g8c', '<urlopen error [Errno 104] Connection reset by peer>')
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: During handling of the above exception, another exception occurred:
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: Traceback (most recent call last):
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/usr/sbin/esxupdate", line 367, in main
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: EsxupdateLivePatcherMount.InitCommand(command, cmdArgs, options.meta,
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/usr/sbin/esxupdate", line 199, in InitCommand
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: meta = Transaction.Transaction.DownloadMetadatas([url],
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: File "/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 115, in DownloadMetadatas
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: raise Errors.MetadataDownloadError(metaUrl, None, str(e))
2024-07-31T14:26:46Z Er(11) esxupdate[25786092]: vmware.esximage.Errors.MetadataDownloadError: ('https://vCenter.domain.com:9087/vum/repository/hostupdate/ESXi-7.0-Addon-cumulative_metadata.zip', None, "('https://vCenter.domain.com:9087/vum/repository/hostupdate/ESXi-7.0-Addon-cumulative_metadata.zip', '/tmp/tmpasa9_g8c', '<urlopen error [Errno 104] Connection reset by peer>')")
vCenter 8.0 Update 3 (8.0.3.00000)
ESXi is not able to communicate to vCenter over port 9087
vCenter 8.0 U3 GA now utilizes a HTTPS connections instead of HTTP from previous versions to encrypt traffic between ESXi hosts and vCenter
1. Ensure that ESXi can communicate to vCenter over port 9087 successfully and there is not port blockage
To test the connectivity between ESXi and vCenter Server. Open an SSH session to one of the impacted ESXi hosts and run the below command
nc -z vCenter_IP 9087
Expected response is:
Connection to vCenter_IP 9087 port [tcp/*] succeeded!
2. Ensure there is no proxy set on the vCenter or within the environment that may be interfering
3. Ensure there is no firewall blocking communication on port 9087 or blocking HTTPS traffic communication between the ESXi hosts and vCenter