ESXCLI commands are stuck on ESXi host

Products

• VMware vSphere ESXi 7.0
• VMware vSphere ESXi 8.0

Issue/Introduction

• The esxcli commands have no responding on ESXi host.
• The localcli commands work normally.
• ESXi host is still connecting with vCenter.
• Logining ESXi host client is working.
• Perform a live hostd dump on ESXi host and get the below backtrace:
  
  #0  0x0000008ed3b10f6d in read () at ../sysdeps/unix/syscall-template.S:81
  #1  0x0000008e84feb025 in read (fd=fd@entry=90, buf=buf@entry=0x8edaa3ed08, count=count@entry=1024)
      at bora/vim/hostd/common/IoTrackers.cpp:676
  #2  0x0000008ecdd46c2c in read (__nbytes=1024, __buf=0x8edaa3ed08, __fd=90)
      at /build/mts/release/bora-23794027/compcache/cayman_esx_glibc/ob-19709665/linux64/sysroot/usr/include/bits/unistd.h:44
  #3  ReadFromDescriptor (output="", fd=90) at bora/lib/cpptools/autocli/Util.cpp:246
  #4  CppTools::AutoCli::AutoCli_ShellCmd (
      command="LANG=en_US.UTF-8 /opt/vxrail/bin/esxcli-vxrail.py ++group=host/vim/vmvisor/pservice firmware.list", output="", input="")
      at bora/lib/cpptools/autocli/Util.cpp:391
  #5  0x0000008ecdd4dd6f in CppTools::AutoCli::ExtensionCommand::ExecuteInternal (this=<optimized out>, input=..., output=...)
      at bora/lib/cpptools/autocli/ExtensionCommand.cpp:384
  #6  0x0000008ecdd36ed0 in CppTools::AutoCli::Command::Execute (this=this@entry=0x8edb0b4c90, input=..., output=...)

Environment

VMware vSphere ESXi 8.0.x
VMware vSphere ESXi 7.0.x

Resolution

The hostd hang caused by the esxcli-vxrail.py which refers to a Python script used within the VxRail environment for managing and interacting with the ESXi hosts within the VxRail cluster. Contact Dell to check the script issue.