ESXi host frequently goes to "Not Responding" state with multiple hostd crash dumps
search cancel

ESXi host frequently goes to "Not Responding" state with multiple hostd crash dumps

book

Article ID: 385528

calendar_today

Updated On:

Products

VMware vSphere ESXi VMware vSphere ESXi 7.0 VMware vSphere ESXi 8.0

Issue/Introduction

  • ESXi host often goes to "Not Responding" state with multiple hostd crash dumps located in /var/core.
  • The hostd crash dump would have the following back trace:

#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
#1  0x000000e4783dcdf4 in __GI_abort () at abort.c:79
#2  0x000000e47209dabf in Vmacore::System::SignalTerminateHandler (info=0xe47e18eb80, ctx=0xe47e18ec00)
    at bora/vim/lib/vmacore/posix/defSigHandlers.cpp:62
#3  <signal handler called>
#4  0x000000e476ac9a32 in EsxConfigStore::ConfigStoreObject::GetData (this=0x0)
    at external/cayman_esx_toolchain_gcc9/usr/bin/../lib/gcc/x86_64-vmk-linux-gnu/9.3.0/../../../../x86_64-vmk-linux-gnu/include/c++/9.3.0/bits/shared_ptr_base.h:1020
#5  0x000000e476486931 in VmkCtl::Network::DVSwitchImpl::SetDvsName (this=<optimized out>, Python Exception <class 'gdb.error'> No type named class std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep.:
dvsName=)
    at external/cayman_esx_toolchain_gcc9/usr/bin/../lib/gcc/x86_64-vmk-linux-gnu/9.3.0/../../../../x86_64-vmk-linux-gnu/include/c++/9.3.0/bits/shared_ptr_base.h:1020
#6  0x000000e42da3cd70 in Hostsvc::DvsVmkProvider::SetDVSwitchName (this=0xe47d832670, Python Exception <class 'gdb.error'> No type named class std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep.:
dvsId=, Python Exception <class 'gdb.error'> No type named class std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep.:
dvsName=)
    at bora/vim/hostd/hostsvc/provider/vmkernel/DvsVmkProvider.cpp:1311
#7  0x000000e42d991b87 in Hostsvc::ActionSetDvsProp<std::string, std::string const&, std::string, &Hostsvc::DvsProvider::GetDVSwitchName, &Hostsvc::DvsProvider::SetDVSwitchName>::Do (this=0xe48852e470)
    at /build/mts/release/bora-22380479/compcache/cayman_esx_toolchain/ob-19272582/linux-centos72-gc32/usr/x86_64-vmk-linux-gnu/include/c++/9.3.0/bits/basic_string.h:3747
#8  0x000000e42d989281 in Hostsvc::NetworkSystemProviderTrans::SetDVSwitchName (this=this@entry=0xe47e1902d8, Python Exception <class 'gdb.error'> No type named class std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep.:
dvsId=,
    Python Exception <class 'gdb.error'> No type named class std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep.:
dvsName=) at bora/vim/hostd/hostsvc/provider/networkSystemTrans.cpp:4101
#9  0x000000e42d9069a9 in Hostsvc::HostDvsManager::ReconfigureDVSInt (this=this@entry=0xe482df01d0, xaction=...,
    spec=spec@entry=0xe489003f70, msg=msg@entry=0xe48892e0b0, isCswitchUpgrade=isCswitchUpgrade@entry=false)
    at bora/vim/lib/public/vmacore/Optional.h:335
#10 0x000000e42d9078f4 in Hostsvc::HostDvsManager::ApplyDvsInt (this=0xe482df01d0, xaction=..., spec=spec@entry=
    0xe4879a6650, msg=0xe48892e0b0) at bora/vim/hostd/hostsvc/impl/HostDvsManager.cpp:1972
#11 0x000000e42d9245d6 in Hostsvc::NetworkSystemImpl::InvokeHostTransactionCall (this=0xe47cf051e0, Python Exception <class 'gdb.error'> No type named class std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep.:
transactionId=,
    timeout=30, methodName=..., param1=0xe4879a6650, param2=<optimized out>, result=...)
    at bora/vim/hostd/hostsvc/impl/NetworkSystem.cpp:3966
#12 0x000000e473d16065 in sVimHostNetworkSystemDispatch (mobj=0xe47e190380, id=1880572704,
    params=std::vector of length 7, capacity 7 = {...}, resultObj=...)
    at bazel-out/k8-opt-release-ST-9672336e6809/bin/bora/vim/vmodl/vim/vim/host/typeinfo.cpp:65311
#13 0x000000e42d4d9fef in HostdCommon::VmomiAdapterServer::InvokeNow (actv=0xe488069130)
    at bora/vim/lib/public/vmomi/server.h:920
#14 0x000000e471ec718e in std::function<void ()>::operator()() const (this=0xe487f46b58)
    at external/cayman_esx_toolchain_gcc9/usr/bin/../lib/gcc/x86_64-vmk-linux-gnu/9.3.0/../../../../x86_64-vmk-linux-gnu/include/c++/9.3.0/bits/std_function.h:683
#15 Vmacore::System::ThreadPoolFair::InvokeItem(std::function<void ()>&) const (this=<optimized out>, item=...)
    at bora/vim/lib/vmacore/asio/ThreadPoolFair.cpp:641
#16 0x000000e471ec8cb0 in Vmacore::System::ThreadPoolFair::RunWorkerThread (this=0xe42edaaa00)
    at bora/vim/lib/vmacore/asio/ThreadPoolFair.cpp:1298
#17 0x000000e4720e194b in std::function<void ()>::operator()() const (this=0xe47c4095e8)
    at external/cayman_esx_toolchain_gcc9/usr/bin/../lib/gcc/x86_64-vmk-linux-gnu/9.3.0/../../../../x86_64-vmk-linux-gnu/include/c++/9.3.0/bits/std_function.h:683
#18 Vmacore::System::ThreadPosix::ThreadBegin (data=0xe47c4095e0) at bora/vim/lib/vmacore/posix/thread.cpp:122
#19 0x000000e4783a2a82 in start_thread (arg=<optimized out>) at pthread_create.c:479
#20 0x000000e4784adeef in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95

Environment

VMware vSphere ESXi

Resolution

Powered by Wolken Software