scsi connection drop causes HA event

Products

• VMware vSphere ESXi

Issue/Introduction

• In the /var/log/vobd.log you will see these messages:
  

  [iscsiCorrelator] ##############us: [vob.iscsi.connection.stopped] iScsi connection 0 stopped for vmhba##:C#:T#
  
  [vmfsCorrelator] ##############us: [esx.problem.vmfs.heartbeat.timedout] <Datastore UUID>  <Datastore Name>
  

• In the /var/log/vmkernel logs you will see storage transient condition messages:
  

  cpu15:2868080)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba##:C#:T#:L##" - Transient storage condition, suggest retry
  
  cpu35:2098495)WARNING: iscsi_vmk: iscsivmk_ConnSetupTMFResp:1728: vmhba##:CH:# T:# CN:0: TMF Response PDU: Referenced task not found: itt 0x#########
  cpu35:2098495)WARNING: iscsi_vmk: iscsivmk_ConnSetupTMFResp:1741: Sess [ISID: ############ TARGET: iqn.<IQN ID> TPGT: # TSIH: #]
  cpu35:2098495)WARNING: iscsi_vmk: iscsivmk_ConnSetupTMFResp:1742: Conn [CID: 0 L: <IP-Address:Port> R: <IP-Address:Port>]
  

Environment

7.x

8.x

Resolution

Multiple hosts disconnecting their scsi sessions at the same time is an indication of either a connectivity issue from hosts to the storage or the storage it self. This needs to be investigated at the switch and array level.