ESXi host running on Cisco UCS/VBLOCK lose access to volumes with the error: fnic : 2 :: Abort Cmd called

Products

• VMware vSphere ESXi

Issue/Introduction

• VMware ESXi host running on Cisco UCS/VBLOCK lose access to storage volumes.
• In the /var/log/vmkernel.log file on the affected ESXi host, you see entries similar to:
  <YYYY-MM-DD>T<HH:MM:SS>.541Z cpu3:34498345)PVSCSI: 1587: ctx=0xfffffa8031dbe5a0 cdb0=0x2a on scsi0:0 completed during reset (0x8)
  <YYYY-MM-DD>T<HH:MM:SS>.965Z cpu24:33052)< 7 >fnic : 2 :: Abort Cmd called FCID 0x11100, LUN 0x3 TAG 66e flags 3
  <YYYY-MM-DD>T<HH:MM:SS>.965Z cpu15:32981)< 7 >fnic : 2 :: abts cmpl recd. id 1646 status FCPIO_SUCCESS
  <YYYY-MM-DD>T<HH:MM:SS>.965Z cpu24:33052)< 7 >fnic : 2 :: Returning from abort cmd type 2 SUCCESS
  <YYYY-MM-DD>T<HH:MM:SS>.965Z cpu24:33052)< 7 >fnic : 2 :: Abort Cmd called FCID 0x11100, LUN 0x3 TAG 678 flags 3
  <YYYY-MM-DD>T<HH:MM:SS>.965Z cpu15:32981)< 7 >fnic : 2 :: abts cmpl recd. id 1656 status FCPIO_SUCCESS
  
• The VMware vCenter Server displays an error similar to:
  Lost access to volume ########-########-####-######## due to connectivity issues.

Cause

This issue occurs due to these Cisco bugs: CSCuh61202 or CSCus64439.

For more information, see Cisco bug search.

Note: You need to have a registered Cisco account to access the bug information.

Resolution

This is not a VMware issue.

To work around this issue, reboot the ESXi host that is flooding traffic to the IOM. This will result in the Pause configuration being re-programmed.

Important: The preferred method to avoid this issue altogether, if an upgrade from 2.1(2) is to be performed, is to plan the upgrade such that the adapters/blade servers are upgraded prior to the infrastructure components. It is recommended to upgrade all components in the system from the server blade to the FI in the same maintenance window so the system is not in disparate versions. For more information, contact Cisco support.

Disclaimer: Broadcom is not responsible for the reliability of any data, opinions, advice, or statements made on third-party websites. Inclusion of such links does not imply that Broadcom endorses, recommends, or accepts any responsibility for the content of such sites.

Additional Information