ESXi host with Cisco HBA driver fails with the error: "FCPIO_DATA_CNT_MISMATCH"
search cancel

ESXi host with Cisco HBA driver fails with the error: "FCPIO_DATA_CNT_MISMATCH"

book

Article ID: 340039

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

Symptoms:
  • ESXi host with Cisco VIC HBA is in unresponsive state.
  • hostd process is unreponsive.
  • LUNs are disconnected and fails to boot using FC/FCoE.
  • In the vmkwarning.log file, you see errors similar to:

2017-03-15T04:47:00.051Z cpu28:33310)WARNING: LinScsi: SCSILinuxAbortCommands:1890: Failed, Driver fnic, for vmhba4

2017-03-15T04:47:01.137Z cpu27:47509)WARNING: LinScsi: SCSILinuxProcessCompletions:826: Error BytesXferred > Requested Length Marking transfer length as 0 - vmhba = vmhba4, Driver Name = fnic, Requested length = 512, Resid = 131072

2017-03-15T04:47:01.137Z cpu27:47509)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.514f0c59bf000079" state in doubt; requested fast path state update...

2017-03-15T04:47:02.052Z cpu17:32785)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.514f0c59bf0000a9" state in doubt; requested fast path state update...

2017-03-15T04:47:08.242Z cpu3:40875)WARNING: VMotion: 1884: 1489551966631519 S: Waited 119.995 seconds for the monitor to process a preCopyNext action. This may cause unexpected vMotion failures.

2017-03-15T04:47:17.288Z cpu25:33529)WARNING: LinScsi: SCSILinuxProcessCompletions:826: Error BytesXferred > Requested Length Marking transfer length as 0 - vmhba = vmhba4, Driver Name = fnic, Requested length = 4096, Resid = 1048576

2017-03-15T04:47:17.288Z cpu25:33529)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.514f0c59bf0000a9" state in doubt; requested fast path state update...

2017-03-15T04:47:25.390Z cpu46:33310)WARNING: LinScsi: SCSILinuxAbortCommands:1890: Failed, Driver fnic, for vmhba4

  • In the vmkernel.log file, you see errors similar to:

2017-03-15T06:27:18.961Z cpu32:33284)<3>fnic : 4 :: hdr status = FCPIO_DATA_CNT_MISMATCH

2017-03-15T06:27:18.961Z cpu24:33308)WARNING: LinScsi: SCSILinuxProcessCompletions:826: Error BytesXferred > Requested Length Marking transfer length as 0 - vmhba = vmhba4, Driver Name = fnic, Requested length = 512, Resid = 131072

2017-03-15T06:27:18.961Z cpu24:33308)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x2a (0x439e58573580, 32830) to dev "naa.514f0c59bf0000a7" on path "vmhba4:C0:T4:L49" Failed: H:0x7 D:0x28 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL

2017-03-15T06:27:18.961Z cpu24:33308)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.514f0c59bf0000a7" state in doubt; requested fast path state update...

2017-03-15T06:27:18.961Z cpu24:33308)ScsiDeviceIO: 2613: Cmd(0x439e58573580) 0x2a, CmdSN 0x677 from world 32830 to dev "naa.514f0c59bf0000a7" failed H:0x7 D:0x28 P:0x0 Possible sense data: 0x0 0x0 0x0.

2017-03-15T06:27:18.961Z cpu32:33284)<3>fnic : 4 :: hdr status = FCPIO_DATA_CNT_MISMATCH

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.


Environment

VMware vSphere ESXi 5.5
VMware vSphere ESXi 6.0
VMware vSphere ESXi 6.5
VMware vSphere ESXi 7.0x

Cause

This issue occurs due to a bug with Cisco VIC hardware adapter.

For more information, see Cisco Bug: CSCva47085 - VIC1340+2304 IOM Native 40g Link Training Issue Causes Connectivity Loss.

Resolution

This is not a VMware issue.

To resolve this issue, contact Cisco support.


Additional Information