Content library sync failure

Products

• VMware vSphere ESXi

Issue/Introduction

• You have a local content library that fails to sync items into subscribed content library in other location
• The required ESXi host NFC port 902 are opened in both directions
• On source vCenter, in /var/log/vpxd.log file, you see logs similar to  :

<timestamp> info vpxd[06948] [Originator@6876 sub=vpxdUtil opID=<opid>] [VmFileAccess] Operation: copy, SrcFile: /vmfs/volumes/<source_datastore_uuid>//<source_contentlib-uuid>/<source_directory_uuid>/<template_name>.vmdk, DstFile: /vmfs/volumes/<vsan_datastore_uuid>//<destination_contentlib-uuid>/<destination_directory_uuid>/<template_name>.vmdk, User: VSPHERE.LOCAL\<vpxd-extension-uuid>, ClientIP: <destination_vcenter_ip>

<timestamp> error vpxd[06957] [Originator@6876 sub=Default opID=<opid>] [VpxLRO] -- ERROR <task_id> --  -- nfcManager -- nfc.NfcManager.copy: :vim.fault.NetworkCopyFault
--> Result:
--> (vim.fault.NetworkCopyFault) {
-->    faultCause = (vmodl.MethodFault) null,
-->    faultMessage = (vmodl.LocalizableMessage) [
-->       (vmodl.LocalizableMessage) {
-->          key = "",
-->          arg = (vmodl.KeyAnyValue) [
-->             (vmodl.KeyAnyValue) {
-->                key = "DestFile",
-->                value = "/vmfs/volumes/<vsan_datastore_uuid>//<destination_contentlib-uuid>/<destination_directory_uuid>/<template_name>.vmdk"
-->             },
-->             (vmodl.KeyAnyValue) {
-->                key = "NfcErrorCode",
-->                value = 8
-->             },
-->             (vmodl.KeyAnyValue) {
-->                key = "NfcErrorCodeString",
-->                value = "NFC_SESSION_ERROR"
-->             },
-->             (vmodl.KeyAnyValue) {
-->                key = "NfcErrorString",
-->                value = "The session encountered an error"
-->             }
-->          ],
-->          message = ""
-->       }
-->    ],
-->    file = "//vmfs/volumes/<source_datastore_uuid>//<source_contentlib-uuid>/<source_directory_uuid>/<template_name>.vmdk"
-->    msg = "Could not complete network copy for file /vmfs/volumes/<source_datastore_uuid>//<source_contentlib-uuid>/<source_directory_uuid>/<template_name>.vmdk"

--> Arg spec:
--> (nfc.CopySpec) [
-->    (nfc.CopySpec) {
-->       source = (nfc.CopySpec.Location) {
-->          filePath = "/vmfs/volumes/<source_datastore_uuid>//<source_contentlib-uuid>/<source_directory_uuid>/<template_name>.vmdk",
-->          cnxSpec = (nfc.CopySpec.CnxSpec) {
-->             host = "<source_esxi_ip>",
-->             },

-->          }
-->       },
-->       destination = (nfc.CopySpec.Location) {
-->          filePath = "/vmfs/volumes/<vsan_datastore_uuid>//<destination_contentlib-uuid>/<destination_directory_uuid>/<template_name>.vmdk",
-->          cnxSpec = (nfc.CopySpec.CnxSpec) {
-->             host = "<destination_esxi_ip>", <============ <The destination_esxi_ip> is not an expected one as it does not have access to the destination content library.

 

 

Environment

• vCenter Server 8.x
• VSAN 8.x

Cause

This is caused by a duplicate vsan datastore uuid in the environment due to a hostprofile that contains Storage configuration/vSAN Configuration "Cluster UUID"  being shared across multiple clusters.

Resolution

Use one of the following workaround:

• Create the subscribed content library in another datastore
• Recreate the VSAN cluster without the existing hostprofile (contact Broadcom support if needed)

https://knowledge.broadcom.com/external/article/326896/migrating-a-vsan-node-from-one-vsan-clus.html

 

 

Additional Information

• For VSAN clusters, hostprofile should be extracted from an existing host in the cluster. (not from another cluster)

https://techdocs.broadcom.com/us/en/vmware-cis/vsan/vsan/8-0/vsan-administration/expanding-and-managing-a-vsan-cluster/expanding-a-vsan-cluster/configuring-hosts-in-the-vsan-cluster-using-host-profile.html