Tanzu Guest Cluster Deployment not progressing, vCenter task "Deploy OVF package from Content Library to Resource Pool" sticks to 0% progress

Products

• VMware vSphere Kubernetes Service

Issue/Introduction

• A new Tanzu Guest Cluster was created, but is not deployed. The new deployed virtual machine might show some hardware configuration, but is never powered on.
• When checking vCenter tasks of respective namespace, the vCenter task "Deploy OVF template" is not moving beyond 0% progress.
• After couple of minutes, above task "Deploy OVF package from Content Library to Resource Pool" eventually shows "Copying virtual machine configuration", but not progresses
• In respective logs of Content Library at /var/log/vmware/content-library/cls.log, it can be observed value "bytes_transferred" not increasing over an extended period of time:
  (In this example, referring to VMDK "ubuntu-ova-disk1.vmdk" of a Tanzu Kubernetes Release from Broadcom-hosted Tanzu-specific Content Library)
  

  YYYY-mm-ddTHH:mm:ss.000Z | DEBUG | ########-########-####-############ | cls-simple-activity-7 | ImportSessionActivity | Session is in state IMPORT_FILE_TRANSFER
  rItemState => {
      [...]
      transfer_uri => https://vcenter.example.com:443/cls/data/########-########-####-############/ubuntu-ova-disk1.vmdk,
      source => com.vmware.transfer.TransferEndpointState => {
          bytes_transferred => 0,
          [...]
          status => DONE,
      },
      type => DISK,
      transfer_uri_map => [],
      targets => [com.vmware.transfer.TransferEndpointState => {
          bytes_transferred => 0,
          [...]
          status => WAITING,
      }],
      status => WAITING,
      source_endpoint_states => <unset>,
  
  },

Environment

VMware vCenter
VMware vSphere Kubernetes Service

Cause

Due to environmental instability the content-library service might get unstable.

Resolution

• Restart vCenter's Content Library service:
  • service-control --restart vmware-content-library
    
    
• In certain cases, if the task remains stuck or does not progress even after restarting the content library service, restarting the vpxd service is required to manually terminate the content library tasks.
  • service-control --restart vpxd

Additional Information

Japanese version: Tanzu ゲスト クラスタの展開が進まず、vCenter タスク「コンテンツ ライブラリからリソース プールに OVF パッケージを展開」の進行状況が 0% のままになる