HCX OSAM Migration Does Not Progress

Products

• VMware HCX

Issue/Introduction

HCX OSAM Migration never completes initial sync. Seems to be stuck around 41% no matter how many times sentinel agent service is restarted. The percentage value used in this example is not definitive. User can experience this issue at any point during the base sync.

 

In the densync logs you will see the below messages:

Scenario 1:

runs/densync-20:2024/10/16 11:23:06 [371376] file has vanished: "/data/####/########_data/###/###########.file_extension"

Scenario 2:

2025/02/20 11:18:34 [1918937] rsync: send_files failed to open "/sys/module/configfs/#event": Permission denied (13)2025/02/20 11:19:34 [1918937] rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1382) [sender=3.1.3]

Scenario 3:

2025/02/19 18:17:23 [822410] rsync: get_xattr_names: llistxattr("/var/cache/dnf/########-#####-#-for-rhel-8-x86_64-rpms-##########ee83c9/repodata/##################################################7be092d3298eec-primary.xml.gz",92145) failed: Argument list too long (7)

The location of densync logging can be found below:

Linux: 

/var/log/vmware/hcx/

Windows: 

 C:\ProgramData\VMware\HCX

 

Environment

HCX

Cause

HCX Sentinel agent DENSYNC process is not able to finish cataloging and synching all files before application or user removes it.

Resolution

Scenario 1:

Stop the process which is generating and deleting large volumes of files in order for initial sync to complete. 

 

Scenario 2:

Engage OS owner to understand why permissions is being denied for rsync service. 

 

Scenario 3:

Request OS/app owner investigate the file being called out and see if the application can be quiesced during the entire OSAM migration.