Performance of large file transfer has recently degraded significantly with XCOM for Unix
search cancel

Performance of large file transfer has recently degraded significantly with XCOM for Unix

book

Article ID: 198998

calendar_today

Updated On:

Products

XCOM Data Transport XCOM Data Transport - Linux PC

Issue/Introduction

Over the past 2 weeks, the performance of a XCOM standard file transfer of 13GB (non-compressed) has suddenly started to degrade significantly and is taking approximately 4 times longer to complete i.e. 2-3 hours instead of 30-40 minutes. There are no errors or change in the environment or command that indicates a possible root cause. 
However, in the $XCOM_HOME/Q directory it has been noticed that there is a build-up of .MBR files from the date when the XCOM performance started to slow down.

Environment

XCOM™ Data Transport® for UNIX/Linux PC

Cause

Queue corruption

Resolution

The $XCOM_HOME/Q directory contains the .IDX file and .MBR files, each .MBR corresponding to a transfer on that system. 

If for whatever reason there are old .MBR files that do not show when command "xcomqm -La" is issued, then those are .MBR files from old transfers which were not properly removed from the queue due to a specific reason. Finding the reason is impossible, but if xcomd is abnormally terminated then old .MBR files can be the result because XCOM could not perform the necessary tasks of waiting for the transfer to end or cleanup. In other words, "the rug was pulled out from under XCOM". 
The .MBR files can increase in number over time and it will affect how many transfers can be in the queue at any given time because of the value of MAX_QUEUE_ENTRIES in the xcom.glb.

In summary, it is best practice to:

  1. Stop xcomd normally using "xcomd -s"
  2. Review what is in the Q directory.  
  3. If there are old or corrupted .MBR files then remove the old .MBR files.  (Old .MBR files will not show when the command "xcomqm -La" is issued)
  4. Restart xcomd - using "xcomd"

In this case stopping xcomd, removing the .MBR files and restarting xcomd restored the performance to normal.

Additional Information