Reconfigure replication task failed with "Socket read timeout"
search cancel

Reconfigure replication task failed with "Socket read timeout"

book

Article ID: 414081

calendar_today

Updated On:

Products

VMware Cloud Director

Issue/Introduction

  • Edit replication task failed with the error:

Socket Read TimeOut

  • Cloud.log file you see entries similar to:

YYYY-MM-DD 08:08:54.024 DEBUG - [UI-######-######-######-######] [job-50] c.vmware.h4.cloud.job.VmReconfigureJob   : Reconfiguring replication C4-######-######-######-###### with settings C4ReplicationReconfigureSettings{description='null', rpo=20, dataConnectionType=ENCRYPTED_COMPRESSED, quiesced=false, retentionPolicy=RetentionPolicy{rules=[RetentionRule [numberOfIns
tances=20, distance=240]]}, sourceReconfigure=null, destinationReconfigure=VcloudReconfigure{placementPolicy=''sizingPolicy=''}, slaProfileId='null', initialSyncTime=0}

YYYY-MM-DD 08:09:24.106 ERROR - [UI-######-######-######-######] [task-poller-4] com.vmware.h4.jobengine.JobExecution     : Task ######-######-######-###### (WorkflowInfo{type='reconfigure', resourceType='vmReplication', resourceId='C4-######-######-######-######', isPrivate=false, resourceName='VM-NAME'}) has failed

  • hbrsrv.log file on the destination Replicator, you see entries similar to:

YYYY-MM-DDTHHT07:54:02.264+08:00 verbose hbrsrv[######] [Originator@6876 sub=Misc groupID=######-######-######-###### opID=hsl-######] Removing disk instance (GroupID=######-######-######-######) (diskID=H4D-######-######-######-######) (diskInstanceKey=######)
YYYY-MM-DDTHHT07:54:02.269+08:00 info hbrsrv[######] [Originator@6876 sub=Host groupID=######-######-######-###### opID=hsl-######] Starting ConsolidateDisks task=haTask--vim.VirtualDiskManager.consolidateDisks-###### for [child=[] /vmfs/volumes/######-######-######-######/C4-######-######-######-######/hbrdisk.H4D-######-######-######-######.######-######.vmdk into parent=[] /vmfs/volumes/######-######-######-######/C4-######-######-######-######/hbrdisk.H4D-######-######-######-######.######-######.vmdk] with host=######-######-######-######:host-######

YYYY-MM-DDTHHT07:57:13.051+08:00 verbose hbrsrv[######] [Originator@6876 sub=RemoteTask] Task haTask--vim.VirtualDiskManager.consolidateDisks-###### progress: 18
YYYY-MM-DDTHHT07:57:13.051+08:00 info hbrsrv[######] [Originator@6876 sub=StatsLog] HbrEvent: {"eventID":"consolidateProgress","groupID":"######-######-######-######","diskID":"H4D-######-######-######-######","percentCompleted":16,"ETA":"YYYY-MM-DDTHHT00:22:25.051898Z","serverID":"######-######-######-######","hbrEvent":1}YYYY-MM-DDTHHT08:07:55.729+08:00 info hbrsrv[######] [Originator@6876 sub=StatsLog] HbrEvent: {"eventID":"consolidateProgress","groupID":"######-######-######-######","diskID":"H4D-######-######-######-######","percentCompleted":50,"ETA":"YYYY-MM-DDTHHT00:25:25.729749Z","serverID":"######-######-######-######","hbrEvent":1}

YYYY-MM-DDTHHT08:08:56.372+08:00 info hbrsrv[######] [Originator@6876 sub=StatsLog] HbrEvent: {"eventID":"consolidateProgress","groupID":"######-######-######-######","diskID":"H4D-######-######-######-######","percentCompleted":52,"ETA":"YYYY-MM-DDTHHT00:33:44.372708Z","serverID":"######-######-######-######","hbrEvent":1}

YYYY-MM-DDTHHT08:09:37.258+08:00 info hbrsrv[######] [Originator@6876 sub=StatsLog] HbrEvent: {"eventID":"consolidateProgress","groupID":"######-######-######-######","diskID":"H4D-######-######","percentCompleted":75,"ETA":"YYYY-MM-DDTHHT00:26:42.258285Z","serverID":"######-######-######-######","hbrEvent":1}

Environment

VMware Cloud Director Availability 4.7.x

Cause

Large VMs consisting of multiple disks can take a long time to merge their associated hbrdisks with parent disks. This consolidation process takes a long time to complete causing operation timed out errors. 

Resolution

Give sometime for the consolidation process to complete and then run the Recovery Plan again, it must succeed. You can monitor the target vSphere Replication appliances' hbrsrv.log to find out when the consolidation task completes. 

Edit replication task after  consolidation finish.