Error "Failed to perform Reconfigure operation on deployment <deployment name>. Reconfigure Operation failed with errors. Auto rollback successful" while performing a CNF upgrade or reconfigure operation

Products

• VMware Telco Cloud Automation

Issue/Introduction

TCA 2.3 CNF upgrade or reconfigure times out after 60 minutes despite the timeout being increased in the GUI per this document Telco Cloud Automation User Guide.

TCA logs have the below errors 

2025-10-28 01:29:59.627 UTC [NfvVimService_SvcThread-1126, Ent: HybridityAdmin, Usr: <username>, , TxId: ######-##########-#######-######] ERROR com.vmware.hybridity.nfvm.JobUtils- CN_CHART_RECONFIGURE failed, errorCode:null. stacktrace:null, response: {"errors":[{"internalMessage":"Helm Upgrade Failure: HelmReconfigure task timed out.","errorCode":"CNF130006"}]}

2025-10-28 01:29:59.628 UTC [NfvVimService_SvcThread-1126, Ent: HybridityAdmin, Usr:  <username>, , TxId: ######-##########-#######-######] WARN  c.v.h.s.n.v.w.orch.CnfReconfigureJob- Error dispatching CNF orchestration to VIM, for Subflow {"hasFailure":true,"succeededSubflowJobDataArr":[],"failedSubflowDataArr":[{"parentState":"BEGIN","jobData":{"action":"Reconfigure","nfInstanceId":"######-#####_#####-###","chartName":"##########","chartVersion":"23.5.1-253","deploymentName":"###########","helmVersion":"v3","namespace":"######","repoUrl":"https:######-##########-#######-######","username":"#####","password":"****","vimName":"############","doWait":true,"timeoutInSecs":3600,"endpointUserInfo":[{"endpointId":"######-##########-#######-######","userName":"HybridityAdmin"}],"revision":19,"expirationTimeForCnfVduLcmTask":1761614991278,"k8sHelmUpgradeJob":{"cluster":"<Cluster name>","releaseNamespace":"########","release":"##########","helmOp":"UPGRADE"},"instance":{"internalRef":"##############","namespace":"###########","package":{"repository":"https:######-##########-#######-######","repositoryId":"######-##########-#######-######","username":"####","password":"****","name":"######","version":"23.5.1-253","extraSpecs":{"helmVersion":"3.0.0"},"timeoutInSecs":3600}},"error":"Helm Upgrade Failure: HelmReconfigure task timed out.","response":{"errors":[{"internalMessage":"Helm Upgrade Failure: HelmReconfigure task timed out.","errorCode":"CNF130006"}]}},"jobId":"################,"jobType":"nfvVimJob","workflowType":"CN_CHART_RECONFIGURE","state":"POLL_FOR_HELM_JOB_COMPLETE","previousState":"BEGIN","didFail":true,"lastUpdated":"Tue Oct 28 01:29:59 GMT 2025"}],"errors":[],"response":{"errors":[{"internalMessage":"Helm Upgrade Failure: HelmReconfigure task timed out.","errorCode":"CNF130006"}],"warnings":[]}}

Environment

2.3

Cause

This issue occurs because the upgrade ir reconfiguration task does not complete within the specified timeout interval. 

 

Resolution

If the issue still exists after changing the timeout value from the UI, the manually update the helm timeout global settings

1. Generate token
2. PUSH new settings
3. GET new settings

All commands posted are single-line

1. Generate Authorization Token
   
   
   curl -v -k -X POST https:// TCACP IP /hybridity/api/sessions -H "accept: application/json" -H "Content-Type: application/json" -d '{ "username": "[email protected]", "password": "password" }'
   
   Look for - x-hm-authorization ###########
   Example: b7630667:####:####:9b0c:de2a###2c23c
   
   
   
2. PUT
   
   curl -v -k -X PUT -H "Accept:application/json" -H "Content-Type:application/json" -H "x-hm-authorization: b7630667:####:####:9b0c:de2a###2c23c" https:// TCACP IP /admin/hybridity/api/global/settings/CnfPackageManager/helmTimeout -d '{"value":"9999"}
   
   
   
3.  GET current settings
   
   curl -v -k -X GET -H "Accept:application/json" -H "x-hm-authorization: b7630667:####:####:9b0c:de2a###2c23c" https:// TCACP IP /admin/hybridity/api/global/settings/CnfPackageManager/helmTimeout