VMware NSX Management Cluster upgrade dry-run fails with the error "Local backup generation failed".

Products

• VMware NSX

Issue/Introduction

• The NSX Management Cluster upgrade fails at the dry-run stage with an error similar to "Local backup generation failed on node <node-name>".
• The upgrade pauses and a retry results in the same error being encountered.
• An entry similar to the below will be visible in /var/log/syslog:

  

  NSX 3205 SYSTEM [nsx@6876 comp="nsx-manager" level="INFO" subcomp="upgrade-coordinator"] response: Response:: status code:200 OK status:OK body:123"status": "Failed", "progress_percentage": 0, "failure_reason": "Local backup generation failed. Reason: unsupported operand type(s) for +: 'NoneType' and 'str'", "_self": {"href": "/cluster/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/node/local-backup/status", "rel": "self"}}

  
  
  
  
  

Resolution

Workaround:

1. As the NSX Manager Nodes have not yet began upgrading they can be rebooted individually.
2. A reboot of the upgrade-coordinator node should be carried out first and an upgrade re-attempted.
3. If the error persists then a rolling reboot of all three nodes carried out.

 

NB: Reboots of subsequent nodes should not be performed until the previous node reboot is complete and the cluster shows as fully up when get cluster status is ran via the CLI.

 

Additional Information

If a reboot of all three nodes does not allow the upgrade to continue then please open a ticket with VMware support for further assistance.