Error: "invoke : vmware.solution-addon-landing-zone" or "vmware.autoscale-1.4.0-242" failed tasks appear in UI after upgrade

Products

• VMware Cloud Director
• VMware Telco Cloud Platform

Issue/Introduction

• After upgrading Cloud Director, multiple failed tasks repeat regarding the Solution Add-On Management Landing Zone with the following messages:
  • invoke : vmware.solution-addon-landing-zone...(urn:vcloud:entity:vmware:solutions_add_on_instance:#####-#####-#####-#####-#####)
  • Created vmware.autoscale-default:xxxxx...(urn:vcloud:entity:vmware:solutions_add_on_task:#####-#####-#####-#####-#####)
  • Invoked vmware.autoscale-1.4.0-242...(urn:vcloud:entity:vmware:solutions_add_on_instance:#####-#####-#####-#####-#####)

• In /opt/vmware/vcloud-director/logs/vcloud-container-debug.log on the Cloud Director Cells  Internal Server Error entries are present with a stack trace similar to:
  • Caused by: java.lang.IllegalStateException: at com.vmware.vcloud.solutions.activities.AddOnRealizeActivity$ApplyOperation.buildResult(AddOnRealizeActivity.java:602) at com.vmware.vcloud.solutions.activities.AddOnRealizeActivity$ApplyOperation.invoke(AddOnRealizeActivity.java:627)


Environment

VCD 10.4.x, 10.5.x, 10.6.x

TCP 4.0, 4.0.1

Cause

• Certain releases of Cloud Director, do not include an upgrade of the Solution Add-On Landing Zone if upgrading from certain earlier releases.
• For a period post upgrade, Cloud Director will attempt to invoke changes in the backed.
• If there are any environmental issues such as misconfiguration of the Cloud Director Public Address, certificates or load balancer then it can lead to these failed tasks appearing for a short time as those backend tasks are unable to complete successfully.

Resolution

These failed tasks in Cloud Director can be safely ignored and the upgrade can be considered successful.

Additional Information

NOTE:  If you are using Add-ons in your vcd environment please review the Using Solution Add-Ons with VMware Cloud Director 

• It is recommended as an system admin account to review the Cloud Director Public Addresses, Certificates and load balancer to validate if all are configured correctly under the Provider UI. For More information, see:
  • VMware Cloud Director Cell Load Balancing Configuration 
  • SSL Certificate Creation and Management of Your VMware Cloud Director Appliance
  • Configure VMware Cloud Director Public Addresses