VCF 9.1 Unable to unregister/delete "Log Management"

Products

• VMware Cloud Foundation

Issue/Introduction

• The Log Management component cannot be removed from VCF Operations 9.1. The unregister component task fails with the following error in the UI:   
  
  Unable to unregister components from VCF Operations. Failed components: ############## (type:OPS_LOGS). Details: ############# (type: OPS_LOGS) failed: Component registration task in VCF Operations with ID '###############' failed.
  
  
• Attempting to remove the log management component via "cleanup_component.py" script from KB 441333 causes the process to hang and eventually fail.
  
  

• In VCF Operations, /storage/vcops/log/component-manager-plugin-#######.log has following error message:

  [com.vmware.vrealize.lcm.lcops.service.InventoryWorkflowServiceImpl.initiateDeleteComponentFlow] - Delete component flow initiated for component :: ###################### with request id :: ###################
YYYY-MM-DDTHH:MM:SS.477Z INFO component-manager-plugin #### [ops@### threadId="#####" threadName="ServerConnection on port 10000 Thread 127" operationId="#####################"] [com.vmware.vrealize.lcm.requestservice.service.RequestServiceImpl.patchRetryRequest] - Retry error cause data for request ID ##################: [ {
  "messageId" : "OPSVSP00012",
  "message" : "Failed to delete Log management configuration with VCF Management Services appliance",
  "eventId" : "####################",
  "retry" : true,
  "exceptionMessage" : "java.lang.RuntimeException: Error occurred while invoking API Task : [Received response with failure from Collector with id: 2]"

Environment

VMware Cloud Foundation 9.1

Cause

This issue is caused due to to a stale component registration entry exists in the VCF Operations registry, compounded by potential deadlocks, which prevent the cleanup utility from completing the unregistration lifecycle.

Resolution

1. In VCF Operations 9.1, Navigate to Operate -> Administration -> Control Panel -> Management Task -> Click on the failed delete task -> select the checkbox for skip -> click on retry.
   
   
2. If skip option is not available, reboot the VCF Operations nodes sequentially as per KB Shutdown and Startup sequence for VCF/Aria Operations cluster to clear any stale lock and re-try the delete task.
   
   
3. If the task still fails, contact Broadcom Support and open a support case