Node creation fails when DRS Automation Level is set to Manual in Tanzu Kubernetes Grid Integrated Edition

Products

• VMware Tanzu Kubernetes Grid Integrated Edition

Issue/Introduction

Symptoms:

• Node creation using the bosh cck command fails when DRS Automation Level is set to Manual in Tanzu Kubernetes Grid Integrated Edition (TKGI).
• You see messages similar to the following in the debug Bosh task logs:

{"time":1628707792,"stage":"Applying problem resolutions","tags":[],"total":1,"task":"VM for ''worker/c4a2a7ae-b809-4e9b-8fd0-ac51be44444d5 (9)'' missing. (missing_vm 197): Recreate VM and wait for processes to start","index":1,"state":"failed","progress":100,"data":{"error":"Unknown CPI error ''Unknown'' with message ''Recommendations were detected, you may be running in Manual DRS mode. Aborting.'' in ''create_vm'' CPI method (CPI request ID: ''cpi-999771'')"}}
{"time":1628707792,"error":{"code":100,"message":"Error resolving problem ''18886'': Unknown CPI error ''Unknown'' with message ''Recommendations were detected, you may be running in Manual DRS mode. Aborting.'' in ''create_vm'' CPI method (CPI request ID: ''cpi-999771'')"}}

Note: You can run commands similar to the following to get output of the failed bosh tasks.

 

bosh task <task_id> --debug > task-_d-debug.log
bosh task <task_id> --cpi > task_id-cpi.log

 

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment

Environment

VMware Tanzu Kubernetes Grid Integrated Edition 1.x

Resolution

Set the TKGi Cluster DRS Automation Level to "Fully Automated".

Procedure

1. Browse to the cluster in the vSphere Client.
2. Click the Configure tab and click Services.
3. Under Services, select vSphere DRS and click Edit. Expand DRS Automation.
4. Click the Automation Level column and select "Fully Automated" as automation level.
5. Click OK.