Tanzu Platform for Cloud Foundry on Windows - Nov 2024 Stemcell (2019.79) Issue Causing Stuck/Hung BOSH Deployments on Windows Diego Cells

Products

• VMware Tanzu Application Service for VMs
• VMware Tanzu Application Service
• VMware Tanzu Application Service

Issue/Introduction

There is a compatibility issue between Tanzu Platform for Cloud Foundry on Windows, and the November 12, 2024 Windows patches. When encountered, Windows Diego Cells will hang indefinitely during a deployment on the `pre-start` phase, and the deployment will never succeed.

Environment

Affects customers using Tanzu Platform for Cloud Foundry on Windows, with Windows stemcells containing the November 12, 2024 Windows patches.

For pre-built stemcells, this would be versions 2019.79+.

For stemcells built by customers using stembuild, this would include any 2019.* stemcells built after November 12, 2024.

Resolution

The issue has been resolved in winc-release 2.32.0. 
Upgrade TAS for Windows to v10.0.1, v6.0.11, v4.0.31 or above along with the 2019.81 or later stemcell (or any stemcells built via stembuild after Jan 2025).

Then temporary workaround to recover a hung bosh deployment is:

1. `bosh ssh` onto the Windows Diego Cell that is currently hanging on the pre-start job.
2. Use the `ps` command in powershell to find the stuck groot processes
3. Use the `kill` command in powershell to kill the stuck groot processes.
4. The deployment should go to a failed state, and allow you to redeploy with the 2019.78 stemcell.