windows2019fs cert-injector failed when upgrading VMware Tanzu Application Service [Windows] tile

Products

• VMware Tanzu Application Service for VMs

Issue/Introduction

You hit an issue when upgrading VMware Tanzu Application Service [Windows] (TASW) tile to PASW 2.6.15, TASW 2.7.11, or TASW 2.8.6.

There is a race condition where the path upgrade may break if the Windows stemcell 2019.17 was already used before the TASW upgrade.

From the log windows2019fs/pre-start.stderr.log, you see the following:

2020/03/11 04:31:11 cert-injector failed: winc run failed: exit status 1
container layer-1583907219 encountered an error during Start: failure in a Windows system call: The virtual machine or container exited unexpectedly. (0xc0370106)

Environment

Product Version: 2.6

Resolution

To resolve this issue, you need to upgrade TASW 2.6.15, 2.7.11, or 2.8.6 with the Windows stemcell 2019.15.

Note: Skip the steps 1 and 2 if the Windows stemcell 2019.15 is already available in Ops Manager.

1. Upload the Windows stemcell 2019.15 from Ops manager VM to Bosh director blobstore

bosh upload-stemcell /var/tempest/stemcells/bosh-stemcell-2019.15-vsphere-esxi-windows2019-go_agent.tgz 

2. Edit and replace the Windows stemcell version from 2019.17 to 2019.15 in the pasw-deployment.yml
located in Ops Manager VM: /var/tempest/workspaces/default/deployments/pas-windows-GUID.yml

3. Manually deploy the manifest:

bosh -d <PASW-DEPLOYEMENT> deploy /var/tempest/workspaces/default/deployments/pas-windows-GUID.yml

4. Upgrade to Windows 2019.17+ stemcell in Ops manager, got to the stemcell library, and click Apply Changes.