Windows Cells are unresponsive/failed post restart or apply changes. Apply changes fails with: 1 of 14 pre-start scripts failed. Failed Jobs: winc-network-hns-acls.

Products

• VMware Tanzu Application Service for VMs

Issue/Introduction

Post apply changes or restart of Windows Diego Cells the Windows cells only come back with an unresponsive agent and failing with error:

1 of 14 pre-start scripts failed. Failed Jobs: winc-network-hns-acls.

If you run PowerShell Get-NetConnectionProfile command on the cell you see that winc-nat network is not created on the failing VMs. 

 

Running the FULL pre-start script C:\var\vcap\jobs\winc-network-hns-acls\bin\pre-start.ps1 fails with: hnsCall Failed in Wnd32: The object already exists. (0x1392)

 

In the logs for winc-network-hns-acls process on the failing windows Diego Cell you may see:

{"level":"error","msg":"networkUp: Network winc-nat not found","time":"2020-06-27T04:16:34Z"}
{"level":"error","msg":"networkUp: Network winc-nat not found","time":"2020-06-27T04:16:38Z"}
{"level":"error","msg":"networkUp: Network winc-nat not found","time":"2020-06-27T04:16:41Z”}

Resolution

Bosh delete-vm <vm-id>
bosh cck - select option recreate

or

stop winc-network-hns-acls
rename or delete C:\ProgramData\Microsoft\Windows\HNS\HNS.datanet
run C:\var\vcap\jobs\winc-network-hns-acls\bin\pre-start.ps1