VCF Automation 9.1 VM Creation Fails with 'connection refused' to configuration-service-webhook-service

Products

• VCF Automation

Issue/Introduction

In VCF Automation 9.1, attempts to create a Virtual Machine fail with the following internal error:

'failed calling webhook "default.mutating.virtualmachine.config.vcf.vmware.com": failed to call webhook: Post "https://configuration-service-webhook-service.svc-configuration-<unique-id>.svc:443/mutate-virtual-machine?timeout=30s": dial tcp <IP>:443: connect: connection refused'

You observe the same error message if you try to create a VM from the vSphere Client supervisor UI.

Environment

VCF Automation 9.1

vCenter 9.1 - VMware vSphere Kubernetes Service (VKS)

Cause

The 'configuration-service-controller-manager' pod in the 'svc-configuration-<unique-id>' namespace has failed or is in a CrashLoopBackOff state. VM creation goes through the Configuration Service webhook.

Resolution

This issue is not related to the VCF automation environment. Please open a support case with the VMware vSphere Kubernetes Service (VKS) team to check the status of pods in the supervisor cluster.