"Cannot Fetch Provider Configuration" returned when attempting to create a Tanzu Kubernetes Grid Cluster in VMware Cloud Director

Products

• VMware Cloud Director

Issue/Introduction

On the second step of creating a new Tanzu Kubernetes Grid cluster the error "Cannot fetch provider configuration. Please contact your administrator" is returned. This would be when the Kubernetes version is selected.

Environment

VMware Cloud Director 10.5.x

CSE 4.2.x

Cause

The CSE appliance lacks proper DNS configuration after deployment. This can be told from the logs on the CSE appliance.

Resolution

• Log into the CSE appliance command line. The default login for user/password is root/vmware.
• Verify the error in the CSE.log. It should be located in /root/cse.log. In this situation it may look like:

I0115 03:47:09.177567   23580 auth.go:50] Using VCD OpenAPI version [37.2]
E0115 03:47:09.179876   23580 auth.go:64] failed to authenticate using refresh token
panic: error logging into VCD: [unable to get swagger client from secrets: [unable to get bearer token from secrets: [failed to set authorization header: [error getting bearer token: error authorizing service account: Post "https://<VCD FQDN>/oauth/provider/token": dial tcp: lookup <VCD FQDN> on 127.0.0.53:53: server misbehaving]]]]

• Confirm the error with the following command: nslookup <VCD FQDN>
• If name resolution fails with that command then proceed to set the correct DNS with the steps located at https://vmware.github.io/photon/assets/files/html/3.0/photon_admin/adding-a-dns-server.html