Unable to connect to Bosh client with an error "Requesting token via client credentials grant: UAA responded with non-successful status code '503' response 'FAILURE'"

Products

• VMware Cloud PKS

Issue/Introduction

Symptoms:

• You are unable to connect to Bosh client after rebooting the bosh vm.

• When you run any bosh commands, you see an error similar to:

Fetching info:
Performing request GET 'https://bosh-ip:25555/info':
Performing GET request:
Requesting token via client credentials grant: UAA responded with non-successful status code '503' response 'FAILURE'

Environment

VMware PKS 1.x

Cause

This issue occurs if some of the bosh services are not running.

Resolution

To resolve this issue, verify and ensure all the services are running on Bosh instance.

1. Log in to Ops Manager and note down the VM Credentials available under Ops Manager > Bosh tile > Credentials > Bosh Director.

2. Connect to Bosh vm by using the above credentials.

3. Provide root privileges by running the command: sudo -i

4. Run monit summary to verify the services status.

5. Run monit restart service_name if any of the services is not monitored or failing.