Error: "context deadline exceeded (Client.Timeout exceeded while awaiting headers)" observed when using ose config validate command.

Products

• VMware Cloud Director

Issue/Introduction

• Running ose config validate gives a Client.Timeout exceeded while awaiting headers error in the Cloud Director Detail section.
• Running ose director show gives the correct URL and credentials.
  • To confirm the password, add --with-secret to the command.
• The SSL Protocols and Ciphers are correct between Object Storage Extension and VMware Cloud Director.

Environment

• VMware Cloud Director 10.5.1.1
• Object Storage Extension 3.1

Cause

This issue will occur if the OSE node cannot reach the Cloud Director API public address to generate the Authorization Token due to an MTU configuration issue.

Resolution

To verify if you node is having this issue:

1. Login to the node and ensure you are using root credentials or have elevated to root.
2. Attempt to connect to the Cloud Director address, specifying a packet size of 1600
   • ping vcloud.example.com -s 1600
3. If you notice nothing being sent, confirm the same command works against one of the Cells
   • ping cell.example.com -s 1600

If the ping for the Cell succeeds but the Loadbalancer is failing, contact your local Networking Admin to correctly configure the environment.

 

Note: As a temporary measure you can update the /etc/hosts file of the OSE Node to point to the Cell rather than the Loadbalancer. This is a temporary measure to avoid outages if the Loadbalancer configuration cannot be immediately addressed.