gorouter logs lines with x_cf_routererror:"endpoint_failure (context deadline exceeded)"
searchcancel
gorouter logs lines with x_cf_routererror:"endpoint_failure (context deadline exceeded)"
book
Article ID: 378520
calendar_today
Updated On: 03-24-2025
Products
VMware Tanzu Application Service
Issue/Introduction
In a GoRouter log, the message 'x_cf_routererror:"endpoint_failure (context deadline exceeded)"' means that the router (GoRouter) was unable to successfully get a responde from the intended backend endpoint within the specified time limit.
Slow application response: The backend service or application is too slow in processing the request.
Network issues: There may be network connectivity problems between the GoRouter and the backend service.
Overloaded endpoint: The backend could be overloaded, leading to longer response times.
Misconfiguration: There might be configuration issues causing delays or the router's timeout setting is too short for the current workload.
Resolution
This usually points the application as root cause of the issue. Find below some tips to troubleshoot it.
When the issue happens, collect few thread dump and analyse them(we don't support analysing thread dumps). Easier way for that is explained in following doc.
When the issue happens, run strace on the app process.Use following KB article to find the root OS pid (this is, pid, outside the container) and then run strace on it.
Start a tcpdump at any time, wait until the issue happens, and check it to search any possible communication issue.
Ask the dev team to include as many debug lines as possible in the code handling the endpoint, to see where it get stuck.