"Pool#acquire(Duration) has been pending for more than the configured timeout of 45000ms" message when creating or deleting Spring Cloud Service services

Products

• Support Only for Spring

Issue/Introduction

When attempting to create or delete a Spring Cloud Service (SCS) service instance (config server or service registry), it fails with the following message:

message: Pool#acquire(Duration) has been pending for more than the configured timeout of 45000ms

Environment

Product Version: 3.1

Resolution

This message is caused by many connections remaining in a CLOSED_WAIT state on the spring-cloud-services VM.

To see these connections, run this command:

netstat -anlp | grep java | grep 443 

This issue is fixed in SCS 3.1.25. If possible, upgrade to SCS 3.1.25 to permanently resolve this issue.

To work around this issue, you can restart the monit processes that hold the connections. To restart the monit processes holding these connections in a CLOSED_WAIT state, run these commands:

monit restart scs-service-broker
monit restart mirror-service