Spring Cloud Service instance upgrade failed with CF-InsufficientResources(170008)

Products

• VMware Tanzu Application Service

Issue/Introduction

The Spring Cloud Services "upgrade-all-instances" failed with the error when updating a services instance.

2025-02-27T16:24:59.060Z ERROR 8 --- [ry-client-nio-2] i.p.s.c.s.e.core.CloudFoundryService     : Failed to upgrade service instance with id 'abcdefgh-1234-wxyz—pqrs-123456789012'.
                   The status before upgrade was 'failed' with message 'CF-InsufficientResources(170008): Insufficient resources'.
                   The status after upgrade was 'failed' with message 'CF-InsufficientResources(170008): Insufficient resources'.
2025-02-27T16:34:49.347Z ERROR 8 --- [           main] i.p.s.c.s.errand.BrokerErrandCli         : Errand failed

 

Environment

• Tanzu Platform for Cloud Foundry
• Spring Cloud Services for TPCF

Cause

1. This error is encountered when there is insufficient resources available during an upgrade. Please verify diego cells capacity/utilization. You may need to add more diego cells or increase diego cell size.

2. The error will persist until the service instance state is reset.

Resolution

Assuming that available resources have been confirmed to be sufficient proceed with the following steps:

 

1. Identify the backend SERVICE_INSTANCE_GUID
   The failed service GUID listed in the Apply Change output. For example the error below shows that the GUID is abcdefgh-1234-wxyz—pqrs-123456789012
   

   2025-02-27T16:24:59.060Z ERROR 8 --- [ry-client-nio-2] i.p.s.c.s.e.core.CloudFoundryService     : Failed to upgrade service instance with id 'abcdefgh-1234-wxyz—pqrs-123456789012'.

2. Target the org and space using the GUID from step 1:  

   cf target -o p-spring-cloud-services -s <SERVICE_INSTANCE-GUID>

3. Reset the application status by restarting the backing application:

   cf restart config-server
   
   OR
   
   cf restart service-registry
   
   

4. Identify the name and locate the org/space of the service instance 
   
   
5. Upgrade the service instance
    

   cf target -o <USER_ORG> -s <USER-SPACE>
   
   cf update-service <SERVICE-INSTANCE> -s '{"upgrade":true}'

6. Confirm that the service has been updated successfully. We can periodically run the command cf services and check the last operation field to ensure that it will output a status of "update succeeded"
   
   
7. Repeat above steps for next GUID.

Note: After manually upgrading all failed service instances you DO NOT NEED to run upgrade-all-instances errand.