Cf push fails with "Waiting for API to complete processing files"

Products

• VMware Tanzu Platform Core

Issue/Introduction

When pushing an app, the process has a few stages. Part of it is to upload files to a blobstore. If the blobstore is full the cf push will fail. Example errors are:

 Waiting for API to complete processing files...
           FAILED
Stderr     Package failed to process correctly after upload

Environment

TAS/EAR

Cause

Review cloud_controller logs for failures as API referred in the error message is the cloud_controller API. 

Resolution

Use app guid or process_guid to review the cloud_controller_ng logs for failures. In this scenario the errors observed were the following:

Error with blobstore: Excon::Error::Socket - Connection reset by peer (Errno::ECONNRESET)

Request failed: 500: {\"description\"=\u003e\"Failed to perform blobstore operation after three retries.

indicating the problem is with Blobstore. Review the blobstore storage to make sure there is enough space for the app packages to be uploaded to it.

Cloud_controller logs will contain most descriptive error messages to help troubleshoot the issue.