Preventing data loss during upload due to "black hole" proxy
search cancel

Preventing data loss during upload due to "black hole" proxy

book

Article ID: 341427

calendar_today

Updated On:

Products

VMware

Issue/Introduction

The data synchronization job shows completed successfully however no files appear on the Dashboard in Dashboards > Collection Dashboard > Inventory Uploads, or Performance Uploads. The files are deleted from the outbox folder on the collector. What happened to the data?


Environment

VMware Capacity Planner 2.5.x
VMware Capacity Planner 2.6.x
VMware Capacity Planner 2.1.x

Resolution

In this case the data did not actually reach the Information Warehouse (Dashboard). There is a proxy server between the Collector and the Information Warehouse. The API set used with the Collector cannot determine if the data was relayed by the proxy server, it can only detect if the files were accepted by the proxy server. The proxy may be a "black hole". It accepts the files successfully however it does not relay the files to the Information Warehouse. The result of the Data Synchronization is a success message because the proxy issue is masked from the Collector API. Therefore when the Data Synchronization task receives a success message it deletes the files in the outbox and the data is lost.
To avoid potential data loss for this condition, enable the archive option. The files can be retransmitted if necessary when using a different method or when the proxy server is configured to relay the files correctly.
To enable the archive option:
  1. Open the Data Manager.
  2. Click Admin > Options > File Paths > Archive files after data processing.

    Note: This option is listed under the Connection tab in versions 2.1 and 2.5.


    Note: If the server is limited on space, you can specify a mapped drive letter to a file server for the archive path.

  3. When the proxy situation is resolved, retransmit the data from the Archive folder. For more information, see Synchronizing Archived CSV Files to the Information Warehouse (1001612) .

For additional informational related to data issues, see Troubleshooting no data or new data appearing on the dashboard (1005492).