ABX database grows large and causes postgres startup failure

Products

• VMware
• VMware Aria Suite

Issue/Introduction

Symptoms:

• You are using VMware vRealize Automation 8.8 - 8.11.1.
• VM disk 2 (/data) continuously runs out of space.
• /opt/scripts/deploy.sh script runs for very long time or times out while trying to start postgres pods.
• Upgrade runs for very long time or times out during service startup in deploy.sh.

Verifying Symptoms

1. SSH to one node in the Aria Automation cluster.
2. Run the following command

   du -sh /data/db/live

3. Run the following command to connect to the ABX database

   vracli dev psql abx-db

4. Run the following query to check the size of the database and row counts

   SELECT pg_size_pretty(
       (cast(pg_total_relation_size('abx_action_content') AS decimal)
       / (SELECT COUNT(*) FROM abx_action_content))
       * (SELECT COUNT(*) FROM abx_action_content WHERE id NOT IN (
       	SELECT content_id FROM abx_action WHERE content_id IS NOT NULL)));

5. The numbers from Step 4 are in the range of hundreds of gigabytes and is close to the number reported in Step #2.

Environment

VMware vRealize Automation SaltStack Config 8.11.x
VMware vRealize Automation 8.10.x
VMware vRealize Automation 8.8.x
VMware vRealize Automation 8.x
VMware vRealize Automation 8.9.x
VMware vRealize Automation 8.11.x
VMware Aria Automation 8.12.x
VMware Aria Automation Config 8.12.x

Cause

Upon each action update, ABX stores its content in the database. In some cases, an obsolete version of this content remains in the database causing a gradual growth with not needed records.

Resolution

This data records leak is resolved in VMware vRealize Automation 8.11.2 and above.

Clean-up logic is introduced in VMware Aria Automation 8.13.0 (formerly vRealize Automation).

See the Workaround section for additional information for versions 8.8. - 8.11.2.

Workaround:

Patch Procedure for 8.8 - 8.12.2

Prerequisites

• Create simultaneous VM snapshots without memory (8.8 - 8.9) for each appliance in the cluster.
  • For versions 8.9. and above, use the quiesce option.

Procedure

1. SSH into one appliance in the cluster.
2. Run the following command:

   echo "W1VuaXRdCkRlc2NyaXB0aW9uPUNsZWFuLXVwIHNlcnZpY2UgZm9yIEFCWCBkYXRhYmFzZSBmb3IgaXNzdWUgNDg4NDgKCltTZXJ2aWNlXQpUeXBlPXNpbXBsZQpFeGVjU3RhcnQ9L2Jpbi9iYXNoIC1jICdlY2hvICJJeUV2WW1sdUwySmhjMmdLQ2lNS0l5QkRiM0I1Y21sbmFIUWdLR01wSURJd01qTWdWazEzWVhKbExDQkpibU11SUNCQmJHd2djbWxuYUhSeklISmxjMlZ5ZG1Wa0xnb2pDZ3B6WlhRZ0szZ0tjMlYwSUN0bENncHNiMmRFYVhJOUlpOTJZWEl2Ykc5bkwzWnRkMkZ5WlM5d2NtVnNkV1JsSWdwMGFXMWxjM1JoYlhBOUpDaGtZWFJsSUNjckpWa3RKVzB0SldRdEpVZ3RKVTB0SlZNbktRcHdjajBpTkRnNE5EZ2lDa3hQUjE5UVFWUklQU0lrYkc5blJHbHlMMjFoYVc1MFpXNWhibU5sTFhCaGRHTm9MWEJ5SkhCeUxTUjBhVzFsYzNSaGJYQXViRzluSWdwbGVIQnZjblFnUzFWQ1JVTlBUa1pKUnowdlpYUmpMMnQxWW1WeWJtVjBaWE12WVdSdGFXNHVZMjl1WmdvS2JXdGthWElnTFhBZ0lpUnNiMmRFYVhJaUNncG1kVzVqZEdsdmJpQnNiMmNvS1NCN0NpQWdiRzlqWVd3Z2JYTm5QU0lrTVNJS0lDQnNiMk5oYkNCc1pYWmxiRDBpSkRJaUNpQWdiRzlqWVd3Z1pIUTlKQ2hrWVhSbElDY3JKVmt0SlcwdEpXUWdKVWc2SlUwNkpWTW5LUW9nSUd4dlkyRnNJR2h2YzNST1lXMWxQU0lrS0dodmMzUnVZVzFsSUMxbUtTSUtDaUFnWldOb2J5QWlXeVJzWlhabGJGMWJKR1IwWFZza2FHOXpkRTVoYldWZElDUnRjMmNpSUh3Z2RHVmxJQzFoSUNJa1RFOUhYMUJCVkVnaUNuMEtDbVoxYm1OMGFXOXVJR3h2WjE5cGJtWnZLQ2tnZXdvZ0lHeHZaeUFpSkRFaUlDSkpUa1pQSWdwOUNncG1kVzVqZEdsdmJpQnNiMmRmWlhKeWIzSW9LU0I3Q2lBZ2JHOW5JQ0lrTVNJZ0lrVlNVazlTSWdwOUNncG1kVzVqZEdsdmJpQmphR1ZqYTE5aGNIQnNhV0Z1WTJWZmRtVnljMmx2YmlncElIc0tJQ0JzYjJOaGJDQjJZVzFwVm1WeVBTUW9MMjl3ZEM5MmJYZGhjbVV2WW1sdUwzWmhiV2xqYkdrZ2RtVnljMmx2YmlBdExXRndjR3hwWVc1alpTa0tJQ0JzYjJOaGJDQmhjSEJzVm1WeVBTUW9aV05vYnlBaUpIWmhiV2xXWlhJaUlId2daM0psY0NBaVZtVnljMmx2YmlBdElDSWdmQ0JoZDJzZ0ozdHdjbWx1ZENBa00zMG5LUW9LSUNCc2IyZGZhVzVtYnlBaVFYQndiR2xoYm1ObElIWmxjbk5wYjI0NklDUmhjSEJzVm1WeUlnb0tJQ0JsWTJodklDSWtZWEJ3YkZabGNpSWdmQ0JuY21Wd0lDMXhJQ0plT0M0NExqQWlJQ1ltSUhKbGRIVnliaUF3Q2lBZ1pXTm9ieUFpSkdGd2NHeFdaWElpSUh3Z1ozSmxjQ0F0Y1NBaVhqZ3VPQzR4SWlBbUppQnlaWFIxY200Z01Bb2dJR1ZqYUc4Z0lpUmhjSEJzVm1WeUlpQjhJR2R5WlhBZ0xYRWdJbDQ0TGpndU1pSWdKaVlnY21WMGRYSnVJREFLSUNCbFkyaHZJQ0lrWVhCd2JGWmxjaUlnZkNCbmNtVndJQzF4SUNKZU9DNDVMakVpSUNZbUlISmxkSFZ5YmlBd0NpQWdaV05vYnlBaUpHRndjR3hXWlhJaUlId2daM0psY0NBdGNTQWlYamd1TVRBdU1DSWdKaVlnY21WMGRYSnVJREFLSUNCbFkyaHZJQ0lrWVhCd2JGWmxjaUlnZkNCbmNtVndJQzF4SUNKZU9DNHhNQzR4SWlBbUppQnlaWFIxY200Z01Bb2dJR1ZqYUc4Z0lpUmhjSEJzVm1WeUlpQjhJR2R5WlhBZ0xYRWdJbDQ0TGpFd0xqSWlJQ1ltSUhKbGRIVnliaUF3Q2lBZ1pXTm9ieUFpSkdGd2NHeFdaWElpSUh3Z1ozSmxjQ0F0Y1NBaVhqZ3VNVEV1TVNJZ0ppWWdjbVYwZFhKdUlEQUtJQ0JsWTJodklDSWtZWEJ3YkZabGNpSWdmQ0JuY21Wd0lDMXhJQ0plT0M0eE1TNHlJaUFtSmlCeVpYUjFjbTRnTUFvZ0lHVmphRzhnSWlSaGNIQnNWbVZ5SWlCOElHZHlaWEFnTFhFZ0lsNDRMakV5TGpBaUlDWW1JSEpsZEhWeWJpQXdDaUFnWldOb2J5QWlKR0Z3Y0d4V1pYSWlJSHdnWjNKbGNDQXRjU0FpWGpndU1USXVNU0lnSmlZZ2NtVjBkWEp1SURBS0lDQmxZMmh2SUNJa1lYQndiRlpsY2lJZ2ZDQm5jbVZ3SUMxeElDSmVPQzR4TWk0eUlpQW1KaUJ5WlhSMWNtNGdNQW9LSUNCeVpYUjFjbTRnTVFwOUNncG1kVzVqZEdsdmJpQnJPSE5mY21WaFpIa29LU0I3Q2lBZ2JHOWpZV3dnYm05a1pYTlRkR0YwZFhNOUpDaDBhVzFsYjNWMElETXdNQ0F2ZFhOeUwyeHZZMkZzTDJKcGJpOXJkV0psWTNSc0lHZGxkQ0J1YjJSbGN5QXRMVzV2TFdobFlXUmxjbk1nZkNCaGQyc2dKM3R3Y21sdWRDQWtNbjBuS1FvZ0lHeHZZMkZzSUhKbGMzVnNkRDBrUHdvS0lDQWpJRlJvWlhKbEozTWdVbVZoWkhrZ2MzUmhkR1VnYVc0Z2RHaGxJRzV2WkdWeklHeHBjM1F1Q2lBZ1cxc2dKSEpsYzNWc2RDQXRaWEVnTUNCZFhTQW1KaUI3SUdWamFHOGdJaVJ1YjJSbGMxTjBZWFIxY3lJZ2ZDQnpiM0owSUMxMUlId2daM0psY0NBdGNTQWlVbVZoWkhraUlDWW1JSEpsYzNWc2REMHdJSHg4SUhKbGMzVnNkRDB5T3lCOUNnb2dJQ01nVkdobElHOXViSGtnWVhaaGFXeGhZbXhsSUc1dlpHVWdjM1JoZEdVZ2FYTWdVbVZoWkhrdUNpQWdXMXNnSkhKbGMzVnNkQ0F0WlhFZ01DQmRYU0FtSmlCN0lGdGJJQ1FvWldOb2J5QWlKRzV2WkdWelUzUmhkSFZ6SWlCOElITnZjblFnTFhVZ2ZDQjNZeUF0YkNrZ0xXVnhJREVnWFYwZ0ppWWdjbVZ6ZFd4MFBUQWdmSHdnY21WemRXeDBQVE03SUgwS0NpQWdJeUJEYkhWemRHVnlJSEpsYlc5MFpTQmpiMjF0ZFc1cFkyRjBhVzl1SUdseklFOU9JR1V1Wnk0Z1lXeHNJSEpsYkdWMllXNTBJSEJ2WkhNZ2FXNGdhM1ZpWlMxemVYTjBaVzBnWVhKbElIVndMZ29nSUZ0YklDUnlaWE4xYkhRZ0xXVnhJREFnWFYwZ0ppWWdleUIwYVcxbGIzVjBJRE13TUNCMmNtRmpiR2tnWTJ4MWMzUmxjaUJsZUdWaklDMHRJR0poYzJnZ0xXTWdKeTkxYzNJdlltbHVMMlJoZEdVbklDWW1JSEpsYzNWc2REMHdJSHg4SUhKbGMzVnNkRDAwT3lCOUNnb2dJSEpsZEhWeWJpQWtjbVZ6ZFd4MENuMEtDbVoxYm1OMGFXOXVJSEJ6Y1d4ZmNtVmhaSGtvS1NCN0NpQWdiRzlqWVd3Z1kyOTFiblE5SkNndmRYTnlMMnh2WTJGc0wySnBiaTlyZFdKbFkzUnNJQzF1SUhCeVpXeDFaR1VnWjJWMElIQnZaSE1nZkNCbmNtVndJSEJ2YzNSbmNtVnpJSHdnWjNKbGNDQWlVblZ1Ym1sdVp5SWdmQ0JuY21Wd0lDSXhMekVpSUh3Z2QyTWdMV3dwQ2dvZ0lGdGJJQ1JqYjNWdWRDQXRaWEVnTXlCZFhTQW1KaUJ5WlhSMWNtNGdNQ0I4ZkNCeVpYUjFjbTRnTVFwOUNncG1kVzVqZEdsdmJpQndjM0ZzWDNCeWFXMWhjbmtvS1NCN0NpQWdiRzlqWVd3Z0xXNGdjSEpwYldGeWVUMGtNUW9nSUhCeWFXMWhjbms5SWlRb2RuSmhZMnhwSUhOMFlYUjFjeUI4SUdweElDMXlJQ2N1WkdGMFlXSmhjMlZPYjJSbGMxdGRJSHdnYzJWc1pXTjBLQzVTYjJ4bFBUMGljSEpwYldGeWVTSXBMaUpPYjJSbElHNWhiV1VpSnlCOElHTjFkQ0F0WkNBbkxpY2dMV1lnTVNraUNuMEtDbVoxYm1OMGFXOXVJSEJ6Y1d4ZlpHVnNaWFJsWDJKaGRHTm9LQ2tnZXdvZ0lHeHZZMkZzSUhCeWFXMWhjbms5SWlReElnb2dJR3h2WTJGc0lISnZkM05CWm1abFkzUmxaRDBpSkNndmRYTnlMMnh2WTJGc0wySnBiaTlyZFdKbFkzUnNJR1Y0WldNZ0xXNGdjSEpsYkhWa1pTQWlKSEJ5YVcxaGNua2lJQzB0SUdOb2NITjBJQzExSUhCdmMzUm5jbVZ6SUhCemNXd2dYQW9nSUNBZ0xXUWdJbUZpZUMxa1lpSWdYQW9nSUNBZ0xXTWdJZ29nSUNBZ0lDQkVSVXhGVkVVS0lDQWdJQ0FnUmxKUFRTQmhZbmhmWVdOMGFXOXVYMk52Ym5SbGJuUUtJQ0FnSUNBZ1YwaEZVa1VnYVdRZ2FXNGdLQW9nSUNBZ0lDQWdJRk5GVEVWRFZDQnBaQW9nSUNBZ0lDQWdJRVpTVDAwZ1lXSjRYMkZqZEdsdmJsOWpiMjUwWlc1MENpQWdJQ0FnSUNBZ1YwaEZVa1VnYVdRZ2JtOTBJRWxPSUNnS0lDQWdJQ0FnSUNBZ0lGTkZURVZEVkNCaFkzUnBiMjR0UGo0blkyOXVkR1Z1ZEVsa0p5QkJVeUJqYjI1MFpXNTBYMmxrQ2lBZ0lDQWdJQ0FnSUNCR1VrOU5JSEIxWW14cFl5NWhZbmhmWVdOMGFXOXVYM1psY25OcGIyNEtJQ0FnSUNBZ0lDQWdJRmRJUlZKRklHRmpkR2x2YmkwK1BpZGpiMjUwWlc1MFNXUW5JRWxUSUU1UFZDQk9WVXhNQ2lBZ0lDQWdJQ0FnSUNCVlRrbFBUZ29nSUNBZ0lDQWdJQ0FnVTBWTVJVTlVJR052Ym5SbGJuUmZhV1FLSUNBZ0lDQWdJQ0FnSUVaU1QwMGdjSFZpYkdsakxtRmllRjloWTNScGIyNEtJQ0FnSUNBZ0lDQWdJRmRJUlZKRklHTnZiblJsYm5SZmFXUWdTVk1nVGs5VUlFNVZURXdLSUNBZ0lDQWdJQ0FnSUNrZ1RFbE5TVlFnTVRBS0lDQWdJQ0FnSUNBcENpQWdJQ0FnSUNJcElnb2dJR3h2WTJGc0lISmxjM1ZzZEQwa1B3b2dJRnRiSUNSeVpYTjFiSFFnTFc1bElEQWdYVjBnSmlZZ2NtVjBkWEp1SURJS0lDQmxZMmh2SUNJa2NtOTNjMEZtWm1WamRHVmtJaUI4SUdkeVpYQWdMWEVnSWtSRlRFVlVSU0F3SWlBbUppQnlaWFIxY200Z01Bb2dJSEpsZEhWeWJpQXhDbjBLQ21aMWJtTjBhVzl1SUhCemNXeGZjbVZ3YjNKMFgzSmxiV0ZwYm1sdVp5Z3BJSHNLSUNCc2IyTmhiQ0J3Y21sdFlYSjVQU0lrTVNJS0NpQWdMM1Z6Y2k5c2IyTmhiQzlpYVc0dmEzVmlaV04wYkNCbGVHVmpJQzF1SUhCeVpXeDFaR1VnSWlSd2NtbHRZWEo1SWlBdExTQmphSEJ6ZENBdGRTQndiM04wWjNKbGN5QndjM0ZzSUZ3S0lDQWdJQzFrSUNKaFluZ3RaR0lpSUZ3S0lDQWdJQzFqSUNJS0lDQWdJQ0JUUlV4RlExUWdRMDlWVGxRb0tpa2dSbEpQVFNCaFluaGZZV04wYVc5dVgyTnZiblJsYm5RZ1YwaEZVa1VnYVdRZ1RrOVVJRWxPSUNnS0lDQWdJQ0FnSUNBZ0lDQWdVMFZNUlVOVUlHTnZiblJsYm5SZmFXUWdSbEpQVFNCaFluaGZZV04wYVc5dUlGZElSVkpGSUdOdmJuUmxiblJmYVdRZ1NWTWdUazlVSUU1VlRFd3BPd29nSUNBZ0lDQWlJRDQrSUNJa1RFOUhYMUJCVkVnaUNuMEtDbVoxYm1OMGFXOXVJSEJ6Y1d4ZmRtRmpkWFZ0S0NrZ2V3b2dJR3h2WTJGc0lIQnlhVzFoY25rOUlpUXhJZ29nSUM5MWMzSXZiRzlqWVd3dlltbHVMMnQxWW1WamRHd2daWGhsWXlBdGJpQndjbVZzZFdSbElDSWtjSEpwYldGeWVTSWdMUzBnWTJod2MzUWdMWFVnY0c5emRHZHlaWE1nY0hOeGJDQXRaQ0FpWVdKNExXUmlJaUF0WXlBaVZrRkRWVlZOSUVaVlRFd2dZV0o0WDJGamRHbHZibDlqYjI1MFpXNTBPeUlLZlFvS1puVnVZM1JwYjI0Z2MzbHpkR1Z0WkY5eVpXMXZkbVZmYzJWeWRtbGpaU2dwSUhzS0lDQnplWE4wWlcxamRHd2djM1J2Y0NCaFluZ3RaR0l0WTJ4bFlXNTFjQzAwT0RnME9DNXpaWEoyYVdObENpQWdjbTBnTFdZZ0wyVjBZeTl6ZVhOMFpXMWtMM041YzNSbGJTOWhZbmd0WkdJdFkyeGxZVzUxY0MwME9EZzBPQzV6WlhKMmFXTmxDaUFnY20wZ0xXWWdMM1poY2k5eWRXNHZZV0o0TFdSaUxXTnNaV0Z1ZFhBdE5EZzRORGd1YzJnS0lDQnplWE4wWlcxamRHd2daR0ZsYlc5dUxYSmxiRzloWkFwOUNnb2pJRlpsY25OcGIyNGdZMmhsWTJzS1kyaGxZMnRmWVhCd2JHbGhibU5sWDNabGNuTnBiMjRLY21WemRXeDBQU1EvQ2dwcFppQmJJQ1J5WlhOMWJIUWdMVzVsSURBZ1hRcDBhR1Z1Q2lBZ2JHOW5YMlZ5Y205eUlDSlVhR1VnYldGcGJuUmxibUZ1WTJVZ2NHRjBZMmdnYVhNZ2JtOTBJR052YlhCaGRHbGliR1VnZDJsMGFDQjBhR2x6SUhCeWIyUjFZM1FnZG1WeWMybHZiaTRpQ2lBZ2MzbHpkR1Z0WkY5eVpXMXZkbVZmYzJWeWRtbGpaUW9LSUNCbGVHbDBJREFLWm1rS0NuZG9hV3hsSUZzZ01TQXRaWEVnTVNCZENtUnZDaUFnYzJ4bFpYQWdNVEFLQ2lBZ2JHOW5YMmx1Wm04Z0lrTm9aV05yYVc1bklHRjJZV2xzWVdKcGJHbDBlU0J2WmlCTGRXSmxjbTVsZEdWekxpSUtJQ0JyT0hOZmNtVmhaSGtLSUNCeVpYTjFiSFE5SkQ4S0lDQnBaaUJiSUNSeVpYTjFiSFFnTFc1bElEQWdYUW9nSUhSb1pXNEtJQ0FnSUd4dloxOWxjbkp2Y2lBaVMzVmlaWEp1WlhSbGN5QnViM1FnY21WaFpIa3VJRkpsZEhKNWFXNW5JR2x1SURFd0lITmxZMjl1WkhNZ0xpNHVJZ29nSUNBZ1kyOXVkR2x1ZFdVS0lDQm1hUW9LSUNCc2IyZGZhVzVtYnlBaVEyaGxZMnRwYm1jZ1lYWmhhV3hoWW1sc2FYUjVJRzltSUZCdmMzUm5jbVZ6TGlJS0lDQndjM0ZzWDNKbFlXUjVDaUFnY21WemRXeDBQU1EvQ2lBZ2FXWWdXeUFrY21WemRXeDBJQzF1WlNBd0lGMEtJQ0IwYUdWdUNpQWdJQ0JzYjJkZlpYSnliM0lnSWxCdmMzUm5jbVZ6SUc1dmRDQnlaV0ZrZVM0Z1VtVjBjbmxwYm1jZ2FXNGdNVEFnYzJWamIyNWtjeUF1TGk0aUNpQWdJQ0JqYjI1MGFXNTFaUW9nSUdacENnb2dJR3h2WjE5cGJtWnZJQ0pUWldGamFHbHVaeUJtYjNJZ2NHOXpkR2R5WlhNZ2NISnBiV0Z5ZVM0aUNpQWdjSE54YkY5d2NtbHRZWEo1SUhCemNXeGZjRzlrWDNCeWFXMWhjbmtLSUNCcFppQmJJQzE2SUNJa2NITnhiRjl3YjJSZmNISnBiV0Z5ZVNJZ1hRb2dJSFJvWlc0S0lDQWdJR3h2WjE5bGNuSnZjaUFpVUc5emRHZHlaWE1nY0hKcGJXRnllU0J1YjNRZ1ptOTFibVF1SUZKbGRISjVhVzVuSUdsdUlERXdJSE5sWTI5dVpITWdMaTR1SWdvZ0lDQWdZMjl1ZEdsdWRXVUtJQ0JtYVFvS0lDQnNiMmRmYVc1bWJ5QWlVbVZ0WVdsdWFXNW5JRzl5Y0doaGJtVmtJSEpsWTI5eVpITWdabTl5SUhKbGJXOTJZV3c2SWdvZ0lIQnpjV3hmY21Wd2IzSjBYM0psYldGcGJtbHVaeUFpSkhCemNXeGZjRzlrWDNCeWFXMWhjbmtpQ2dvZ0lHbGtlRDB3Q2lBZ2QyaHBiR1VnV3lBeElDMWxjU0F4SUYwS0lDQmtid29nSUNBZ2JHOW5YMmx1Wm04Z0lrUmxiR1YwYVc1bklHRWdZbUYwWTJnZ2IyWWdiM0p3YUdGdVpXUWdaR0YwWVNCeVpXTnZjbVJ6SUM0dUxpSUtJQ0FnSUhCemNXeGZaR1ZzWlhSbFgySmhkR05vSUNJa2NITnhiRjl3YjJSZmNISnBiV0Z5ZVNJS0lDQWdJSEpsYzNWc2REMGtQd29LSUNBZ0lHbG1JRnNnSkhKbGMzVnNkQ0F0WlhFZ01TQmRDaUFnSUNCMGFHVnVDaUFnSUNBZ0lITnNaV1Z3SURJS0NpQWdJQ0FnSUNnb2FXUjRLeXNwS1FvZ0lDQWdJQ0JwWmlCYklDUW9LR2xrZUNBbElEVXdLU2tnTFdWeElEQWdYUW9nSUNBZ0lDQjBhR1Z1Q2lBZ0lDQWdJQ0FnYkc5blgybHVabThnSWxKbGJXRnBibWx1WnlCdmNuQm9ZVzVsWkNCeVpXTnZjbVJ6SUdadmNpQnlaVzF2ZG1Gc2N6b2lDaUFnSUNBZ0lDQWdjSE54YkY5eVpYQnZjblJmY21WdFlXbHVhVzVuSUNJa2NITnhiRjl3YjJSZmNISnBiV0Z5ZVNJS0lDQWdJQ0FnWm1rS0lDQWdJQ0FnWTI5dWRHbHVkV1VLSUNBZ0lHVnNhV1lnV3lBa2NtVnpkV3gwSUMxbGNTQXlJRjBLSUNBZ0lIUm9aVzRLSUNBZ0lDQWdiRzluWDJWeWNtOXlJQ0pCYmlCbGNuSnZjaUJ2WTJOMWNuSmxaQ0IzYUdsc1pTQmtaV3hsZEdsdVp5QnZjbkJvWVc1bFpDQmtZWFJoSUhKbFkyOXlaSE1pQ2lBZ0lDQWdJR0p5WldGckNpQWdJQ0JsYkhObENpQWdJQ0FnSUd4dloxOXBibVp2SUNKQ1lYUmphQ0JrWld4bGRHVnpJR052YlhCc1pYUmxMaUlLQ2lBZ0lDQWdJR2xtSUZzZ0pHbGtlQ0F0WjNRZ01TQmRDaUFnSUNBZ0lIUm9aVzRLSUNBZ0lDQWdJQ0JzYjJkZmFXNW1ieUFpVm1GamRYVnRhVzVuSUM0dUxpSUtJQ0FnSUNBZ0lDQndjM0ZzWDNaaFkzVjFiU0FpSkhCemNXeGZjRzlrWDNCeWFXMWhjbmtpQ2lBZ0lDQWdJR1pwQ2lBZ0lDQWdJR0p5WldGckNpQWdJQ0JtYVFvZ0lHUnZibVVLQ2lBZ2FXWWdXeUFrY21WemRXeDBJQzFsY1NBd0lGMEtJQ0IwYUdWdUNpQWdJQ0JzYjJkZmFXNW1ieUFpUTJ4bFlXNHRkWEFnWTI5dGNHeGxkR1ZrSUhOMVkyTmxjM05tZFd4c2VTNGlDaUFnSUNCaWNtVmhhd29nSUdacENtUnZibVVLQ2lNZ1UyVnNaaUJrWld4bGRHVUtjM2x6ZEdWdFpGOXlaVzF2ZG1WZmMyVnlkbWxqWlFvPSIgfCBiYXNlNjQgLWQgPiAvdmFyL3J1bi9hYngtZGItY2xlYW51cC00ODg0OC5zaDsgY2htb2QgYSt4IC92YXIvcnVuL2FieC1kYi1jbGVhbnVwLTQ4ODQ4LnNoOyAvdmFyL3J1bi9hYngtZGItY2xlYW51cC00ODg0OC5zaCc=" | base64 -d > /etc/systemd/system/abx-db-cleanup-48848.service; systemctl daemon-reload; systemctl start abx-db-cleanup-48848.service;

3. Review the /var/log/vmware/prelude/maintenance-patch-pr48848-timestamp.log files to monitor progress.

Note: This procedure may take many hours. Periodically the "Remaining orphaned records for removal" message will appear within the log with the remaining orphaned ABX data subject to this clean-up.
Note: Once the clean-up is complete, the maintenance script will uninstall itself. However, for vRA versions prior to 8.11.2, the ABX service will create new orphaned records after the clean-up is complete. Therefore, the procedure should be repeated if the system continues operating for very long periods of time before the next scheduled upgrade.