When upgrading VMware Cloud Foundation (VCF) Automation from versions 9.0.1, 9.0.2.X, or 9.1.0.X, you must proactively remove any custom profiles before proceeding. If these profiles are left in place, the upgrade will fail
VCF Automation 9.0.x | 9.1.0
Custom profiles are drop-in configuration overlays applied to VMware Cloud Foundation (VCF) Automation services via the Synthetic Checker API. They are stored in the VAConfig CR under spec.profiles.bundles and referenced in the PackageDeployment under spec.values.vcfa.configOverrides.tag. During upgrades to earlier versions, the profile artifacts from the source release are no longer compatible and cause vmsp-prelude-deployer to fail due to a missing ConfigMap. VCFA 9.0.0.0 is not affected, as no custom profiles exist on that version.
Broadcom is aware of this issue and plans to resolve it in an upcoming feature release.
Workaround:
Run the remove-profiles.sh script on the source environment (9.0.1, 9.0.2, or 9.1.0) to remove all custom profile bundles and clean up the VAConfig CR and PackageDeployment before starting the upgrade. The script is self-contained and handles listing, backup, deletion, and verification.
Downtime Notice: The removal of profiles triggers a redeployment of VCFA services on the source environment, which typically takes 15–30 minutes. Plan for this downtime before initiating your upgrade window.
NOTE: VCFA 9.0.0.0 has no custom profiles and does not need this workaround.
Procedure:
Take a backup of VCFA via Fleet LCM. Reference On-Demand Backup of VCFA 9.0.x On-Demand Backup of VCFA 9.1.0
Log in to one of the VMs of VCFA and switch to root:
ssh vmware-system-user@<VCFA-Platform-FQDN>
sudo -i
Install the patch script on the node by extracting the encoded bundle:
mkdir -p ~/vcfapr-1697 && cd ~/vcfapr-1697base64 -d <<< '/Td6WFoAAAFpIt42BMCgHYCgASEBHAAAAAAAANgD7IbgT/8OmF0AORlJ/trZGdwEcY6G0My4WSX3KYMQztPlimsEmom8JRNSHExypAB5UVbV8MG9igbxChh4p8cKB7oyo5XPQA+4j8skofEYFpsFhYreodk6+rqKuaSASanRL1TQa4nX61w3oqew+mobW9IJrYLjseal8GNupdqndMld2BXobufKVod05+GHdrrAUCCZv3pk3Rm26Gz8bo5Zip9rgYFQqrrSqYqgGZr4Jvc00to39LagrLfbH2OKGd/wpd77Zn4xU42lfI9IKwABj9nKj68xPizjKJYZ7wLOiO5YHeEe8vNBCOnbv6hQIagHGzmCIqmVupWBv3f8KzLSK2HMNwzAE6gsXWob6nXkKm3BLmAM3x4M7Hq13O4kHTXfnWIyNRRAlkhn8/OLdseuSGDtLHlcBh4wd7fe95HKzFZiVMqujGfzs2KITYuLfALPmz9y/NUHYFw3L0PzzGnhjYBEyKNedCY//CJXb6ycfp010w6PiaHPreGP1Jz32AFrbidvS5/q1o5g5Cic3ykklPk/waEylY3oSGfq/HiGfuO75b+t3/yLlsH4Pl4P6UGP8CiqYuFeaIMHDrX6CXjT7q/M4w+HMyY5ggzAt5y6tY12MSP/YX4N++rPOz35GOVOcN6/QRpqEPsomIxk9R2mYfpffRS692U2mX11I7rCwh8MDQDLXOZOD/UFYePD1IAyPiE/2AD3OQAcqEyINHF2TvL+xRylluCCe+Lw40rhQN2oypMhJWlT7HC5ftLaJWfzwio0cTr5KDJ7HNJN0ldofUCMtBvUvjdIyYpJXXA/kZ2qlt2CzWwrSG4blda9xU9L+/avY6RQA2B/RL+p0rRoO1W7VGU5LYi2/QxWd16YcnHWSI75Axvrv3QT0HAiRZZxb7rDmRm7G2+QrFfOwI/Gzzv9RgBkh3yvsfdRiMEuNTDL8I4lBbdRqKv65oFXGV8o4D+QrSAxa/4nyB4iBGSBVSATA6udsFMqmIq0sDEq+QCXn//nnwa+6IYZnMYLmt5MWz94ceX9cAi6k3bVXdy+PLYwJFOUV769nFETDv4Xpo18EUDk6PZii4+RhWX5I9mQCdQDnNlJRexodnP6834S+5zi8vgGnK6tO9DJTboJY/vt6hZRlVZsWmLtgcIVcQ1kjC1rnQ6aGDtgupWmY31YJrtd2O3+Ol86GGftKiMJYBc/5J9lPqwuNXJQYdjyHHW+d4hNB1ou2Cy8Y6+raYjbf0PeytUrDiQwhNoB/zgTMXl3A7umTFcWKwR+FmbWOnrWl6D4ahofOxonMbWkTS+rrj6GJU35XqJJtDsxhXH1t6rCQG9KivSATX6Vhwr4InpI3BNBwsqEfKV5LlmNEIajUZW5cCyHJrBcmn/GVMIT9KGPD91e1BFgIqFz9WUid2edJsHTTA1IGO60rQO4E+K8NEUvGqIF2wFsYDUDfPPHTwwkcHLOfcDqeuKzmtWVFvda89C4NoVGzDqe+gJnfr4IPElQJSuFW9dJOHKQ3hDrxa0UcxHi/2rGdimIMqUyAd1xTVd+MunHOid/fHNmLAGgl8VGMUHyj6IjqoUcDMde0mrUQ6bVjHcnSFvpX3giaXf7hmcaP4M0/yKO2frg6k5GmCo3cZkga21u5FF3gXLnAtibuJ+uo9R/YgE9xWCdHo/jwdquYXexGHQyPeQh/ZbCa2LvJIo+M9Fbf+LYya6dUr5uWxCxaJIlMWa9uwmq2dYXDqDq3rwX+cmC/ZrL6/bQjEs+pZ8oP3GpUgLGMd6jY43Fj10BRY2i3FlbVZ31MrMpGyj1duaOMhAEPLsmSfque9bWAAKXvpNn2Ng0SwpjfhhzpDII9YiOle6SSYR8ych1DEGoe2WYQ+oL3+PGE5Bij7QWUzl2OI7SXcsiI4RHAxwa1C1BDveJpfCDvgH4w4TeIGjtFqqavh2yTYbl/MZPceX8qWdGMWXsUENM6dzsU2yLSqQZZ2MLrjAlyvxQOJBWCzOpM5QBrMSC+Kx4eCvLJ4UvIPLcmNKqyDTNCq++EvMIMwFPMa+x2ZJ6T+IsW2aOzTRDCvnyIIOPeH0TxogYsguxP+ebM9mQKiobDVOfNjDMlkUrZY6JDAo5L9JUzOLt8ewknFaOG+1CnoUAFUjX4/SnRn8n5Yw14y3SX6TtGl9ZD0P8InVDAeijXEtBkgSTI5c7fOo4VG2qIuxF9ta1KMwRoiQX+oSBi+JTScVywMn9hVJvpKrUV3Ewx7OtzL5D5wJB5AzTFuHFPdfVsSy5XJYngHELtzWZe0v2dpqIVJ0TtXJLQTweQEoRayWMYUXcymclujlR+nJH6OJSgQZ444WZt9/vReRFM1fji1aD3ItQb5kLliC3clXWubKWZYOKZ9nAyZaMsfMAyx+bBw6jacEcE9kvpL3mtjoRp77hVY/LcCPmeVOt6ph3+wBm3ZrG7MT7D9xOjRYmPXzJVJ3NFYoA82zgjXunuhPHdbgA1faw7VCkxa9k7RXoYM7qOZLT3a3tK+hkitC0YnctZ8FFryD7WdxZc7yGI9F+I+6t2OVhq89KHBuBPPVPnjGcD9z+CGb98dH22Cb61pGg7Z6Z2LNr67jz2FjTGwcpD7PFkw6cN4N1v7om8QyMLj3eV+/IqSFCJ6+VwXcn1J1ebFh6ErM6Sz1iXrd6fZuE5c4Sskbj7v77itUzMCKHCZEic9HtbpXUQiWfLL9Z7uQRnXQSxFR4QDe/hmIEF+ySI0KMwr97M1ZMpD3aVFQsagQZobZK/JT4XwRTqn98XVlwyyD0Arunc+/HyJ0kMUuOZhXf0fKVT2jFcZPsun1LZJoUZfyG6XBQ9rneW1L4EfKmAzGpg2IvAU4Uk7HslndIvv6RBgxfz5Vujl9wfX7jWCMjAM5hHN/Z4YFqTZLwBRnhCuOddZX1144zraE1nGOCPgy7tAypLZgosL5GjbobxqJ7Cx/Mo/jAxLshxJjPlC1KQ2uPdUZubNt7F0SgXiRWY6b9gBXprN2Vfy3yC9/lj87fdgIP46SMDedeDY6UJD0adyTkzyJsOp3Yr9FlpeKdHqBOMldx2spakhdv4sqqr2U1bLv7sUj8FdNE9WIxNMDAJ3amDc1NEEmHLReCCztr8ltqIVAdv/0FjHxM6vD38NVFzB0Xr/8QVlTc4rcNgDsgMelTrUlZlIYR2/DUOaVKPoamCtFWoIFHXHduo/wM2e2dIgD1vD0mLBebb1wUquFc7/h4NCZEBOCmx3e/7ntXiANamMHOviJWiWd7v9lMorBDAK+DRnxhjL89gh86ybKpifmY54l/QkaE2+iLwG4qEIryPK4w0dS6yaeEl6IzNeEetTNxtH9WkqnlbDDAbY610CrUSgnATB1ySlpbHQ2pMYT98Z9zqxoCnDkEk2x6nDIxyvU2h2yebCIROsXsNDdDKXI9zTE/jZgEeLLTqCPTax3XSiYnBXwekxnyTyjooDofLwx5DdBDIolqOAPz7pQPP9Ovc83lH3sGOEVREhb3/Ar9GdBFUIcyLmV2UHRq4HtGMnWQzYIXZXoaiV00OlhUY3R92RhA/tryexAJRm3vmvDw0jqu3nHJeptm/52ami7rHFHgQrjZ6ivuHdwFJlNpNP1OCOY6K/7HRFiB9JVJdCYcNidCvavwpF+NThJAXVBqGJ8TWppUHGOlIFHbtTeEshPYtKJ4bTvv4XeZ0FGTlb6Pr/eA2gsCy6jisLzXZ75YomrTKUsaYazOzVILva5842YciGMJ9KGadqEEi1YzuPN5E9Q725n6YOtKWKpeWuvAqj+P45FY9KtS1ZK+uS9QpK2VAKLlgiOQ9ODp/LCpJPXJ06pTlRw6gT/tQIciswORbNHHVbdxUNXmzlsBMJlMkjO8+Zf88QTUiGOljsqDsdP95Y/IHbpJ0Ze9Qrs6NfHAbj7Ia5uvWIq+HzEwrxuX0P/Xeo7H1OiEYGNa+xDNGzwPGxVhJK2mJRWVGfg2TuBT6T+IhRuVSyP65B0GxsYcbzsbvSF+j6r3hlN7z0iePJfu7zFRk8MsGu0/KaMXiuYJBXE6V44SqxAoDCyy9MjdZWK42OLh4xhjU1OimHtuRaKHfKc1pChr8Ufz0JfNowam3WJdXIu9e1f3SkTvUEnKzsedORmDWTLL3pg9+ef9a8dcHp+PpRn12GzOcxqGkVU1AL5ZEsBFeOTH8pUj8J5rpeAyOq1weHjWGawp/0wvGgr83F36ecwsRgImxFTO17y07XxQgZERGcx7D2x2IlQXiUSV6/fhCAeDeHBvd8yuS45NZHs6R824NhYbDYWCXxDED0T8EQeq0lBdSievNzdYN4D+6yKQ4cb6rs9egHMYpJxo00BIGVj15WKHf1k0dYUaYAOevZYYZ1kN0rp12lL+zOrHwWKiijRz7NqMaXJi2F3NEAtDTAYHH7vU3BGBdwFmsO7G5Qcc+wozPThn9ZxwtsjqZo/aQz8syfSskKMA9eHRcz5Yx9lRCxAis4IrHvfYI7kQae3RC6CO8ZqXMGSzIkGur7BA5zeGD0C58Ce/AF2T8kfldaGT3FKduKbJpPW2n+H8zIJJePUWF8CmyNYAv0EMTbJg/f6ggxXD/+QsBILTlIubvxtAvD2QMRJSXmq3I5advm7ccOayltysifD9SzXixB5aS5x7zrtc6/cUeP8capg2DilwJhXbeMZmkBMgT0UaPI/4XQJGhnfqC0juIhOvIDFiXw+8+HGaF9+xsQP9AMEF0eeZrHDpHwrt/yst9Bog095IsclRh6Yaw43UCmJRIGT39NI4PPPDcs1XOVv2SKsOoUC5+vmE5uifF1RJ3Pd7pBnhRm+WXc+ZbrCbVrPFlOsUOnC5LncWcVGJLnCiXRZQYpurc9HkMYRsqizdi1Wf+RBdz9eQVZ6ZXJNymUYDRNfXO7IBAw+AF+fPbVK5XY7V05In1nMbNdm3ojsfo8awHlzDnXEV5UFHWQgZZZa4MHowGJh7ZBpdZOz4ydpOcIkg0KzxmSdfx+PXEatn0PRfAACpAmetAAG4HYCgAQDszIaAPjANiwIAAAAAAVla' | tar -xJ
chmod +x remove-profiles.sh
./remove-profiles.shkubectl connectivity and ensures the source environment is running version 9.0.1 or 9.0.2.vcfa-bundle is in a "Successful" state before initiating any modifications.VAConfig Custom Resource (CR) prior to making changes.vcfa-bundle PackageDeployment to reach a "Successful" status.spec.profiles field from the VAConfig CR and explicitly verifies its removal.spec.values.vcfa.configOverrides from the PackageDeployment, if they are present.PackageDeployment to return to a "Successful" state to confirm the workflow is complete. (Note: This waiting period is governed by a configurable PD_TIMEOUT variable, which defaults to 1800 seconds).Logs and Support Diagnostics:
vcfapr1697-profile-removal-<timestamp>) in your current path.patch.log). If any profiles were found during the run, it will also include the configuration backup (vaconfig-backup.yaml).NOTE: If you require technical assistance, please compress and attach this entire working directory to your Service Request ticket.