After upgrading from TKGm 2.5.3 to 2.5.4 and then upgrading a workload cluster from v1.27 to v1.28, the update was successfully but with follow warning.
Warning: Cluster is upgraded successfully, but some packages are failing. failure while waiting for packages to be installed: package reconciliation failed. package: antrea, reason: Stopped installing matched version '1.15.1+vmware.1-tkg.4' since last attempted version '1.15.1+vmware.1-tkg.3-vmware' is higher.
hint: Add annotation packaging.carvel.dev/downgradable: "" to PackageInstall to proceed with downgrade
Cluster 'play-tk' successfully upgraded to kubernetes version 'v1.28.15+vmware.7'
TKGm 2.5.4
Workload cluster 1.27 to 1.28
This is a known issue as per the error message of which advises the solution in it.
hint: Add annotation packaging.carvel.dev/downgradable: "" to PackageInstall to proceed with downgrade
As per guided here after upgrading a workload cluster from 1.27 to 1.28 the antrea package install fails to reconcile.
This error occurs because kapp-controller interprets the previously installed version (1.15.1+vmware.1-tkg.3-vmware) as higher than the desired version (1.15.1+vmware.1-tkg.4). By default, the controller does not allow downgrades unless explicitly permitted.
The solution is as per hint in error received which is to add the below annotation to the package install of antrea.
packaging.carvel.dev/downgradable: ""
To do this you need to edit the antrea package install using below command:
kubectl edit pkgi antrea -n tkg-system
After adding the annotation advised Save the edit using either of below:
:wq!
or
:x!
-- either of the above will save the edit of the antrea package install.