"Replace cert Failed: Exception found (Invalid input certificate: DNS in Subject Alternative Name is not correct. DNS Name must contain machine FQDN.)"
/usr/lib/vmware-vmafd/bin/vmafd-cli get-pnid --server-name localhost && hostname -f
VMware vCenter Server 8.X
This is due to the mismatch between the PNID (IP address) and the DNS/FQDN name provided in the custom certificate's SAN field. vCenter requires that the DNS name in the certificate match the PNID exactly.
Change the PNID of the vCenter via VAMI to match the FQDN/DNS Name.
Link for reference: Reconfigure the Primary Network Identifier
Afterwards, proceed with replacing the self-signed certificate with custom certificates again.