SDDC Backup User Password Operation Failing with an Error - 'Json de-serialization error: property seconds_between

Products

VMware SDDC Manager

Issue/Introduction

SDDC Backup user password operation failing with an error 'Json de-serialization error: property seconds_between_backups is unrecognized'

Below log entries are registered in operationsmanager.log

2025-01-09T08:05:40.726+0000 DEBUG [vcf_om,73db666546745743,0489] [c.v.v.s.t.DynamicTrustManager,om-exec-28] Certificate chain CN=nsxt-mgr.domain.com, O=VMware, OU=VMware Engineering, C=US, ST=California, L=Palo Alto,OU=VMware Engineering, O=vc.domain.com, ST=California, C=US, DC=local, DC=vsphere, CN=CA is valid
2025-01-09T08:05:40.748+0000 DEBUG [vcf_om,73db666546745743,0489] [c.v.v.p.helper.NsxtApiUtil,om-exec-28] Failed to update NSXT for BACKUP settings : { "error_code" : 287, "module_name" : "common-services", "error_message" : "Json de-serialization error: property seconds_between_backups is unrecognized." } with status :
2025-01-09T08:05:40.749+0000 ERROR [vcf_om,73db666546745743,0489] [c.v.v.p.u.c.AbstractPasswordChanger,om-exec-28] Unable to update password for sddc-manager.domain.com in BACKUP_NSXT
com.vmware.vcf.passwordmanager.exception.PasswordUpdateException: Json de-serialization error: property seconds_between_backups is unrecognized.
at com.vmware.vcf.passwordmanager.update.dependents.BackupNsxtUpdater.update(BackupNsxtUpdater.java:69)
at com.vmware.vcf.passwordmanager.update.changers.AbstractPasswordChanger.doUpdaters(AbstractPasswordChanger.java:993)
at com.vmware.vcf.passwordmanager.update.changers.AbstractPasswordChanger.updateAsync(AbstractPasswordChanger.java:595)
at com.vmware.vcf.passwordmanager.update.changers.AbstractPasswordChanger.doUpdate(AbstractPasswordChanger.java:199)
at com.vmware.vcf.passwordmanager.rotate.AbstractPasswordTransactionExecutor$1.call(AbstractPasswordTransactionExecutor.java:100)
at com.vmware.vcf.passwordmanager.rotate.AbstractPasswordTransactionExecutor$1.call(AbstractPasswordTransactionExecutor.java:88)
at org.springframework.cloud.sleuth.instrument.async.TraceCallable.call(TraceCallable.java:71)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.springframework.web.client.HttpClientErrorException$BadRequest: 400 : "{<EOL> "error_code" : 287,<EOL> "module_name" : "common-services",<EOL> "error_message" : "Json de-serialization error: property seconds_between_backups is unrecogn
ized."<EOL>}"

Environment

SDDC 4.5

SDDC 4.5.x

Cause

No NSXT backup configuration on SDDC.

NSXT native backup configured with WeeklyBackupSchedule property.

Any password operation on SDDC checks for NSXT backups configuration and specifically requires 'seconds_between_backups' parameter.

2025-01-09T08:05:40.684+0000 DEBUG [vcf_om,73db666546745743,0489] [c.v.v.p.helper.NsxtApiUtil,om-exec-28] NSXT BACKUP settings API response status:200 OK & content:{ "backup_enabled" : true, "backup_schedule" : { "days_of_week" : [ 1, 4, 0, 2, 6, 3, 5 ], "hour_of_day" : 22, "minute_of_day" : 0, "resource_type" : "WeeklyBackupSchedule" }, "inventory_summary_interval" : 240, "remote_file_server" : { "server" : "10.10.10.10", "port" : 22, "protocol" : { "protocol_name" : "sftp", "ssh_fingerprint" : "SHA256:******************************", "authentication_scheme" : { "scheme_name" : "PASSWORD", "username" : "backup" } }, "directory_path" : "/nfs/vmware/vcf/nfs-mount/backup" } }
..
..
2025-01-09T08:05:40.748+0000 DEBUG [vcf_om,73db666546745743,0489] [c.v.v.p.helper.NsxtApiUtil,om-exec-28] Failed to update NSXT for BACKUP settings : { "error_code" : 287, "module_name" : "common-services", "error_message" : "Json de-serialization error: property seconds_between_backups is unrecognized." } with status :
2025-01-09T08:05:40.749+0000 ERROR [vcf_om,73db666546745743,0489] [c.v.v.p.u.c.AbstractPasswordChanger,om-exec-28] Unable to update password for sddc-manager.domain.com in BACKUP_NSXT
com.vmware.vcf.passwordmanager.exception.PasswordUpdateException: Json de-serialization error: property seconds_between_backups is unrecognized.
at com.vmware.vcf.passwordmanager.update.dependents.BackupNsxtUpdater.update(BackupNsxtUpdater.java:69)
at com.vmware.vcf.passwordmanager.update.changers.AbstractPasswordChanger.doUpdaters(AbstractPasswordChanger.java:993)
at com.vmware.vcf.passwordmanager.update.changers.AbstractPasswordChanger.updateAsync(AbstractPasswordChanger.java:595)
at com.vmware.vcf.passwordmanager.update.changers.AbstractPasswordChanger.doUpdate(AbstractPasswordChanger.java:199)
at com.vmware.vcf.passwordmanager.rotate.AbstractPasswordTransactionExecutor$1.call(AbstractPasswordTransactionExecutor.java:100)
at com.vmware.vcf.passwordmanager.rotate.AbstractPasswordTransactionExecutor$1.call(AbstractPasswordTransactionExecutor.java:88)
at org.springframework.cloud.sleuth.instrument.async.TraceCallable.call(TraceCallable.java:71)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.springframework.web.client.HttpClientErrorException$BadRequest: 400 : "{<EOL> "error_code" : 287,<EOL> "module_name" : "common-services",<EOL> "error_message" : "Json de-serialization error: property seconds_between_backups is unrecognized."<EOL>}"

Resolution

'seconds_between_backups' is available in below two backup scenarios:

Backup of NSXT configured from SDDC Manager, which also requires external SFTP server.
Native NSXT backup configured with interval which uses 'interval backup schedule' property.

We would need to perform any of the above backup configuration for NSXT backups.