Commissioning Hosts in SDDC Manager Fails with Error, HOST_COMMISSION operation validation failed due to: Failed to run guardrail validations of type HOST_COMMISSION on resource Error

Products

• VMware SDDC Manager

Issue/Introduction

• Commissioning Hosts in SDDC Manager Fails with below Error, 

Error

HOST_COMMISSION operation validation failed due to: Failed to run guardrail validations of type HOST_COMMISSION on resource ####-#####-######-####-####

Message: HOST_COMMISSION operation validation failed due to: Failed to run
guardrail validations of type HOST_COMMISSION on resource ####-#####-######-####-####
Remediation Message:
Reference Token: #####
Cause:

• In operationsmanager logs below entries are seen,

/var/log/vmware/vcf/operationsmanager/operationsmanager.log:

<YYYY-MM-DD>T<time> +0000 DEBUG [vcf_om,#######################,####] [c.v.vcf.assessment.sdk.LambdaService,pool-3-thread-11] DAY_N_GUARDRAILS check type HOST_COMMISSION #####-#####-#####-####-### status is FAIL
<YYYY-MM-DD>T<time> +0000 ERROR [vcf_om,#######################,####] [c.v.vcf.assessment.sdk.LambdaService,pool-3-thread-11] Lambda task #####-#####-#####-####-### failed due to {"errorCode":"ASSESSMENT_CANNOT_ADD_CONNECTION","arguments":["nsxmgr.domain.com"],"message":"Cannot connect to nsxmgr.domain.com","cause":[{"type":"com.vmware.vapi.std.errors.Unauthorized","message":"Unauthorized (com.vmware.vapi.std.errors.unauthorized) => {\n    messages = [],\n    data = struct => {error_message=The credentials were incorrect or the account specified has been locked., error_code=403, module_name=common-services},\n    errorType = UNAUTHORIZED\n}"}],"referenceToken":"*****"}
<YYYY-MM-DD>T<time> +0000 ERROR [vcf_om,#######################,####] [c.v.e.s.c.s.a.DayNGuardrailsValidationAction,pool-3-thread-11] Failed to run HOST_COMMISSION validations due to error: Failed to run guardrail validations of type HOST_COMMISSION on resource #####-#####-#####-####-###
<YYYY-MM-DD>T<time> +0000 ERROR [vcf_om,#######################,####] [c.v.e.s.o.model.error.ErrorFactory,pool-3-thread-11] [FHFCDR] DAYN_GUARDRAILS_VALIDATION_FAILED HOST_COMMISSION operation validation failed due to: Failed to run guardrail validations of type HOST_COMMISSION on resource #####-#####-#####-####-### com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: HOST_COMMISSION operation validation failed due to: Failed to run guardrail validations of type HOST_COMMISSION on resource #####-#####-#####-####-###

 

Note: nsxmgr.domain.com would be the actual NSX manager FQDN in the customer environment.

Environment

VMware Cloud Foundation 5.x

VMware Cloud Foundation 9.x

VMware NSX 

SDDC Manager 5.2

Cause

SDDC Manager is unable to connect to NSXT Manager, due to expired/invalid credentials from NSXT manager.

Resolution

• Utilize the lookup_passwords command in SDDC to retrieve the passwords for NSXT_MANAGER, and subsequently confirm their functionality on NSXT.
• Steps to check Password: Use the SDDC Manager Appliance to Look Up Account Credentials
• If the NSX-T Manager's passwords be found to be expired, reset the password.
• Detailed Steps: Credential operations fail on NSX-T Components in SDDC Manager