Deploying VCF Operations fleet management on SDDC Manager fails with error 'VIRTUAL_APPLIANCE_NTP_CONFIGURATION_FAILED'

Products

• VMware SDDC Manager
• VMware Cloud Foundation
• VCF Operations

Issue/Introduction

• Deploying VCF Operations fleet management on SDDC Manager fails during Configuration of NTP with error 'VIRTUAL_APPLIANCE_NTP_CONFIGURATION_FAILED'.
• /var/log/vmware/vcf/domainmanager/domainmanager.log reports below error stack:

  YYYY-MM-DDThh:mm:ss..177+0000 INFO  [vcf_dm,################################,####] [c.v.v.l.a.a.ActivityLoggingInterceptor,http-nio-###.#.#.#-7200-exec-7]  {"username":null,"timestamp":"YYYY-MM-DDThh:mm:ss.177Z","clientIP":"###.#.#.#","userAgent":"Apache-HttpClient/5.3.1 (Java/17.0.16)","api":"/domainmanager/workflows/################################","httpMethod":"GET","httpStatus":200,"operation":"Get a workflow with a specific UUID","remoteIP":"###.#.#.#","duration":39}
  YYYY-MM-DDThh:mm:ss..600+0000 DEBUG [vcf_dm,################################,####] [c.v.e.s.r.c.LoggingHttpRequestInterceptor,dm-exec-31]  Request URI: https://fleetmanager.example.com/lcm/lcops/api/v2/settings/system-details/time
  Request method: POST
  Request body: {"syncWithHost":false,"ntpServerEnabled":true,"ntpServerStarted":false,"ntpServers":"###.##.###.###,###.##.###.###"}
  Response code: 400 BAD_REQUEST
  Response headers: [Date:YYYY-MM-DDThh:mm:ss.", Content-Type:"application/json", Transfer-Encoding:"chunked", Connection:"keep-alive", Set-Cookie:"JSESSIONID=################################; Path=/; HttpOnly; Secure; HttpOnly; SameSite=Lax", X-Content-Type-Options:"nosniff", X-XSS-Protection:"1; mode=block", Cache-Control:"no-cache, no-store, max-age=0, must-revalidate", Pragma:"no-cache", Expires:"0", X-Frame-Opt
  ions:"DENY", Content-Security-Policy:"script-src 'self'", Strict-Transport-Security:"max-age=31536000; includeSubDomains", Lcm-API-Version:"8.0"]
  Response body: {"status":"ERROR","statusCode":"BAD_REQUEST","message":"Please check if the provided IP/FQDN is of an NTP server and is reachable.","resourceIdentifier":null,"errorCode":0,"errors":null}
  YYYY-MM-DDThh:mm:ss..601+0000 ERROR [vcf_dm,################################,####] [c.v.e.s.v.ConfigureVirtualApplianceNtp,dm-exec-31]  Configuration of NTP ###.##.###.### ###.##.###.### servers for VM fleetmanager.example.com failed
  YYYY-MM-DDThh:mm:ss..601+0000 ERROR [vcf_dm,################################,####] [c.v.e.s.o.model.error.ErrorFactory,dm-exec-31]  [LU5892] VIRTUAL_APPLIANCE_NTP_CONFIGURATION_FAILED Failed to configure NTP on virtual appliance fleetmanager.example.com
  com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Failed to configure NTP on virtual appliance fleetmanager.example.com

Environment

VMware Cloud Foundation 9.0

Cause

VCF Operations fleet manager cannot reach the NTP server.

Resolution

Ensure the Fleet Manager appliance has a clear network path to the NTP servers:

1. Verify Network Connectivity: Log in to the Fleet Manager appliance via SSH and attempt to ping the NTP server.
2. Check Firewall Ports: Ensure UDP Port 123 is open between the VCF Operations management network and the NTP server. 

   ntpdate -q <NTP_IP_Address>

   
   
   
3. Once connectivity is ensured, re-try the deployment task in SDDC Manager.