Deploying VCF Operations fleet management on SDDC Manager fails with error 'VIRTUAL_APPLIANCE_NTP_CONFIGURATION

Products

VMware SDDC Manager VMware Cloud Foundation VCF Operations

Issue/Introduction

Deploying VCF Operations fleet management on SDDC Manager fails during Configuration of NTP with error 'VIRTUAL_APPLIANCE_NTP_CONFIGURATION_FAILED'.
/var/log/vmware/vcf/domainmanager/domainmanager.log reports below error stack:
YYYY-MM-DDThh:mm:ss..177+0000 INFO [vcf_dm,################################,####] [c.v.v.l.a.a.ActivityLoggingInterceptor,http-nio-###.#.#.#-7200-exec-7] {"username":null,"timestamp":"YYYY-MM-DDThh:mm:ss.177Z","clientIP":"###.#.#.#","userAgent":"Apache-HttpClient/5.3.1 (Java/17.0.16)","api":"/domainmanager/workflows/################################","httpMethod":"GET","httpStatus":200,"operation":"Get a workflow with a specific UUID","remoteIP":"###.#.#.#","duration":39}
YYYY-MM-DDThh:mm:ss..600+0000 DEBUG [vcf_dm,################################,####] [c.v.e.s.r.c.LoggingHttpRequestInterceptor,dm-exec-31] Request URI: https://fleetmanager.example.com/lcm/lcops/api/v2/settings/system-details/time
Request method: POST
Request body: {"syncWithHost":false,"ntpServerEnabled":true,"ntpServerStarted":false,"ntpServers":"###.##.###.###,###.##.###.###"}
Response code: 400 BAD_REQUEST
Response headers: [Date:YYYY-MM-DDThh:mm:ss.", Content-Type:"application/json", Transfer-Encoding:"chunked", Connection:"keep-alive", Set-Cookie:"JSESSIONID=################################; Path=/; HttpOnly; Secure; HttpOnly; SameSite=Lax", X-Content-Type-Options:"nosniff", X-XSS-Protection:"1; mode=block", Cache-Control:"no-cache, no-store, max-age=0, must-revalidate", Pragma:"no-cache", Expires:"0", X-Frame-Opt
ions:"DENY", Content-Security-Policy:"script-src 'self'", Strict-Transport-Security:"max-age=31536000; includeSubDomains", Lcm-API-Version:"8.0"]
Response body: {"status":"ERROR","statusCode":"BAD_REQUEST","message":"Please check if the provided IP/FQDN is of an NTP server and is reachable.","resourceIdentifier":null,"errorCode":0,"errors":null}
YYYY-MM-DDThh:mm:ss..601+0000 ERROR [vcf_dm,################################,####] [c.v.e.s.v.ConfigureVirtualApplianceNtp,dm-exec-31] Configuration of NTP ###.##.###.### ###.##.###.### servers for VM fleetmanager.example.com failed
YYYY-MM-DDThh:mm:ss..601+0000 ERROR [vcf_dm,################################,####] [c.v.e.s.o.model.error.ErrorFactory,dm-exec-31] [LU5892] VIRTUAL_APPLIANCE_NTP_CONFIGURATION_FAILED Failed to configure NTP on virtual appliance fleetmanager.example.com
com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Failed to configure NTP on virtual appliance fleetmanager.example.com

Environment

VMware Cloud Foundation 9.0

Cause

VCF Operations fleet manager cannot reach the NTP server.

Resolution

Ensure the Fleet Manager appliance has a clear network path to the NTP servers:

Verify Network Connectivity: Log in to the Fleet Manager appliance via SSH and attempt to ping the NTP server.
Check Firewall Ports: Ensure UDP Port 123 is open between the VCF Operations management network and the NTP server.
```
ntpdate -q <NTP_IP_Address>
```
Check if the NTP Ports are open.
The Connection will fail/refuse while trying to access the NTP server via port 123 if the ports are closed.

root@vcf [ /var/log/vmware/vcf/domainmanager ]# curl -v telnet://<NTP-IP>:123
* Trying <NTP-IP>:123...
* connect to <NTP-IP> port 123 from <NTP-IP> port 59678 failed: Connection refused
* Failed to connect to ###.###.###.### port 123 after 0 ms: Could not connect to server
* closing connection #0
curl: (7) Failed to connect to <NTP-IP> port 123 after 0 ms: Could not connect to server

OR

root@vcf [ /var/log/vmware/vcf/domainmanager ]# nc -zv <NTP-IP> 123
fqdn.com [NTP-IP] 123 (ntp): Connection refused
Open Port 123 between all the VCF components and the NTP Server.
Once connectivity is ensured, re-try the deployment task in SDDC Manager.

Additional Information

To ensure a successful VCF 9 deployment, please verify that the ports specified in the following link are open.

Network port requirements for VMware Cloud Foundation for Service Providers

Deploying VCF Operations fleet management on SDDC Manager fails with error 'VIRTUAL_APPLIANCE_NTP_CONFIGURATION_FAILED'

Article ID: 421274