Error: This Site can't be reached
Log Trace:
vcf-commonsvcs.log:
pringframework.security.web.header.HeaderWriterFilter@4b9af98f, org.springframework.security.web.authentication.logout.LogoutFilter@4a848e28, com.vmware.vcf.security.authorization.AuthorizationFilter@15945b2e, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@526474ba, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@54514c09, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@1a639e3f, org.springframework.security.web.session.SessionManagementFilter@2eac7650, org.springframework.security.web.access.ExceptionTranslationFilter@4df7361b, org.springframework.security.web.access.intercept.AuthorizationFilter@5e95ab37]
[YYYY-MM-DDTHH:MM:SS]
INFO [common,0000000000000000,0000] [i.g.p.rsql.RSQLCommonSupport,main] 2 EntityManager beans are found: {jpaSharedEM_entityManagerFactory=Shared EntityManager proxy for target factory [org.springframework.orm.jpa.LocalContainerEntityManagerFactoryBean@54df485], jpaSharedEM_AWC_entityManagerFactory=Shared EntityManager proxy for target factory [org.springframework.orm.jpa.LocalContainerEntityManagerFactoryBean@54df485]}[YYYY-MM-DDTHH:MM:SS] INFO [common,0000000000000000,0000] [i.g.p.rsql.RSQLCommonSupport,main] RSQLCommonSupport is initialized
[YYYY-MM-DDTHH:MM:SS] INFO [common,0000000000000000,0000] [i.github.perplexhub.rsql.RSQLSupport,main] RSQLSupport is initialized.
[YYYY-MM-DDTHH:MM:SS] INFO [common,0000000000000000,0000] [o.s.b.a.e.web.EndpointLinksResolver,main] Exposing 15 endpoint(s) beneath base path '/commonsvcs/internal/debug'
[YYYY-MM-DDTHH:MM:SS] INFO [common,0000000000000000,0000] [o.a.coyote.http11.Http11NioProtocol,main] Starting ProtocolHandler ["http-nio-127.0.0.1-7100"]
[YYYY-MM-DDTHH:MM:SS] INFO [common,0000000000000000,0000] [o.s.b.w.e.tomcat.TomcatWebServer,main] Tomcat started on port(s): 7100 (http) with context path ''
[YYYY-MM-DDTHH:MM:SS] INFO [common,0000000000000000,0000] [c.v.e.s.c.c.u.ComponentUpgradeRunner,main] Checking if a component upgrade is needed
[YYYY-MM-DDTHH:MM:SS] INFO [common,0000000000000000,0000] [c.v.e.s.i.s.VcfServiceInventoryServiceImpl,main] Get all VcfServices
[YYYY-MM-DDTHH:MM:SS] ERROR [common,0000000000000000,0000] [c.v.e.s.i.s.VcfServiceInventoryServiceImpl,main] Error while trying to retrieve service http://127.0.0.1/domainmanager/about status, I/O error on GET request for "http://127.0.0.1/domainmanager/about": Connect to http://127.0.0.1:80 [/127.0.0.1] failed: Connection refused
org.springframework.web.client.ResourceAccessException: I/O error on GET request for "http://127.0.0.1/domainmanager/about": Connect to http://127.0.0.1:80 [/127.0.0.1] failed: Connection refused
at org.springframework.web.client.RestTemplate.createResourceAccessException(RestTemplate.java:888)
at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:868)
at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:764)
at org.springframework.web.client.RestTemplate.exchange(RestTemplate.java:646)
at com.vmware.evo.sddc.inventory.services.VcfServiceInventoryServiceImpl.getVcfServiceStatus(VcfServiceInventoryServiceImpl.java:98)
at com.vmware.evo.sddc.inventory.services.VcfServiceInventoryServiceImpl.lambda$getVcfServices$0(VcfServiceInventoryServiceImpl.java:70)
at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625)
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)
at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682)
at com.vmware.evo.sddc.inventory.services.VcfServiceInventoryServiceImpl.getVcfServices(VcfServiceInventoryServiceImpl.java:74)
at com.vmware.evo.sddc.inventory.services.InventoryService.getVcfServices(InventoryService.java:3536)
at com.vmware.evo.sddc.commonsvcs.component.upgrades.ComponentUpgradeRunner.onApplicationEvent(ComponentUpgradeRunner.java:70)
at com.vmware.evo.sddc.commonsvcs.component.upgrades.ComponentUpgradeRunner.onApplicationEvent(ComponentUpgradeRunner.java:36)
at org.springframework.context.event.SimpleApplicationEventMulticaster.doInvokeListener(SimpleApplicationEventMulticaster.java:172)
at org.springframework.context.event.SimpleApplicationEventMulticaster.invokeListener(SimpleApplicationEventMulticaster.java:165)
at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:143)
at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:437)
at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:370)
at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:961)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:611)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:146)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:734)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:436)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at com.vmware.evo.sddc.commonsvcs.Application.main(Application.java:41)
Caused by: org.apache.hc.client5.http.HttpHostConnectException: Connect to http://127.0.0.1:80 [/127.0.0.1] failed: Connection refused
at java.base/sun.nio.ch.Net.pollConnect(Native Method)
at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)
at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:542)
at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597)
at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)
at java.base/java.net.Socket.connect(Socket.java:633)
at org.apache.hc.client5.http.socket.PlainConnectionSocketFactory$1.run(PlainConnectionSocketFactory.java:87)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:569)
at org.apache.hc.client5.http.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:84)
at org.apache.hc.client5.http.impl.io.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:148)
at org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:396)
at org.apache.hc.client5.http.impl.classic.InternalExecRuntime.connectEndpoint(InternalExecRuntime.java:158)
at org.apache.hc.client5.http.impl.classic.InternalExecRuntime.connectEndpoint(InternalExecRuntime.java:168)
at org.apache.hc.client5.http.impl.classic.ConnectExec.execute(ConnectExec.java:136)
at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
at org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
at org.apache.hc.client5.http.impl.classic.ProtocolExec.execute(ProtocolExec.java:190)
at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
at org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
at org.apache.hc.client5.http.impl.classic.HttpRequestRetryExec.execute(HttpRequestRetryExec.java:96)
at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
at org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
at org.apache.hc.client5.http.impl.classic.ContentCompressionExec.execute(ContentCompressionExec.java:133)
at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
at org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
at org.apache.hc.client5.http.impl.classic.RedirectExec.execute(RedirectExec.java:115)
at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
at org.apache.hc.client5.http.impl.classic.InternalHttpClient.doExecute(InternalHttpClient.java:170)
at org.apache.hc.client5.http.impl.classic.CloseableHttpClient.execute(CloseableHttpClient.java:75)
at org.apache.hc.client5.http.impl.classic.CloseableHttpClient.execute(CloseableHttpClient.java:54)
at org.springframework.http.client.HttpComponentsStreamingClientHttpRequest.executeInternal(HttpComponentsStreamingClientHttpRequest.java:106)
at org.springframework.http.client.AbstractClientHttpRequest.execute(AbstractClientHttpRequest.java:66)
at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:862)
... 27 common frames omitted
[YYYY-MM-DDTHH:MM:SS] ERROR [common,0000000000000000,0000] [c.v.e.s.i.s.VcfServiceInventoryServiceImpl,main] Error while trying to retrieve service http://127.0.0.1/sddc-manager-ui-app/about status, I/O error on GET request for "http://127.0.0.1/sddc-manager-ui-app/about": Connect to http://127.0.0.1:80 [/127.0.0.1] failed: Connection refused
org.springframework.web.client.ResourceAccessException: I/O error on GET request for "http://127.0.0.1/sddc-manager-ui-app/about": Connect to http://127.0.0.1:80 [/127.0.0.1] failed: Connection refused
at org.springframework.web.client.RestTemplate.createResourceAccessException(RestTemplate.java:888)
Later confirmed via running the command: curl localhost/commonsvcs/about
root@SDDC_FQDN[ /var/log/vmware/vcf/commonsvcs ]# curl localhost/commonsvcs/about
curl: (7) Failed to connect to localhost port 80 after 0 ms: Couldn't connect to server
NOTE: journalctl
is a command-line tool used in Linux systems (especially those using systemd) to view logs collected by the systemd journal service. The logs can include messages from:
The kernel
System services (e.g., nginx
, ssh
, docker
)
User services
Boot processes
Custom application logs (if they're set up to log to the systemd journal)
Log Traces:
journalctl.log
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PROCTITLE proctitle=2F62696E2F7368002D630073797374656D63746C2073746174757320636F6D6D6F6E73766373207C206772657020274163746976653A20616374697665202872756E6E696E672927
[YYYY-MM-DDTHH:MM:SS]
SDDC_FQDN systemd[1]: sosrest.service: Main process exited, code=exited, status=1/FAILURE-- Subject: Unit process exited
-- Defined-By: systemd
-- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- An ExecStart= process belonging to unit sosrest.service has exited.
--
-- The process' exit code is 'exited' and its exit status is 1.
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit[1]: SYSCALL arch=c000003e syscall=84 success=no exit=-2 a0=55f3f54d9040 a1=0 a2=2 a3=4000000 items=1 ppid=0 pid=1 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="systemd" exe="/usr/lib/systemd/systemd" subj=unconfined key=(null)
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: CWD cwd="/"
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PATH item=0 name="/sys/fs/cgroup/cpu/system.slice/sosrest.service" nametype=UNKNOWN cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PROCTITLE proctitle=2F7573722F6C69622F73797374656D642F73797374656D64002D2D73776974636865642D726F6F74002D2D73797374656D002D2D646573657269616C697A65003136
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit[1]: SYSCALL arch=c000003e syscall=84 success=no exit=-2 a0=55f3f54d9040 a1=0 a2=2 a3=0 items=1 ppid=0 pid=1 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="systemd" exe="/usr/lib/systemd/systemd" subj=unconfined key=(null)
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: CWD cwd="/"
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PATH item=0 name="/sys/fs/cgroup/blkio/system.slice/sosrest.service" nametype=UNKNOWN cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PROCTITLE proctitle=2F7573722F6C69622F73797374656D642F73797374656D64002D2D73776974636865642D726F6F74002D2D73797374656D002D2D646573657269616C697A65003136
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN systemd[1]: sosrest.service: Failed with result 'exit-code'.
-- Subject: Unit failed
-- Defined-By: systemd
-- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- The unit sosrest.service has entered the 'failed' state with result 'exit-code'.
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN BASH_LOGS[3322]: root [1928]: systemctl status nginx [3]
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit[1]: SYSCALL arch=c000003e syscall=84 success=no exit=-2 a0=55f3f53f3160 a1=0 a2=2 a3=2000 items=1 ppid=0 pid=1 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="systemd" exe="/usr/lib/systemd/systemd" subj=unconfined key=(null)
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: CWD cwd="/"
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PATH item=0 name="/sys/fs/cgroup/cpu/system.slice/nginx.service" nametype=UNKNOWN cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PROCTITLE proctitle=2F7573722F6C69622F73797374656D642F73797374656D64002D2D73776974636865642D726F6F74002D2D73797374656D002D2D646573657269616C697A65003136
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit[1]: SYSCALL arch=c000003e syscall=84 success=no exit=-2 a0=55f3f53f3160 a1=0 a2=2 a3=8000 items=1 ppid=0 pid=1 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="systemd" exe="/usr/lib/systemd/systemd" subj=unconfined key=(null)
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: CWD cwd="/"
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PATH item=0 name="/sys/fs/cgroup/blkio/system.slice/nginx.service" nametype=UNKNOWN cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PROCTITLE proctitle=2F7573722F6C69622F73797374656D642F73797374656D64002D2D73776974636865642D726F6F74002D2D73797374656D002D2D646573657269616C697A65003136
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit[1]: SYSCALL arch=c000003e syscall=188 success=yes exit=0 a0=55f3f53f3160 a1=55f3ef9a767a a2=7ffcabd28bf0 a3=20 items=1 ppid=0 pid=1 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="systemd" exe="/usr/lib/systemd/systemd" subj=unconfined key=(null)
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: CWD cwd="/"
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PATH item=0 name="/sys/fs/cgroup/systemd/system.slice/nginx.service" inode=1155 dev=00:1a mode=040755 ouid=0 ogid=0 rdev=00:00 nametype=NORMAL cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PROCTITLE proctitle=2F7573722F6C69622F73797374656D642F73797374656D64002D2D73776974636865642D726F6F74002D2D73797374656D002D2D646573657269616C697A65003136
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit[1]: SYSCALL arch=c000003e syscall=197 success=no exit=-61 a0=55f3f53f3160 a1=55f3ef9a7690 a2=0 a3=0 items=1 ppid=0 pid=1 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="systemd" exe="/usr/lib/systemd/systemd" subj=unconfined key=(null)
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: CWD cwd="/"
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PATH item=0 name="/sys/fs/cgroup/systemd/system.slice/nginx.service" inode=1155 dev=00:1a mode=040755 ouid=0 ogid=0 rdev=00:00 nametype=NORMAL cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN audit: PROCTITLE proctitle=2F7573722F6C69622F73797374656D642F73797374656D64002D2D73776974636865642D726F6F74002D2D73797374656D002D2D646573657269616C697A65003136
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN systemd[1]: Starting The NGINX HTTP and reverse proxy server...
-- Subject: A start job for unit nginx.service has begun execution
-- Defined-By: systemd
-- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- A start job for unit nginx.service has begun execution.
--
-- The job identifier is 8418.
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN nginx[3325]: nginx: [emerg] cannot load certificate "/etc/ssl/certs/vcf_https.crt": BIO_new_file() failed (SSL: error:80000002:system library::No such file or directory:calling fopen(/etc/ssl/certs/vcf_https.crt, r) error:10000080:BIO routines::no such file)
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN nginx[3325]: nginx: configuration file /etc/nginx/nginx.conf test failed
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN systemd[1]: nginx.service: Control process exited, code=exited, status=1/FAILURE
-- Subject: Unit process exited
-- Defined-By: systemd
-- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- An ExecStartPre= process belonging to unit nginx.service has exited.
--
-- The process' exit code is 'exited' and its exit status is 1.
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN systemd[1]: nginx.service: Failed with result 'exit-code'.
-- Subject: Unit failed
-- Defined-By: systemd
-- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- The unit nginx.service has entered the 'failed' state with result 'exit-code'.
Later confirmed via running the command: systemctl status nginx
root@SDDC_FQDN[ /var/log/vmware/vcf/commonsvcs ]# systemctl status nginx
nginx. service - The NGINX HTTP and reverse proxy server
Loaded: loaded (/usr/lib/systemd/system/nginx.service; enabled; vendor preset: enabled)
(Result: exit-code) since Fri 2025-04-11 04:37:12 UTC; 22min ago
Active: failed
Process: 1536 ExecStartPre=/usr/sbin/nginx -t (code=exited, status=1/FAILURE)
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN systemd[1]: Starting The NGINX HTTP and reverse proxy server ...
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN [1536]: nginx: [emerg] cannot load certificate "/etc/ssl/certs/vcf_https.crt": BIO_new_file () failed (SSL: err>
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN nginx [1536]: nginx: configuration file /etc/nginx/nginx.conf test failed
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN systemd[1]: nginx. service: Control process exited, code=exited, status=1/FAILURE
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN systemd[1]: nginx. service: Failed with result 'exit-code'.
[YYYY-MM-DDTHH:MM:SS] SDDC_FQDN systemd[1]: Failed to start The NGINX HTTP and reverse proxy server.
VMware Cloud Foundation 5.x
The Nginx service failed to start due to an issue related to SSL certificate configuration. It was identified that the failure was caused by a missing SSL certificate file. Specifically, the certificate file vcf_https.crt
, which is referenced in the Nginx configuration, was not present in the expected directory: /etc/ssl/certs/.
As a result, the service was unable to initialize the secure HTTPS configuration, leading to the startup failure.
Port 80 was also not maturing, we identified it from the vcf-commonsvcs.log.
vcf_https.crt
in /etc/ssl/certs/
.nginx
service and confirm that it is active and listening on the expected ports: systemctl start nginxcurl
(curl localhost/commonsvcs/about) and ensure internal services are reachable.vcf-commonsvcs
, etc.) no longer report connection issues (as shown in above traces).A new SSL certificate was successfully created by following the steps outlined in the referenced Knowledge Base (KB) article. Once the certificate was generated and properly configured, the Nginx service was restarted to apply the changes. After restarting the service, the issue was resolved, and we were able to access the SDDC Manager UI without any further problems.
NA