Failed to initialize TagGateway
search cancel

Failed to initialize TagGateway

book

Article ID: 388406

calendar_today

Updated On: 03-11-2025

Products

VMware Live Recovery VMware vSphere ESXi

Issue/Introduction

1. Adding NEW replications locally (within the same vCenter) fails  

2. Adding NEW replications remotely (across vCenters) fails  

ERROR
Operation Failed
A generic error occurred in the vSphere Replication Management Server. 
Exception details: 'Failed to initialize TagGateway'.
Operation ID: e5d0ad34-b5cl-4ee3-9b59-ed6421c08269
1/15/25, 8:34:36 AM -0500

hms.log:

2025-01-17 14:39:08.876 WARN  hms.monitor.host [hms-main-scheduled-thread-13] (..host.disallowed.DisallowedTagMonitor$PollTask) [] | Unable to compute disallowed object set.
java.util.concurrent.CompletionException: java.lang.RuntimeException: Failed to initialize TagGateway
        at java.util.concurrent.CompletableFuture.encodeThrowable(Unknown Source) ~[?:?]
        at java.util.concurrent.CompletableFuture.uniComposeStage(Unknown Source) ~[?:?]
        at java.util.concurrent.CompletableFuture.thenCompose(Unknown Source) ~[?:?]
        at com.vmware.hms.monitor.host.disallowed.DisallowedTagMonitor$PollTask.run(DisallowedTagMonitor.java:228) ~[hms.jar:?]
        at com.vmware.hms.util.executor.LoggerOpIdConfigurator$RunnableWithDiagnosticContext.run(LoggerOpIdConfigurator.java:132) ~[hms.jar:?]
        at com.vmware.hms.util.executor.LoggerOpIdConfigurator$2.run(LoggerOpIdConfigurator.java:99) ~[hms.jar:?]
        at com.vmware.jvsl.sessions.net.impl.TlsPreservingWrapper$2.run(TlsPreservingWrapper.java:47) ~[jvsl-sessions-8.7.0.jar:?]
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[?:?]
        at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]
        at java.lang.Thread.run(Unknown Source) ~[?:?]
Caused by: java.lang.RuntimeException: Failed to initialize TagGateway
        at com.vmware.hms.gateway.is.tag.impl.TagGatewayImpl.init(TagGatewayImpl.java:102) ~[hms.jar:?]
        at com.vmware.hms.gateway.is.tag.impl.TagGatewayImpl.findAllManagedObjectsWithDisallowedTag(TagGatewayImpl.java:421) ~[hms.jar:?]
        at com.vmware.hms.monitor.host.disallowed.DisallowedTagMonitor$PollTask.run(DisallowedTagMonitor.java:227) ~[hms.jar:?]
        ... 9 more
Caused by: com.vmware.vim.binding.vmodl.fault.SecurityError
        at jdk.internal.reflect.GeneratedConstructorAccessor512.newInstance(Unknown Source) ~[?:?]
        at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) ~[?:?]
        at java.lang.reflect.Constructor.newInstance(Unknown Source) ~[?:?]
        at java.lang.Class.newInstance(Unknown Source) ~[?:?]
        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl$RetryingFuture.setException(MethodInvocationHandlerImpl.java:567) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.setResponse(ResponseImpl.java:239) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.http.impl.HttpExchangeBase.parseResponse(HttpExchangeBase.java:286) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.http.impl.HttpExchange.invokeWithinScope(HttpExchange.java:54) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.http.impl.TracingScopedRunnable.run(TracingScopedRunnable.java:24) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.http.impl.HttpExchangeBase.run(HttpExchangeBase.java:60) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.http.impl.HttpProtocolBindingBase.executeRunnable(HttpProtocolBindingBase.java:229) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.http.impl.HttpProtocolBindingImpl.send(HttpProtocolBindingImpl.java:114) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl$CallExecutor.sendCall(MethodInvocationHandlerImpl.java:693) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl$CallExecutor.executeCall(MethodInvocationHandlerImpl.java:674) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl.completeCall(MethodInvocationHandlerImpl.java:371) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl.invokeOperation(MethodInvocationHandlerImpl.java:322) ~[vlsi-client-8.7.0.jar:?]
        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl.invoke(MethodInvocationHandlerImpl.java:195) ~[vlsi-client-8.7.0.jar:?]
        at com.sun.proxy.$Proxy200.createCategory(Unknown Source) ~[?:?]
        at com.vmware.hms.gateway.is.tag.impl.TagGatewayImpl.createCategory(TagGatewayImpl.java:197) ~[hms.jar:?]
        at com.vmware.hms.gateway.is.tag.impl.TagGatewayImpl.createVrCategory(TagGatewayImpl.java:140) ~[hms.jar:?]
        at com.vmware.hms.gateway.is.tag.impl.TagGatewayImpl.initImpl(TagGatewayImpl.java:125) ~[hms.jar:?]
        at com.vmware.hms.gateway.is.tag.impl.TagGatewayImpl.init(TagGatewayImpl.java:96) ~[hms.jar:?]
        at com.vmware.hms.gateway.is.tag.impl.TagGatewayImpl.findAllManagedObjectsWithDisallowedTag(TagGatewayImpl.java:421) ~[hms.jar:?]
        at com.vmware.hms.monitor.host.disallowed.DisallowedTagMonitor$PollTask.run(DisallowedTagMonitor.java:227) ~[hms.jar:?]
        ... 9 more
 
2025-01-17 14:39:11.205 INFO  com.vmware.hms.gateway.is.impl.LsInventoryServiceFactory [hms-main-scheduled-thread-8] (..is.impl.LsInventoryServiceFactory) []| InventoryService Client created successfully.
2025-01-17 14:39:11.206 INFO  com.vmware.hms.gateway.is.tag.impl.TagGatewayImpl [hms-main-scheduled-thread-8] (..tag.impl.TagGatewayImpl) [] | creating Category[vSphereReplication] ...
2025-01-17 14:39:11.213 INFO  com.vmware.hms.gateway.is.impl.LsInventoryServiceFactory [hms-main-scheduled-thread-8] (..is.impl.LsInventoryServiceFactory$1) [] | (re)login to InventoryService ...
2025-01-17 14:39:11.283 INFO  com.vmware.hms.gateway.is.impl.LsInventoryServiceFactory [hms-main-scheduled-thread-8] (..is.impl.LsInventoryServiceFactory$1) [] | (re)login to InventoryService ...OK
2025-01-17 14:39:11.298 WARN  com.vmware.hms.sdrs.DatastoreTaggingServiceImpl [hms-main-scheduled-thread-8] (..hms.sdrs.DatastoreTaggingServiceImpl$1) [] | Failed to synchronize tags: Failed to initialize TagGateway


vpxd.log:

2025-01-17T09:34:02.476-05:00 warning vpxd[21324] [Originator@6876 sub=vmomi.soapStub[25] opID=fe5839da-fe7f-4f44-b70c-8998c9b11052-HMS-168499-e4] SOAP request returned HTTP failure; <SSL(<io_obj p:0x00007f0750b498d8, h:15,
<TCP '10.15.100.61 : 34334'>, <TCP '10.15.200.17 : 443'>>), /vpxa>, method: ConvertNamespacePathToUuidPath; code: 500(Internal Server Error)
2025-01-17T09:34:02.480-05:00 info vpxd[21492] [Originator@6876 sub=vpxLro opID=441f2782] [VpxLRO] -- FINISH lro-334047069
2025-01-17T09:34:02.477-05:00 warning vpxd[21324] [Originator@6876 sub=Vmomi opID=fe5839da-fe7f-4f44-b70c-8998c9b11052-HMS-168499-e4] VMOMI activation LRO failed; <<524ef621-0ba0-a7a0-effd-4613bf0f9846, <TCP '127.0.0.1 : 808
5'>, <TCP '127.0.0.1 : 51254'>>, DatastoreNamespaceManager, vim.DatastoreNamespaceManager.ConvertNamespacePathToUuidPath>, N5Vmomi5Fault11SystemError9ExceptionE(Fault cause: vmodl.fault.SystemError
--> )
--> [context]zKq7AVECAQAAAEq5RwEddnB4ZAAAENk3bGlidm1hY29yZS5zbwAAp3gsACVsLQAt6TIBDUsabGlidm1vbWkuc28AAQMmDgHuzRYB3tcWAe5tFgJTg312cHhkAAIF0H0CrNN9AiR4fQL+xn0BGW4SA2WV/2xpYnZpbS10eXBlcy5zbwACruBwg2FFBQGCwtZhAYK92WABgv7aYAGCLOp
gAYKPF2ABglrBYAEAp0kjAE+fIwDOZDcEh38AbGlicHRocmVhZC5zby4wAAUvNg9saWJjLnNvLjYA[/context]
2025-01-17T09:34:02.481-05:00 info vpxd[21324] [Originator@6876 sub=vpxLro opID=fe5839da-fe7f-4f44-b70c-8998c9b11052-HMS-168499-e4] [VpxLRO] -- FINISH lro-334047101
2025-01-17T09:34:02.481-05:00 info vpxd[21324] [Originator@6876 sub=Default opID=fe5839da-fe7f-4f44-b70c-8998c9b11052-HMS-168499-e4] [VpxLRO] -- ERROR lro-334047101 -- DatastoreNamespaceManager -- vim.DatastoreNamespaceManager.ConvertNamespacePathToUuidPath: vmodl.fault.SystemError:
--> Result:
--> (vmodl.fault.SystemError) {
-->    faultCause = (vmodl.MethodFault) null,
-->    faultMessage = <unset>,
-->    reason = "Invalid fault"
-->    msg = "Received SOAP response fault from [<SSL(<io_obj p:0x00007f0750b498d8, h:15, <TCP '10.15.100.61 : 34334'>, <TCP '10.15.200.17 : 443'>>), /vpxa>]: ConvertNamespacePathToUuidPath
--> Received SOAP response fault from [<<io_obj p:0x00000095755d2688, h:18, <TCP '127.0.0.1 : 49844'>, <TCP '127.0.0.1 : 8307'>>, /sdk>]: ConvertNamespacePathToUuidPath
--> vim.fault.NotFound"

Environment

VMware vSphere Replication 8.x
VMware vSphere Replication 9.x

Cause

vSphere replication appliance cannot be registered to a different vCenter than the one its deployed under because of vService binding/dependency between the vSphere replication appliance OVF and vService Manager in vCenter. 

Resolution

Make sure to register the replication appliance (VRMS) with the same vCenter where it is deployed, and ensure it is not registering with a different vCenter.

Additional Information

Powered by Wolken Software