Reconfigure fails after upgrading appliance.
ERROR
Operation Failed
A general system error occurred: Failed to register VRMS.
Operation ID: 96760177-c985-4f53-9195-5a06dfd5fee7
11/22/24, 11:13:23 AM -0700
drconfig.log:
--> vSphere Replication Appliance configuration error:vCenter Server extension configuration problem.
--> Details: Unable to register extension in vCenter Server.
--> [ msgId: com.vmware.vr.config.ext_config_failure; value: null; errorStacktrace : com.vmware.jvsl.cfg.ConfigException: Internal error.
--> at com.vmware.jvsl.cfg.RegisterExtensionCommand.execute(RegisterExtensionCommand.java:154)
--> at com.vmware.hms.config.helper.VcHelper.registerExtension(VcHelper.java:280)
--> at com.vmware.hms.config.VrConfig.expressSetup(VrConfig.java:358)
--> at com.vmware.hms.config.cli.command.ExpressSetup.run(ExpressSetup.java:59)
--> at com.vmware.hms.config.cli.command.CommandBase.run(CommandBase.java:347)
--> at com.vmware.hms.config.cli.App.run(App.java:146)
--> at com.vmware.hms.config.cli.App.main(App.java:206)
--> Caused by: (vim.fault.AlreadyExists) {
--> faultCause = null,
--> faultMessage = null,
--> name = null
--> }
--> at java.base/jdk.internal.reflect.DirectConstructorHandleAccessor.newInstance(Unknown Source)
--> at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Unknown Source)
--> at java.base/java.lang.reflect.ReflectAccess.newInstance(Unknown Source)
--> at java.base/jdk.internal.reflect.ReflectionFactory.newInstance(Unknown Source)
--> at java.base/java.lang.Class.newInstance(Unknown Source)
--> at com.vmware.vim.vmomi.core.types.impl.ComplexTypeImpl.newInstance(ComplexTypeImpl.java:174)
--> at com.vmware.vim.vmomi.core.types.impl.DefaultDataObjectFactory.newDataObject(DefaultDataObjectFactory.java:25)
--> at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.ComplexStackContext.<init>(ComplexStackContext.java:30)
--> at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl$UnmarshallSoapFaultContext.parse(UnmarshallerImpl.java:167)
--> at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl$UnmarshallSoapFaultContext.unmarshall(UnmarshallerImpl.java:105)
--> at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl.unmarshalSoapFault(UnmarshallerImpl.java:92)
--> at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl.unmarshalSoapFault(UnmarshallerImpl.java:86)
--> at com.vmware.vim.vmomi.client.common.impl.SoapFaultStackContext.setValue(SoapFaultStackContext.java:41)
--> at com.vmware.vim.vmomi.client.common.impl.ResponseUnmarshaller.processNextElement(ResponseUnmarshaller.java:127)
--> at com.vmware.vim.vmomi.client.common.impl.ResponseUnmarshaller.unmarshal(ResponseUnmarshaller.java:70)
--> at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.unmarshalResponse(ResponseImpl.java:288)
--> at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.setResponse(ResponseImpl.java:243)
--> at com.vmware.vim.vmomi.client.http.impl.HttpExchangeBase.parseResponse(HttpExchangeBase.java:267)
--> at com.vmware.vim.vmomi.client.http.impl.HttpExchange.invokeWithinScope(HttpExchange.java:56)
--> at com.vmware.vim.vmomi.core.tracing.NoopTracer$NoopSpan.runWithinSpanContext(NoopTracer.java:120)
--> at com.vmware.vim.vmomi.client.http.impl.TracingScopedRunnable.run(TracingScopedRunnable.java:17)
--> at com.vmware.vim.vmomi.client.http.impl.HttpExchangeBase.run(HttpExchangeBase.java:52)
--> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
--> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
--> at java.base/java.lang.Thread.run(Unknown Source)
--> ]
--> at com.vmware.hms.config.helper.VcHelper.registerExtension(VcHelper.java:287)
--> at com.vmware.hms.config.VrConfig.expressSetup(VrConfig.java:358)
--> at com.vmware.hms.config.cli.command.ExpressSetup.run(ExpressSetup.java:59)
--> at com.vmware.hms.config.cli.command.CommandBase.run(CommandBase.java:347)
--> at com.vmware.hms.config.cli.App.run(App.java:146)
--> at com.vmware.hms.config.cli.App.main(App.java:206)
--> Caused by: com.vmware.jvsl.cfg.ConfigException: Internal error.
--> at com.vmware.jvsl.cfg.RegisterExtensionCommand.execute(RegisterExtensionCommand.java:154)
--> at com.vmware.hms.config.helper.VcHelper.registerExtension(VcHelper.java:280)
--> ... 5 more
--> Caused by: (vim.fault.AlreadyExists) {
--> faultCause = null,
--> faultMessage = null,
--> name = null
--> }
2024-11-22T11:13:23.020-07:00 info drconfig[01115] [SRM@6876 sub=ConfigureVrmsOp opID=bf3fdbc3-394a-4f7e-8283-fc937667c563-configure:fe09] Exiting ConfigureVrms
2024-11-22T11:13:23.021-07:00 verbose drconfig[01115] [SRM@6876 sub=vmomi.soapStub[108] opID=bf3fdbc3-394a-4f7e-8283-fc937667c563-configure:fe09] Resetting stub adapter; <[N7Vmacore4Http3Ext15DrUserAgentImplE:0x00007febdc0146c8], /lookupservice/sdk>, (null)
2024-11-22T11:13:23.021-07:00 error drconfig[01115] [SRM@6876 sub=ConfigureVrmsOp opID=bf3fdbc3-394a-4f7e-8283-fc937667c563-configure:fe09] Operation failed
--> (vmodl.fault.SystemError) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>,
--> reason = "Failed to register VRMS."
--> msg = ""
--> }
vpxd.log:
2022-01-13T23:07:21.353Z info vpxd[07184] [Originator@6876 sub=vpxLro opID=73d3f128] [VpxLRO] -- BEGIN lro-15188940 -- AuthorizationManager -- vim.AuthorizationManager.updateRole -- 52c82293-e339-a4ad-9c25-7fb79e265962(529903de-cd2f-ff3a-3add-f0636826f490)
2022-01-13T23:07:21.354Z warning vpxd[07184] [Originator@6876 sub=AuthorizeManager opID=73d3f128] Role with name 'HmsCloudAdmin' already exists
2022-01-13T23:07:21.354Z info vpxd[07184] [Originator@6876 sub=vpxLro opID=73d3f128] [VpxLRO] -- FINISH lro-15188940
2022-01-13T23:07:21.354Z info vpxd[07184] [Originator@6876 sub=Default opID=73d3f128] [VpxLRO] -- ERROR lro-15188940 -- AuthorizationManager -- vim.AuthorizationManager.updateRole: vim.fault.AlreadyExists:
--> Result:
--> (vim.fault.AlreadyExists) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>,
--> name = <unset>
--> msg = ""
--> }
--> Args:
-->
--> Arg roleId:
--> -1440203378
--> Arg newName:
--> "HmsCloudAdmin"
--> Arg privIds:
--> (string) [
--> "System.Read",
--> "Host.Hbr.HbrManagement",
--> "VirtualMachine.Hbr.ConfigureReplication",
--> "VirtualMachine.Hbr.ReplicaManagement",
--> "VirtualMachine.Hbr.MonitorReplication",
--> "HmsRemote.com.vmware.vcHms.Hbr.View",
--> "HmsRemote.com.vmware.vcHms.Hms.Manage",
--> "HmsRemote.com.vmware.vcHms.Hms.View",
--> "HmsReplication.com.vmware.vcHms.Replication.View",
--> "HmsDatastoreMapper.com.vmware.vcHms.Mappings.Manage",
--> "HmsDatastoreMapper.com.vmware.vcHms.Mappings.View",
--> "HmsDiagnostics.com.vmware.vcHms.Diagnostics.Manage",
--> "HmsSession.com.vmware.vcHms.Session.Terminate",
--> "Datastore.FileManagement",
--> "Datastore.Browse",
--> "Datastore.Config",
--> "VirtualMachine.Config.AddExistingDisk",
--> "VirtualMachine.Config.AddRemoveDevice",
--> "VirtualMachine.Interact.PowerOn",
--> "VirtualMachine.Interact.DeviceConnection",
--> "VirtualMachine.Inventory.Register",
--> "VirtualMachine.Inventory.Unregister",
--> "VirtualMachine.State.RemoveSnapshot",
--> "Resource.AssignVMToPool",
--> "StorageProfile.View"
--> ]
2024-11-22T12:10:21.611-07:00 info vpxd[06552] [Originator@6876 sub=vmomi.soapStub[1253] opID=751ad160] SOAP request returned HTTP failure; <<cs p:00007fafc0014a90, TCP:localhost:1080>, /invsvc/vmomi/sdk>, method: updateRoleByUser; code: 500(Internal Server Error); fault: (dataservice.fault.NotAuthenticatedFault) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>
--> msg = "Received SOAP response fault from [<<cs p:00007fafc0014a90, TCP:localhost:1080>, /invsvc/vmomi/sdk>]: updateRoleByUser
--> "
--> }
2024-11-22T12:10:21.615-07:00 error vpxd[06552] [Originator@6876 sub=AuthzStorageProvider opID=751ad160] AuthzStorageProviderDecorator::UpdateRole Invoking UpdateRole failed. Error: N11Dataservice5Fault21NotAuthenticatedFault9ExceptionE(Fault cause: dataservice.fault.NotAuthenticatedFault
--> )
--> [context]zKq7AVECAQAAAA8jcwEjdnB4ZAAAMxxTbGlidm1hY29yZS5zbwAA/hdCAB8/QwCMmUoB1woHbGliZGF0YXNlcnZpY2UtdHlwZXMuc28AAVQQBwLhYiFsaWJ2bW9taS5zbwAC6pAhAl8KIQLX2hoBG60IAwTIAWxpYmF1dGh6Y2xpZW50LnNvAAMr+wEDU/4BAwb/AQMr+wEDHgICA96ZAgCGYT0AImU9hDOo0AF2cHhkAIQ4qtABhYARNQFsaWJ2aW0tdHlwZXMuc28AhG0VggICTXUchKTvXwKE7KCAAoQ3sYAChCvEfwKEGpuAAgAE7DcAF0U4ALsPUQawjgBsaWJwdGhyZWFkLnNvLjAAB9/6D2xpYmMuc28uNgA=[/context]
2024-11-22T12:10:21.769-07:00 warning vpxd[06550] [Originator@6876 sub=AuthorizeManager opID=1df58cad] Role with name 'HmsDpxAgentUser' already exists
2024-11-22T12:10:21.770-07:00 warning vpxd[06550] [Originator@6876 sub=Vmomi opID=1df58cad] VMOMI activation LRO failed; <<52b0d93b-62c1-174a-399c-1fc1e193ab8a, <TCP '127.0.0.1 : 8085'>, <TCP '127.0.0.1 : 51820'>>, AuthorizationManager, vim.AuthorizationManager.updateRole, <vim.version.v8_0_3_0, official, 8.0.3.0>, {stm: {<io_obj p:0x00007faf9002f950, h:145, <TCP '127.0.0.1 : 8085'>, <TCP '127.0.0.1 : 51820'>>, id: 1296537, state(in/out): 3/1}, session: <52b0d93b-62c1-174a-399c-1fc1e193ab8a, <TCP '127.0.0.1 : 8085'>, <TCP '127.0.0.1 : 51820'>>, req: {POST, /sdk}}>, N3Vim5Fault13AlreadyExists9ExceptionE(Fault cause: vim.fault.AlreadyExists
--> )
--> [context]zKq7AVECAQAAAA8jcwEVdnB4ZAAAMxxTbGlidm1hY29yZS5zbwAA/hdCAB8/QwCMmUqBw30cAXZweGQAgdJk0AGBUKnQAYE4qtABgoARNQFsaWJ2aW0tdHlwZXMuc28AgW0VggIDTXUcbGlidm1vbWkuc28AgaTvXwKB7KCAAoE3sYACgSvEfwKBGpuAAgAE7DcAF0U4ALsPUQSwjgBsaWJwdGhyZWFkLnNvLjAABd/6D2xpYmMuc28uNgA=[/context]
2024-11-22T12:10:21.771-07:00 info vpxd[06550] [Originator@6876 sub=vpxLro opID=1df58cad] [VpxLRO] -- FINISH lro-1844503
2024-11-22T12:10:21.771-07:00 error vpxd[06550] [Originator@6876 sub=Default opID=1df58cad] [VpxLRO] -- ERROR lro-1844503 -- 52b0d93b-62c1-174a-399c-1fc1e193ab8a(5288d9eb-ece8-0ee3-fe24-de627ba958b4) -- AuthorizationManager -- vim.AuthorizationManager.updateRole: :vim.fault.AlreadyExists
--> Result:
--> (vim.fault.AlreadyExists) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>,
--> name = <unset>
--> msg = ""
--> }
--> Args:
-->
--> Arg roleId:
--> 488702710
--> Arg newName:
--> "HmsDpxAgentUser"
--> Arg privIds:
--> (string) [
--> "System.Read",
--> "Global.LogEvent",
--> "VirtualMachine.Hbr.MonitorReplication",
--> "HmsRemote.com.vmware.vcHms.Hbr.View",
--> "HmsRemote.com.vmware.vcHms.Hms.View",
--> "HmsDatastoreMapper.com.vmware.vcHms.Mappings.View",
--> "HmsReplication.com.vmware.vcHms.Replication.View",
--> "HmsDpx.com.vmware.vcHms.Subscription.Manage"
--> ]
2024-11-22T11:27:50.146-07:00 warning vpxd[06334] [Originator@6876 sub=AuthorizeManager opID=13204840] Role with name 'HmsRecoveryUser' already exists
2024-11-22T11:27:50.146-07:00 warning vpxd[06334] [Originator@6876 sub=Vmomi opID=13204840] VMOMI activation LRO failed; <<525eff5b-9c40-1b28-6c85-c66bfbb7fa8c, <TCP '127.0.0.1 : 8085'>, <TCP '127.0.0.1 : 51812'>>, AuthorizationManager, vim.AuthorizationManager.updateRole, <vim.version.v8_0_3_0, official, 8.0.3.0>, {stm: {<io_obj p:0x00007faf9c032470, h:79, <TCP '127.0.0.1 : 80
85'>, <TCP '127.0.0.1 : 51812'>>, id: 1183309, state(in/out): 3/1}, session: <525eff5b-9c40-1b28-6c85-c66bfbb7fa8c, <TCP '127.0.0.1 : 8085'>, <TCP '127.0.0.1 : 51812'>>, req: {POST, /sdk}}>,
N3Vim5Fault13AlreadyExists9ExceptionE(Fault cause: vim.fault.AlreadyExists
--> )
--> [context]zKq7AVECAQAAAA8jcwEVdnB4ZAAAMxxTbGlidm1hY29yZS5zbwAA/hdCAB8/QwCMmUqBw30cAXZweGQAgdJk0AGBUKnQAYE4qtABgoARNQFsaWJ2aW0tdHlwZXMuc28AgW0VggIDTXUcbGlidm1vbWkuc28AgaTvXwKB7KCAAoE3sYACgSvEfwKBGpuAAgAE7DcAF0U4ALsPUQSwjgBsaWJwdGhyZWFkLnNvLjAABd/6D2xpYmMuc28uNgA=[/context]
2024-11-22T11:27:50.148-07:00 info vpxd[06334] [Originator@6876 sub=vpxLro opID=13204840] [VpxLRO] -- FINISH lro-1813115
2024-11-22T11:27:50.148-07:00 error vpxd[06334] [Originator@6876 sub=Default opID=13204840] [VpxLRO] -- ERROR lro-1813115 -- 525eff5b-9c40-1b28-6c85-c66bfbb7fa8c(52919742-90bf-3ce5-667d-e197955e6516) -- AuthorizationManager -- vim.AuthorizationManager.updateRole: :vim.fault.AlreadyExists
--> Result:
--> (vim.fault.AlreadyExists) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>,
--> name = <unset>
--> msg = ""
--> }
--> Args:
-->
--> Arg roleId:
--> -1970262551
--> Arg newName:
--> "HmsRecoveryUser"
--> Arg privIds:
--> (string) [
--> "System.Read",
--> "Host.Hbr.HbrManagement",
--> "Datastore.FileManagement",
--> "Datastore.Browse",
--> "VirtualMachine.Config.AddExistingDisk",
--> "VirtualMachine.Config.AddRemoveDevice",
--> "VirtualMachine.Interact.PowerOn",
--> "VirtualMachine.Interact.DeviceConnection",
--> "VirtualMachine.Inventory.Register",
--> "VirtualMachine.Inventory.Unregister",
--> "VirtualMachine.State.RemoveSnapshot",
--> "Resource.AssignVMToPool"
--> ]
vSphere Replication
VMware Live Site Recovery
Duplicate VRM & HMS roles found in ELM (Enhanced Linked Mode) vCenter
1. Remove all the VRM & HMS roles from vCenter/s in linked mode
2. Remove com.vmware.vcHms
from the vCenter MOB
3. Reconfigure the appliance