Error: "vmware_b2b.patching.phases.patcher Patch hook Patch got unhandled exception" when trying to update the vCenter
search cancel

Error: "vmware_b2b.patching.phases.patcher Patch hook Patch got unhandled exception" when trying to update the vCenter

book

Article ID: 402072

calendar_today

Updated On:

Products

VMware vCenter Server 8.0

Issue/Introduction

  • Patching vCenter fails with error:  
    "vmware_b2b.patching.phases.patcher Patch hook Patch got unhandled exception"
  • In /var/log/vmware/applmgmt/PatchRunner.log
    ERROR vmware_b2b.patching.phases.patcher Patch hook Patch got unhandled exception.
Traceback (most recent call last):
  File "/storage/seat/software-updateisi9dh0b/stage/scripts/patches/py/vmware_b2b/patching/phases/patcher.py", line 208, in patch
    _patchComponents(ctx, userData, statusAggregator.reportingQueue)
  File "/storage/seat/software-updateisi9dh0b/stage/scripts/patches/py/vmware_b2b/patching/phases/patcher.py", line 89, in _patchComponents
    _startDependentServices(c)
  File "/storage/seat/software-updateisi9dh0b/stage/scripts/patches/py/vmware_b2b/patching/phases/patcher.py", line 56, in _startDependentServices
    serviceManager.start(depService)
  File "/storage/seat/software-updateisi9dh0b/stage/scripts/patches/libs/sdk/service_manager.py", line 909, in wrapper
    return getattr(controller, attr)(*args, **kwargs)
  File "/storage/seat/software-updateisi9dh0b/stage/scripts/patches/libs/sdk/service_manager.py", line 799, in start
    super(VMwareServiceController, self).start(serviceName)
  File "/storage/seat/software-updateisi9dh0b/stage/scripts/patches/libs/sdk/service_manager.py", line 665, in start
    raise IllegalServiceOperation(errorText)
service_manager.IllegalServiceOperation: Service cannot be started. Error: Error executing start on service vpxd-svcs. Details {
    "detail": [
        {
            "id": "install.ciscommon.service.failstart",
            "translatable": "An error occurred while starting service '%(0)s'",
            "args": [
                "vpxd-svcs"
            ],
            "localized": "An error occurred while starting service 'vpxd-svcs'"
        }
    ],
    "componentKey": null,
    "problemId": null,
    "resolution": null
}
Service-control failed. Error: {
    "detail": [
        {
            "id": "install.ciscommon.service.failstart",
            "translatable": "An error occurred while starting service '%(0)s'",
            "args": [
                "vpxd-svcs"
            ],
            "localized": "An error occurred while starting service 'vpxd-svcs'"
        }
    ],
    "componentKey": null,
    "problemId": null,
    "resolution": null
}
  • In /var/log/vmware/applmgmt/update_microservice.log
    - 49127 -    update_b2b_target::               postInstallHook:2526 -    ERROR - Exception occured in postInstallHook for B2B-patching. Please check the logs for more details. Take corrective action and then resume.
 - 49127 -  task_manager_target::                        update:  91 -    DEBUG - UpdateTask: status=FAILED, progress=80, message={'id': 'com.vmware.appliance.plain_message', 'default_message': '%s', 'args': ['Exception occured in postInstallHook for B2B-patching. Please check the logs for more details. Take corrective action and then resume.']}, failure_state=RESUMABLE_AND_REVERTIBLE
 - 49127 -   dbfunctions_target::                    executeDML:  56 -    DEBUG - Executing Query {UPDATE install_progress SET Subphase = ?,          end_time = DATETIME('now'), status = ?          WHERE Phase = ? } with parameters ('Exception occured in postInstallHook for B2B-patching', 'failed', 'Running Post-install')
 - 49127 -    update_b2b_target::                       install:3007 -    ERROR - Post-Install hook phase failed.
  • In /var/log/vmware/vpxd-svcs/vpxd-svcs.log 
     [main [] INFO  com.vmware.vim.sso.client.impl.SecurityTokenServiceImpl  opId=] Successfully acquired token for user: {Name: vpxd-extension-XXX65d02-74c4-XXYY-acXX-5e4b5XXXXed0, Domain: vsphere.local}
 [main [] ERROR com.vmware.vim.vcauthenticate.servlets.AuthenticationHelper  opId=] Hit ServiceCommunicationException while fetching admin group for the SSO Admin user : [email protected]
com.vmware.cis.server.ssoauthentication.exception.ServiceCommunicationException: java.lang.IllegalArgumentException: The given token does not match the expected confirmation type
        at com.vmware.cis.server.ssoauthentication.impl.RetryAction.execute(RetryAction.java:79) ~[inventory-server.jar:?]

     

  • In /var/log/vmware/vpxd-svcs/vpxd-svcs-runtime.log.stderr

     
    org.apache.catalina.util.LifecycleBase handleSubClassException
SEVERE: Failed to initialize component [Connector["http-nio-0:0:0:0:0:0:0:1-10080"]]
org.apache.catalina.LifecycleException: Protocol handler initialization failed
        at org.apache.catalina.connector.Connector.initInternal(Connector.java:1012)
        at org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:122)
        at org.apache.catalina.core.StandardService.initInternal(StandardService.java:525)
        at org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:122)
        at org.apache.catalina.core.StandardServer.initInternal(StandardServer.java:990)
        at org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:122)
        at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:155)
        at org.apache.catalina.startup.Tomcat.start(Tomcat.java:438)
        at com.vmware.vim.vmomi.server.http.impl.TcServer.start(TcServer.java:365)
        at com.vmware.vim.dataservices.DataService.init(DataService.java:62)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeCustomInitMethod(AbstractAutowireCapableBeanFactory.java:1930)
        at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1872)
        at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1800)
        at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:620)
        at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
        at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:354)
        at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:209)
        at org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1171)
        at com.vmware.vim.dataservices.DataService.getService(DataService.java:160)
        at com.vmware.vim.dataservices.VpxdSvcsMain$Main_Vmon.start(VpxdSvcsMain.java:47)
        at com.vmware.vim.dataservices.VpxdSvcsMain.main(VpxdSvcsMain.java:34)
Caused by: java.net.SocketException: Protocol family unavailable
  • In /var/log/vmware/sso/vmware-identity-sts-default.log
    INFO sts-default[22:Thread-9] [CorId= OpId=] [com.vmware.identity.saml.impl.TokenLifetimeRemediator] There is a HoK confirmation certificate with end time: [YYYY-MM-DDTHH:MM:SS]
INFO sts-default[22:Thread-9] [CorId= OpId=] [com.vmware.identity.token.impl.SamlTokenImpl] SAML token for SubjectNameId [[email protected], format=http://schemas.xmlsoap.org/claims/UPN] successfully parsed from Element
ERROR sts-default[22:Thread-9] [CorId= OpId=] [com.vmware.identity.util.VcTrustCache] Refresh thread failed to retreive Vctrusts.
com.vmware.vapi.client.exception.TransportProtocolException: HTTP response with status code 503 (enable debug logging for details): no healthy upstream

Environment

vSphere vCenter Server 8.x

Cause

  • The failure of the vpxd-svcs service to start is a direct result of the Trustmanagement service not running.

Resolution

  • To start Trustmanagement service follow the below steps. 
    • SSH to vCenter Server
    • Run below command
      service-control --start vmware-trustmanagement
    • Resume the patching of vCenter Server
Powered by Wolken Software