After a failed convergence, vpxd service fails to start with the error: "Error 90021: The system is not joined to a domain"
search cancel

After a failed convergence, vpxd service fails to start with the error: "Error 90021: The system is not joined to a domain"

book

Article ID: 313938

calendar_today

Updated On:

Products

VMware vCenter Server

Issue/Introduction

Symptoms:
  • A convergence of the PSC fails. 
  • vCenter Server services fail to start.
  • The /var/log/vmware/vpxd/vpxd.log file contains no new entries.
  • In the /var/log/vmware/vmon/vmon.log file, you see entries similar to:
<YYYY-MM-DD>T<TIME> notice vmon  Client info Uid=0,Gid=0,Pid=22509,Comm=(vmon-cli),PPid=22494,Comm=(service-control),PPid=2345,Comm=(bash),PPid=2301,Comm=(vherdrunner),PPid=1668,Comm=(sshd),PPid=1357
<YYYY-MM-DD>T<TIME> notice vmon  Received start request for vpxd
<YYYY-MM-DD>T<TIME> notice vmon  <vpxd-prestart> Constructed command: /usr/bin/python /usr/lib/vmware-vpx/py/vpxd-prestart.py
<YYYY-MM-DD>T<TIME> warning vmon  <vpxd> Service pre-start command's stderr: <YYYY-MM-DD>T<TIME>  Invoked command: ['/usr/lib/vmware-vmafd/bin/vmafd-cli', 'get-machine-id', '--server-name', 'localhost']
<YYYY-MM-DD>T<TIME> warning vmon
<YYYY-MM-DD>T<TIME> warning vmon  <vpxd> Service pre-start command's stderr: <YYYY-MM-DD>T<TIME>  RC = 1
<YYYY-MM-DD>T<TIME> warning vmon  Stdout =
<YYYY-MM-DD>T<TIME> warning vmon  Stderr = Error 90021: The system is not joined to a domain
<YYYY-MM-DD>T<TIME> warning vmon
<YYYY-MM-DD>T<TIME> warning vmon
<YYYY-MM-DD>T<TIME> warning vmon  <vpxd> Service pre-start command's stderr: Traceback (most recent call last):
<YYYY-MM-DD>T<TIME> warning vmon    File "/usr/lib/vmware-vpx/py/vpxd-prestart.py", line 59, in <module>
<YYYY-MM-DD>T<TIME> warning vmon      patch_vpxd_prop()
<YYYY-MM-DD>T<TIME> warning vmon    File "/usr/lib/vmware-vpx/py/vpxd_update.py", line 188, in patch_vpxd_prop
<YYYY-MM-DD>T<TIME> warning vmon      ls_patch = LSPatch()
<YYYY-MM-DD>T<TIME> warning vmon    File "/usr/lib/vmware-vpx/py/vpxd_update.py", line 68, in __init__
<YYYY-MM-DD>T<TIME> warning vmon      self.sol_id = "{}-{}".format(self.soluser, vmafd_machine_id())
<YYYY-MM-DD>T<TIME> warning vmon    File "/usr/lib/vmware/site-packages/cis/vecs.py", line 47, in vmafd_machine_id
<YYYY-MM-DD>T<TIME> warning vmon      raise ex
<YYYY-MM-DD>T<TIME> warning vmon    File "/usr/lib/vmware/site-packages/cis/vecs.py", line 41, in vmafd_machine_id
<YYYY-MM-DD>T<TIME> warning vmon      result = invoke_command(cmd, encoding=sys.getdefaultencoding())
<YYYY-MM-DD>T<TIME> warning vmon    File "/usr/lib/vmware/site-packages/cis/utils.py", line 369, in invoke_command
<YYYY-MM-DD>T<TIME> warning vmon      (cmd, stderr))
<YYYY-MM-DD>T<TIME> warning vmon  cis.exceptions.InvokeCommandException: {
<YYYY-MM-DD>T<TIME> warning vmon      "detail": [
<YYYY-MM-DD>T<TIME> warning vmon          {
<YYYY-MM-DD>T<TIME> warning vmon              "id": "install.ciscommon.command.errinvoke",
<YYYY-MM-DD>T<TIME> warning vmon              "localized": "An error occurred while invoking external command : 'Command: ['/usr/lib/vmware-vmafd/bin/vmafd-cli', 'get-machine-id', '--server-name', 'localhost']\nStderr: Error 90021: The system is not joined to a domain\n'",
<YYYY-MM-DD>T<TIME> warning vmon              "args": [
<YYYY-MM-DD>T<TIME> warning vmon                  "Command: ['/usr/lib/vmware-vmafd/bin/vmafd-cli', 'get-machine-id', '--server-name', 'localhost']\nStderr: Error 90021: The system is not joined to a domain\n"
<YYYY-MM-DD>T<TIME> warning vmon              ],
<YYYY-MM-DD>T<TIME> warning vmon              "translatable": "An error occurred while invoking external command : '%(0)s'"
<YYYY-MM-DD>T<TIME> warning vmon          },
 
  • In the /var/log/vmware/vmdird/vmdird-syslog.log file, you see entries similar to:
<YY-MM-DD>T<TIME> err vmdird  t@140166960015104: VmDirSRPGetIdentityData ([email protected]) failed, (9611)
<YY-MM-DD>T<TIME> err vmdird  t@140166960015104: VmDirSRPGetIdentityData ([email protected]) failed, (9611)
<YY-MM-DD>T<TIME> err vmdird  t@140166960015104: SASLSessionStart: sasl error (-20)(SASL(-13): user not found: no secret in database)
 
  • The command /opt/likewise/bin/lwregshell list_values "[HKEY_THIS_MACHINE\Services\vmafd\Parameters]" | grep DomainState returns the output:
+  "DomainState"             REG_DWORD       0x00000000 (0)


Environment

VMware vCenter Server Appliance 6.7.x
VMware vCenter Server Appliance 6.5.x

Cause

The issue occurs as a result of a failed convergence.

Resolution

To resolve the issue, follow the steps below:
  1. Recreate the computer account for the vCenter Server by following the Resolution outlined in Recreate vCenter Server Machine Account in Platform Services Controller after Failed Convergence.
  2. Move the file /root/velma/afd.db to the directory /storage/db/vmware-vmafd/ using the command:
mv /root/velma/afd.db /storage/db/vmware-vmafd/afd.db;
 
  1. Run the command below to configure the DomainState of the vCenter Server to an external topology:
/opt/likewise/bin/lwregshell set_value "[HKEY_THIS_MACHINE\Services\vmafd\Parameters]" "DomainState" 2;
 
  1. Restart the vCenter Server services using the command below:
service-control --stop --all;service-control --start --all;
 


Workaround:
Restore both the PSC and the vCenter server from a backup which was taken while both nodes were offline. Please note that restoring a backup of just one node can have adverse effects on the environment.