Unable to commission ESXI hosts to the SDDC Manager where the Commission Hosts button is greyed out.

Products

• VMware SDDC Manager

Issue/Introduction

Unable to commission ESXI hosts to the SDDC Manager with the following tooltip when the mouse pointer hovers the Commission hosts button that is greyed out: "The operation is not allowed because you have reached the maximum number of 10 concurrent host commission operations and cannot commission hosts at this time" as seen from the screenshot below:

Environment

VMware Cloud Foundation 5.x

Cause

• The issue is caused due to a high number of running tasks in the SDDC UI with no associated task descriptions, the sosrest service although running was reporting the error "Convert from db to json failed" or "Upserting Json to DB failed".
• From the /var/log/vmware/vcf/sddc-support/vcf-sos.log we observe "Database disk image is malformed":

  Traceback (most recent call last):
  File "framework/dbinterface/db_api.py", line 64, in return_a_session
  File "framework/dbinterface/db_api.py", line 241, in fetch_all_records
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/orm/query.py", line 2692, in all
    return self._iter().all() # type: ignore
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/orm/query.py", line 2846, in _iter
    result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/orm/session.py", line 2232, in execute
    return self._execute_internal(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/orm/session.py", line 2127, in _execute_internal
    result: Result[Any] = compile_state_cls.orm_execute_statement(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/orm/context.py", line 293, in orm_execute_statement
    result = conn.execute(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/engine/base.py", line 1413, in execute
    return meth(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/sql/elements.py", line 483, in _execute_on_connection
    return connection._execute_clauseelement(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/engine/base.py", line 1637, in _execute_clauseelement
    ret = self._execute_context(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/engine/base.py", line 1846, in _execute_context
    return self._exec_single_context(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/engine/base.py", line 1987, in _exec_single_context
    self._handle_dbapi_exception(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/engine/base.py", line 2344, in _handle_dbapi_exception
    raise sqlalchemy_exception.with_traceback(exc_info[2]) from e
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/engine/base.py", line 1968, in _exec_single_context
    self.dialect.do_execute(
  File "/opt/vmware/sddc-support/services/../framework/../dependency/sqlalchemy/engine/default.py", line 920, in do_execute
    cursor.execute(statement, parameters)
sqlalchemy.exc.DatabaseError: (sqlite3.DatabaseError) database disk image is malformed
[SQL: SELECT subtasks.name AS subtasks_name, subtasks.status AS subtasks_status, subtasks.description AS subtasks_description, subtasks
.stages AS subtasks_stages, subtasks.errors AS subtasks_errors, subtasks."creationTimestamp" AS "subtasks_creationTimestamp", subtasks.
"completionTimestamp" AS "subtasks_completionTimestamp", subtasks.task_id AS subtasks_task_id
FROM subtasks
WHERE subtasks.task_id IN (?)]
[parameters: ('xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx',)]

Resolution

Please contact Broadcom Technical Support for further assistance.