Upgrade failed with Error: Failedresource key=pak_manager.action_failed, resource args=[run cassandra db upgrade]

Products

• VMware Aria Suite

Issue/Introduction

While trying to upgrade vRealize Operations, upgrade failed at Step 9 of 14 with the Cassandra DB Error.

Environment

VMware vRealize Operations 8.6

Cause

Multiple "admin" users existed in the Cassandra Database.  The following logs were found in the cassandradbupgrade.log:

 

2024-08-28T21:01:25,518+0000 INFO  [main]  .runOneScript - Invoking execute() method of class: com.vmware.vcops.dbupgrade.cassandra.upgrade.next.ConvertTravSpecToObjectScope

2024-08-28T21:01:25,619+0000 WARN  [main]  com.vmware.vcops.auth.server.util.AuthUtils.searchUserByNameAndSourceId - Search for user by name: admin and sourceId: null returned 2 entries. Must return only one entry. Something wrong

2024-08-28T21:01:25,619+0000 ERROR [main]  .runOneScript - Exception running upgrade script:826

java.lang.reflect.InvocationTargetException: null

        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]

        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:?]

        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:?]

        at java.lang.reflect.Method.invoke(Unknown Source) ~[?:?]

        at com.vmware.vcops.dbupgrade.cassandra.CassandraDbUpgrade.runOneScript(CassandraDbUpgrade.java:250) ~[vcops-dbupgrade-1.0-SNAPSHOT.jar:?]

        at com.vmware.vcops.dbupgrade.cassandra.CassandraDbUpgrade.upgradeDB(CassandraDbUpgrade.java:414) ~[vcops-dbupgrade-1.0-SNAPSHOT.jar:?]

        at com.vmware.vcops.dbupgrade.cassandra.CassandraDbUpgrade.upgradeCassandraDB(CassandraDbUpgrade.java:116) ~[vcops-dbupgrade-1.0-SNAPSHOT.jar:?]

        at com.vmware.vcops.dbupgrade.cassandra.CassandraDbUpgrade.main(CassandraDbUpgrade.java:562) ~[vcops-dbupgrade-1.0-SNAPSHOT.jar:?]

Caused by: com.vmware.vcops.auth.server.exception.DuplicateUserException: User with username: admin exist multiple times

        at com.vmware.vcops.auth.server.util.AuthUtils.searchUserByNameAndSourceId(AuthUtils.java:1575) ~[vcops-auth-server-1.0-SNAPSHOT.jar:?]

        at com.vmware.vcops.dbupgrade.cassandra.upgrade.next.ConvertTravSpecToObjectScope.getSuperAdminUserId(ConvertTravSpecToObjectScope.java:139) ~[vcops-dbupgrade-1.0-SNAPSHOT.jar:?]

        at com.vmware.vcops.dbupgrade.cassandra.upgrade.next.ConvertTravSpecToObjectScope.execute(ConvertTravSpecToObjectScope.java:53) ~[vcops-dbupgrade-1.0-SNAPSHOT.jar:?]

 

Resolution

This needs to be addressed at the cassandra database level. Please submit a support case by following the instructions in the KB: https://knowledge.broadcom.com/external/article/142884/creating-and-managing-broadcom-support-c.html.

 

Additional Information

PR referencing this Cassandra related upgrade issue:

UPGRADE to 8.10 failed due to Cassandra errors - Cassandra DB Upgrade failed with exit code: 2