Spectrum Upgrade Failed - Script Install-Tools/CUS/mysql.cus has FAILED
search cancel

Spectrum Upgrade Failed - Script Install-Tools/CUS/mysql.cus has FAILED

book

Article ID: 254458

calendar_today

Updated On:

Products

DX NetOps CA Spectrum

Issue/Introduction


The upgrade of Spectrum from 21.2.2 to 22.2.3 failed when updating MySql



$SPECROOT/Install-Tools/LOGS/22.2.3.0.15_xxxxxxxx/postinst.xx.xx

********** Started: Wed Nov 16 09:39:16 2022 **********
running Custom Script Install-Tools/CUS/mysql.cus
 Error(s) occurred. Please see /opt/Spectrum/Install-Tools/LOGS/22.2.3.0.15_20221116/mysql.log.

Script Install-Tools/CUS/mysql.cus has FAILED
********** Completed: Wed Nov 16 09:44:57 2022 **********

 

********** Started: Wed Nov 16 09:48:56 2022 **********
running Custom Script Install-Tools/CUS/mibtools.cus
 mysqladmin: connect to server at 'localhost' failed
error: 'Access denied for user 'root'@'localhost' (using password: YES)'
Error(s) occurred. Please see /opt/Spectrum/Install-Tools/LOGS/22.2.3.0.15_20221116/mibtools.log.

Script Install-Tools/CUS/mibtools.cus has FAILED
********** Completed: Wed Nov 16 09:48:56 2022 **********

 

********** Started: Wed Nov 16 09:48:57 2022 **********
running Custom Script Install-Tools/CUS/slmWebOp.cus
 SLMDbMigrater: Memory Limit: 7,113.000 MB
SLMDbMigrater: SLMDatabase.create () starting
java.lang.NoClassDefFoundError: com/aprisma/util/environment/InstallEnvironment
	at com.aprisma.util.mysql.MySQLUtils.getSqlPassword(MySQLUtils.java:254)
	at com.aprisma.util.mysql.Database.create(Database.java:309)
	at com.aprisma.util.mysql.Database.create(Database.java:410)
	at com.aprisma.slm.install.SLMDbMigrater$SLMDatabase.create(SLMDbMigrater.java:1096)
	at com.aprisma.util.mysql.Database.reconnect(Database.java:531)
	at com.aprisma.util.mysql.Database.reconnect(Database.java:487)
	at com.aprisma.util.mysql.Database.openStatement(Database.java:552)
	at com.aprisma.util.mysql.Database.initTableSet(Database.java:884)
	at com.aprisma.util.mysql.Database.tableExists(Database.java:906)
	at com.aprisma.slm.install.SLMDbMigrater.getSchemaVersion(SLMDbMigrater.java:266)
	at com.aprisma.slm.install.SLMDbMigrater.<init>(SLMDbMigrater.java:125)
	at com.aprisma.slm.install.SLMDbMigrater.main(SLMDbMigrater.java:1185)
Caused by: java.lang.ClassNotFoundException: com.aprisma.util.environment.InstallEnvironment
	at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
	... 12 more
java.sql.SQLException: Access denied for user 'root'@'localhost' (using password: YES)

 


$SPECROOT/mysql/bin/MYSQL.OUT

2022-11-16T14:58:17.179724Z 0 [Warning] [MY-010139] [Server] Changed limits: max_open_files: 1024 (requested 8161)
2022-11-16T14:58:17.179732Z 0 [Warning] [MY-010142] [Server] Changed limits: table_open_cache: 431 (requested 4000)
2022-11-16T14:58:17.421818Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead.
2022-11-16T14:58:17.421839Z 0 [System] [MY-010116] [Server] /opt/Spectrum/mysql/bin//mysqld (mysqld 8.0.30-commercial) starting as process 48787
2022-11-16T14:58:17.424904Z 0 [Warning] [MY-013242] [Server] --character-set-server: 'utf8' is currently an alias for the character set UTF8MB3, but will be an alias for UTF8MB4 in a future release. Please consider using UTF8MB4 in order to be unambiguous.
2022-11-16T14:58:17.424918Z 0 [Warning] [MY-013244] [Server] --collation-server: 'utf8mb3_general_ci' is a collation of the deprecated character set UTF8MB3. Please consider using UTF8MB4 with an appropriate collation instead.
2022-11-16T14:58:17.428436Z 0 [Warning] [MY-013907] [InnoDB] Deprecated configuration parameters innodb_log_file_size and/or innodb_log_files_in_group have been used to compute innodb_redo_log_capacity=1073741824. Please use innodb_redo_log_capacity instead.
2022-11-16T14:58:17.430500Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2022-11-16T14:58:17.856863Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:18.857109Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:19.857265Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:20.857430Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:21.857662Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:22.857829Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:23.857993Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:24.858523Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:25.858682Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:26.858840Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:27.859020Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:28.859228Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:29.859466Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:30.859739Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:31.859922Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:32.860103Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:58:33.860378Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
~
~
2022-11-16T14:59:36.875121Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:37.875422Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:38.876035Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:39.876198Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:40.876798Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:41.876970Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:42.877153Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:43.877324Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:44.877646Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:45.877844Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:46.878096Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:47.878327Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:48.878501Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:49.878691Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:50.878907Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:51.879121Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:52.879333Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:53.879552Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11
2022-11-16T14:59:54.879754Z 1 [ERROR] [MY-012574] [InnoDB] Unable to lock ./ibdata1 error: 11

 Enterprise Server - Commercial.

 

 

$SPECROOT/Install-Tools/LOGS/22.2.3.0.15_xxxxxxxx/mysql.log

******* Begin Installation of the Distributed Data Manager *******

******* Upgrading mysql *******

stop_mysqld --login-path=myclient
Shutting down mysqld...
Shutting down mysqld...
2022-11-16T14:39:21.645943Z 0 [Note] Giving 0 client threads a chance to die gracefully
2022-11-16T14:39:21.645966Z 0 [Note] Shutting down slave threads
2022-11-16T14:39:21.645981Z 0 [Note] Forcefully disconnecting 0 remaining clients
2022-11-16T14:39:21.645987Z 0 [Note] Event Scheduler: Purging the queue. 0 events
2022-11-16T14:39:21.646055Z 0 [Note] Binlog end
2022-11-16T14:39:21.646620Z 0 [Note] Shutting down plugin 'ngram'
2022-11-16T14:39:21.646652Z 0 [Note] Shutting down plugin 'ARCHIVE'
2022-11-16T14:39:21.646656Z 0 [Note] Shutting down plugin 'partition'
2022-11-16T14:39:21.646658Z 0 [Note] Shutting down plugin 'BLACKHOLE'
2022-11-16T14:39:21.646661Z 0 [Note] Shutting down plugin 'MEMORY'
2022-11-16T14:39:21.646666Z 0 [Note] Shutting down plugin 'PERFORMANCE_SCHEMA'
2022-11-16T14:39:21.646708Z 0 [Note] Shutting down plugin 'MyISAM'
2022-11-16T14:39:21.646717Z 0 [Note] Shutting down plugin 'INNODB_SYS_VIRTUAL'
2022-11-16T14:39:21.646719Z 0 [Note] Shutting down plugin 'INNODB_SYS_DATAFILES'
2022-11-16T14:39:21.646721Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESPACES'
2022-11-16T14:39:21.646723Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN_COLS'
2022-11-16T14:39:21.646725Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN'
2022-11-16T14:39:21.646727Z 0 [Note] Shutting down plugin 'INNODB_SYS_FIELDS'
2022-11-16T14:39:21.646729Z 0 [Note] Shutting down plugin 'INNODB_SYS_COLUMNS'
2022-11-16T14:39:21.646731Z 0 [Note] Shutting down plugin 'INNODB_SYS_INDEXES'
2022-11-16T14:39:21.646733Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESTATS'
2022-11-16T14:39:21.646735Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLES'
2022-11-16T14:39:21.646737Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_TABLE'
2022-11-16T14:39:21.646739Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_CACHE'
2022-11-16T14:39:21.646741Z 0 [Note] Shutting down plugin 'INNODB_FT_CONFIG'
2022-11-16T14:39:21.646743Z 0 [Note] Shutting down plugin 'INNODB_FT_BEING_DELETED'
2022-11-16T14:39:21.646745Z 0 [Note] Shutting down plugin 'INNODB_FT_DELETED'
2022-11-16T14:39:21.646747Z 0 [Note] Shutting down plugin 'INNODB_FT_DEFAULT_STOPWORD'
2022-11-16T14:39:21.646749Z 0 [Note] Shutting down plugin 'INNODB_METRICS'
2022-11-16T14:39:21.646751Z 0 [Note] Shutting down plugin 'INNODB_TEMP_TABLE_INFO'
2022-11-16T14:39:21.646753Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_POOL_STATS'
2022-11-16T14:39:21.646755Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE_LRU'
2022-11-16T14:39:21.646757Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE'
2022-11-16T14:39:21.646759Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX_RESET'
2022-11-16T14:39:21.646761Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX'
2022-11-16T14:39:21.646763Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM_RESET'
2022-11-16T14:39:21.646765Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM'
2022-11-16T14:39:21.646767Z 0 [Note] Shutting down plugin 'INNODB_CMP_RESET'
2022-11-16T14:39:21.646769Z 0 [Note] Shutting down plugin 'INNODB_CMP'
2022-11-16T14:39:21.646771Z 0 [Note] Shutting down plugin 'INNODB_LOCK_WAITS'
2022-11-16T14:39:21.646773Z 0 [Note] Shutting down plugin 'INNODB_LOCKS'
2022-11-16T14:39:21.646775Z 0 [Note] Shutting down plugin 'INNODB_TRX'
2022-11-16T14:39:21.646776Z 0 [Note] Shutting down plugin 'InnoDB'
2022-11-16T14:39:21.646884Z 0 [Note] InnoDB: FTS optimize thread exiting.
2022-11-16T14:39:21.646962Z 0 [Note] InnoDB: Starting shutdown...
2022-11-16T14:39:21.665495Z 0 [Note] InnoDB: Buffer pool(s) load completed at 221116  9:39:21
2022-11-16T14:39:21.665526Z 0 [Note] InnoDB: Dumping buffer pool(s) to /opt/Spectrum/mysql/data/ib_buffer_pool
2022-11-16T14:39:21.666672Z 0 [Note] InnoDB: Buffer pool(s) dump completed at 221116  9:39:21
2022-11-16T14:39:22.822527Z 0 [Note] InnoDB: Shutdown completed; log sequence number 1989110878135
2022-11-16T14:39:22.824120Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2022-11-16T14:39:22.824151Z 0 [Note] Shutting down plugin 'CSV'
2022-11-16T14:39:22.824184Z 0 [Note] Shutting down plugin 'MRG_MYISAM'
2022-11-16T14:39:22.824189Z 0 [Note] Shutting down plugin 'sha256_password'
2022-11-16T14:39:22.824192Z 0 [Note] Shutting down plugin 'mysql_native_password'
2022-11-16T14:39:22.824316Z 0 [Note] Shutting down plugin 'binlog'
2022-11-16T14:39:22.824708Z 0 [Note] ./bin/mysqld: Shutdown complete

MySql didn't configured with Encrypted PEM files
******* Starting mysql *******
 wait_for_mysql_to_actually_startup upgrade mysql --login-path=myclient
Waiting for mysql to start up... --login-path=myclient
2022-11-16T14:39:28.840984Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2022-11-16T14:39:28.841059Z 0 [Warning] 'NO_AUTO_CREATE_USER' sql mode was not set.
2022-11-16T14:39:28.841080Z 0 [Warning] Insecure configuration for --secure-file-priv: Current value does not restrict location of generated files. Consider setting it to a valid, non-empty path.
2022-11-16T14:39:28.841114Z 0 [Note] ./bin/mysqld (mysqld 5.7.35-enterprise-commercial-advanced) starting as process 41189 ...
2022-11-16T14:39:28.845101Z 0 [Note] InnoDB: PUNCH HOLE support available
2022-11-16T14:39:28.845134Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2022-11-16T14:39:28.845138Z 0 [Note] InnoDB: Uses event mutexes
2022-11-16T14:39:28.845141Z 0 [Note] InnoDB: GCC builtin __sync_synchronize() is used for memory barrier
2022-11-16T14:39:28.845144Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2022-11-16T14:39:28.845147Z 0 [Note] InnoDB: Using Linux native AIO
2022-11-16T14:39:28.845412Z 0 [Note] InnoDB: Number of pools: 1
2022-11-16T14:39:28.845512Z 0 [Note] InnoDB: Using CPU crc32 instructions
2022-11-16T14:39:28.849835Z 0 [Note] InnoDB: Initializing buffer pool, total size = 3G, instances = 2, chunk size = 128M
2022-11-16T14:39:29.003588Z 0 [Note] InnoDB: Completed initialization of buffer pool
2022-11-16T14:39:29.027468Z 0 [Note] InnoDB: page_cleaner worker priority: -20
2022-11-16T14:39:29.027471Z 0 [Note] InnoDB: page_cleaner coordinator priority: -20
2022-11-16T14:39:29.039973Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
2022-11-16T14:39:29.105563Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2022-11-16T14:39:29.105704Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2022-11-16T14:39:29.119935Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2022-11-16T14:39:29.120663Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
2022-11-16T14:39:29.120676Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
2022-11-16T14:39:29.120949Z 0 [Note] InnoDB: Waiting for purge to start
2022-11-16T14:39:29.171221Z 0 [Note] InnoDB: 5.7.35 started; log sequence number 1989110878135
2022-11-16T14:39:29.171506Z 0 [Note] InnoDB: Loading buffer pool(s) from /opt/Spectrum/mysql/data/ib_buffer_pool
2022-11-16T14:39:29.171716Z 0 [Note] Plugin 'FEDERATED' is disabled.
2022-11-16T14:39:29.177964Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
2022-11-16T14:39:29.177984Z 0 [Note] Skipping generation of SSL certificates as certificate files are present in data directory.
2022-11-16T14:39:29.177989Z 0 [Warning] A deprecated TLS version TLSv1 is enabled. Please use TLSv1.2 or higher.
2022-11-16T14:39:29.177991Z 0 [Warning] A deprecated TLS version TLSv1.1 is enabled. Please use TLSv1.2 or higher.
2022-11-16T14:39:29.179191Z 0 [Warning] CA certificate ca.pem is self signed.
2022-11-16T14:39:29.179259Z 0 [Note] Skipping generation of RSA key pair as key files are present in data directory.
2022-11-16T14:39:29.179434Z 0 [Note] Server hostname (bind-address): '*'; port: 3306
2022-11-16T14:39:29.179499Z 0 [Note] IPv6 is available.
2022-11-16T14:39:29.179508Z 0 [Note]   - '::' resolves to '::';
2022-11-16T14:39:29.179535Z 0 [Note] Server socket created on IP: '::'.
2022-11-16T14:39:29.188060Z 0 [Note] Event Scheduler: Loaded 0 events
2022-11-16T14:39:29.188604Z 0 [Note] ./bin/mysqld: ready for connections.
Version: '5.7.35-enterprise-commercial-advanced'  socket: '/opt/Spectrum/mysql/tmp/mysql.sock'  port: 3306  MySQL Enterprise Server - Advanced Edition (Commercial)
2022-11-16T14:39:30.209688Z 0 [Note] InnoDB: Buffer pool(s) load completed at 221116  9:39:30
Waiting for mysql to start up... try count 1 
******* setting GLOBAL innodb_fast_shutdown=0 *******
Shutting down mysqld...
Shutting down mysqld...
2022-11-16T14:39:39.687250Z 0 [Note] Giving 0 client threads a chance to die gracefully
2022-11-16T14:39:39.687274Z 0 [Note] Shutting down slave threads
2022-11-16T14:39:39.687280Z 0 [Note] Forcefully disconnecting 0 remaining clients
2022-11-16T14:39:39.687285Z 0 [Note] Event Scheduler: Purging the queue. 0 events
2022-11-16T14:39:39.687338Z 0 [Note] Binlog end
2022-11-16T14:39:39.687957Z 0 [Note] Shutting down plugin 'ngram'
2022-11-16T14:39:39.687973Z 0 [Note] Shutting down plugin 'ARCHIVE'
2022-11-16T14:39:39.687976Z 0 [Note] Shutting down plugin 'partition'
2022-11-16T14:39:39.687978Z 0 [Note] Shutting down plugin 'BLACKHOLE'
2022-11-16T14:39:39.687981Z 0 [Note] Shutting down plugin 'MEMORY'
2022-11-16T14:39:39.687985Z 0 [Note] Shutting down plugin 'PERFORMANCE_SCHEMA'
2022-11-16T14:39:39.688013Z 0 [Note] Shutting down plugin 'MyISAM'
2022-11-16T14:39:39.688021Z 0 [Note] Shutting down plugin 'INNODB_SYS_VIRTUAL'
2022-11-16T14:39:39.688024Z 0 [Note] Shutting down plugin 'INNODB_SYS_DATAFILES'
2022-11-16T14:39:39.688026Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESPACES'
2022-11-16T14:39:39.688029Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN_COLS'
2022-11-16T14:39:39.688031Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN'
2022-11-16T14:39:39.688033Z 0 [Note] Shutting down plugin 'INNODB_SYS_FIELDS'
2022-11-16T14:39:39.688036Z 0 [Note] Shutting down plugin 'INNODB_SYS_COLUMNS'
2022-11-16T14:39:39.688038Z 0 [Note] Shutting down plugin 'INNODB_SYS_INDEXES'
2022-11-16T14:39:39.688040Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESTATS'
2022-11-16T14:39:39.688042Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLES'
2022-11-16T14:39:39.688043Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_TABLE'
2022-11-16T14:39:39.688045Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_CACHE'
2022-11-16T14:39:39.688047Z 0 [Note] Shutting down plugin 'INNODB_FT_CONFIG'
2022-11-16T14:39:39.688049Z 0 [Note] Shutting down plugin 'INNODB_FT_BEING_DELETED'
2022-11-16T14:39:39.688052Z 0 [Note] Shutting down plugin 'INNODB_FT_DELETED'
2022-11-16T14:39:39.688054Z 0 [Note] Shutting down plugin 'INNODB_FT_DEFAULT_STOPWORD'
2022-11-16T14:39:39.688056Z 0 [Note] Shutting down plugin 'INNODB_METRICS'
2022-11-16T14:39:39.688058Z 0 [Note] Shutting down plugin 'INNODB_TEMP_TABLE_INFO'
2022-11-16T14:39:39.688060Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_POOL_STATS'
2022-11-16T14:39:39.688062Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE_LRU'
2022-11-16T14:39:39.688064Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE'
2022-11-16T14:39:39.688067Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX_RESET'
2022-11-16T14:39:39.688069Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX'
2022-11-16T14:39:39.688071Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM_RESET'
2022-11-16T14:39:39.688073Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM'
2022-11-16T14:39:39.688075Z 0 [Note] Shutting down plugin 'INNODB_CMP_RESET'
2022-11-16T14:39:39.688077Z 0 [Note] Shutting down plugin 'INNODB_CMP'
2022-11-16T14:39:39.688079Z 0 [Note] Shutting down plugin 'INNODB_LOCK_WAITS'
2022-11-16T14:39:39.688081Z 0 [Note] Shutting down plugin 'INNODB_LOCKS'
2022-11-16T14:39:39.688083Z 0 [Note] Shutting down plugin 'INNODB_TRX'
2022-11-16T14:39:39.688086Z 0 [Note] Shutting down plugin 'InnoDB'
2022-11-16T14:39:39.688155Z 0 [Note] InnoDB: FTS optimize thread exiting.
2022-11-16T14:39:39.688314Z 0 [Note] InnoDB: Starting shutdown...
2022-11-16T14:39:39.788577Z 0 [Note] InnoDB: Dumping buffer pool(s) to /opt/Spectrum/mysql/data/ib_buffer_pool
2022-11-16T14:39:39.789102Z 0 [Note] InnoDB: Buffer pool(s) dump completed at 221116  9:39:39
2022-11-16T14:39:41.062851Z 0 [Note] InnoDB: Shutdown completed; log sequence number 1989110878163
2022-11-16T14:39:41.064655Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2022-11-16T14:39:41.064680Z 0 [Note] Shutting down plugin 'CSV'
2022-11-16T14:39:41.064688Z 0 [Note] Shutting down plugin 'MRG_MYISAM'
2022-11-16T14:39:41.064693Z 0 [Note] Shutting down plugin 'sha256_password'
2022-11-16T14:39:41.064695Z 0 [Note] Shutting down plugin 'mysql_native_password'
2022-11-16T14:39:41.064824Z 0 [Note] Shutting down plugin 'binlog'
2022-11-16T14:39:41.065151Z 0 [Note] ./bin/mysqld: Shutdown complete

******* Removing and copying new mysql/bin dir *******
******* Removing and copying new mysql/share dir *******
******* copying new mysql/lib dir *******
done fetching the old password
cp /opt/Spectrum/mysql/new/myspectrumlogin.cnf /opt/Spectrum/mysql/data/myspectrumlogin.cnf
mv /opt/Spectrum/mysql/data/mylogin.cnf /opt/Spectrum/mysql/data/mylogin_2022.11.16-09.39.50.cnf.
cp /opt/Spectrum/mysql/new/mylogin.cnf /opt/Spectrum/mysql/data/mylogin.cnf
mysql_idb_check : IDB backup directory exist
mysql_idb_check : MYSQL.idb file exists
mysql_idb_check : Encrypt related data in IDB => 
mysql_idb_check : MYSQL without encrypted PEM
mysqlEncryptPEMWrapper.cnf copying from Install-Tools folder

******* Preserving mysql directory *******


******* Begin Configuration of mysql ********

Updating /opt/Spectrum/mysql/myspectrum.cnf  
/opt/Spectrum/mysql/myspectrum.cnf alreadly exist 
INFO    Reading Customer File /opt/Spectrum/mysql/my-spectrum.cnf
INFO    Reading Delta File /opt/Spectrum/mysql/my-spectrum.cnf.deltas
INFO    Reading deltas file 

INFO    Applying Changes 
Existing my-spectrum.cnf merged with new out of box values and saved as my-spectrum.cnf_after_16112022_093950, Default out of box my-spectrum.cnf will be effective
Generating defaults /opt/Spectrum/mysql/myspectrum.cnf  
INFO    Reading Customer File /opt/Spectrum/mysql/my-spectrum.cnf
INFO    Reading Delta File /opt/Spectrum/mysql/my-spectrum.cnf.deltas
INFO    Reading deltas file 

INFO    Applying Changes 
MySql didn't configured with Encrypted PEM files
Waiting for mysql to start up... --login-path=myclient
Waiting for mysql to start up... try count 1 
Waiting for mysql to start up... try count 2 
Waiting for mysql to start up... try count 3 
Waiting for mysql to start up... try count 4 
Waiting for mysql to start up... try count 5 
Waiting for mysql to start up... try count 6 
Waiting for mysql to start up... try count 7 
Waiting for mysql to start up... try count 8 
Waiting for mysql to start up... try count 9 
Waiting for mysql to start up... try count 10 
Waiting for mysql to start up... try count 11 
Waiting for mysql to start up... try count 12 
Waiting for mysql to start up... try count 13 
Waiting for mysql to start up... try count 14 
Waiting for mysql to start up... try count 15 
Waiting for mysql to start up... try count 16 
Waiting for mysql to start up... try count 17 
Waiting for mysql to start up... try count 18 
Waiting for mysql to start up... try count 19 
Waiting for mysql to start up... try count 20 
Waiting for mysql to start up... try count 21 
Waiting for mysql to start up... try count 22 
Waiting for mysql to start up... try count 23 
Waiting for mysql to start up... try count 24 
Waiting for mysql to start up... try count 25 
Waiting for mysql to start up... try count 26 
Waiting for mysql to start up... try count 27 
Waiting for mysql to start up... try count 28 
Waiting for mysql to start up... try count 29 
Waiting for mysql to start up... try count 30 
Waiting for mysql to start up... try count 31 
Waiting for mysql to start up... try count 32 
Waiting for mysql to start up... try count 33 
Waiting for mysql to start up... try count 34 
Waiting for mysql to start up... try count 35 
Waiting for mysql to start up... try count 36 
Waiting for mysql to start up... try count 37 
Waiting for mysql to start up... try count 38 
Waiting for mysql to start up... try count 39 
Waiting for mysql to start up... try count 40 
Waiting for mysql to start up... try count 41 
Waiting for mysql to start up... try count 42 
Waiting for mysql to start up... try count 43 
Waiting for mysql to start up... try count 44 
Waiting for mysql to start up... try count 45 
Waiting for mysql to start up... try count 46 
Waiting for mysql to start up... try count 47 
Waiting for mysql to start up... try count 48 
Waiting for mysql to start up... try count 49 
Waiting for mysql to start up... try count 50 
Final attempt to reach mysql... 
**^G Error during mysqladmin --defaults-file=/opt/Spectrum/mysql/my-spectrum.cnf --login-path=myclient ping

Environment

Release : 22.2

Resolution


In this instance, the upgrade to MySQL 8 succeeded, however, a subsequent shutdown did not fully finish before restarting
   and the rest of the configuration did not occur.

- stop processd (as root)
    systemctl stop processd

- ps -ef showed that ./bin/mysqld was still running

    ps -ef |grep -i mysqld

- kill -9 <PID of mysqld>

- start processd (as root)
    systemctl start processd

- Check processd status
     systemctl status processd

This showed all processes as running.


- Check Authentication to MySql
      cd $SPECROOT/mysql/bin/
      ./mysql --defaults-file=../my-spectrum.cnf -uroot -p<pass>

      mysql: [Warning] Using a password on the command line interface can be insecure.
      ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)


In this instance, since the pre-upgrade version was prior to 21.2.4 the password was not updated from root to <pass>

     <Changed Password to <pass>> - see Steps in Additional Information


- shutdown processd

- re-ran the Spectrum 22.2.3 installer which now completes successfully

Additional Information


Change MySQL root passwords

https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/spectrum/22-2/administrating/database-management/configure-mysql-root-password.html


mylogin.cnf

export MYSQL_TEST_LOGIN_FILE=$SPECROOT/mysql/data/mylogin.cnf
./mysql_config_editor set --login-path=myclient --host=localhost --user=root --password

<pass>

 

myspectrumlogin.cnf

export MYSQL_TEST_LOGIN_FILE=$SPECROOT/mysql/data/myspectrumlogin.cnf
./mysql_config_editor set --login-path=myclient --host=localhost --user=root --password

<pass>

 

Change MySql Root password in MySQL

cd $SPECROOT/mysql/bin
./mysql --defaults-file=../my-spectrum.cnf -uroot -proot


The password has now been changed