Identity Governance is not starting - Error: Failed to start bean 'quartzScheduler'
Article ID: 386946
Updated On:
Products
Issue/Introduction
Identity Governance is not starting. Fails with the below error message in the eurekify.log:
15:08:52,676 ERROR [org.springframework.web.context.ContextLoader] (ServerService Thread Pool -- 128) Context initialization failed: org.springframework.context.ApplicationContextException: Failed to start bean 'quartzScheduler'; nested exception is org.springframework.scheduling.SchedulingException: Could not start Quartz Scheduler; nested exception is org.quartz.SchedulerConfigException: Failure occured during job recovery. [See nested exception: org.quartz.JobPersistenceException: Couldn't recover jobs: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module "deployment.eurekify.war" from Service Module Loader] [See nested exception: org.quartz.JobPersistenceException: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module "deployment.eurekify.war" from Service Module Loader] [See nested exception: java.lang.ClassNotFoundException: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module "deployment.eurekify.war" from Service Module Loader]]]]
at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:169) [spring-context-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.context.support.DefaultLifecycleProcessor.access$1(DefaultLifecycleProcessor.java:154) [spring-context-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:335) [spring-context-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:143) [spring-context-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:108) [spring-context-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:908) [spring-context-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:428) [spring-context-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.web.context.ContextLoader.createWebApplicationContext(ContextLoader.java:282) [spring-web-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:204) [spring-web-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:47) [spring-web-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at com.eurekify.spring.SpringContextLoaderListener.contextInitialized(SpringContextLoaderListener.java:18) [classes:]
at io.undertow.servlet.core.ApplicationListeners.contextInitialized(ApplicationListeners.java:187) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final]
at io.undertow.servlet.core.DeploymentManagerImpl$1.call(DeploymentManagerImpl.java:216) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final]
at io.undertow.servlet.core.DeploymentManagerImpl$1.call(DeploymentManagerImpl.java:185) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final]
at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:42) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final]
at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final]
at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.lambda$create$0(SecurityContextThreadSetupAction.java:105)
at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502)
at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502)
at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502)
at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502)
at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502)
at io.undertow.servlet.core.DeploymentManagerImpl.deploy(DeploymentManagerImpl.java:250) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final]
at org.wildfly.extension.undertow.deployment.UndertowDeploymentService.startContext(UndertowDeploymentService.java:96)
at org.wildfly.extension.undertow.deployment.UndertowDeploymentService$1.run(UndertowDeploymentService.java:78)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_381]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_381]
at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378)
at java.lang.Thread.run(Thread.java:750) [rt.jar:1.8.0_381]
at org.jboss.threads.JBossThread.run(JBossThread.java:485)
Caused by: org.springframework.scheduling.SchedulingException: Could not start Quartz Scheduler; nested exception is org.quartz.SchedulerConfigException: Failure occured during job recovery. [See nested exception: org.quartz.JobPersistenceException: Couldn't recover jobs: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module "deployment.eurekify.war" from Service Module Loader] [See nested exception: org.quartz.JobPersistenceException: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module "deployment.eurekify.war" from Service Module Loader] [See nested exception: java.lang.ClassNotFoundException: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module "deployment.eurekify.war" from Service Module Loader]]]]
at org.springframework.scheduling.quartz.SchedulerFactoryBean.start(SchedulerFactoryBean.java:717) [spring-context-support-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:166) [spring-context-3.0.6.RELEASE.jar:3.0.6.RELEASE]
... 32 more
Caused by: org.quartz.SchedulerConfigException: Failure occured during job recovery. [See nested exception: org.quartz.JobPersistenceException: Couldn't recover jobs: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module "deployment.eurekify.war" from Service Module Loader] [See nested exception: org.quartz.JobPersistenceException: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module "deployment.eurekify.war" from Service Module Loader] [See nested exception: java.lang.ClassNotFoundException: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module "deployment.eurekify.war" from Service Module Loader]]]]
at org.quartz.impl.jdbcjobstore.JobStoreSupport.schedulerStarted(JobStoreSupport.java:512) [quartz-1.5.2.jar:1.5.2]
at org.quartz.core.QuartzScheduler.start(QuartzScheduler.java:396) [quartz-1.5.2.jar:1.5.2]
at org.quartz.impl.StdScheduler.start(StdScheduler.java:147) [quartz-1.5.2.jar:1.5.2]
at org.springframework.scheduling.quartz.SchedulerFactoryBean.startScheduler(SchedulerFactoryBean.java:651) [spring-context-support-3.0.6.RELEASE.jar:3.0.6.RELEASE]
at org.springframework.scheduling.quartz.SchedulerFactoryBean.start(SchedulerFactoryBean.java:714) [spring-context-support-3.0.6.RELEASE.jar:3.0.6.RELEASE]
... 33 more
15:08:52,695 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("deploy") failed - address: ([("deployment" => "eurekify.war")]) - failure description: {"WFLYCTL0080: Failed services" => {"jboss.deployment.unit.\"eurekify.war\".undertow-deployment" => "java.lang.RuntimeException: org.springframework.context.ApplicationContextException: Failed to start bean 'quartzScheduler'; nested exception is org.springframework.scheduling.SchedulingException: Could not start Quartz Scheduler; nested exception is org.quartz.SchedulerConfigException: Failure occured during job recovery. [See nested exception: org.quartz.JobPersistenceException: Couldn't recover jobs: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: org.quartz.JobPersistenceException: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: java.lang.ClassNotFoundException: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader]]]]
Caused by: java.lang.RuntimeException: org.springframework.context.ApplicationContextException: Failed to start bean 'quartzScheduler'; nested exception is org.springframework.scheduling.SchedulingException: Could not start Quartz Scheduler; nested exception is org.quartz.SchedulerConfigException: Failure occured during job recovery. [See nested exception: org.quartz.JobPersistenceException: Couldn't recover jobs: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: org.quartz.JobPersistenceException: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: java.lang.ClassNotFoundException: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader]]]]
Caused by: org.springframework.context.ApplicationContextException: Failed to start bean 'quartzScheduler'; nested exception is org.springframework.scheduling.SchedulingException: Could not start Quartz Scheduler; nested exception is org.quartz.SchedulerConfigException: Failure occured during job recovery. [See nested exception: org.quartz.JobPersistenceException: Couldn't recover jobs: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: org.quartz.JobPersistenceException: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: java.lang.ClassNotFoundException: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader]]]]
Caused by: org.springframework.scheduling.SchedulingException: Could not start Quartz Scheduler; nested exception is org.quartz.SchedulerConfigException: Failure occured during job recovery. [See nested exception: org.quartz.JobPersistenceException: Couldn't recover jobs: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: org.quartz.JobPersistenceException: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: java.lang.ClassNotFoundException: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader]]]]
Caused by: org.quartz.SchedulerConfigException: Failure occured during job recovery. [See nested exception: org.quartz.JobPersistenceException: Couldn't recover jobs: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: org.quartz.JobPersistenceException: Couldn't store trigger: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader] [See nested exception: java.lang.ClassNotFoundException: com.eurekify.schedule.jobs.DeltaCertificationForContinuousUpdateJob from [Module \"deployment.eurekify.war\" from Service Module Loader]]]]"}}
Environment
IGA 14.4
Cause
QRTZ tables are likely corrupted and this prevents the IG startup sequence.
Resolution
We need to drop and recreate the QRTZ tables. Please follow the below steps to recreate the tables:
Note: It is recommended to engage the database engineer to perform the below steps on the database.
1. Take a full back of the IG (Identity Governance) databases listed below. Please use the correct DB names as per your environment
- Eurekify SDB
- Eurekify TicketDB
- Eurekify WPDS
- Eurekify ReportDB
Note: We must trust the backup of the client's database because if this solution does not work, backups are the only way to return to the previous state.
2. Locate the SQL script inside the IG installation media.
The exact location of the script is
For MS SQL: <location of the IG core installation media>\Utils&Conf\SQL Scripts\mssql\SDB
For Oracle: <location of the IG core installation media>\Utils&Conf\SQL Scripts\oracle\SDB
File name: QRTZ_BUILD_TABLES.sql
3. The database engineer will execute the aforementioned SQL script which will drop and recreate QRTZ tables in the Eurekify database.
4. Verify if the tables are recreated.
5. Start the IG and verify if the services are now starting.
Feedback
