BG going down frequently, restarting or stuck (threads issue)

Products

• Clarity PPM On Premise
• Clarity PPM SaaS

Issue/Introduction

Jobs are getting stuck frequently and when you cancel and reinitiate them the BG is stuck. You have to restart the BG again to process the jobs or the BG restarts by itself .

You notice evidence of BG running out of usable threads in the logs, such as Thread full message

Environment

Release : Any

Cause

Some of the possible causes include:

1. INFO logging on one or more classes that result in high number of messages being logged into the bg-ca.log
2. BPM_ERRORS table having high number of records
3. Increased load on BG 

Resolution

1. Remove any INFO logging that is no longer needed and keep it to mininum, especially the Process Engine Persistence logging
2. Clean up BPM_ERRORS tables as described here
3. Make sure you have enough memory assigned to BG service in JVM memory in properties.xml, and that your OS allows to bump this if required.