DWH Sync Performance is slow for large numbers of records

Products

• Clarity PPM SaaS
• Clarity PPM On Premise

Issue/Introduction

On a large dataset with integrations that update multiple million records, DWH Sync (Instantaneous Sync) does not perform as well as Load DWH job

STEPS TO REPRODUCE:

1. Have a system set up with DWH Sync where DWH Sync works well
2. Run Load DWH – Full and note the time it takes to complete
3. With an integration, insert a large quantity of records (such as 5M) in DWH_ODF_INST_CHANGES by updating the records and running CLARITY_DWH_SYNC_SP
4. Note the DWH Sync Performance to move all the records to DWH_ODF_INST_CHANGES_ARCHIVE

Expected Results: The DWH Sync performance to be comparable to DWH – Full

Actual Results: DWH Sync will take significantly longer to pick up and process the records over 1M

Environment

Clarity 16.3.3, 16.4.0

Cause

DE180715

Resolution

In review with Engineering

Workaround:

1. Uncheck Enable Instantaneous Sync from System Options
2. Run Load DWH – Full Load
3. Check Enable Instantaneous Sync back in, Save