Load DWH incremental fails with duplicate key after a previous incremental failure

Products

• Clarity PPM On Premise
• Clarity PPM SaaS

Issue/Introduction

The Load Data Warehouse (DWH) - Incremental has failed because of a field. After correcting the issue and running the incremental, it failed with duplicates. 

2021/02/01 08:54:27 - Error for table 'DWH_INV_TASK_PERIOD_FACTS' - Error Number 1505 'The CREATE UNIQUE INDEX statement terminated because a duplicate key was found for the object name 'ppm_dwh.DWH_INV_TASK_PERIOD_FACTS' and the index name 'DWH_INV_TASK_PER_FACTS_U1'. The duplicate key value is (7625096, 2007338).'

Environment

Release : Any

Component : CLARITY DATA WAREHOUSE

Resolution

Always run a Full Load after an Incremental Load has failed. This is a requirement due to the current Load Data Warehouse job design. If the Full Load hasn't run, an Incremental run after a failure may fail with duplicates.

See Load DWH Full - When to run to prevent failures

Additional Information

See also: Data Warehouse (DWH) known issues for Clarity