Anonymize Personally Identifiable Information (PII) Job extemely slow when run for all resources with PostgreSQL as Database

Products

• Clarity PPM SaaS

Issue/Introduction

Anonymize Personally Identifiable Information (PII) Job extremely slow when run for all resources PostgreSQL as Database

 

STEPS TO REPRODUCE: 

1. Login to Clarity with more than 25k active resources  

2. Pre requisite to select WARNING! Anonymize ALL Resources parameter in the job and run the Personally Identifiable Information (PII) Job 

 Note: The WARNING! Anonymize ALL Resources parameter will anonymize all the resources, irrespective of their status or anonymization flag. This option is set to read-only by default in the job to avoid accidental selection. If you have a use case to anonymize all  resources, remove the read-only flag from the job parameters list. Ensure that you use this parameter with extreme caution as you cannot revert once the resource data is anonymized. 

Expected Results: The job should complete in reasonable time 

Actual Results: The job takes more than 10 hours and then fails as ETL Job limit is set to 600 minutes in CSA 

 

 

Environment

Release : 15.9

Component : CA PPM SAAS DATA WAREHOUSE

Cause

This is a defect (DE59364) currently in review with our engineering team

Resolution

Workaround: Run for sub set of resource at once