Data Model Scanning slowly progresses

Products

• CA Test Data Manager (Data Finder / Grid Tools)

Issue/Introduction

We are running TDM Portal 4.9.256.0. While running a Data Model scan on a vendor database, and noticed while running an advanced scan, the scan seems to progress very slowly. Even after letting it run for three days, it still has not completed. The basic scan on the exact same database completes within minutes. Could you help us understand why the advanced scan is taking so long?

Environment

Release : 4.9.1

Component : CA Test Data Manager

Resolution

After reviewing the TDMDataModel.log (in debug mode) with Engineering, Engineering confirmed that the Data Model scan is slowing down because TDM is running a comparison on tables of like names, and attempting to build logical relationships between those tables. This is something we normally do during an advanced scan. One way to speed this up is to have unique indexing and primary keys for your tables. However, since this is a vendor database, and you don't have control, there's not much you can do other than exclude tables that have a large amount of data.

The basic scan only scans the metadata in the database and does not look deeply at the data. Therefore, this scan completes much quicker than an advanced scan. If you do not require a deep analysis of the data, and logical relationships built between the tables, you should use the basic scan. 

Additional Information

For more information regarding Data Model scans, and looking for PII:

• PII Data Terminology - https://techdocs.broadcom.com/us/en/ca-enterprise-software/devops/test-data-management/4-9/create-a-data-model-and-audit-pii-data/pii-audit-using-ca-tdm-portal/pii-data-scan-terminology.html
• Scan Data Model for PII - https://techdocs.broadcom.com/us/en/ca-enterprise-software/devops/test-data-management/4-9/create-a-data-model-and-audit-pii-data/the-data-model-in-ca-tdm-portal/scan-data-model-for-pii.html
• End-to-End Scenario for PII Audit - https://techdocs.broadcom.com/us/en/ca-enterprise-software/devops/test-data-management/4-9/create-a-data-model-and-audit-pii-data/pii-audit-using-ca-tdm-portal/end-to-end-scenario-for-pii-audit.html
• End-to-End Scenario for Data Discovery - https://techdocs.broadcom.com/us/en/ca-enterprise-software/devops/test-data-management/4-9/create-a-data-model-and-audit-pii-data/the-data-model-in-ca-tdm-portal/end-to-end-scenario-for-data-discovery.html
•