Error during Data Model Scan

Products

• CA Test Data Manager (Data Finder / Grid Tools)

Issue/Introduction

While running data model scan on complete database we got error on TDM portal as:

TDMModelServiceLog:

2022-08-02 08:26:10.154 UTC [ERROR] [ModellingEngine-DATADISCOVERY-jobId-536] --- [U:][M:][P:]                      o.h.e.j.s.SqlExceptionHelper:  Arithmetic overflow error converting bigint to data type numeric.
2022-08-02 08:26:10.175 UTC [ERROR] [ModellingEngine-DATADISCOVERY-jobId-536] --- [U:][M:][P:]                             c.c.t.e.LocoException:  postProcess:  post processing failed with an exception: exception raised: post processing failed with an exception: Exception raised: InvalidDataAccessResourceUsageException: could not execute statement; SQL [n/a]; nested exception is org.hibernate.exception.SQLGrammarException: could not execute statement
2022-08-02 08:26:10.184 UTC [ERROR] [ModellingEngine-DATADISCOVERY-jobId-536] --- [U:][M:][P:]                             c.c.t.e.LocoException:  stack dump:
com.microsoft.sqlserver.jdbc.SQLServerException: Arithmetic overflow error converting bigint to data type numeric.
 at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:265)
 at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1662)

Details below:

We have requirement to scan the ORACLE DB and identify the tables & columns which are sensitive. So what we did is :

1. We got Select ANY access of the database to our user which we are using for DB scanning.

2. We created a new project , configured ENV and in data model scan option where we can select Scan all , include/ exclude tables/schema, we excluded one schema which is very big and we planned to scan that separately.

3. Now when the scan ran, it showed around 22K tables discovered. However after some time it failed with the error mentioned above. I have collected the logs in debug mode however as the logs are too much I wan to know what logs you need for this investigation , so that I can share those only.

Screenshot of the error below for reference

Environment

Release : 4.10.x

Component : TDM Portal

Cause

Product defect

Resolution

Upgrade the TDM portal to version 4.10.68.

- https://ftp.broadcom.com/user/downloads/priv/cbtmaint/zahab01/TDM/TDMPortal/TDMWeb-4.10.68.0.zip

Steps to apply: Portal section in below article:

- https://knowledge.broadcom.com/external/article?articleId=10931