TDM becoming slow and services going down when data model rescan is performed

Products

• CA Test Data Manager (Data Finder / Grid Tools)

Issue/Introduction

When the data model rescan is performed from TDM web for a project, Portal will become super slow and the data model of none of the projects will loaded until tdm services are restarted.

No of Tables: 1000 Plus
Number of Schema’s in the project: 60+

TDM Web version : Version: 4.9.404.0
Database: SQL
Scope : TDM Web Portal (Masking)

Logs: Attached above

Observation in repository database :
Sessions are blocking each other.

203   --     <?query --

update gtrep_attr_mask_function set entity_id=@P0, attr_id=@P1 where project_version_id=@P2 and attr_id=@P3

--?>

Environment

Release : 4.9.1

Component : TDM Web Portal

Cause

From the provided log

o-8443-exec-76] Timeout: Pool empty. Unable to fetch a connection in 30 seconds, none available[size:20; busy:20; idle:0; lastwait:30000].

 

 

Resolution

The client had to increase the connection pool size to the database.

When the portal is heavily used the connection pool gets used up and any new connection requests above 20 will be ignored.
To fix their problem they should increase the maximum number of connections to 100 in the application.properties

spring.datasource.tomcat.max-active=100