CA TDM Fast Data Masker is not able to execute the masking the script with PostgreSQL DB.

Products

• CA Test Data Manager (Data Finder / Grid Tools)

Issue/Introduction

I have checked externally by connecting to DB and it is working(Access is fine).
However when it comes FDM execution, it is throwing below error -
 (Note – Hence I wanted to check with GT Data Maker query on DB, But First priority is to resolve the current issue)
Attaching complete log –
 
>2020-12-10 12:20:23.403 Fastdatamasker version: 4.9.44.0
>2020-12-10 12:20:23.403 Fastdatamasker build date - July 23 2020
>2020-12-10 12:20:23.418 PID:972@YYZAPP1084
>2020-12-10 12:20:23.418 Java version 1.8.0_251
>2020-12-10 12:20:23.418 OPERATING SYSTEM USER: <USER>
>2020-12-10 12:20:23.450 Attempting to configure cloakware with cspm_client_config_xml:C:\cspm\cloakware\cspmclient\config\cspm_client_config.xml and java_library_path:C:\cspm\cloakware\cspmclient\lib;c:\cspm\cloakware\cspmclient\jre\bin;.\SQLSERVER_DLLs\x64
>2020-12-10 12:20:23.450 Cloakware configuration initialized.
>2020-12-10 12:20:25.872 Can't send telemetry message to TDM portal at URL https://<IPADDRESS>:8443/TDMEventService/api/ca/v1/events
>To disable future connection attempts set environment variable TDM_PORTAL_URL to N.
>
>2020-12-10 12:20:27.918 Failed to post event, send will be retried later.
>com.ca.tdm.eventserviceclient.exception.EventPostException: Error occurred while sending event
>2020-12-10 12:20:27.934 attempting to connect
>2020-12-10 12:20:27.934 Using URL:jdbc:postgresql://<IPADDRESS>:5432/planalyticsdm?user=data_mask_dml&password=****
>2020-12-10 12:20:28.231 Connected to jdbc:postgresql://<IPADDRESS>:5432/planalyticsdm?user=data_mask_dml&password=***** username:<USER>
>2020-12-10 12:20:28.231 Driver Major Version:9
>              at com.ca.tdm.eventserviceclient.EventServiceClient.postEventEx(EventServiceClient.java:109)
>              at com.ca.tdm.eventserviceclient.EventServiceClient.postEvent(EventServiceClient.java:70)
>2020-12-10 12:20:28.231 Driver Minor Version:4
>              at com.ca.catdm.event.EventClient.postJobTriggeredEvent(EventClient.java:35)
>2020-12-10 12:20:28.278 OPTIONS
>              at com.grid_tools.products.datamasker.profilegenerator.MainProfileGenerator.generateMainProfile(MainProfileGenerator.java:216)
>2020-12-10 12:20:28.278 *************************
>2020-12-10 12:20:28.278 RESTART=Y
>2020-12-10 12:20:28.278 *************************
>              at com.grid_tools.products.datamasker.Datamasker.main(Datamasker.java:1971)
>2020-12-10 12:20:28.293 Validating table names, column names and data types for mapping file...
>Caused by: org.apache.http.conn.HttpHostConnectException: Connect to <IPADDRESS>:8443 [<IPADDRESS>/<IPADDRESS>, <IPADDRESS>/0:0:0:0:0:0:0:1] failed: Connection refused: connect
>2020-12-10 12:20:28.293 starting validate:2020.12.10 12:20:28.293 EST
>              at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
>2020-12-10 12:20:28.293 Validating mapping row 1 of 12
>              at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:373)
>              at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:394)
>2020-12-10 12:20:28.325 get Table Indexes:ERROR: column am.amcanorder does not exist
>              at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
>              at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
>  Position: 427
>              at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
>2020-12-10 12:20:28.340 Validating mapping row 2 of 12
>              at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
>              at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
>              at com.ca.tdm.eventserviceclient.EventServiceClient.postEventEx(EventServiceClient.java:97)
>2020-12-10 12:20:28.340 Validating mapping row 3 of 12
>              ... 4 more
>2020-12-10 12:20:28.340 Validating mapping row 4 of 12
>Caused by: java.net.ConnectException: Connection refused: connect
>2020-12-10 12:20:28.340 Validating mapping row 5 of 12
>              at java.net.DualStackPlainSocketImpl.connect0(Native Method)
>2020-12-10 12:20:28.340 Validating mapping row 6 of 12
>              at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
>2020-12-10 12:20:28.340 Validating mapping row 7 of 12
>2020-12-10 12:20:28.340 Validating mapping row 8 of 12
>2020-12-10 12:20:28.340 Validating mapping row 9 of 12
>2020-12-10 12:20:28.340 Validating mapping row 10 of 12
>2020-12-10 12:20:28.340 Validating mapping row 11 of 12
>              at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
>              at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
>2020-12-10 12:20:28.340 Validating mapping row 12 of 12
>2020-12-10 12:20:28.340 end validate:2020.12.10 12:20:28.340 EST
>2020-12-10 12:20:28.356 starting masking at 2020.12.10 12:20:28.356 EST
>2020-12-10 12:20:28.356 Using commit frequency of: 1000
>              at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
>              at java.net.PlainSocketImpl.connect(Unknown Source)
>              at java.net.SocksSocketImpl.connect(Unknown Source)
>2020-12-10 12:20:28.356 Error returned from Database:ERROR: current transaction is aborted, commands ignored until end of transaction block
>              at java.net.Socket.connect(Unknown Source)
>2020-12-10 12:20:28.356 SQL State:25P02
>              at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
>              at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
>              ... 12 more
>2020-12-10 12:20:28.356 SQL For Test: select count(*) from "t_dm_planalyticsdm"."customer_dim"
> 
>2020-12-10 12:20:28.356 exit value = 1

Environment

TDM Portal 4.9
FDM 4.9

Component : CA Test Data Manager

Cause

The database had a limit on the number of connections for the masking role

Resolution

The database was returning a message:To many connections from role "XXXX"

You will need to contact your PostgreSql DBA to have them help you resolve this issue.

Additional Information

Follow below steps and validate
1) Test using telnet from the FDM machine to the PostgreSql DB and make sure there are no issues.
2) Verify the hostname and IP address resolved correctly on FDM server.
3) Verify the schema name on database.
4) Verify using FDM we could see we are getting connection refused.
6) Go to FDM logs located at <Appdata>\Grid-Tools\FastDataMasker\errorlogs
7) Noticed that database was returning a message:To many connections from role "XXXX"