Tried to maska data with 4 billions of records, First tried with 16GB heap memery then it stuck, increased to 32GB and again same issue. Please find log below:
13:44:37.148 [ValidationWorker-1770299076766] INFO INFO - Trying to get master key for [11223344556677889900AABBCCDDEEFF] Function [HASHCARD1FPE1] Parameter [parm5]...
13:44:37.155 [main] INFO INFO - End validate:2026.02.05 13:44:37.155 GMT
13:44:37.156 [main] INFO INFO - Masking started
13:44:37.156 [main] INFO INFO - Using commit frequency of: 10000
13:44:37.158 [main] INFO INFO - checking Pre Process results for table Name: DETAIL
13:44:37.158 [pool-3-thread-1] INFO INFO - processing table: DETAIL
13:44:37.165 [main] INFO INFO - results for table: DETAIL completed in : 0 seconds
13:44:37.191 [main] INFO INFO - Masking will be as follows
13:44:37.191 [main] INFO INFO - ***************************
13:44:37.193 [main] INFO INFO - ******************************
13:44:37.194 [main] INFO INFO - After executor initialization
13:44:37.208 [pool-4-thread-1] INFO INFO - Starting method:batchPreparedMasking
13:44:37.212 [pool-4-thread-1] INFO INFO - DETAIL started masking
13:44:37.213 [pool-4-thread-1] INFO INFO - canCommit = true
13:44:37.214 [pool-4-thread-1] INFO INFO - Fetchsize = 1000
13:44:37.214 [pool-4-thread-1] INFO INFO - Autocommit = false
13:44:37.233 [pool-4-thread-1] INFO INFO - DETAIL executed select query
java.lang.OutOfMemoryError: Java heap space
Dumping heap to java_pid24520.hprof ...
Heap dump file created [33659502901 bytes in 255.586 secs]
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "event-retry"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Log4j2-TF-7-Scheduled-3"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-4-thread-1"
TDM 4.11.x
Identified as product defect.
Apply below FDM patch build:
https://ftp.broadcom.com/user/downloads/pub/TDM/FDM/FastDataMasker-4.11.2017.0.zip
Steps to apply:
https://knowledge.broadcom.com/external/article?articleId=10931