Definition file not created correctly for excel spread sheet using FDM

Products

• CA Test Data Manager (Data Finder / Grid Tools)

Issue/Introduction

 

When creating a file definition using FDM for an excel spreadsheet the definition file is leaving off the last two columns.
Need to understand why.
Aso on some excel file we can not get the header file window to display at all.
Example File
70 Columns
40K rows
approximate size 10MB

 

Cause

 

FDM is failing without errors due to running out of memory.

Environment

 

FDM 4.9.x
Fast Data Masker

Component : CA Test Data Manager

Resolution

 

Sorry you can not use such a large file with FDM as it is running out of memory

Exception in thread "D3D Screen Updater" java.lang.OutOfMemoryError: Java heap space
Exception in thread "AWT-EventQueue-0" java.lang.OutOfMemoryError: Java heap space

The perceived hanging was caused by the out of memory problem.

The client should increase the heapsize and reduce the file size until you hit the sweet spot

This will be a trial and error process as there is not currently a way to test the file ahead of time.

Additional Information

 

Workaround:

- create a small xlsx file to generate the definition file with the hearer row and one data row.

- then update the connection file to use the big file

- batch file can then be updated with a large heapsize to allow the masking to complete.