Need To Register File and generate data for delimiter file of uneven length

Products

• CA Test Data Manager (Data Finder / Grid Tools)

Issue/Introduction

We need to register a file and generate data for delimited file of uneven length.

Please find below length and sample file attached:

AAA -> 49
BBB-> 149
CCC-> 30

Example data:

HDR|~|  |~|MYPPM|~|154309|~|MY|~|14012019|~|instrument|~|ppm_instrument_my_eod_1_14012019_014652.txt|~|14012019|~|010620|~|15012019
AAA|~|201604121414704|~|S19041601414704|~||~|730007058|~|MYY|~|10.000000|~||~||~|10.000000|~||~||~||~|12042016|~|12042016|~|19042016 17:50:47|~|19042016 17:50:47|~|apl_U_ac1010292131|~|apl_U_ac1001239058|~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~|N
BBB|~|C|~|11604124776798|~|201604121414704|~|C201901100000001|~||~|730007058|~|1730007058|~|1730007058|~||~|C02|~|MYY|~|11604124776798|~|DDB|~|DDI|~|MYY|~|MY|~||~|DDI|~|DDI-GCG|~|12042016|~|10.000000|~||~|CITI|~|531290000011|~|CITI|~|123456789|~||~||~||~|P|~|10.000000|~|DDI-GCG|~||~||~||~|1|~||~||~||~||~|Y|~||~|17424B670AB24C6DB70968A764BF8012|~||~|MY|~||~|11604124776798|~||~|14012019|~|12042016|~|12042016|~|12042016|~||~||~|12042016|~||~||~||~||~||~||~||~|12042016|~|12042016|~|12042016|~|12042016|~||~||~||~|19042016 17:50:47|~|19042016 17:50:47|~||~||~||~|Test|~||~|ref1|~|ref2|~|ref3|~||~||~||~||~||~||~||~||~||~||~|apl_U_ac1010292131|~|apl_U_ac1001239058|~|MY1730007058|~||~||~||~|11604124776798|~|11604124776798|~||~||~|531290000011|~||~|MLGC|~||~||~||~||~|19042016 20:07:02|~||~||~||~||~||~||~||~||~||~||~||~||~||~||~|N|~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~|
CCC|~|140275350000067|~|C201901100000002|~|123456|~|21903283794305|~|123456|~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~||~|N
TRL|~|14012019|~|3

Environment

TDM Portal 4.9.X

Component : CA Test Data Manager

Resolution

To register a flat CSV file TDM expects the data to be well formatted and structured.
This means things such as
1) column header names in the first row.
2) the file must be a CSV, Comma Separated value text file.( the Piped value will not work)


the size or data does not have to be consistent for each field, IE each column 3 does not have to be 10 characters in length you can have one row with column 3 with 10 characters and another with 50.

We do not support completely unstructured random data nor the user of none comma separator values.


Example of Good file:
Column1,Column2,Column3,Column4,Column5,Column6,Column7,Column8,Column9,Column10,Column11,Column12,Column13,Column14,Column15,Column16,Column17,Column18,Column19,Column20,Column21,Column22,Column23,Column24,Column25,Column26,Column27,Column29,Column29,Column30,Column31,Column32,Column33,Column34,Column35,Column36,Column37,Column38,Column39,Column40,Column41,Column42,Column43,Column44,Column45,Column46,Column47,Column48,Column49,Column50,Column51,Column52,Column53,Column53,Column55,Column56,Column57,Column58,Column59,Column60,Column61,Column62,Column63,Column64,Column65,Column66,Column67,Column68,Column69,Column70,Column71,Column72,Column73,Column74,Column75,Column76,Column77,Column78,Column79,Column80,Column81,Column82,Column83,Column84,Column85,Column86,Column87,Column88,Column89,Column90,Column91,Column92,Column93,Column94,Column95,Column96,Column97,Column98,Column99,Column100,Column101,Column102,Column103,Column104,Column105,Column106,Column107,Column108,Column109,Column1110
HDR,~,  ,~,MYPPM,~,154309,~,MY,~,14012019,~,instrument,~,ppm_instrument_my_eod_1_14012019_014652.txt,~,14012019,~,010620,~,15012019
AAA,~,201604121414704,~,S19041601414704,~,,~,730007058,~,MYY,~,10.000000,~,,~,,~,10.000000,~,,~,,~,,~,12042016,~,12042016,~,19042016 17:50:47,~,19042016 17:50:47,~,apl_U_ac1010292131,~,apl_U_ac1001239058,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,N
BBB,~,C,~,11604124776798,~,201604121414704,~,C201901100000001,~,,~,730007058,~,1730007058,~,1730007058,~,,~,C02,~,MYY,~,11604124776798,~,DDB,~,DDI,~,MYY,~,MY,~,,~,DDI,~,DDI-GCG,~,12042016,~,10.000000,~,,~,CITI,~,531290000011,~,CITI,~,123456789,~,,~,,~,,~,P,~,10.000000,~,DDI-GCG,~,,~,,~,,~,1,~,,~,,~,,~,,~,Y,~,,~,17424B670AB24C6DB70968A764BF8012,~,,~,MY,~,,~,11604124776798,~,,~,14012019,~,12042016,~,12042016,~,12042016,~,,~,,~,12042016,~,,~,,~,,~,,~,,~,,~,,~,12042016,~,12042016,~,12042016,~,12042016,~,,~,,~,,~,19042016 17:50:47,~,19042016 17:50:47,~,,~,,~,,~,Test,~,,~,ref1,~,ref2,~,ref3,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,apl_U_ac1010292131,~,apl_U_ac1001239058,~,MY1730007058,~,,~,,~,,~,11604124776798,~,11604124776798,~,,~,,~,531290000011,~,,~,MLGC,~,,~,,~,,~,,~,19042016 20:07:02,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,N,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,
CCC,~,140275350000067,~,C201901100000002,~,123456,~,21903283794305,~,123456,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,,~,N
TRL,~,14012019,~,3