/opt/IMDataAggregator/app/dto error directory on the Data Aggregator filling up in Dx NetOps Performance Management

Products

• CA Infrastructure Management
• CA Performance Management

Issue/Introduction

The Data Collectors are showing inconsistent results in Dx NetOps Performance Center. Upon investigation, found the files in /opt/IMDataAggregator/app/dto_error are filling up the /opt/IMDataAggregator directory and found one of the directories used for exporting data to be full -

/dev/mapper/sda 49G 49G 0 100% /opt/IMDataAggregator

New files are created around every 10 mins. For example, the content of the files in the dto_error directory looks like:

[root@hostname:1 /opt/IMDataAggregator/app/dto_error] # more virtual_memstats_rate_300000_2018-11-01_16-56-29.621.perf.dto
#{http://im.ca.com/normalizer}NormalizedVirtualMemoryInfo,680775,300000,virtual_memstats_rate
#dcm_id, pollgroup_id, item_id, rollup_type, tstamp, dto_sequence_id, rinterval, duration, thresh_duration, thresh_count, im_Free, im_Total, im_Used, im_Utilization, std_im_Utilization, im_MemoryVirtualActive 4781,2043,5695515,0,1541091300,680775,300,300,0,0,1787305984,2113822720,326516736,15.446741721084347,0.0,null 4781,2043,5683241,0,1541091300,680775,300,300,0,0,1729441792,2097143808,367702016,17.533466927605186,0.0,null 4781,2043,5707220,0,1541091300,680775,300,300,0,0,1180868608,2113822720,932954112,44.135873040479005,0.0,null 4781,2043,5656678,0,1541091300,680775,300,300,0,0,1500127232,2097143808,597016576,28.468079953437318,0.0,null 4781,2043,5687168,0,1541091300,680775,300,300,0,0,1393274880,2113822720,720547840,34.08742999980623,0.0,null 4781,2043,5603042,0,1541091300,680775,300,300,0,0,1225293824,2113822720,888528896,42.03422016393125,0.0,null 4781,2043,5590781,0,1541091300,680775,300,300,0,0,10641211392,13199003648,2557792256,19.37867678661922,0.0,null 4781,2043,5710730,0,1541091300,680775,300,300,0,0,1506095104,2097143808,591048704,28.183508529330194,0.0,null

What are these files are and what they are used for?

Environment

All supported releases

Cause

When Dx NetOps Performance Management copies data into Vertica and it fails due to some issues with the DR, it will move the dto files to ../dto_error 

Resolution

You can delete anything in the dto_error directory, as Dx NetOps Performance Management failed to load it and will never try to reload it.