Unable to add Data Aggregator to NetOps Portal

Products

• Network Observability
• CA Performance Management

Issue/Introduction

I'm working in a lab environment to test and train and I have this situation:

- 3 boxes with DA, DC, and DR working ok at version 23.3.6 (fresh install)

- 1 box with netops portal 23.3.6 fully working and integrated with spectrum and NFA (recently upgraded to 23.3.6)

When I try to add Data Aggregator as a data source I get this message:

Data Source Test Failed

Communication with the data source failed.

Unable to open the Data Aggregator REST Web Services page either.

http://<DA>:8581/rest

curl -v -s -u admin http://<DA>:8581/rest

No service was found

Environment

DX NetOps Performance Management 23.3.6

Cause

After the DR/Vertica was successfully installed, reduced the RAM from 24 GB to 8 GB.

We have a set minimum reserved memory % for various resource pools. 

Vertica sums up reserved memory %'s and if < 25% of memory is left for the general pool, will not allow the resource pool alteration during startup.

Defaults:

etl_processing                 | 10%
rib_processing                 | 10%
sysquery                       | 1G
irep_processing                | 2%
aggregateditems_processing     | 2%
scheduled_short_rib_processing | 3%
tm                             | 3G
threshold_processing           | 4%
dataload_processing            | 5%
scheduled_long_rib_processing  | 5%
odata_processing               | 5%
workload_processing            | 5%
====================================
                                 54% + 4G of memory reserved.

So depending on memory on box, we reserve 4G + 54% for resource pools, and general uses up to only 95%, so take 5% off more, so 59% + 4GB taken by non-general pools.

 

In the /opt/IMDataAggregator/apache-karaf-4.4.3/data/log/karaf.log file:

ERROR | ExtenderThread-1 | 2024-02-15T14:50:07,376 | ExceptionLog | .ca.im.core.util.ExceptionLogger   99 | m.ca.im.common.core.util |       | A NEW application exception occurred (Key=56d0550d608b8427660817465a79fab5793f048c) : Resource Pool: irep_processing - Exception while creating/updating Resource Pool. : StatementCallback; SQL [CREATE RESOURCE POOL irep_processing PRIORITY 0 RUNTIMEPRIORITY MEDIUM RUNTIMEPRIORITYTHRESHOLD 2 MEMORYSIZE '2%' MAXMEMORYSIZE NONE CPUAFFINITYSET NONE CPUAFFINITYMODE ANY PLANNEDCONCURRENCY AUTO MAXCONCURRENCY NONE QUEUETIMEOUT '0 00:05:00.000000' RUNTIMECAP NONE CASCADE TO DEFAULT]; [Vertica][VJDBC](9611) ROLLBACK: Increase in pool size to 2% [100696 KB] causes general pool to fall below minimum [25% = 1258702 KB] ; nested exception is java.sql.SQLDataException: [Vertica][VJDBC](9611) ROLLBACK: Increase in pool size to 2% [100696 KB] causes general pool to fall below minimum [25% = 1258702 KB] 
org.springframework.dao.DataIntegrityViolationException: StatementCallback; SQL [CREATE RESOURCE POOL irep_processing PRIORITY 0 RUNTIMEPRIORITY MEDIUM RUNTIMEPRIORITYTHRESHOLD 2 MEMORYSIZE '2%' MAXMEMORYSIZE NONE CPUAFFINITYSET NONE CPUAFFINITYMODE ANY PLANNEDCONCURRENCY AUTO MAXCONCURRENCY NONE QUEUETIMEOUT '0 00:05:00.000000' RUNTIMECAP NONE CASCADE TO DEFAULT]; [Vertica][VJDBC](9611) ROLLBACK: Increase in pool size to 2% [100696 KB] causes general pool to fall below minimum [25% = 1258702 KB] ; nested exception is java.sql.SQLDataException: [Vertica][VJDBC](9611) ROLLBACK: Increase in pool size to 2% [100696 KB] causes general pool to fall below minimum [25% = 1258702 KB] 

In the /opt/CA/PerformanceCenter/PC/PCservice.log file:

INFO  | qtp826981074-209         | 2024-02-14 17:36:35,675 | com.ca.im.portal.api.services.datasource.DataSourcePoll          
    | Test DataSource: Data Aggregator@<DA_IP>
ERROR | qtp826981074-209         | 2024-02-14 17:36:35,703 | com.ca.im.portal.api.services.datasource.DataSourcePoll          
    | Received WebServiceException from version check for data source Data Aggregator@<DA_IP>.  CAUSE=org.apache.cxf.transport.http.HTTPException: HTTP response '404: Not Found' when communicating with http://<CA_IP>:8581/DataSourceWS. MESSAGE=Could not send Message..  Returning DS_COMM_FAILURE result.
ERROR | qtp826981074-209         | 2024-02-14 17:36:35,703 | com.ca.im.portal.api.services.datasource.DataSourcePoll          
      | javax.xml.ws.WebServiceException: Could not send Message.

Resolution

After increasing RAM back to 24GB on DR, the problem was resolved.