DX AIOPs - Troubleshooting, Common Issues and Best Practices

book

Article ID: 190815

calendar_today

Updated On:

Products

DX Operational Intelligence DX Application Performance Management CA App Experience Analytics

Issue/Introduction

The following is a high-list of techniques and suggestions to employ when troubleshooting performance, display and configuration issues

A) Openshift / Kubernetes
B) DX Common Services  : Login, Postgres, Jarvis (Kafka, Zookeeper, ElasticSearch), ServiceNow, etc..
C) DX Operational Intelligence 1.3.x, 20.2
D) DX Application Performance Management 11.x, 20.2

Environment

DX Operational Intelligence 1.3.x, 20.2
DX Application Performance Management 11.x, 20.2

Resolution

A) Openshift / Kubernetes


DX OI/APM - Unable to open Openshift console
https://knowledge.broadcom.com/external/article/198091

DX OI/APM - Unable to login to OI console, all Openshift nodes appear in a NotReady status 
https://knowledge.broadcom.com/external/article/206000

DX OI/APM - many pods in Evicted status - how can I delete these unwanted pods?
https://knowledge.broadcom.com/external/article/206249

 

B) DX Common Services  (Login, Postgres, Jarvis, Elastic)

Login issues:

DX AIOps - Unable to login to OI console, error code 2011034
https://knowledge.broadcom.com/external/article/194529

DX AIOps - Unable to login to DX - postgres database corruption
https://knowledge.broadcom.com/external/article?articleId=184125

DX AIOPs - Unable to login to tenant or masteradmin console
https://knowledge.broadcom.com/external/article?articleId=185182

DX AIOPs - Unable to login to tenant  and mastertenant - jarvis-elasticsearch pods evicted
https://knowledge.broadcom.com/external/article?articleId=185156

Jarvis (kafka, zookeeper, elasticSearch):

DX AIOps - Jarvis (kafka, zookeeper, elasticSearch) Troubleshooting
 
DX AIOps - NFS or Elastic Nodes disk full - How to reduce Elastic data retention
 

Maintenance:

DX AIOps - How to gracefully restart AIOps servers
https://knowledge.broadcom.com/external/article/202717

DX AIOps - what unnecessary logs and files can I delete?
https://knowledge.broadcom.com/external/article/198040

ServiceNow integration

DX AIOps - ServiceNow Integration Troubleshooting
https://knowledge.broadcom.com/external/article/206791

DX AIOps - Nim Troubleshooting
https://knowledge.broadcom.com/external/article/206252

DX AIOps- How to manually recreate a tenant configuration in NIM UI?
https://knowledge.broadcom.com/external/article/206011

 

DX OI - ServiceNow Automatic incident creation/closure is not working
https://knowledge.broadcom.com/external/article/198666

DX OI - Alarms do not display the generated ServiceNow incidents
https://knowledge.broadcom.com/external/article/206248

DX OI - Many ServiceNow incidents and Service Alarms are being created
https://knowledge.broadcom.com/external/article/208782

DX OI - ServiceNow incidents are getting reopened many times.
https://knowledge.broadcom.com/external/article/189070

DX OI - ServiceNow incidents are created but OI console still shows the “Open ticket” option rather than the incident number
https://knowledge.broadcom.com/external/article/193262

DX OI - How to assign an event to a particular group in ServiceNow based on CI's like Process, Service or URL.
https://knowledge.broadcom.com/external/article/201071
 
DX OI - Is it possible to create a new custom Field in ServiceNow incident that includes the UIM process name?
https://knowledge.broadcom.com/external/article/199325

C) DX Operational Intelligence


Alarms:

DX OI - Predictive Insights stop working, the page is empty
https://knowledge.broadcom.com/external/article/206880
 
DX OI - New alarms don't appear in OI Console

DX OI - Is it possible to customize the Alarm monitoring details from OI console or a config file?
 
DX OI - (Enhancement) Be able to automate the way of assigning the events based on alarm type/Description/Sub description

Make a saved filter public (limitation)

 

DSP / Anomaly Alarms:

DX OI - How to configure DSP to process only CAPM metrics
https://knowledge.broadcom.com/external/article/200173

 

Service Analytics

Add a Service based on Custom ingested data
 

Predictive Insight:

Capacity forecast analytics show CPU consumption 6000% for next 6 month
 
Capacity Analytics error messages

 

Performance Analytics:

DX OI - Unable to see CAPM Inventory data from Performance Analytics
https://knowledge.broadcom.com/external/article/202699
 
OI green highways not displaying correctly for custom metrics

 

APM 10.7 Integration:

DX OI integration with APM 10.7 - Troubleshooting, Common Issues and Best Practices
DX OI - Alarms explosion caused by the APM integration - How to delete All or individual APM alarms?
https://knowledge.broadcom.com/external/article/204085
 
DX OI - "APM Alarms do not support the action" message, unable to clear or  hide any APM Alarm in OI UI
https://knowledge.broadcom.com/external/article/201612
 

CAPM/NetOps Integration:

DX OI - OIConnector not connecting when CAPC user and password changes
https://knowledge.broadcom.com/external/article/204144

 

UIM Integration:

 
DX OI integration with UIM - Troubleshooting, Common Issues and Best Practices
 
UIM alarms are not reflecting the colored status on the UIM device in the Service Topology view
 
The edit service or Update service(Synch for group/Inventory) are not supported.

 

Spectrum integration:

Spectrum topology not properly synced
mapping Spectrum alarms to services

 

REST API

DX OI - Using REST API to query/export OI data - an example
https://knowledge.broadcom.com/external/article/206461

 

Self Service Dashboards

DOI 1.3.2 - How to check the licenses in use?
https://knowledge.broadcom.com/external/article/207285

 

SOACorrelationEngine

DX APM - Troubleshooting Guidelines for doi-soacorrelationengine
https://knowledge.broadcom.com/external/article?articleId=143270

 

Limitation:
 
LDAP Integration with SSL on OI (limitation)

Unable to access self service dashboard (limitation)

 

D) DX Application Performance Management

Business Transactions

DX APM "No traces" available in the Map > Business Transaction
https://knowledge.broadcom.com/external/article?articleId=143002

 

Upgrade

DX APM - REST API to import and delete Management Module
https://knowledge.broadcom.com/external/article?articleId=145459

 

Command Center

DX APM - ACC not working, ng-acc-configserver pods in CrashLoop
https://knowledge.broadcom.com/external/article?articleId=144154

 

Tenant data migration

DX APM - Removing service data and fixing partitioning
https://knowledge.broadcom.com/external/article?articleId=144011

 

Additional Information

Installation 

https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/dx-platform-on-premise/20-2/installing/troubleshooting-the-installation.html

DX OI

https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/digital-operational-intelligence/20-2/troubleshooting-consolidated.html

DX APM

https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/application-performance-management/20-2/troubleshooting.html