DX AIOPs - Troubleshooting, Common Issues and Best Practices

book

Article ID: 190815

calendar_today

Updated On:

Products

DX Operational Intelligence DX Application Performance Management CA App Experience Analytics

Issue/Introduction

The following is a high-list of techniques and suggestions to employ when troubleshooting performance, display and configuration issues

A) Openshift / Kubernetes
B) AIOps Installer
C) AIOps Common Platform (Login, Postgres, Jarvis, Elastic)
D) DX Operational Intelligence
E) DX Application Performance Management

Environment

DX Operational Intelligence 1.3.x, 20.2
DX Application Performance Management 11.x, 20.2
DX AXA 20.2

Resolution

A) Openshift / Kubernetes


DX AIOps - Unable to open Openshift console
https://knowledge.broadcom.com/external/article/198091

DX AIOps - Unable to login to OI console, all Openshift nodes appear in a NotReady status 
https://knowledge.broadcom.com/external/article/206000

DX AIOps - many pods in Evicted status - how can I delete these unwanted pods?
https://knowledge.broadcom.com/external/article/206249

 

B) DX Platform

Installer:

DX Platform - Example how to install Openshift 3.11 + DX 20.2.1 - OI+APM+AXA (template 4 servers x 64GB Mem)
https://knowledge.broadcom.com/external/article?articleId=210870

DX Platform - Example how to Install Openshift 3.11 + DX 20.2.1- OI+APM (template 6 servers x 64GB Mem) + 3 ElasticNodes
https://knowledge.broadcom.com/external/article?articleId=210871

DX Platform - Example how of Install Kubernetes + DX 20.2.1 - OI+APM+AXA Only (template 5 servers x 64GB Mem) 
https://knowledge.broadcom.com/external/article/210158

NFS:

DX Platform - "Recommended Throughput for NFS Storage" How the value were calculated? What tools can be used to validate the same?
https://knowledge.broadcom.com/external/article/212399


Cluster Management:

DX Platform - LDAP Tenant authentication issues and limitations
https://knowledge.broadcom.com/external/article/203976

 

C) AIOps Common Platform (Login, Postgres, Jarvis, Elastic)

Login issues:

DX Platform - Unable to login to DX Platform - due to pods connectivity issues
https://knowledge.broadcom.com/external/article?articleId=185182

DX Installer - Unable to login - dxi-platform-init-pod had errors
https://knowledge.broadcom.com/external/article/211353

DX Platform - Unable to login - How to reset masteradmin password if forgotten
https://knowledge.broadcom.com/external/article/206620

DX Platform - Unable to login to newly created Tenants - login process enter in a loop
https://knowledge.broadcom.com/external/article/211175

Login issue as masteradmin on DX Platform 20.2.1 after install
https://knowledge.broadcom.com/external/article?articleId=209838

DX Platform - Unable to login to OI console, error code 2011034
https://knowledge.broadcom.com/external/article/194529

DX Platform - Unable to login to DX - postgres database corruption
https://knowledge.broadcom.com/external/article?articleId=184125

DX Platform - Unable to login to DX Platform due to Account locked out
https://knowledge.broadcom.com/external/article?articleId=212059

DX Platform - Unable to login to DX Platform - jarvis-elasticsearch pods evicted
https://knowledge.broadcom.com/external/article?articleId=185156

Jarvis (kafka, zookeeper, elasticSearch):


DX AIOps - Jarvis (kafka, zookeeper, elasticSearch) Troubleshooting
 
DX AIOps - NFS or Elastic Nodes disk full - How to reduce Elastic data retention
 

Maintenance:

DX AIOps - How to gracefully restart AIOps servers
https://knowledge.broadcom.com/external/article/202717

DX AIOps - what unnecessary logs and files can I delete?
https://knowledge.broadcom.com/external/article/198040

ServiceNow integration

DX AIOps - ServiceNow Integration Troubleshooting
https://knowledge.broadcom.com/external/article/206791

DX AIOps - Nim Troubleshooting
https://knowledge.broadcom.com/external/article/206252

DX AIOps- How to manually recreate a tenant configuration in NIM UI?
https://knowledge.broadcom.com/external/article/206011

 

DX OI - ServiceNow Automatic incident creation/closure is not working
https://knowledge.broadcom.com/external/article/198666

DX OI - Alarms do not display the generated ServiceNow incidents
https://knowledge.broadcom.com/external/article/206248

DX OI - Many ServiceNow incidents and Service Alarms are being created
https://knowledge.broadcom.com/external/article/208782

DX OI - ServiceNow incidents are getting reopened many times.
https://knowledge.broadcom.com/external/article/189070

DX OI - ServiceNow incidents are created but OI console still shows the “Open ticket” option rather than the incident number
https://knowledge.broadcom.com/external/article/193262

DX OI - How to assign an event to a particular group in ServiceNow based on CI's like Process, Service or URL.
https://knowledge.broadcom.com/external/article/201071
 
DX OI - Is it possible to create a new custom Field in ServiceNow incident that includes the UIM process name?
https://knowledge.broadcom.com/external/article/199325

D) DX Operational Intelligence (OI)


Alarms:

DX OI - Predictive Insights stop working, the page is empty
https://knowledge.broadcom.com/external/article/206880
 
DX OI - No New alarms or Alarms are not getting updated

DX OI - Is it possible to customize the Alarm monitoring details from OI console or a config file?
 
DX OI - (Enhancement) Be able to automate the way of assigning the events based on alarm type/Description/Sub description

Make a saved filter public (limitation)

 

DSP / Anomaly Alarms:

DX OI - How to configure DSP to process only CAPM metrics
https://knowledge.broadcom.com/external/article/200173

 

Service Analytics

Add a Service based on Custom ingested data
 
 

Performance Analytics:

DX OI - Unable to see CAPM Inventory data from Performance Analytics
https://knowledge.broadcom.com/external/article/202699
 
OI green highways not displaying correctly for custom metrics

 

Predictive Insight:

DX OI - How to export Capacity Analytics and Predictive Insight data?
https://knowledge.broadcom.com/external/article/210534
 
Capacity forecast analytics show CPU consumption 6000% for next 6 month
 
Capacity Analytics error messages

 

APM 10.7 Integration:

DX OI integration with APM 10.7 - Troubleshooting, Common Issues and Best Practices
DX OI - Alarms explosion caused by the APM integration - How to delete All or individual APM alarms?
https://knowledge.broadcom.com/external/article/204085
 
DX OI - "APM Alarms do not support the action" message, unable to clear or  hide any APM Alarm in OI UI
https://knowledge.broadcom.com/external/article/201612
 

DX NetOps PM, CA ADA, and CA NFA Integration:

DX OI integration with DX NetOps PM, CA ADA, and CA NFA - OI Connector Troubleshooting, Common Issues and Best Practices
https://knowledge.broadcom.com/external/article/210469

DX OI - OIConnector not connecting when CAPC user and password changes
https://knowledge.broadcom.com/external/article/204144

 

UIM Integration:

 
DX OI integration with UIM - Troubleshooting, Common Issues and Best Practices

DX OI integration with UIM - Disaster Recovery for OI Connector and APM Bridge
https://knowledge.broadcom.com/external/article/212166

DX OI integration with UIM - apm_bridge is not sending data : Could not determine UIM or TAS devices to forward for profile 0 with origin
https://knowledge.broadcom.com/external/article/211750

DX OI integration with UIM - duplicated alarms and some alarms are not cleared property in OI Console
https://knowledge.broadcom.com/external/article/211757

DX OI - UIM integration, user tags missing as part of the UIM Alarms
https://knowledge.broadcom.com/external/article/210512
 
UIM alarms are not reflecting the colored status on the UIM device in the Service Topology view
 
The edit service or Update service(Synch for group/Inventory) are not supported.

 

Spectrum integration:

Spectrum topology not properly synced
mapping Spectrum alarms to services

 

REST API

DX OI - Using REST API to query/export OI data - an example
https://knowledge.broadcom.com/external/article/206461

 

Self Service Dashboards

DOI 1.3.2 - How to check the licenses in use?
https://knowledge.broadcom.com/external/article/207285

 

SOACorrelationEngine

DX APM - Troubleshooting Guidelines for doi-soacorrelationengine
https://knowledge.broadcom.com/external/article?articleId=143270

 

Limitation:
 
LDAP Integration with SSL on OI (limitation)

Unable to access self service dashboard (limitation)

 

E) DX Application Performance Management (APM)

Business Transactions

DX APM "No traces" available in the Map > Business Transaction
https://knowledge.broadcom.com/external/article?articleId=143002

 

Upgrade

DX APM - REST API to import and delete Management Module
https://knowledge.broadcom.com/external/article?articleId=145459

 

ACC Command Center

DX APM - ng-acc-configserver-deployment pod in CrashLoopBackOff due to FATAL: password authentication failed for user "acc"
https://knowledge.broadcom.com/external/article/212835

DX APM - ng-acc-configserver pods in CrashLoopBackOff due to ACC postgres DB corruption
https://knowledge.broadcom.com/external/article?articleId=144154

 

Tenant data migration

DX APM - Removing service data and fixing partitioning
https://knowledge.broadcom.com/external/article?articleId=144011

 

Additional Information

Installation 

https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/dx-platform-on-premise/20-2/installing/troubleshooting-the-installation.html

DX OI

https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/digital-operational-intelligence/20-2/troubleshooting-consolidated.html

DX APM

https://techdocs.broadcom.com/us/en/ca-enterprise-software/it-operations-management/application-performance-management/20-2/troubleshooting.html

Powered by Wolken Software