Elasticsearch (Infrastructure) Agent captures multiple instances with date/time stamp

Products

• CA Application Performance Management Agent (APM / Wily / Introscope)
• CA Application Performance Management (APM / Wily / Introscope)
• INTROSCOPE
• DX Application Performance Management

Issue/Introduction

Using the Elasticsearch (Infrastructure) agent.  This agent is storing multiple 'filebeat' file instances with daily time stamps. 

Elasticsearch Indexes, and they get created based on Index Lifecycle Management ( ILM )policies defined in Elastic Landscape.

The indices with time stamps are being generated that way by design.  Need the individual indices stored for reference.

So, we need your assistance to understand filtering options to select only top-level, current, or most recent instances.

Environment

Release : 11.1.0

Component : APM Agents

Cause

Misconfiguration of elastic-monitoring on Bundle.properties 

Resolution

The indices metrics should be from "Index Summary" or "Index Details" monitor group.

 

Uncomment this line in the bundle.properties for elasticsearch extension and adjust the value accordingly:

 

(Check the comment above the property for available groups)

#introscope.agent.elasticsearch.profiles.default.monitored.groups=Cluster Information,Index Summary,Node Index Details

 

 

Additional Information

Values for the Monitored Groups
The values for the monitored groups ({elasticsearch_profile#}.monitored.groups) are as follows:
• Cluster Information
Provides metrics to show the overall status of the cluster.
• Index Details
Provides the metrics pertaining to each Index. Metrics include status of index and shard related metrics.
• Index Summary
This shows metrics at a pan index level. Metrics include Docs count, Segment count etc
• Node Summary
Provides high level metrics for nodes at an aggregated level. Eg. Total nodes, OS free memory
• Node details
Provides the metrics pertaining to each node.
• Node index details
Provides the metrics pertaining to indexes as each node.
• Connections
Provides the status of the different URLs that the Infrastructure Agent calls to fetch the metrics.
Note: The suggested groups are as follows: Cluster Information, Index Summary and Node Index Details. More details

available on Doc ops link: Elasticsearch Monitoring