DX SaaS Kafka extension unable to connect to brokers

Products

• CA Application Performance Management Agent (APM / Wily / Introscope)
• CA Application Performance Management (APM / Wily / Introscope)
• INTROSCOPE
• DX Application Performance Management

Issue/Introduction

Kafka brokers available on port 2181. However, the Kafka extension keeps reporting that it cannot find any brokers.

Log Entries:

[ERROR] [IntroscopeAgent.KafkaExtension] No Kafka brokers online to monitor
[ERROR] [IntroscopeAgent.KafkaExtension] Unexpected exception while trying to fetch Kafka brokers from zookeeper instance: APMtestKafka03.broadcom.net:2181/kafka
 [DEBUG] [IntroscopeAgent.KafkaExtension] For input string: "2181/kafka"
java.lang.NumberFormatException: For input string: "2181/kafka"

Environment

Release :  10.7.0

Component : APM IA, Kafka extension SaaS 20.1

Cause

Per engineering, The log message "No Kafka brokers online to monitor" implies that zookeeper API did not fetch the connected kafka brokers. The zookeeper property expects a host:port value. So 2181/kafka is an incorrect input resulting in the exception

Resolution

Verify that the zookeeper and brokers are correctly configured, run the following commands on the zookeeper server.

 

- ./zookeeper-shell.sh host:port

- ls /brokers/ids - This should list all the connected brokers if the config is correct.

If this works as expected, try passing the same host:port to zookeeper config property in the Kafka extension.