Migrate the Kafka and OI Connector Server

Products

• Network Observability
• CA Performance Management

Issue/Introduction

Best practices to migrate the OI Connector and Kafka to a different server.

Environment

DX NetOps Performance Management

Resolution

 

Migrate the Kafka and OI Connector server using one of the following options:

• During a maintenance window when you can shut down the data aggregator during the process
• The data aggregator remains running

Tip! To minimize data loss, migrate the Kafka and OI Connector server this during a maintenance window when you can shut down the data aggregator during the process.

 

If you can shut down/restart the data aggregator:

1. Change the Kafka configuration using the following data aggregator REST calls:

GET  http://example-server:8581/rest/kafkaeventservice

Lookup the KafkaConfigID

 

PUT http://example-server:8581/rest/kafkaconfig/{KafkaConfigID}
Body (specify as many BootstrapServer entries as needed for Kafka nodes):

<KafkaConfiguration version="1.0.0">
       <BootstrapServersList>
            <BootstrapServers>example-kafka-1:9092</BootstrapServers>
            <BootstrapServers>example-kafka-2:9092</BootstrapServers>
            <BootstrapServers>example-kafka-3:9092</BootstrapServers>
        </BootstrapServersList>
</KafkaConfiguration>

1. Shut down the data aggregator.
2. Install Kafka and the OI Connector on new host(s).
3. Edit the /opt/IMDataAggregator/apache-karaf/etc/kafkaexport.producer.cfg file.
4. Start the data aggregator.

If you prefer not to shut down the data aggregator (a data aggregator restart is not required):

1. Install Kafka on new hosts.
2. Edit the /opt/IMDataAggregator/apache-karaf/etc/kafkaexport.producer.cfg file.
3. Change the Kafka configuration on the data aggregator using the following data aggregator REST calls:

GET  http://example-server:8581/rest/kafkaeventservice

Lookup the KafkaConfigID

 

PUT http://example-server:8581/rest/kafkaconfig/{KafkaConfigID}
Body (specify as many BootstrapServer entries as needed for Kafka nodes):

<KafkaConfiguration version="1.0.0">
       <BootstrapServersList>
            <BootstrapServers>example-kafka-1:9092</BootstrapServers>
            <BootstrapServers>example-kafka-2:9092</BootstrapServers>
            <BootstrapServers>example-kafka-3:9092</BootstrapServers>
        </BootstrapServersList>
</KafkaConfiguration>

1. 4. Install the OI Connector on the new host.

Uninstall Kafka/OI Connector from old host(s) at leisure if desired.

 

Change Kafka configuration on the Data Aggregator by way of REST

GET  http://example-server:8581/rest/kafkaeventservice

Lookup the KafkaConfigID

 

PUT http://example-server:8581/rest/kafkaconfig/{KafkaConfigID}
Body (specify as many BootstrapServer entries as needed for Kafka nodes):

<KafkaConfiguration version="1.0.0">
       <BootstrapServersList>
            <BootstrapServers>example-kafka-1:9092</BootstrapServers>
            <BootstrapServers>example-kafka-2:9092</BootstrapServers>
            <BootstrapServers>example-kafka-3:9092</BootstrapServers>
        </BootstrapServersList>
</KafkaConfiguration>