Operatr, from operatr.io, is a tool that allows Kafka data visualization. Various Kafka related dashboards are available to view. The main ones are:

Broker:

  • Under replicated partitions

Topic:

  • Partitions
  • Topic data
  • Writes per second

Consumer:

  • Group lag
  • Message rate

Producer:

  • Message rate

How to setup Operatr with Aiven for Kafka

Prerequisites

The following configurations have to be set on Aiven for Kafka service via the Console (advanced configuration):
kafka.auto_create_topics_enable - This should be set to enable
kafka_authentication_methods.sasl - This should be enabled

Request Aiven support to enable PUBLIC_CA for your Kafka service, inquire what the public CA port is.

The following information should be obtained from the Aiven console for your Kafka service.
KAFKA_HOST
KAFKA_PW
SCHEMA_REGISTRY_PORT
SCHEMA_REGISTRY_PW
SASL_PUBLIC_CA_PORT

You must also get either a trial (or other) license code, OPERATR_TRIAL_CODE, from Operatr.io

You must also install Docker, from docker.io, on the VM which will host Operatr.

Operatr configuration fileĀ 

The operator-aiven.env file use to configure operatr for Aiven should contain the following parameters with their respective values.

BOOTSTRAP=KAFKA_HOST:SASL_PUBLIC_CA_PORT
SECURITY_PROTOCOL=SASL_SSL
SASL_MECHANISM=PLAIN
SASL_JAAS_CONFIG=org.apache.kafka.common.security.plain.PlainLoginModule required username="avnadmin" password="KAFKA_PW";
SSL_ENDPOINT_IDENTIFICATION_ALGORITHM=https
SCHEMA_REGISTRY_URL=https://KAFKA_HOST:SCHEMA_REGISTRY_PORT
SCHEMA_REGISTRY_AUTH=USER_INFO
SCHEMA_REGISTRY_USER=avnadmin
SCHEMA_REGISTRY_PASSWORD=SCHEMA_REGISTRY_PW
ALLOW_TOPIC_INSPECT=true
TRIAL_CODE=OPERATR_TRIAL_CODE

Starting up Operatr in a docker container

Once the operator-aiven.env configuration file has been created, go ahead run Operatr container within docker as shown below.

$ docker pull operatr/operatr:latest

$ docker run -p 3000:3000 --env-file ./operatr-aiven.env operatr/operatr:latest

Visualizing Kafka data

Once the operatr docker container has successfully started, you can point a browser to localhost:3000 and visualize Kafka data. Here are some sample screenshots of Operatr for Kafka.

Did this answer your question?