When you enable the Datadog integration in Aiven for Apache Kafka, the service supports all of the broker-side metrics that are listed in the Datadog Kafka integration documentation. The service also allows you to send custom metrics.

However, all metrics that have a kafka.producer.* or kafka.consumer.* prefix are client-side metrics and require a connection from the Datadog agent to the Java producer or consumer processes.

This type of setup, where the Datadog agent running on the Kafka nodes polls the application code processes, is feasible in an environment where you are hosting Kafka and your producers and consumers are available at specific IP addresses. For Kafka running in a managed service, having the Datadaog reach out to the client processes to poll for metrics lowers the security of the service.

For this reason, Aiven does not support gathering client-side metrics with the Datadog integration. If you want to send these additional metrics to Datadog, send them directly using DogStatsD as recommended in the Datadog documentation.

Did this answer your question?