Kafka

Getting started with Aiven Kafka

Written by Hannu
Updated this week

Migrating your Kafka to Aiven

How to migrate your Kafka to Aiven

Written by Prem
Updated this week

Kafka Streams with Aiven Kafka

How to setup a Kafka Streams application with Aiven Kafka and Schema Registry

Written by Prem
Updated this week

Apache Flink with Aiven Kafka

How to setup a Apache Flink with Aiven Kafka

Written by George
Updated this week

Viewing and Resetting Consumer Group Offsets

Usage instructions for kafka-consumer-groups.sh tool

Written by Heikki
Updated this week

Kafka cluster upgrades

Scaling up your Kafka cluster

Written by Oskari
Updated this week

Consumer group graph addition to Kafka dashboard

Kafka consumer group telemetry and graphs

Written by Prem
Updated this week

Kafka metrics through Prometheus integration

All available metrics in Kafka

Written by Markus
Updated this week

Kafka UI tools

UI for monitoring Apache Kafka

Written by Markus
Updated this week

Kafka data visualization with Operatr

Steps to integrating Operatr with Aiven for Kafka

Written by Prem
Updated this week

Kafka Users and Access Control

Written by Heikki
Updated this week

Kafka data retention

Utilizing log compaction and different data retention periods

Written by Oskari
Updated this week

Kafka topic auto-create

This help article explains how to enable topic auto-create in Apache Kafka and adjust default properties for topics

Written by Mathias
Updated this week

Setting max.message.bytes and other Kafka parameters

How to configure Aiven Kafka parameters?

Written by Olli
Updated this week

Programmatic topic management

Using Java AdminClient interface to create and modify topics

Written by Heikki
Updated this week

Kafka topic index disk usage

Why are empty topics using over 20 MiB disk space?

Written by Marko
Updated this week

Kafka disk full prevention

What to do when the disk gets full in an Aiven Kafka

Written by Mathias
Updated this week

Bring your own Kafka connect cluster

How to integrate your own Kafka connect cluster with Aiven for Kafka

Written by Prem
Updated this week

Sending custom Kafka metrics to Datadog

How to configure Aiven Kafka Datadog metrics?

Written by Juho V-H
Updated this week

Using kafkacat

Kafkacat is an useful utility for inspecting and producing messages into Kafka on the commandline.

Written by Heikki
Updated this week

Kafkatool integration with Aiven for Kafka

How to integrate Kafkatool with Aiven for Kafka

Written by Prem
Updated this week

Using Schema Registry with Aiven Kafka

Example on how to use Kafka Schema Registry available in Aiven Kafka

Written by Prem
Updated this week

Kafka MirrorMaker use within Aiven

Using Kafka MirrorMaker integration in Aiven to copy data across two Kafka clusters

Written by Ville
Updated this week

Configuring Kafka REST

Written by Timo
Updated this week

Is Kafka REST's performance at the same level as native Kafka connections?

Written by Mika
Updated this week

Using KSQL with Aiven Kafka

How to run KSQL against Aiven hosted Kafka and Schema Registry

Written by Rauli
Updated this week

Kafka Connect Connectors

Aiven supported connectors

Written by Hannu
Updated this week

JDBC source connector with PostgreSQL

How to setup and use JDBC source connector for Kafka with PostgreSQL

Written by Prem
Updated this week

JDBC source connector with MySQL

How to setup and use JDBC source connector for Kafka with MySQL

Written by Prem
Updated this week

Using Debezium connector with RDS PostgreSQL and Aiven Kafka

How to use Debezium connector for change data capture (CDC) with RDS PostgreSQL and Aiven Kafka

Written by Prem
Updated this week

Aiven Kafka S3 sink connector

How to setup and use Aiven Kafka S3 sink connector

Written by Prem
Updated this week

Aiven Kafka GCS sink connector

How to setup and use Aiven Kafka GCS sink connector

Written by Ivan
Updated this week

Aiven Kafka - Kafka Connect S3

How to setup and use the S3 connector by Confluent

Written by Heikki
Updated this week

Aiven Kafka - Elasticsearch sink connector

How to setup and use Elasticsearch sink connector with Aiven for Kafka

Written by Prem
Updated this week

Setting up Cassandra sink connector for Kafka

Consuming data from Kafka topic and storing in Cassandra

Written by Prem
Updated this week

Setting up Debezium with Aiven for MySQL

Get your data flowing from MySQL to Kafka

Written by Hannu
Updated this week

Setting up Debezium with Aiven for PostgreSQL

Get your data flowing from PostgreSQL to Kafka

Written by Hannu
Updated this week

Setting up Debezium for MongoDB

How to push data from MongoDB to Aiven for Kafka using Debezium

Written by Prem
Updated this week

Kafka Connect: JDBC Source with SQL Server

Example configuration for SQL Server JDBC source

Written by Heikki
Updated this week