How to declaratively manage Kafka topics?

Question

We're using Apache Kafka and have a lot of manually created topics (with custom topic config). We want to manage our topics like the rest of our infrastructure/configuration as code.

How can we programmatically and declaratively manage our topics? Whats the sane way?

Extraterrestrial

What is your definition of "manage"? – Grandiloquence

Terraform plugins exist for Kafka... – Mydriasis

Personally, I have developed an open-source tool for doing that with a GitOps approach : github.com/streamthoughts/kafka-specs – Scurf

Answer 1

Here is a list of tools that might fit what you are looking for. They are all focused around declaratively managing resources, such as topics and ACLs, in Kafka.

Command-line

• jikkou
• kafka-gitops
• kdef
• topicctl

Terraform

• terraform-provider-kafka

Kimberli