I have Kafka commit policy set to latest and missing first few messages. If I give a sleep of 20 seconds before starting to send the messages to the input topic, everything is working as desired. I...

I am using Kafka: 2.11-1.0.1. The application contains consumers with concurrency=5 for the topic 'X' with partitions=5. When the application is restarted and the message is published on topic 'X' ...

I have a kubernetes cluster with a few nodes set up. I want to make sure that pods are distributed efficiently on the nodes. I'll explain: Let's assume that I have two nodes: Node 1 - 2gb ram No...

I am reading Kafka: The Definitive Guide and would like to better understand the rebalance listener. The example in the book simple uses a HashMap to maintain the current offsets that have been pro...

I am using kafka connector confluent 3.0.1 version.I create a new group named new-group and there are about 20 topics on it.most of these topics is busy.But It is a pity that when I start the conne...

I have a huge InnoDB table (>1TB, >1B rows) that I would like to shard: I would like to make multiple smaller independent tables from that big table. How to do that ? What I've already tried: M...