kafka-consumer-api Questions
2
Solved
I am sending an array of JSON by converting it to toString() in Kafka Producer using Spring Boot app, but I am getting following error in Consumer:
org.springframework.kafka.listener.ListenerExe...
Headmaster asked 16/9, 2019 at 8:59
2
Solved
i am trying to create producer and send some data to it from intellij idea but while running this program i got ERROR like ERROR org.apache.kafka.common.utils.KafkaThread - Uncaught exception in th...
Anemology asked 17/9, 2020 at 23:58
2
I don't understand the practical use case of the consumer group in Kafka.
A partition can only be read by only one consumer in a consumer group, so only a subset of a topic record is read by one co...
Hummer asked 8/2, 2023 at 19:39
4
I am trying to import KafkaConsumer from kafka.
It says:
no module named kafka
from kafka import KafkaConsumer
import sys
consumer = KafkaConsumer('test', bootstrap_servers='10.221.129.223...
Boz asked 26/4, 2018 at 6:4
4
This is the extension that I am trying to install: https://github.com/EVODelavega/phpkafka
The messages passed to the queue should be in JSON format.
Currently, I am getting installation errors...
Duron asked 6/12, 2017 at 14:16
2
Solved
How to print response from Kafka console consumer to JSON pretty. I have tried this but it's not working.
./kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic indexing-v1
--from-...
Amen asked 4/3, 2020 at 12:12
7
Solved
I am manually starting Zookeeper, then Kafka server and finally the Kafka-Rest server with their respective properties file. Next, I am deploying my Spring Boot application on tomcat
In the Tomcat ...
Convent asked 25/12, 2017 at 15:31
1
Kafka version : 0.9
We have a java application trying to read from Kafka . but we see data corruption in kafka messages
Below is the error from Java application :
org.apache.kafka.common.Kaf...
Tootsy asked 12/4, 2017 at 20:42
3
Solved
I'm currently working with Kafka and Flink, I have kafka running in my local PC and I created a topic that is being consumed.
Desktop\kafka\bin\windows>kafka-console-consumer.bat --zookeeper loca...
Divan asked 30/12, 2016 at 17:30
2
Solved
I'm using confluent-kafka-client. I have one producer producing into a topic with one partition and one consumer within one group ID. First, I create a producer (with default configs) for the topic...
Cytosine asked 25/4 at 2:14
3
Solved
producer sends messages 1, 2, 3, 4
consumer receives messages 1, 2, 3, 4
consumer crashes/disconnects
producer sends messages 5, 6, 7
consumer comes back up and should receive messages starting...
Tysontyumen asked 18/1, 2018 at 11:50
4
Getting the following error (Kafka 2.1.0):
2018-12-03 21:22:37.873 ERROR 37645 --- [nio-8080-exec-1]
o.s.k.support.LoggingProducerListener : Exception thrown when
sending a message with key='n...
Selfregulated asked 4/12, 2018 at 3:27
3
Solved
I have one Kafka topic and five partitions for that one topic. There will be 5 consumer groups. Each consumer group has one service instances consuming from that topic.
Will the offset be the same...
Lurid asked 17/12, 2018 at 15:49
3
Solved
I am running a data pipeline such that
I read data from sql db into kafka topic through jdbc connect
I sink this data in Elasticsearch using kafka sink connector for ES
I have a need to reset thi...
Diapositive asked 23/10, 2018 at 20:29
3
I noticed that the Consumer configuration has two IDs. One is group.id (mandatory) and second one is consumer.id (not Mandatory).
What is the difference between these 2 IDs?
Carryingon asked 31/12, 2015 at 19:31
6
I'm super new to Kafka. I've installed kafka and zookeeper using homebrew on my mac, and I'm playing around with the quickstart guide.
I've been able to push messages onto Kafka using the followin...
Whallon asked 28/8, 2018 at 22:56
3
Solved
I am using python-kafka to listen to a kafka topic and use that the records. I want to keep it polling infinitely without any exit. This is my code below:
def test():
consumer = KafkaConsumer('abc...
Lilalilac asked 8/2, 2021 at 12:15
3
Solved
I have Java 8 application working with Apache Kafka 2.11-0.10.1.0. I need to use the seek feature to poll old messages from partitions. However I faced an exception of No current assignment for par...
Petard asked 1/2, 2019 at 13:39
5
I'm using: https://github.com/mumrah/kafka-python as a kafka api in Python. I want to get the number of partitions for a specified topic. How do I do that?
Refractometer asked 13/4, 2015 at 18:14
3
Is it possible to retrieve messages in Kafka console conumer for a particular timestamp range?
For example kafka messags between 08:00 to 09:00 yesterday.
Ostensive asked 27/3, 2020 at 9:6
4
Solved
I have following program to consume all the messages coming to Kafka.
from kafka import KafkaConsumer
consumer = KafkaConsumer('my_test_topic',
group_id='my-group',
bootstrap_servers=['my_kafka:...
Hube asked 17/7, 2017 at 12:26
4
Solved
When i try to consume messages from the kafka server which is hosted in ec2 with kafka console tool (V 0.9.0.1 , i think this uses old consumer APIs)
I get following exception.
How can i overcome t...
Harm asked 6/4, 2016 at 4:58
6
Solved
From a couple of days I'm trying out ways to dynamically pass topics to Kafka listener rather than using them through keys from a Java DSL. Anyone around done this before or could throw some light ...
Antacid asked 25/9, 2017 at 8:6
3
Solved
What is the difference between LEO and HW in Replica ( Leader Replica)?
Will they contain the same number? I can understand HW is the last committed message offset.
When LEO will be updated and h...
Perse asked 29/8, 2016 at 9:47
2
Solved
I want to start a consumer in Kafka for a particular topic in a small delay. In detail, I want the consumer to start consuming the messages from the topic after a particular time delay from the tim...
Adigun asked 10/10, 2017 at 11:45
1 Next >
© 2022 - 2024 — McMap. All rights reserved.