kafka-producer-api Questions
2
Solved
i am trying to create producer and send some data to it from intellij idea but while running this program i got ERROR like ERROR org.apache.kafka.common.utils.KafkaThread - Uncaught exception in th...
Anemology asked 17/9, 2020 at 23:58
4
I'm trying to figure out the difference between the settings batch.size and buffer.memory in Kafka Producer.
As I understand batch.size: It's the max size of the batch that can be sent.
The docum...
Shanaeshanahan asked 4/4, 2018 at 10:56
4
This is the extension that I am trying to install: https://github.com/EVODelavega/phpkafka
The messages passed to the queue should be in JSON format.
Currently, I am getting installation errors...
Duron asked 6/12, 2017 at 14:16
18
Solved
I'm getting the error:
org.apache.kafka.common.errors.TimeoutException: Topic testtopic2 not present in metadata after 60000 ms.
When trying to produce to the topic in my local kafka instance on ...
Stoa asked 2/9, 2020 at 22:39
3
Solved
I created 3 Kafka brokers setup with broker id's 20,21,22. Then I created this topic:
bin/kafka-topics.sh --zookeeper localhost:2181 \
--create --topic zeta --partitions 4 --replication-factor 3
...
Poynter asked 30/7, 2020 at 6:24
2
Solved
My Apache Kafka producer (0.9.0.1) intermittently throws a
org.apache.kafka.common.errors.NotLeaderForPartitionException
My code that performs the Kafka send resembles this
final Future<Reco...
Anselme asked 28/4, 2016 at 14:23
5
We have encountered few exception on production environment:
UnknownTopicOrPartitionException: This server does not host this topic-partition
As per my analysis, one possible workaround for thi...
Magnetics asked 13/6, 2017 at 7:26
2
Solved
I'm trying to configure a kafka client to authenticate against a secure kafkaserver. I've set up the jaas and ssl configs, but it's complaining about serviceNames.
I am not using Kerberos.
comman...
Wombat asked 4/3, 2019 at 18:49
4
Getting the following error (Kafka 2.1.0):
2018-12-03 21:22:37.873 ERROR 37645 --- [nio-8080-exec-1]
o.s.k.support.LoggingProducerListener : Exception thrown when
sending a message with key='n...
Selfregulated asked 4/12, 2018 at 3:27
3
We use Kafka Mirror Maker Version 1 to mirror data between Kafka Clusters. I know that MM1 is deprecated but it is a solid pice of software that does exactly what we need. We use it out of a dedica...
Martelli asked 2/12, 2022 at 7:32
4
Solved
Given the below synchronous kafka producer
Properties props = new Properties();
props.put("max.block.ms", 30000);
props.put("request.timeout.ms", 30000);
props.put("retries", 5);
KafkaProducer<...
Redcap asked 24/1, 2017 at 18:11
2
I have a use case of high throughput kafka producer where I want to push thousands of json messages every second.
I have a 3 node kafka cluster and I am using latest kafka-python library and have ...
Spermous asked 4/6, 2020 at 15:37
3
Solved
Is there any way to produce a message in the kafka-console-producer with a null value (ie. mark it for the compactor to delete it with a tombstone)?
I've tried producing "mykey" and "mykey|". The ...
Lizbeth asked 28/8, 2018 at 12:11
3
I am using kafka_2.11-2.1.1
and Producer using spring 2.1.0.RELEASE.
I am using spring while I am sending the messages to Kafka topic my producer generates a lot of TimeoutExceptions
org.apache.k...
Exactitude asked 28/6, 2019 at 12:43
3
I am getting following error in the logs when trying to publish first message to a new topic.
[WARN ] [o.a.kafka.clients.NetworkClient][[Producer
clientId=producer-1] Error while fetching metad...
Wofford asked 7/12, 2018 at 11:11
7
Solved
I'm pretty sure the bootstrap.servers is correct. Is there anything confliction in Maven or what wrong with Kafka??
Before that It was working successfully. I added some Maven or Spark then someth...
Gossipmonger asked 16/11, 2016 at 13:4
4
Solved
When i try to consume messages from the kafka server which is hosted in ec2 with kafka console tool (V 0.9.0.1 , i think this uses old consumer APIs)
I get following exception.
How can i overcome t...
Harm asked 6/4, 2016 at 4:58
3
Solved
In my spring boot kafka publisher application, I want to provide support for publishing messages both in String(json) or in byte format, because I want to provide support for both json and avro. Bu...
Cimex asked 12/9, 2019 at 10:44
3
Solved
What is the difference between LEO and HW in Replica ( Leader Replica)?
Will they contain the same number? I can understand HW is the last committed message offset.
When LEO will be updated and h...
Perse asked 29/8, 2016 at 9:47
9
I am running the latest Kafka on Ubuntu WSL2 successfully. I can start zookeeper, kafka server, create topics, console produce and console consume just fine from within the Ubuntu that I have runni...
Simplicity asked 2/10, 2020 at 19:45
3
Solved
Kafka doc says:
Kafka relies heavily on the filesystem for storing and caching messages.
A modern operating system provides read-ahead and write-behind techniques that prefetch data in large...
Hunnish asked 18/9, 2019 at 7:47
5
I have created a sample application to check my producer's code. My application runs fine when I'm sending data without a partitioning key. But, on specifying a key for data partitioning I'm gettin...
Patricapatrice asked 14/4, 2020 at 20:54
2
Solved
I am able to list all Kafka Consumer with KafkaAdminClient:
AdminClient client = AdminClient.create(conf);
ListTopicsResult ltr = client.listTopics();
KafkaFuture<Set<String>> names = ...
Judoka asked 20/2, 2020 at 11:5
3
Solved
I'd like to use the kafka-console-producer.sh to fire a few JSON messages with Kafka headers.
Is this possible?
docker exec -it kafka_1 /opt/kafka_2.12-2.3.0/bin/kafka-console-producer.sh --broke...
Michigan asked 5/11, 2019 at 17:38
5
Solved
I am starting to learn Kafka. During my readings, some questions came to my mind:
When a producer is producing a message, it will specify the topic it wants to send the message to. Is that right? ...
Mickel asked 25/6, 2016 at 2:58
1 Next >
© 2022 - 2024 — McMap. All rights reserved.