kafka-producer-api Questions
8
I have to add encryption and authentication with SSL in kafka.
This is what I have done:
Generate certificate for each broker kafka:
keytool -keystore server.keystore.jks -alias localhost -validi...
Langill asked 27/2, 2019 at 10:32
5
Consider the Kafka Producer :
const { Kafka, logLevel } = require('kafkajs');
const kafka = new Kafka({
clientId: 'my-app',
brokers: ['kafka1:9092', 'kafka2:9092'],
logLevel: logLevel.ERROR,
})...
Plating asked 9/10, 2020 at 8:27
10
I want to ensure whether kafka server is running or not before starting production and consumption jobs. It is in windows environment and here's my kafka server's code in eclipse...
Properties prop...
Weatherproof asked 20/6, 2016 at 11:5
6
I am using Kafka producer client and i don't have any log4j configuration in my project.
On running, the program prints a lot of Kafka Debug logs which i really don't want.
So, i tried to add a l...
Thrust asked 3/3, 2016 at 13:40
5
Solved
i need to test a message, which contains headers, so i need to use MessageBuilder, but I can not serialize.
I tried adding the serialization settings on the producer props but it did not work.
Ca...
Dene asked 25/4, 2017 at 13:29
3
In a Kafka cluster containing N brokers , for Topic T against a partition, producers publish data to Leader broker. By the term 'commit' in Kafka terminology , does it mean the data is committed in...
Spaceship asked 2/5, 2018 at 3:17
3
Solved
Whenever I am trying to read the message from kafka queue, I am getting following exception :
[error] (run-main-0) java.lang.ClassCastException: org.apache.avro.generic.GenericData$Record cannot ...
Dewyeyed asked 13/2, 2017 at 9:38
6
One way of achieving it could be by setting the properties parameter
max.in.flight.requests.per.connection = 1.
But I want to know if there is an even direct or alternate way of sending messages sy...
Syllogistic asked 6/8, 2017 at 6:39
7
Solved
i have already started to learn Kafka. Trying basic operations on it. I have stucked on a point which about the 'Brokers'.
My kafka is running but when i want to create a partition.
from kafka ...
Aleedis asked 9/8, 2016 at 15:34
2
I am using kafka-python for accessing Kafka. I try to create a Kafka Producer:
kafka_producer = KafkaProducer(bootstrap_servers=['kafka:9092'])
but this fails with exception kafka.errors.NoBroke...
Sechrist asked 17/7, 2019 at 13:15
3
Solved
I work on a bench of my Kafka cluster in version 1.0.0-cp1.
In part of my bench who focus on the max throughput possible with ordering guarantee and no data loss (a topic with only one partition),...
Vinni asked 12/4, 2018 at 17:29
3
Solved
We are using kafka 0.10.2.1. The documentation specifies that a buffer is available to send even if it isn't full-
By default a buffer is available to send immediately even if there is additiona...
Appendage asked 16/3, 2018 at 7:6
2
As I have seen the Kafka template internally used Kafka producer. I just want to know what is the exact difference.
Also, I found many send() methods available in the Kafka template as compared to ...
Cause asked 9/9, 2020 at 8:53
4
I am trying to send message through kafka console producer. But I am not able to type messages more than 4095 characters. Tried to search if there is any property related to this in producer or ser...
Apologetics asked 8/6, 2016 at 14:5
4
Solved
There is only few serializer available like,
org.apache.kafka.common.serialization.StringSerializer
How can we create our own custom serializer ?
Vociferation asked 20/10, 2016 at 12:12
2
We are running kafka in distributed mode across 2 servers.
I'm sending messages to Kafka through Java sdk to a Queue which has Replication factor 2 and 1 partition.
We are running in async mode.
I...
Siusan asked 17/8, 2017 at 14:29
4
I am using Kafka with Spring-boot:
Kafka Producer class:
@Service
public class MyKafkaProducer {
@Autowired
private KafkaTemplate<String, String> kafkaTemplate;
private static Logger...
Meteorite asked 9/10, 2017 at 15:15
1
On setting kafka producer property - enable.idempotence to true
kafkaProps.put("enable.idempotence" , "true");
I am getting below error -
2021-04-18 16:43:53.584[0;39m [31mERROR...
Biliary asked 18/4, 2021 at 11:29
5
Solved
We are sending message with headers to Kafka using
org.apache.kafka.clients.producer.ProducerRecord
public ProducerRecord(String topic, Integer partition, K key, V value, Iterable<Header> h...
Stalwart asked 15/3, 2019 at 10:33
2
Solved
When setting up a kafka producer to use idempotent behaviour, and transactional behaviour:
I understand that for idempotency we set:
enable.idempotence=true
and that by changing this one flag on o...
Passed asked 18/2, 2020 at 14:57
4
I am trying to use the Kafka Connect JDBC Source Connector with following properties in BULK mode.
connector.class=io.confluent.connect.jdbc.JdbcSourceConnector
timestamp.column.name=timestamp
con...
Kurth asked 4/4, 2019 at 17:6
6
We have 3 zk nodes cluster and 7 brokers. Now we have to create a topic and have to create partitions for this topic.
But I did not find any formula to decide that how much partitions should I cr...
Refreshment asked 10/5, 2018 at 11:16
2
Solved
I get Message size too large exception, when I try to send a message which is over 1 Mb size. The error appears in my client application, when I try to produce a message. After a little googling I ...
Sirajuddaula asked 13/12, 2019 at 11:55
2
My kafka producer is throwing an error "Invalid transition attempted from state IN_TRANSACTION to state IN_TRANSACTION". Here is what I am trying to achieve -
KafkaProducer producer = new...
Narceine asked 22/1, 2020 at 16:48
4
Solved
When I run the following command with kafka 0.9.0.1, I get these warnings[1]. Can you please tell me what is wrong with my topics? (I'm talking to the kafka broker which runs in ec2)
./kafka-consol...
Pock asked 6/4, 2016 at 1:21
© 2022 - 2024 — McMap. All rights reserved.