apache-kafka Questions
4
Solved
Quick question for those who have used Amazon's MSK (Managed Streaming for Kafka):
The docs/FAQ make it clear that you can easily scale up the number of brokers in an MSK cluster. Can you just as ...
Bebeeru asked 18/11, 2019 at 16:51
2
I want to give some time to my consumer to restart so that unnecessary rebalance doesnt happen. How can I do that?
In case of shutdown, I want replication to come in picture and after some time if ...
Imphal asked 12/6, 2019 at 11:40
3
Solved
I have a standalone kafka broker that I'm trying to configure SASL for. Configurations are below. I'm trying to set up SASL_PLAIN authentication on the broker.
My understanding is that with the li...
Recruitment asked 8/1, 2019 at 21:40
1
The requirement is to send alerts if the expected 'final' event (identified from the evenType field in event payload) is not received for a key within a time window of say 2 minutes on the input to...
Lepsy asked 28/2, 2021 at 20:51
2
Solved
I want to limit the rate when fetching data from kafka. My code looks like:
df = spark.read.format('kafka') \
.option("kafka.bootstrap.servers",'...')\
.option("subscribe",'A') \
.option("start...
Overstuffed asked 26/6, 2018 at 0:17
12
I am trying to use wurstmeister\kafka-docker image with docker-compose, but I am having real problems with connecting everything.
All the posts or questions that I check, seems not to have any pro...
Whomp asked 8/3, 2016 at 7:31
7
Solved
I am facing an issue with my Dockerized Django application. I am using the following Dockerfile to build my application:
FROM python:alpine
ENV PYTHONDONTWRITEBYTECODE 1
ENV PYTHONUNBUFFERED 1
ENV...
Conventionality asked 13/10, 2023 at 12:11
10
Solved
I have installed zookeeper and kafka,
first step :
running zookeeper by the following commands :
bin/zkServer.sh start
bin/zkCli.sh
second step :
running kafka server
bin/kafka-server-start.sh ...
Hix asked 19/3, 2018 at 19:31
4
I'm trying to sink the table data one DB to another DB using kafka debezium ( Kafka streaming ) with the help of docker.
DB stream is working fine. But streamed data to sink another MySQL DB proce...
Kantianism asked 21/11, 2019 at 10:59
7
Solved
I am manually starting Zookeeper, then Kafka server and finally the Kafka-Rest server with their respective properties file. Next, I am deploying my Spring Boot application on tomcat
In the Tomcat ...
Convent asked 25/12, 2017 at 15:31
6
Solved
After starting Kafka Connect (connect-standalone), my task fails immediately after starting with:
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffe...
Hypso asked 31/1, 2017 at 18:15
1
Solved
I am building a Kafka Listener / Consumer with Spring Boot that consumes Avro data from a topic.
Here's some of the properties
spring.kafka.properties.specific.avro.reader=true
spring.kafka.consume...
Dichloride asked 6/5 at 11:1
18
Solved
I'm getting the error:
org.apache.kafka.common.errors.TimeoutException: Topic testtopic2 not present in metadata after 60000 ms.
When trying to produce to the topic in my local kafka instance on ...
Stoa asked 2/9, 2020 at 22:39
3
Solved
I created 3 Kafka brokers setup with broker id's 20,21,22. Then I created this topic:
bin/kafka-topics.sh --zookeeper localhost:2181 \
--create --topic zeta --partitions 4 --replication-factor 3
...
Poynter asked 30/7, 2020 at 6:24
2
I've develope a Spring XML + Kafka example. In this example I wanted to understand how to trigger the consumer side of it. I don't want to use main method for consumer.
MainApp.java
public class Ma...
Fustian asked 17/4 at 10:27
3
Solved
I am running wurstmeister/kafka in a ubuntu 14.04 LTS machine. Kafka container is running fine. However I am not able to connect my microservice to this container.
Kafka docker-compose.yml:
versi...
Veracruz asked 30/10, 2016 at 15:28
5
I tried to setup kafka and zookeeper on windows.
Initially I created topics, producers and consumers. It was working fine.
Then I deleted one topic by using the below command:
kafka-run-class.bat k...
Celie asked 16/5, 2021 at 9:42
1
Kafka version : 0.9
We have a java application trying to read from Kafka . but we see data corruption in kafka messages
Below is the error from Java application :
org.apache.kafka.common.Kaf...
Tootsy asked 12/4, 2017 at 20:42
10
I have just upgraded to Kafka 1.0 and zookeeper 3.4.10.At first, it all started fine. Stand - alone producer and consumer worked as expected. After I've ran my code for about 10 minutes, Kafka fail...
Hanan asked 7/11, 2017 at 22:16
3
Solved
I'm currently working with Kafka and Flink, I have kafka running in my local PC and I created a topic that is being consumed.
Desktop\kafka\bin\windows>kafka-console-consumer.bat --zookeeper loca...
Divan asked 30/12, 2016 at 17:30
2
Solved
I'm using confluent-kafka-client. I have one producer producing into a topic with one partition and one consumer within one group ID. First, I create a producer (with default configs) for the topic...
Cytosine asked 25/4 at 2:14
5
Solved
I am trying to run my kafka and zookeeper in kubernetes pods.
Here is my zookeeper-service.yaml:
apiVersion: v1
kind: Service
metadata:
annotations:
kompose.cmd: kompose convert
kompose.versi...
Neutrality asked 3/9, 2018 at 8:35
4
I am setting up Kafka on my local Windows 10 machine. So downloaded all the required binaries and updated the two settings server and zookeeper properties as per the documentation.
But when running...
Comp asked 14/4, 2022 at 5:33
1
Solved
I am trying to serialize an event object to produce a kafka event.
All the code of the proyect can be found here:
https://github.com/Gaboxondo/springBootCQRSExample
When I try to publish the event ...
Vendue asked 27/4 at 9:4
5
Solved
I'm working a couple of Kafka connectors and I don't see any errors in their creation/deployment in the console output, however I am not getting the result that I'm looking for (no results whatsoev...
Borrell asked 16/8, 2017 at 15:32
© 2022 - 2024 — McMap. All rights reserved.