confluent-platform Questions
3
What parameters of Kafka Producer config are needed to be changed so that the producer should:
1) Retry n times
2) After n interval
for the same message in case if the broker is down.
I need to ha...
Vance asked 2/3, 2017 at 20:5
1
Can we setup CDC Tracking on a view or materialized view? We are using confluent platform, source is SQL Server & CDC tool is debezium.
Hautegaronne asked 9/1, 2020 at 14:5
1
On Mac, I pulled latest docker images. As I run stack, everything seems to be okay but "Connect" crashed with Exit 137.
When I looked at the command center, cluster health seems to be fine. What i...
Demodena asked 4/9, 2019 at 1:23
1
I want to read data from a confluent cloud topic and then write in another topic.
At localhost, I haven't had any major problems. But the schema registry of confluent cloud requires to pass some a...
Lexine asked 13/11, 2019 at 10:59
1
I have implemented Avro schema in node.js with schema being sent with the message payload. And it is working fine. I am looking if there is any way I can use schema-registry with Kafka-node module....
Dill asked 25/10, 2017 at 10:48
2
Solved
I am looking to productionize and deploy my Kafka Connect application. However, there are two questions I have about the tasks.max setting which is required and of high importance but details are v...
Traction asked 27/1, 2017 at 18:30
0
I have used mirror maker in the past and not Replicator and am getting an error but now sure where to start to debug it.
Here is the error:
[2019-08-12 18:04:09,672] ERROR Failed to reconfigure ...
Setback asked 13/8, 2019 at 18:56
1
I am pretty new to confluent_kafka but I've gained some experience with kafka-python. What I am trying to do is changing the offset where to start consuming messages. This why I'd like to build a c...
Chateau asked 22/4, 2018 at 16:45
2
Is kafka-connect-jdbc safe in terms of lose and duplicate rows in case of auto incrementing primary key field in database as incrementing field?
Electrometallurgy asked 23/4, 2018 at 5:31
0
It seems like it's not possible to use the RegexRoute to replace all the dots in a topic name with underscores since RegexRouter calls replaceFirst not replaceAll. Is there a way around this? One t...
Platitude asked 13/5, 2019 at 17:14
3
Solved
It seems like most popular .net client for Kafka (https://github.com/confluentinc/confluent-kafka-dotnet) is missing methods to setup and create Topics.
When calling Producer.ProduceAsync() the to...
Josephina asked 27/4, 2018 at 13:23
0
I need to source data from a PostgreSQL database with ~2000 schemas. All schemas contain the same tables (it is a multi-tenant application).
The connector is configured as following:
{
"name": "...
Scissor asked 18/4, 2019 at 17:3
6
I have windows environment and my own set of kafka and zookeeper running. To use custom objects, I started to use Avro. But I needed to get the registry started. Downloaded Confluent platform and r...
Overcheck asked 24/8, 2016 at 17:4
1
I am fairly new to Python and getting started with Kafka. So I have setup a Kafka broker and I am trying to communicate with it using confluent-kafka.
I have been able to produce and consume simpl...
Id asked 14/4, 2019 at 6:1
1
Solved
I'm trying to write an integration test for my Kafka consumer. I've followed through with the official reference documentation but when I start my test I only see this repeated ad infinitum:
-20...
Diverticulitis asked 3/4, 2019 at 14:14
1
I am testing Apache Kafka Producer with native java implementation against Python's confluent-kafka to see which has the maximum throughput.
I am deploying a Kafka cluster with 3 Kafka brokers and...
Mantooth asked 5/3, 2019 at 9:23
1
Solved
I need my consumer to consume from an specific TopicPartitionOffset(here from offset 278). Suppose that Messages have been produced by some Producer in Specific topic like ="Test_1" before.
Here i...
Jeromejeromy asked 29/12, 2018 at 10:17
1
Solved
I am trying to make use of mirror maker to replicate __consumer_offsets topic along with other topics.
It is giving error as mentioned below.
[2018-10-24 16:16:03,802] ERROR Error when sending mes...
Loophole asked 24/10, 2018 at 11:20
0
We're seeing huge memory leaks when consuming from Kafka using the Confluent Kafka .NET library.
One thing I've noticed is the code consumes without a using statement:
while (true)
{
if (_consum...
Daguerre asked 19/11, 2018 at 14:12
1
Solved
I am using confluent kafka connect service but it is not writing logs in /var/log/kafka . How to configure it so that it writes the logs in /var/log/kafka ?
Currently /var/log/kafka only has follo...
Spadework asked 14/11, 2018 at 10:22
1
Solved
I am passing a long JSON String to kafka topic eg:
{
"glossary": {
"title": "example glossary",
"GlossDiv": {
"title": "S",
"GlossList": {
"GlossEntry": {
"ID": "SGML",
"SortAs": "SGML",
...
Caddie asked 1/10, 2018 at 19:54
1
Solved
We have a Kafka consumer which will read messages and do so stuff and again publish to Kafka topic using below script
producer config :
{
"bootstrap.servers": "localhost:9092"
}
I haven't conf...
Denial asked 1/10, 2018 at 11:5
5
I'm using confluent platform, the zookeeper is active with status lookup. but when I try to start kafka with confluent it shows zookeeper is down.
$ sudo service zookeeper status
Redirecting to /b...
Ciaracibber asked 9/8, 2017 at 17:5
2
Solved
I have been trying to connect with kafka-avro-console-consumer from Confluent to our legacy Kafka cluster, which was deployed without Confluent Schema Registry.
I provided schema explicitly using ...
Excruciation asked 19/9, 2018 at 6:24
2
Solved
How to use Spring-Kafka to read AVRO message with Confluent Schema registry? Is there any sample? I can't find it in official reference document.
Boltrope asked 23/8, 2018 at 6:16
© 2022 - 2024 — McMap. All rights reserved.