confluent-platform Questions
1
I'm using the Confluent JDBCSourceConnector to read from an Oracle table. I am trying to use SMT to generate a key composed of 3 concatenated fields.
transforms=createKey
transforms.createKey.type...
Sharolynsharon asked 12/2, 2018 at 19:36
2
Solved
I am currently working with confluent 3.0.1 platform. I am trying to create 2 connectors on two different workers but trying to create a new connector is creating a new group for it.
Two connector...
Polypropylene asked 18/1, 2017 at 12:56
2
Solved
I am going through kafka connect, and i am trying to get the concepts.
Let us say I have kafka cluster (nodes k1, k2 and k3) setup and it is running, now i want to run kafka connect workers in di...
Turmel asked 14/7, 2018 at 5:40
1
Solved
Sorry i am new in Kafka and this question migth be so easy but i need some help.
i did not figure out some configurations.
There is a stream data,
i want Consumers to see only last 5 minutes of me...
Perrone asked 23/7, 2018 at 7:7
1
The github examples page for the Confluent Kafka library lists two methods, namely poll and consume. What is the difference between the two.
I did look at the Consumer implementation in the Conflu...
Tabb asked 26/4, 2018 at 6:20
1
Solved
I setup kafka connect s3 sink, duration set to 1 hour, and also I setup a rather big flush count, say 10,000. Now if there is not many message in the kafka channel, s3 sink will try to buffer them ...
Pereyra asked 8/6, 2018 at 13:42
2
Solved
I want to run a JDBC source connector using Kafka Connect REST API.
Although stand-alone mode works perfect using the following properties file:
name=source-mysql-test
connector.class=io.conflue...
Reinareinald asked 15/5, 2018 at 13:48
1
Solved
I started a kafka s3 sink connector (bundle connector from confluent package) since 1 May. It works fine until 8 May. Checking the status, it tells that some aws exception crashes this connector. T...
Unbonnet asked 10/5, 2018 at 10:27
0
I tried creating this connector from Confluent Control Center and clicking Continue on the first screen does not do anything, does not prompt for an error. When I ran it from the bash it won't stop...
Henderson asked 24/4, 2018 at 20:27
1
Solved
I am trying to use Confluent kafka-avro-console-consumer, but how to pass parameters for Schema Registry to it?
Jemie asked 19/4, 2018 at 18:22
1
Solved
I have an exisiting Kafka Cluster. I want to install the Kafka REST Proxy:
https://github.com/confluentinc/kafka-rest
If I install confluent does that come with Kafka? I am afraid if I still it o...
Accusatory asked 20/3, 2018 at 22:54
1
Solved
I have a total of 3 VM's(CloudVPS). Each of them has java, confluent open source installed on them. In VM1 I am running 3 processes of Splunk-sink-connector which reads from different topics and ar...
Haily asked 6/3, 2018 at 4:52
2
Solved
I am trying to figure out how to fetch all data from a query initially, then incrementally only changes using kafka connector. The reason for this is i want to load all data into elastic search, th...
Mull asked 4/5, 2017 at 0:38
1
When starting up a confluent-dotnet consumer , after the call to subscribe and subsequent polling, it seems to take a very long time to receive the "Partition assigned" event from the server, and t...
Fuss asked 12/1, 2018 at 10:1
2
Solved
I am running Kafka via Confluent platform. I have followed the steps as per documented here, https://docs.confluent.io/2.0.0/quickstart.html#quickstart
start zookeeper,
$ sudo ./bin/zookeeper-se...
Islander asked 9/1, 2018 at 20:49
2
Solved
I am trying to use the TimeBasedPartitioner of the Confluent S3 sink. Here is my config:
{
"name":"s3-sink",
"config":{
"connector.class":"io.confluent.connect.s3.S3SinkConnector",
"tasks.max"...
Atlantis asked 6/1, 2018 at 15:4
2
Solved
Can someone help me understand what the red stripes on the time line mean in confluent control center?
Yeti asked 27/7, 2017 at 19:23
2
Solved
After restarting a Kafka Connect S3 sink task, it restarted writing all the way from the beginning of the topic and wrote duplicate copies of older records. In other words, Kafka Connect seemed to ...
Traumatize asked 25/7, 2017 at 21:28
2
Produce to/Consume from Kafka in JSON. Save to HDFS in JSON using below properties :
key.converter=org.apache.kafka.connect.json.JsonConverter
value.converter=org.apache.kafka.connect.json.JsonCon...
Candytuft asked 21/11, 2016 at 11:57
1
I am using Confluent 3.2 in a set of Docker containers, one of which is running a kafka-connect worker.
For reasons yet unclear to me, two of my four connectors - to be specific, hpgraphsl's Mongo...
Wiggins asked 6/4, 2017 at 11:57
2
Solved
My KafkaProducer is able to use KafkaAvroSerializer to serialize objects to my topic. However, KafkaConsumer.poll() returns deserialized GenericRecord instead of my serialized class.
MyKafkaProduc...
Mickiemickle asked 21/9, 2016 at 1:9
1
Solved
I am learning Kafka recently.
What is the relationship between Kafka and Confluent?
Layard asked 31/1, 2017 at 10:39
1
Solved
I am new to kafka and I am curious about the Confluent platform. It seems that there are not many user stories on the Confluent platform. What are the differences between the Confluent platfo...
Curl asked 26/9, 2016 at 12:50
1
Solved
I'm writing an application with Kafka Streams (v0.10.0.1) and would like to enrich the records I'm processing with lookup data. This data (timestamped file) is written into a HDFS directory on dail...
Binny asked 2/9, 2016 at 14:38
2
Solved
Kafka itself is completely free and open source.
Confluent is the for profit company by the creators of Kafka. The Confluent Platform is Kafka plus various extras such as the schema registry and d...
Easterly asked 9/3, 2016 at 15:59
© 2022 - 2024 — McMap. All rights reserved.