I have this exception in the consumer when trying to cast the record.value() into java object : ClassCastException: class org.apache.avro.generic.GenericData$Record cannot be cast to class [...].Pu...

I am building a Kafka Listener / Consumer with Spring Boot that consumes Avro data from a topic. Here's some of the properties spring.kafka.properties.specific.avro.reader=true spring.kafka.consume...

I'm writing a consumer which listens to a Kafka topic and consumes message whenever message is available. I've tested the logic/code by running Kafka locally and it's working fine. While writing ...

I'm using Kafka schema registry for producing/consuming Kafka messages, for example I have two fields they are both string type, the pseudo schema as following： {"name": "test1", "type": "string"}...

I'm using a Kafka Source in Spark Structured Streaming to receive Confluent encoded Avro records. I intend to use Confluent Schema Registry, but the integration with spark structured streaming seem...

I have been trying to deploy Kafka with schema registry locally using Kubernetes. However, the logs of the schema registry pod show this error message: ERROR Server died unexpectedly: (io.confluen...

We have been using Confluent Schema Registry with KafkaStreams for over a year now and everything has been working well; until yesterday. In an UAT environment we seem to have had a Schema subject...

I am using Kafka streams to read and process protobuf messages. I am using the following properties for the stream: Properties properties = new Properties(); properties.put(ConsumerConfig.GROUP_...

While adding dependencies for confluent kafka in build gradle file, its unable to resolve it. compile group: 'io.confluent', name: 'kafka-avro-serializer', version: '4.0.0' compile group: 'io.c...

I have installed confluent platform in Ubuntu 16.04 machine and initially i have configured zookeeper, Kafka and ksql and started confluent platform. i am able to see the below message. root@DE...

I have created the below test class to produce an event using AvroSerializer. @SpringBootTest @EmbeddedKafka(partitions = 1, brokerProperties = { "listeners=PLAINTEXT://localhost:9092", &...

Kafka schema-registry provides a nice way to serialize and deserialize the data from Kafka using common data contract. However, the data contract (.avsc file) is the glue between the producer and c...

I have a sink connector with the following configuration { "name": "sink-test-mariadb-MY_TOPIC", "config": { "connector.class":"io.confluent.connect.jdbc.JdbcSinkConnector", "tasks.max":"10",...

I'm running Kafka schema registry version 5.5.2, and trying to register a schema that contains a reference to another schema. I managed to do this when the referenced schema was in the same package...

A number of API/microservices provide access to critical resources including Kafka topics. The API/microservice messages are validated using an OpenAPI specification that defines the API/microservi...

I have the following configuration for my Kafka Stream application Properties config = new Properties(); config.put(StreamsConfig.APPLICATION_ID_CONFIG,this.applicaionId); config.put(StreamsCo...

We are planning to use AWS MSK service for Managed Kafka and Schema Registry and Kafka Connect services from Confluent together to run our connectors (Elasticsearch Sink Connector). We have planned...

I read Docker (Compose) client connects to Kafka too early, but it doesn't give which command to check. How should I configure my kafka broker so it retries when zookeeper is not ready? and my sche...

I am trying to read data from a kafka avro topic using the avro schema from the confluent client registry. I am using io.confluent library version 5.4.1. This is the entry in the gradle file compi...

Getting exception while reading from kafka topic: Caused by: org.apache.kafka.common.errors.SerializationException: Error deserializing Avro message for id 1 Caused by: org.apache.kafka.common...

For supporting schema registry on my MSK topic, I found two options - AWS Glue Schema Registry; and Confluent Schema Registry Since, Glue SR is fully managed by AWS, I would prefer to use that. H...

I'm evaluating kinesis as replacement for kafka. One of the things I'm missing is Schema registry equivalent solution. In particular I need: schema upgrade - validate compatibility with the previ...

I have found some code here https://learn.microsoft.com/en-us/azure/hdinsight/hdinsight-dotnet-avro-serialization#Scenario2 that does the reverse of what I need: //Define the schema in JSON const ...

Trying to publish the json message on topic using schema registry but getting below error. followingspring boot approach .. The configuration 'schema.registry.url' was supplied but isn't a known co...

I have a spring boot application with some kafka providers/consumers and some integration tests(using embedded kafka) for them. Everything worked fine, until i have lifted the spring boot version t...