Stream : describe ammas; Field | Type ------------------------------------- ROWTIME | BIGINT (system) ROWKEY | VARCHAR(STRING) (system) ID | INTEGER -----------------------------------...

We're trying to use AWS MSK (managed Kafka), and we want to use AWS GLUE Schema registry with AVRO rather than Confluent Schema Registry. We have brought up KSQLDB, and connected that to MSK, but i...

We have a "microservices" platform and we are using debezium for change data capture from databases on these platforms which is working nicely. Now, we'd like to make it easy for us to jo...

Step 1: Create table I currently have a table in KSQL which created by CREATE TABLE cdc_window_table WITH (KAFKA_TOPIC='cdc_stream', VALUE_FORMAT='JSON') AS SELECT after->application_id AS app...

Is it possible to use KSQL to not only count entries of a specific column via GROUP BY but instead get an aggregate over all the entries that stream through the application? I'm searching for some...

I'm running ksqldb-server from a docker-compor found here https://ksqldb.io/quickstart.html#quickstart-content My kafka bootstrap server is running on the same VM in standard alone mode. I ca...

Does anyone have any idea if AWS MSK (Managed Streaming for Kafka) supports KSQL? I have seen many videos and documentations for KSQL on confluent platform but not for AWS MSK. Please let me know i...

I'm processing a large volume of Kafka messages in .NET with a Kafka consumer at the moment. Step 1 in my processing is to Parse the JSON and to discard many of the messages based on the value of ...

I am trying to group events by one of its properties and over time using the KSQL Windowed Aggregation, specifically the Session Window. I have a STREAM made from a kafka topic with the TIMESTAMP ...

I know , in KSQL we can set offset to earliest or latest But can we get data from specific time period i.e I need to get data inserted to a topic from 06-May-2020 ?

Suppose I have different values for a same message key. For example: { userid: 1, email: [email protected] } { userid: 1, email: [email protected] } { userid: 1, email: [email p...

I am passing a long JSON String to kafka topic eg: { "glossary": { "title": "example glossary", "GlossDiv": { "title": "S", "GlossList": { "GlossEntry": { "ID": "SGML", "SortAs": "SGML", ...

So I have... 1st topic that has general application logs (log4j). Stores things like HTTP API requests/responses and warnings, exceptions etc... There can be multiple logs associated to one logic...

I am trying to create a stream in Apache/KAFKA KSQL The topic contains (somewhat complex JSON) { "agreement_id": "dd8afdbe-59cf-4272-b640-b14a24d8234c", "created_at": "2018-02-17 16:00:00.000Z",...

I'm a new bee to ksql. I'm just playing with read kafka topics to streams and it works great. Also, trying to create a table from kafka topic and failed. Realized that I need to have a key set in...

maybe this is a beginner question but what is the recommended way to read data produced in KSQL? Let's assume I do some stream processing and write the data to a KSQL table. Now I want to access t...