Is there anyway to write data to multiple tables of redshift using a single firehose delivery stream
Asked Answered
D

1

10

I am passing some json data to firehose delivery stream which in the end is getting saved into Redshift table. For my use case, I want the data to be stored in different tables.

Do I create different delivery stream for different tables? If I create it that way, there will be data duplication in S3 as the data must go through S3 in order to push data to Redshift using Firehose delivery stream.

Dialectician answered 27/4, 2016 at 6:25 Comment(0)
L
12

From the Kinesis Firehose FAQ:

Q: Can a single delivery stream deliver data to multiple Amazon Redshift clusters or tables?

A single delivery stream can only deliver data to one Amazon Redshift cluster and one table currently. If you want to have data delivered to multiple Redshift clusters or tables, you can create multiple delivery streams.

You will need multiple streams.

Loiretcher answered 27/4, 2016 at 14:40 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.