Moving data from S3 -> RDS using AWS Glue
Asked Answered
D

1

6

Does AWS Glue provide ability to move data from S3 bucket to RDS database?

I'm trying to setup serverless app that picks up dynamic data uploaded to S3 and migrates it to RDS.

Glue provides Crawlers service that determines schema.

Glue also provides ETL Jobs, but this seems to be where target source is only another S3 bucket.

Any ideas?

Departmentalism answered 11/3, 2019 at 3:33 Comment(1)
This article seems to suggest it is possible to send output to RDS: Connecting to and running ETL jobs across multiple VPCs using a dedicated AWS Glue VPC | AWS Big Data BlogKorwun
T
7

Yes, Glue can send to an RDS datastore. If you are using the job wizard it will give you a target option of "JDBC". If you select JDBC you can setup a connection to your rds instance.

JDBC connection window RDS option window

Terryl answered 21/3, 2019 at 4:29 Comment(1)
It would be great if you would show how to do this in an ETL script rather than just point us to the wizard.Sibyls

© 2022 - 2024 — McMap. All rights reserved.