Are there logical decoding plug-ins available for Cloud SQL PostgreSQL?
Asked Answered
D

3

8

I'm facing the following situation:

I have to do a logical replication of my Cloud SQL PostgreSQL instance to an external PostgreSQL database and vice-versa. More specifically, the CloudSQL and the external instance will contain some master and slave tables that must be replicated between each database. However, PostgreSQL logical and external replication are currently not supported by the GCP.

Since it is not supported, I've searched for an alternative, and I noticed that Debezium + Kafka can be used with CloudSQL MySQL to capture database changes and do logical replication. I asked the same question on the Debezium google group (link below) https://groups.google.com/forum/#!topic/debezium/yS61un46x8k

And they've answered to me:
"Debezium requires a specific logical decoding plug-in (either ProtoBufs or wal2json) installed within the source Postgres, I'm not sure whether you have that flexibility with your cloud SQL provider (but e.g. on Amazon RDS, wal2json is installed by default)."

Can anybody answer me if one of these plugins are available or can be installed within Cloud SQL PostgreSQL? If not, are there any alternative approach for logical replication while it is not supported by the platform? Thanks in advance.

Delighted answered 21/6, 2018 at 14:28 Comment(1)
I have the same issue. Is there anyway to do this?Trajectory
T
1

Cloud SQL Postgres does not support logical replication right now. You also have no way to use Debezium + Kafka because of missing logical replication.

I have to migrate from Cloud SQL Postgres to on-premises Postgres.

Trajectory answered 11/12, 2019 at 15:27 Comment(0)
C
1

Took them a long time, but is supported now

https://cloud.google.com/sql/docs/postgres/replication/configure-logical-replication

Chantress answered 7/6, 2021 at 2:52 Comment(0)
V
1

All major cloud vendors support the below plugins:

  • pgoutput
  • wal2json
  • test_decoding
  • pglogical (this is a Postgres extension)
Venose answered 5/3, 2023 at 9:21 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.