Postgresql CDC tool recommendations ?

On Oct 5, 2017, at 10:28 AM, avi Singh <avisingh19811981@gmail.com> wrote:

Guys
Any recommendation on a good CDC tool that can be used to push postgresql changes to Kafka in json format ?

Not sure whether json is a constraint, but I'd look at http://debezium.io and (maybe) the no longer supported https://github.com/confluentinc/bottledwater-pg

Cheers,
Steve

--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general

On Thu, Oct 05, 2017 at 10:28:31AM -0700, avi Singh wrote:

Any recommendation on a good CDC tool that can be used to push
postgresql changes to Kafka in json format ?

There are quite a few WAL->JSON type tools out there. E.g.,
https://github.com/eulerto/wal2json

I expect this to improve with PG 10 logical replication.

You can easily add the bit that pushes those JSON texts to Kafka.

Nico
--

--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general