pg_receivewal/xlog to ship wal to cloud

Or downloading from cloud experience?

neslişah demirci <neslisah.demirci@gmail.com>, 18 Tem 2022 Pzt, 15:55
tarihinde şunu yazdı:

Hi all,

Wondering if anyone has any experience of using pg_receivewal/xlog to ship
wal files to GCP/S3?

Could you please share ideas or issues you had?

Thanks.

--
Best,
Neslisah

On Mon, 2022-07-18 at 15:55 -0400, neslişah demirci wrote:

Hi all, 

Wondering if anyone has any experience of using pg_receivewal/xlog
to ship wal files to GCP/S3?

I use archive_command to send WAL to S3. It works fine. I do gzip
them before uploading, as they are usually pretty compressible.

I use a lifecycle rule on the bucket to automatically delete ones
older than I might need.

It's not the fastest process in the world, and replay on our
reporting server does occasionally fall behind, but I think that's
true of WAL replay in general as a serialized process.

On Tue, 19 Jul 2022, 2:09 am Alan Hodgson, <ahodgson@lists.simkin.ca> wrote:

On Mon, 2022-07-18 at 15:55 -0400, neslişah demirci wrote:

Hi all,

Wondering if anyone has any experience of using pg_receivewal/xlog
to ship wal files to GCP/S3?

I use archive_command to send WAL to S3. It works fine. I do gzip
them before uploading, as they are usually pretty compressible.

I use a lifecycle rule on the bucket to automatically delete ones
older than I might need.

It's not the fastest process in the world, and replay on our
reporting server does occasionally fall behind, but I think that's
true of WAL replay in general as a serialized process.

Have a look at this also.

https://supabase.com/blog/2020/08/02/continuous-postgresql-backup-walg