suggestion the process to sync the data from PROD DB to Staging environment

Started by postgann2020 salmost 6 years ago7 messagesgeneral
Jump to latest
#1postgann2020 s
postgann2020@gmail.com

Hi Team,

Thanks for your support.

Could someone please suggest the process to *sync the data from PROD DB to
the Staging environment* with minimal manual intervention or automatically.

Thanks & Regards,
Postgann.

#2Luan Huynh
nnhluan@gmail.com
In reply to: postgann2020 s (#1)
Re: suggestion the process to sync the data from PROD DB to Staging environment

Hi Postgann,

How frequently do you sync *hourly/daily/weekly*? Do you have other
processes writing data into Staging env?

Regards,

On Wed, May 27, 2020 at 5:56 PM postgann2020 s <postgann2020@gmail.com>
wrote:

Show quoted text

Hi Team,

Thanks for your support.

Could someone please suggest the process to *sync the data from PROD DB
to the Staging environment* with minimal manual intervention or
automatically.

Thanks & Regards,
Postgann.

#3postgann2020 s
postgann2020@gmail.com
In reply to: Luan Huynh (#2)
Re: suggestion the process to sync the data from PROD DB to Staging environment

Hi Luan,

Thanks for your email.

How frequently do you sync *hourly/daily/weekly*? > looking for a daily
basis.
Do you have other processes writing data into Staging env? > Yes, we have
old PROD data.

Thanks & Regards,
Postgann.

On Wed, May 27, 2020 at 9:33 PM Luan Huynh <nnhluan@gmail.com> wrote:

Show quoted text

Hi Postgann,

How frequently do you sync *hourly/daily/weekly*? Do you have other
processes writing data into Staging env?

Regards,

On Wed, May 27, 2020 at 5:56 PM postgann2020 s <postgann2020@gmail.com>
wrote:

Hi Team,

Thanks for your support.

Could someone please suggest the process to *sync the data from PROD DB
to the Staging environment* with minimal manual intervention or
automatically.

Thanks & Regards,
Postgann.

#4David G. Johnston
david.g.johnston@gmail.com
In reply to: postgann2020 s (#1)
Re: suggestion the process to sync the data from PROD DB to Staging environment

On Wed, May 27, 2020 at 8:56 AM postgann2020 s <postgann2020@gmail.com>
wrote:

Could someone please suggest the process to *sync the data from PROD DB
to the Staging environment* with minimal manual intervention or
automatically.

Read up on the general purpose "bash" scripting language, the PostgreSQL
"pg_dump" and "pg_restore" commands, "ssh", and "cron".

"cron" and "bash" provide for the "automatically" requirement.

It is possible to assemble something functional with those tools. Whether
it will actually work in your specific situation is impossible to say since
you provide zero information about your environment.

David J.

#5postgann2020 s
postgann2020@gmail.com
In reply to: David G. Johnston (#4)
Re: suggestion the process to sync the data from PROD DB to Staging environment

Thanks, David,

Please find the environment details.

Environment:
PROD:
OS: RHEL 7.1
Postgres: 9.5.15

Staging:
OS: RHEL 7.1
Postgres: 9.5.15

Thanks&Regards,
PostgAnn.

On Wed, May 27, 2020 at 9:51 PM David G. Johnston <
david.g.johnston@gmail.com> wrote:

Show quoted text

On Wed, May 27, 2020 at 8:56 AM postgann2020 s <postgann2020@gmail.com>
wrote:

Could someone please suggest the process to *sync the data from PROD DB
to the Staging environment* with minimal manual intervention or
automatically.

Read up on the general purpose "bash" scripting language, the PostgreSQL
"pg_dump" and "pg_restore" commands, "ssh", and "cron".

"cron" and "bash" provide for the "automatically" requirement.

It is possible to assemble something functional with those tools. Whether
it will actually work in your specific situation is impossible to say since
you provide zero information about your environment.

David J.

#6David G. Johnston
david.g.johnston@gmail.com
In reply to: postgann2020 s (#5)
Re: suggestion the process to sync the data from PROD DB to Staging environment

On Wed, May 27, 2020 at 9:31 AM postgann2020 s <postgann2020@gmail.com>
wrote:

Thanks, David,

Please find the environment details.

Environment:
PROD:
OS: RHEL 7.1
Postgres: 9.5.15

Staging:
OS: RHEL 7.1
Postgres: 9.5.15

Ok...not particularly helpful though I do see you are not keeping up with
minor and major releases.

Maybe the terms metrics and goals would have been better...like how big is
the database and what kind of network do the two machines exist in and how
would they communicate data from one to the other...

David J.

#7soumitra bhandary
soumitra.bhandary@hotmail.com
In reply to: postgann2020 s (#1)
Re: suggestion the process to sync the data from PROD DB to Staging environment

If possible you can connect staging server as asynchronous slave node to one of the asynchronous node already in production

Sent from my iPhone

On 27-May-2020, at 9:26 PM, postgann2020 s <postgann2020@gmail.com> wrote:


Hi Team,

Thanks for your support.

Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Thanks & Regards,
Postgann.