RAID0 and pg_xlog

Started by Carlos Benkendorfover 20 years ago13 messagesgeneral
Jump to latest
#1Carlos Benkendorf
carlosbenkendorf@yahoo.com.br

Hi,

Does it make any sense to change the pg_xlog position if all my disks are configured in RAID level 0?

Thanks in advance!

Benkendorf

---------------------------------
Yahoo! Messenger com voz: PROMO��O VOC� PODE LEVAR UMA VIAGEM NA CONVERSA. Participe!

#2Jim Nasby
Jim.Nasby@BlueTreble.com
In reply to: Carlos Benkendorf (#1)
Re: RAID0 and pg_xlog

On Wed, Sep 07, 2005 at 12:47:43PM -0700, Qingqing Zhuo wrote:

Xlog will be the only believable data if your system crashed. So it is a dangerous practice to put xlog stuff in RAID0.

No more or less so than putting your main database on RAID0. If any
drive fails, you lose everything.
--
Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461

#3Scott Marlowe
smarlowe@g2switchworks.com
In reply to: Jim Nasby (#2)
Re: RAID0 and pg_xlog

On Wed, 2005-09-07 at 12:40, Jim C. Nasby wrote:

On Wed, Sep 07, 2005 at 12:47:43PM -0700, Qingqing Zhuo wrote:

Xlog will be the only believable data if your system crashed. So it is a dangerous practice to put xlog stuff in RAID0.

No more or less so than putting your main database on RAID0. If any
drive fails, you lose everything.

Sounds like a good place to have replication.

#4Welty, Richard
richard.welty@bankofamerica.com
In reply to: Scott Marlowe (#3)
Re: RAID0 and pg_xlog

Jim C. Nasby wrote:

No more or less so than putting your main database on RAID0. If any
drive fails, you lose everything.

perhaps it's time to start writing it [^r]A[^i]D 0 to try and make
the point.

richard

#5Qingqing Zhou
zhouqq@cs.toronto.edu
In reply to: Carlos Benkendorf (#1)
Re: RAID0 and pg_xlog

Xlog will be the only believable data if your system crashed. So it is a dangerous practice to put xlog stuff in RAID0.

Regards,
Qingqing
"Carlos Benkendorf" <carlosbenkendorf@yahoo.com.br> wrote in message news:20050903204532.70403.qmail@web35514.mail.mud.yahoo.com...
Hi,

Does it make any sense to change the pg_xlog position if all my disks are configured in RAID level 0?

Thanks in advance!

Benkendorf

------------------------------------------------------------------------------
Yahoo! Messenger com voz: PROMOÇÃO VOCÊ PODE LEVAR UMA VIAGEM NA CONVERSA. Participe!

#6Jim Nasby
Jim.Nasby@BlueTreble.com
In reply to: Scott Marlowe (#3)
Re: RAID0 and pg_xlog

On Wed, Sep 07, 2005 at 01:02:18PM -0500, Scott Marlowe wrote:

On Wed, 2005-09-07 at 12:40, Jim C. Nasby wrote:

On Wed, Sep 07, 2005 at 12:47:43PM -0700, Qingqing Zhuo wrote:

Xlog will be the only believable data if your system crashed. So it is a dangerous practice to put xlog stuff in RAID0.

No more or less so than putting your main database on RAID0. If any
drive fails, you lose everything.

Sounds like a good place to have replication.

If you used syncronous replication, maybe. Otherwise failure of any
drive means you just lost data. And remember that the more drives you
have in your array the more likely you'll have a failure in a given
time period.

Basically, if you can afford to setup replication on 2 machines with
RAID0 you can afford to setup RAID10 on one machine, which will usually
be a better bet.
--
Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461

#7Scott Marlowe
smarlowe@g2switchworks.com
In reply to: Jim Nasby (#6)
Re: RAID0 and pg_xlog

On Wed, 2005-09-07 at 16:15, Jim C. Nasby wrote:

On Wed, Sep 07, 2005 at 01:02:18PM -0500, Scott Marlowe wrote:

On Wed, 2005-09-07 at 12:40, Jim C. Nasby wrote:

On Wed, Sep 07, 2005 at 12:47:43PM -0700, Qingqing Zhuo wrote:

Xlog will be the only believable data if your system crashed. So it is a dangerous practice to put xlog stuff in RAID0.

No more or less so than putting your main database on RAID0. If any
drive fails, you lose everything.

Sounds like a good place to have replication.

If you used syncronous replication, maybe. Otherwise failure of any
drive means you just lost data. And remember that the more drives you
have in your array the more likely you'll have a failure in a given
time period.

Basically, if you can afford to setup replication on 2 machines with
RAID0 you can afford to setup RAID10 on one machine, which will usually
be a better bet.

Yeah, I was thinking pgpool here.

#8Jim Nasby
Jim.Nasby@BlueTreble.com
In reply to: Scott Marlowe (#7)
Re: RAID0 and pg_xlog

On Fri, Sep 09, 2005 at 09:43:56AM -0500, Scott Marlowe wrote:

On Wed, 2005-09-07 at 16:15, Jim C. Nasby wrote:

On Wed, Sep 07, 2005 at 01:02:18PM -0500, Scott Marlowe wrote:

On Wed, 2005-09-07 at 12:40, Jim C. Nasby wrote:

On Wed, Sep 07, 2005 at 12:47:43PM -0700, Qingqing Zhuo wrote:

Xlog will be the only believable data if your system crashed. So it is a dangerous practice to put xlog stuff in RAID0.

No more or less so than putting your main database on RAID0. If any
drive fails, you lose everything.

Sounds like a good place to have replication.

If you used syncronous replication, maybe. Otherwise failure of any
drive means you just lost data. And remember that the more drives you
have in your array the more likely you'll have a failure in a given
time period.

Basically, if you can afford to setup replication on 2 machines with
RAID0 you can afford to setup RAID10 on one machine, which will usually
be a better bet.

Yeah, I was thinking pgpool here.

pgpool is a connection pool; it has (almost) nothing to do with
replication. It certainly doesn't work to provide any kind of data
security on a RAID0 setup.

I'm not arguing against anything people have suggested, only pointing
out that if you're using RAID0 your data is not safe against a drive
failure, except possible using pgcluster (some would argue that
statement-based replication isn't as reliable as log-based).
--
Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461

#9Scott Marlowe
smarlowe@g2switchworks.com
In reply to: Jim Nasby (#8)
Re: RAID0 and pg_xlog

On Fri, 2005-09-09 at 18:16, Jim C. Nasby wrote:

On Fri, Sep 09, 2005 at 09:43:56AM -0500, Scott Marlowe wrote:

On Wed, 2005-09-07 at 16:15, Jim C. Nasby wrote:

On Wed, Sep 07, 2005 at 01:02:18PM -0500, Scott Marlowe wrote:

On Wed, 2005-09-07 at 12:40, Jim C. Nasby wrote:

On Wed, Sep 07, 2005 at 12:47:43PM -0700, Qingqing Zhuo wrote:

Xlog will be the only believable data if your system crashed. So it is a dangerous practice to put xlog stuff in RAID0.

No more or less so than putting your main database on RAID0. If any
drive fails, you lose everything.

Sounds like a good place to have replication.

If you used syncronous replication, maybe. Otherwise failure of any
drive means you just lost data. And remember that the more drives you
have in your array the more likely you'll have a failure in a given
time period.

Basically, if you can afford to setup replication on 2 machines with
RAID0 you can afford to setup RAID10 on one machine, which will usually
be a better bet.

Yeah, I was thinking pgpool here.

pgpool is a connection pool; it has (almost) nothing to do with
replication. It certainly doesn't work to provide any kind of data
security on a RAID0 setup.

I'm not arguing against anything people have suggested, only pointing
out that if you're using RAID0 your data is not safe against a drive
failure, except possible using pgcluster (some would argue that
statement-based replication isn't as reliable as log-based).

Um. No. It has a synchronous replication mode, which I've used, and it
works quite well.

Look it up, it's pretty cool. Writes to both pg machines synchronously,
reads from them load balanced. Of course, there are some limits imposed
by this methodology, re: things like random() and such.

Now, if you're arguing against statement based replication, that I can
understand. but pgpool can definitely do two box sync replication.

#10Jim Nasby
Jim.Nasby@BlueTreble.com
In reply to: Scott Marlowe (#9)
Re: RAID0 and pg_xlog

On Fri, Sep 09, 2005 at 06:20:21PM -0500, Scott Marlowe wrote:

pgpool is a connection pool; it has (almost) nothing to do with
replication. It certainly doesn't work to provide any kind of data
security on a RAID0 setup.

I'm not arguing against anything people have suggested, only pointing
out that if you're using RAID0 your data is not safe against a drive
failure, except possible using pgcluster (some would argue that
statement-based replication isn't as reliable as log-based).

Um. No. It has a synchronous replication mode, which I've used, and it
works quite well.

Look it up, it's pretty cool. Writes to both pg machines synchronously,
reads from them load balanced. Of course, there are some limits imposed
by this methodology, re: things like random() and such.

Now, if you're arguing against statement based replication, that I can
understand. but pgpool can definitely do two box sync replication.

Oh, I didn't realize that. Though I have to wonder why they duplicated
what pgcluster provides...
--
Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461

#11Scott Marlowe
smarlowe@g2switchworks.com
In reply to: Jim Nasby (#10)
Re: RAID0 and pg_xlog

On Fri, 2005-09-09 at 18:54, Jim C. Nasby wrote:

On Fri, Sep 09, 2005 at 06:20:21PM -0500, Scott Marlowe wrote:

pgpool is a connection pool; it has (almost) nothing to do with
replication. It certainly doesn't work to provide any kind of data
security on a RAID0 setup.

I'm not arguing against anything people have suggested, only pointing
out that if you're using RAID0 your data is not safe against a drive
failure, except possible using pgcluster (some would argue that
statement-based replication isn't as reliable as log-based).

Um. No. It has a synchronous replication mode, which I've used, and it
works quite well.

Look it up, it's pretty cool. Writes to both pg machines synchronously,
reads from them load balanced. Of course, there are some limits imposed
by this methodology, re: things like random() and such.

Now, if you're arguing against statement based replication, that I can
understand. but pgpool can definitely do two box sync replication.

Oh, I didn't realize that. Though I have to wonder why they duplicated
what pgcluster provides...

I doubt it's as good as pgcluster. It's simple dual machine sync
replication. I think it was a case of being 95% there when the pooling
part was done, so why not just toss in replication for good measure.

#12Tatsuo Ishii
t-ishii@sra.co.jp
In reply to: Scott Marlowe (#11)
Re: RAID0 and pg_xlog

On Fri, 2005-09-09 at 18:54, Jim C. Nasby wrote:

On Fri, Sep 09, 2005 at 06:20:21PM -0500, Scott Marlowe wrote:

pgpool is a connection pool; it has (almost) nothing to do with
replication. It certainly doesn't work to provide any kind of data
security on a RAID0 setup.

I'm not arguing against anything people have suggested, only pointing
out that if you're using RAID0 your data is not safe against a drive
failure, except possible using pgcluster (some would argue that
statement-based replication isn't as reliable as log-based).

Um. No. It has a synchronous replication mode, which I've used, and it
works quite well.

Look it up, it's pretty cool. Writes to both pg machines synchronously,
reads from them load balanced. Of course, there are some limits imposed
by this methodology, re: things like random() and such.

Now, if you're arguing against statement based replication, that I can
understand. but pgpool can definitely do two box sync replication.

Oh, I didn't realize that. Though I have to wonder why they duplicated
what pgcluster provides...

I doubt it's as good as pgcluster. It's simple dual machine sync
replication. I think it was a case of being 95% there when the pooling
part was done, so why not just toss in replication for good measure.

As a developer of pgpool I have to admit above. If it's technically
possible, why not chalenge it? That's a nature of an engineer:-)

BTW, some codes(probably the connection pooling part) in PGCluster
have been copied from pgpool. Instead I have been getting good
feedbacks/bug fixes from the author of PGCluster. It is kind of a
collaboration work, and I think this is one of the greatest thing with
open source softwares.
--
SRA OSS, Inc. Japan
Tatsuo Ishii

#13Tatsuo Ishii
t-ishii@sra.co.jp
In reply to: Scott Marlowe (#11)
Re: RAID0 and pg_xlog

On Fri, Sep 09, 2005 at 06:20:21PM -0500, Scott Marlowe wrote:

pgpool is a connection pool; it has (almost) nothing to do with
replication. It certainly doesn't work to provide any kind of data
security on a RAID0 setup.

I'm not arguing against anything people have suggested, only pointing
out that if you're using RAID0 your data is not safe against a drive
failure, except possible using pgcluster (some would argue that
statement-based replication isn't as reliable as log-based).

Um. No. It has a synchronous replication mode, which I've used, and it
works quite well.

Look it up, it's pretty cool. Writes to both pg machines synchronously,
reads from them load balanced. Of course, there are some limits imposed
by this methodology, re: things like random() and such.

Now, if you're arguing against statement based replication, that I can
understand. but pgpool can definitely do two box sync replication.

Oh, I didn't realize that. Though I have to wonder why they duplicated
what pgcluster provides...

I doubt it's as good as pgcluster. It's simple dual machine sync
replication. I think it was a case of being 95% there when the pooling
part was done, so why not just toss in replication for good measure.

As a developer of pgpool I have to admit above. If it's technically
possible, why not chalenge it? That's a nature of an engineer:-)

BTW, some codes(probably the connection pooling part) in PGCluster
have been copied from pgpool. Instead I have been getting good
feedbacks/bug fixes from the author of PGCluster. It is kind of a
collaboration work, and I think this is one of the greatest thing with
open source softwares.
--
SRA OSS, Inc. Japan
Tatsuo Ishii