Parallelizing PostgreSQL for Cluster

Started by Laurence Liewalmost 27 years ago11 messagesgeneral
Jump to latest
#1Laurence Liew
laurence@singnet.com.sg

Hi!

Is anyone looking at making postgreSQL scalable across a cluster of PCs?
That is, we have postgreSQL exuting queries which can be parallelised across
a cluster, either something along Informix's method of fragmenting the
tables across multiple disks, or Oracle's method of using a shared disk
(global file)architecture.

It would be interesting to have PostrgreSQL sitting on a Beowulf cluster
giving Informix XPS or Oracle OPS a run for their money :-)

Thanks for any info.

Laurence

#2The Hermit Hacker
scrappy@hub.org
In reply to: Laurence Liew (#1)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

One of the long-term projects that PostgreSQL, Inc is planning on working
on is exactly this, unless someone jumps at it before we get a chance
to...

On Thu, 3 Jun 1999, Laurence Liew wrote:

Hi!

Is anyone looking at making postgreSQL scalable across a cluster of PCs?
That is, we have postgreSQL exuting queries which can be parallelised across
a cluster, either something along Informix's method of fragmenting the
tables across multiple disks, or Oracle's method of using a shared disk
(global file)architecture.

It would be interesting to have PostrgreSQL sitting on a Beowulf cluster
giving Informix XPS or Oracle OPS a run for their money :-)

Thanks for any info.

Laurence

Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org

#3Dustin Sallings
dustin@spy.net
In reply to: The Hermit Hacker (#2)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

On Thu, 3 Jun 1999, The Hermit Hacker wrote:

# One of the long-term projects that PostgreSQL, Inc is planning on
# working on is exactly this, unless someone jumps at it before we get a
# chance to...

It should be a trivial change, right? :)

# On Thu, 3 Jun 1999, Laurence Liew wrote:
#
# > Hi!
# >
# > Is anyone looking at making postgreSQL scalable across a cluster of PCs?
# > That is, we have postgreSQL exuting queries which can be parallelised across
# > a cluster, either something along Informix's method of fragmenting the
# > tables across multiple disks, or Oracle's method of using a shared disk
# > (global file)architecture.
# >
# > It would be interesting to have PostrgreSQL sitting on a Beowulf cluster
# > giving Informix XPS or Oracle OPS a run for their money :-)
# >
# > Thanks for any info.
# >
# > Laurence
# >
# >
# >
# >
#
# Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
# Systems Administrator @ hub.org
# primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org
#
#
#

--
SA, beyond.com My girlfriend asked me which one I like better.
pub 1024/3CAE01D5 1994/11/03 Dustin Sallings <dustin@spy.net>
| Key fingerprint = 87 02 57 08 02 D0 DA D6 C8 0F 3E 65 51 98 D8 BE
L_______________________ I hope the answer won't upset her. ____________

#4Chris Bitmead
chris.bitmead@bigfoot.com
In reply to: Dustin Sallings (#3)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

Dustin Sallings wrote:

On Thu, 3 Jun 1999, The Hermit Hacker wrote:

# One of the long-term projects that PostgreSQL, Inc is planning on
# working on is exactly this, unless someone jumps at it before we get a
# chance to...

It should be a trivial change, right? :)

Will it make it into 6.5?

:)

Show quoted text

# On Thu, 3 Jun 1999, Laurence Liew wrote:
#
# > Hi!
# >
# > Is anyone looking at making postgreSQL scalable across a cluster of PCs?
# > That is, we have postgreSQL exuting queries which can be parallelised across
# > a cluster, either something along Informix's method of fragmenting the
# > tables across multiple disks, or Oracle's method of using a shared disk
# > (global file)architecture.
# >
# > It would be interesting to have PostrgreSQL sitting on a Beowulf cluster
# > giving Informix XPS or Oracle OPS a run for their money :-)
# >
# > Thanks for any info.
# >
# > Laurence
# >
# >
# >
# >
#
# Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
# Systems Administrator @ hub.org
# primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org
#
#
#

--
SA, beyond.com My girlfriend asked me which one I like better.
pub 1024/3CAE01D5 1994/11/03 Dustin Sallings <dustin@spy.net>
| Key fingerprint = 87 02 57 08 02 D0 DA D6 C8 0F 3E 65 51 98 D8 BE
L_______________________ I hope the answer won't upset her. ____________

#5The Hermit Hacker
scrappy@hub.org
In reply to: Chris Bitmead (#4)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

I'm CCng this back into the list, since this is probably something that is
on other ppls minds as well...

On Sat, 5 Jun 1999, Kaare Rasmussen wrote:

One of the long-term projects that PostgreSQL, Inc is planning on working
on is exactly this

Just curious: Will it still be Open Source, or will it be PostgreSQL,
Inc only?

I'm not on a religious quest here, just want to know, triggered by the
"Inc" in your answer.

PostgreSQL, Inc was formed to provide Commercial Support to those
requiring it...our long term goal is to provide funding for projects that
are slightly more involved (or less glamorous) then volunteers are
willing/able to provide. All code derived from such funding will *always*
be rolled back into the PostgreSQL cvs repository for everyone to use.

We are also looking at various trade journals to advertise, and,
eventually, want to be able to be able to setup booths at various
conferences...even do a BOF at Usenix...

Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org

#6Bruce Momjian
bruce@momjian.us
In reply to: The Hermit Hacker (#5)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

That should be clearer on the www.pgsql.com web page. I will add to the
FAQ.

I'm CCng this back into the list, since this is probably something that is
on other ppls minds as well...

On Sat, 5 Jun 1999, Kaare Rasmussen wrote:

One of the long-term projects that PostgreSQL, Inc is planning on working
on is exactly this

Just curious: Will it still be Open Source, or will it be PostgreSQL,
Inc only?

I'm not on a religious quest here, just want to know, triggered by the
"Inc" in your answer.

PostgreSQL, Inc was formed to provide Commercial Support to those
requiring it...our long term goal is to provide funding for projects that
are slightly more involved (or less glamorous) then volunteers are
willing/able to provide. All code derived from such funding will *always*
be rolled back into the PostgreSQL cvs repository for everyone to use.

We are also looking at various trade journals to advertise, and,
eventually, want to be able to be able to setup booths at various
conferences...even do a BOF at Usenix...

Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org

-- 
  Bruce Momjian                        |  http://www.op.net/~candle
  maillist@candle.pha.pa.us            |  (610) 853-3000
  +  If your life is a hard drive,     |  830 Blythe Avenue
  +  Christ can be your backup.        |  Drexel Hill, Pennsylvania 19026
#7M Simms
grim@argh.demon.co.uk
In reply to: The Hermit Hacker (#5)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

PostgreSQL, Inc was formed to provide Commercial Support to those
requiring it...our long term goal is to provide funding for projects that
are slightly more involved (or less glamorous) then volunteers are
willing/able to provide. All code derived from such funding will *always*
be rolled back into the PostgreSQL cvs repository for everyone to use.

It is a pity that postgresql is not released under the GPL, as that would
ensure all future versions MUST be free, as compared to the current
licence that (as far as I am aware, Im no lawyer) only requires that
versions released free stay free.

#8Dustin Sallings
dustin@spy.net
In reply to: M Simms (#7)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

On Sun, 6 Jun 1999, M Simms wrote:

// It is a pity that postgresql is not released under the GPL, as that
// would ensure all future versions MUST be free, as compared to the
// current licence that (as far as I am aware, Im no lawyer) only
// requires that versions released free stay free.

Please let us not get into this. There are those who think GPL is
good, and there are those who think freedom shouldn't be forced upon
people. Those of us who don't like the GPL are quite happy to find
software not released under it.

--
Principal Member Technical Staff, beyond.com The world is watching America,
pub 1024/3CAE01D5 1994/11/03 Dustin Sallings <dustin@spy.net>
| Key fingerprint = 87 02 57 08 02 D0 DA D6 C8 0F 3E 65 51 98 D8 BE
L______________________________________________ and America is watching TV. __

#9The Hermit Hacker
scrappy@hub.org
In reply to: M Simms (#7)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

On Sun, 6 Jun 1999, M Simms wrote:

PostgreSQL, Inc was formed to provide Commercial Support to those
requiring it...our long term goal is to provide funding for projects that
are slightly more involved (or less glamorous) then volunteers are
willing/able to provide. All code derived from such funding will *always*
be rolled back into the PostgreSQL cvs repository for everyone to use.

It is a pity that postgresql is not released under the GPL, as that would
ensure all future versions MUST be free, as compared to the current
licence that (as far as I am aware, Im no lawyer) only requires that
versions released free stay free.

Ya, its such a pity *NAWT* There is a reason why ppl like Netscape
(Mozilla?), SUN, SGI, etc are all creating their own "open source" license
and not fallign under GPL...

GPL is as far left as BSD is right. There is *nobody* that is going to
convince me that the GPL is anything but "the Devil's license"...unless
everyone of the PostgreSQL developers falls behind someone trying to
"commercialize" PostgreSQL, the best they will get is the code...they
won't get the knowledge base to go along with it.

Bruce, Vadim, Thomas and I have been with this since day one, which has
been almost 4 years now. If you watch -hackers, you'll see any one of us
popping up periodically admitting to not knowing areas of the code that
others do. I pity anyone diving in without a very very large learning
curve...

Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org

#10The Hermit Hacker
scrappy@hub.org
In reply to: Bruce Momjian (#6)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

Point taken...I've re-worded/expanded it slightly into a Mission Statement
(http://www.pgsql.com/mission-statement.html)...I&quot;m not an Business major,
so expect that it will get re-worded, but the general "gist" of it will
remain pretty much the same...

On Sat, 5 Jun 1999, Bruce Momjian wrote:

That should be clearer on the www.pgsql.com web page. I will add to the
FAQ.

I'm CCng this back into the list, since this is probably something that is
on other ppls minds as well...

On Sat, 5 Jun 1999, Kaare Rasmussen wrote:

One of the long-term projects that PostgreSQL, Inc is planning on working
on is exactly this

Just curious: Will it still be Open Source, or will it be PostgreSQL,
Inc only?

I'm not on a religious quest here, just want to know, triggered by the
"Inc" in your answer.

PostgreSQL, Inc was formed to provide Commercial Support to those
requiring it...our long term goal is to provide funding for projects that
are slightly more involved (or less glamorous) then volunteers are
willing/able to provide. All code derived from such funding will *always*
be rolled back into the PostgreSQL cvs repository for everyone to use.

We are also looking at various trade journals to advertise, and,
eventually, want to be able to be able to setup booths at various
conferences...even do a BOF at Usenix...

Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org

-- 
Bruce Momjian                        |  http://www.op.net/~candle
maillist@candle.pha.pa.us            |  (610) 853-3000
+  If your life is a hard drive,     |  830 Blythe Avenue
+  Christ can be your backup.        |  Drexel Hill, Pennsylvania 19026

Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org

#11Kaare Rasmussen
kar@webline.dk
In reply to: M Simms (#7)
Re: [GENERAL] Parallelizing PostgreSQL for Cluster

It is a pity that postgresql is not released under the GPL, as that would
ensure all future versions MUST be free, as compared to the current
licence that (as far as I am aware, Im no lawyer) only requires that
versions released free stay free.

I had hoped to stay away from religious debates. Postgresql is free and
that's good. Let's keep it at that.