Is it possible to work with big databases (up to 10Gb) under Postgres?

Started by Ivan Babikovover 24 years ago6 messagesgeneral
Jump to latest
#1Ivan Babikov
iab@qms.e-burg.ru

Hello All!

Maybe this is one of those typical questions, but I have heard people
complaining that Postgres is just for quite small bases, less than 2Gb.

Now, we have to choose a free database engine for an inexpensive branch of
our project and Interbase looks better in sense of capability to work with
quite big bases (up to 10-20Gb). I am not sure that Postgres will work fine
with databases greater than 10Gb. What does All think of it?

Thanks in advance, Ivan Babikoff.

#2Andrew Snow
andrew@modulus.org
In reply to: Ivan Babikov (#1)
RE: Is it possible to work with big databases (up to 10Gb) under Postgres?

I believe if you throw decent hardware at it (the sort of hardware you
need to throw at 10GB database to make it perform well) then it is
definitely worth giving it a go.

Show quoted text

-----Original Message-----
From: pgsql-general-owner@postgresql.org
[mailto:pgsql-general-owner@postgresql.org] On Behalf Of Ivan Babikov
Sent: Monday, 20 August 2001 9:06 PM
To: pgsql-general@postgresql.org
Subject: [GENERAL] Is it possible to work with big databases
(up to 10Gb) under Postgres?

Hello All!

Maybe this is one of those typical questions, but I have
heard people complaining that Postgres is just for quite
small bases, less than 2Gb.

Now, we have to choose a free database engine for an
inexpensive branch of our project and Interbase looks better
in sense of capability to work with quite big bases (up to
10-20Gb). I am not sure that Postgres will work fine with
databases greater than 10Gb. What does All think of it?

Thanks in advance, Ivan Babikoff.

---------------------------(end of
broadcast)---------------------------
TIP 4: Don't 'kill -9' the postmaster

#3Andrew Gould
andrewgould@yahoo.com
In reply to: Ivan Babikov (#1)
Re: Is it possible to work with big databases (up to 10Gb) under Postgres?

Hi Ivan!

Well, I don't have a 10 Gb database _yet_; but my
server manages 3 databases that currently total over
17 Gb without a problem. (Also, linking tables from
different databases by querying via ODBC and MS Access
works like a charm!)

I used MySQL for a while; and considered Interbase. I
moved from MySQL because you can't update one table
using data from another table via the standard update
SQL statement in MySQL.

I never went the Interbase route because at that time:
1. It only imported fixed-length text tables; and 2.
The email list I joined seemed dead. Things may have
changed since then.

The online documentation for PostgreSQL has been very
helpful; and the support on this email list is very
good.

I hope this helps,

Andrew Gould

--- Ivan Babikov <iab@qms.e-burg.ru> wrote:

Hello All!

Maybe this is one of those typical questions, but I
have heard people
complaining that Postgres is just for quite small
bases, less than 2Gb.

Now, we have to choose a free database engine for an
inexpensive branch of
our project and Interbase looks better in sense of
capability to work with
quite big bases (up to 10-20Gb). I am not sure that
Postgres will work fine
with databases greater than 10Gb. What does All
think of it?

Thanks in advance, Ivan Babikoff.

__________________________________________________
Do You Yahoo!?
Make international calls for as low as $.04/minute with Yahoo! Messenger
http://phonecard.yahoo.com/

#4Justin Clift
justin@postgresql.org
In reply to: Ivan Babikov (#1)
Re: Is it possible to work with big databases (up to 10Gb) under Postgres?

Hi Ivan,

I was running a database with ~27GB of info (admittedly in large, very
simple tables) on PostgreSQL 7.0.3 a while ago for a few months.

Didn't have any real problems with it, apart from having to accept that
a lot of data takes time to process. :-/

Regards and best wishes,

Justin Clift

Ivan Babikov wrote:

Hello All!

Maybe this is one of those typical questions, but I have heard people
complaining that Postgres is just for quite small bases, less than 2Gb.

Now, we have to choose a free database engine for an inexpensive branch of
our project and Interbase looks better in sense of capability to work with
quite big bases (up to 10-20Gb). I am not sure that Postgres will work fine
with databases greater than 10Gb. What does All think of it?

Thanks in advance, Ivan Babikoff.

---------------------------(end of broadcast)---------------------------
TIP 4: Don't 'kill -9' the postmaster

--
"My grandfather once told me that there are two kinds of people: those
who work and those who take the credit. He told me to try to be in the
first group; there was less competition there."
- Indira Gandhi

#5Jim Buttafuoco
jim@spectrumtelecorp.com
In reply to: Andrew Gould (#3)
Re: Is it possible to work with big databases (up to 10Gb) under Postgres?

Ivan,

I have 2 databases that are about 400GB each. Some of the tables have
over 60 Million rows. The problem area's that I see are vacuum's,
reindexing, dumps and upgrades.

Speed doesn't seem to be an issue for me. The application was converted
from Oracle. An application transaction hit between 10 to 20 tables.
Most transactions execute under 1 second.

The systems are Intel P3 500's running RedHat 6.2 with 600G of disk
space and 512M of Ram.

Hope this helps.

Let me know if you need any more info

Jim

Hello All!

Maybe this is one of those typical questions, but I have heard people
complaining that Postgres is just for quite small bases, less than

2Gb.

Now, we have to choose a free database engine for an inexpensive

branch of

our project and Interbase looks better in sense of capability to work

with

quite big bases (up to 10-20Gb). I am not sure that Postgres will work

fine

with databases greater than 10Gb. What does All think of it?

Thanks in advance, Ivan Babikoff.

---------------------------(end of

broadcast)---------------------------

Show quoted text

TIP 4: Don't 'kill -9' the postmaster

#6Vivek Khera
khera@kcilink.com
In reply to: Jim Buttafuoco (#5)
Re: Is it possible to work with big databases (up to 10Gb) under Postgres?

"JB" == Jim Buttafuoco <jim@spectrumtelecorp.com> writes:

JB> from Oracle. An application transaction hit between 10 to 20 tables.
JB> Most transactions execute under 1 second.

JB> The systems are Intel P3 500's running RedHat 6.2 with 600G of disk
JB> space and 512M of Ram.

What kind of performance tuning did you do? Most interesting to me
would be your SHM and SEM kernel settings, and your postgres tuning
parameters (max connections, max memory, etc.)

--
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Vivek Khera, Ph.D. Khera Communications, Inc.
Internet: khera@kciLink.com Rockville, MD +1-240-453-8497
AIM: vivekkhera Y!: vivek_khera http://www.khera.org/~vivek/