[Fwd: Maximum filesize of one file]
I have a 40 million record database (about 40GB and growing) and I
notice that some of my multicolumn indices are beginning to approach
2GB on disk.Will there be any problems spanning the 32 bit limit here (a la tables
in version 6.4)?
Please refer to the attached messages from linux-raid@vger.rutgers.edu.
CN
Dear CN,
Yes, thanks for you message. I am well aware of the
32 bit=2GB limitation in the ext2fs.
Currently, pgsql 6.5.x breaks up the files containing
tables into roughly 1 GB chunks. My question is: will
pgsql do the same for the files containing the indices?
Correction to info in my previous post: my index files are
approaching 1GB not 2GB.
--Martin
CN Liu wrote on Mon, 16 Aug 1999 11:47:11 +0800
This is a multi-part message in MIME format.
--------------01A497728CDC1E265B4A5A80
Content-Type: text/plain; charset=big5
Content-Transfer-Encoding: 7bitI have a 40 million record database (about 40GB and growing) and I
notice that some of my multicolumn indices are beginning to approach
2GB on disk.Will there be any problems spanning the 32 bit limit here (a la tables
in version 6.4)?Please refer to the attached messages from linux-raid@vger.rutgers.edu.
CN
[SNIP . . .]
===========================================================================
Martin Weinberg Phone: (413) 545-3821
Dept. of Physics and Astronomy FAX: (413) 545-2117/0648
530 Graduate Research Tower
University of Massachusetts
Amherst, MA 01003-4525
Dear CN,
Yes, thanks for you message. I am well aware of the
32 bit=2GB limitation in the ext2fs.Currently, pgsql 6.5.x breaks up the files containing
tables into roughly 1 GB chunks. My question is: will
pgsql do the same for the files containing the indices?Correction to info in my previous post: my index files are
approaching 1GB not 2GB.
I think so.
--
Bruce Momjian | http://www.op.net/~candle
maillist@candle.pha.pa.us | (610) 853-3000
+ If your life is a hard drive, | 830 Blythe Avenue
+ Christ can be your backup. | Drexel Hill, Pennsylvania 19026
On Mon, 16 Aug 1999, Martin Weinberg wrote:
Currently, pgsql 6.5.x breaks up the files containing
tables into roughly 1 GB chunks. My question is: will
pgsql do the same for the files containing the indices?
It should do, as it's the StorageManager that does the splitting, and
tables/indices both use the StorageManager.
This also includes the current LargeObject implementation, as they are
currently implemented as a table/index pair.
--
Peter T Mount peter@retep.org.uk
Main Homepage: http://www.retep.org.uk
PostgreSQL JDBC Faq: http://www.retep.org.uk/postgres
Java PDF Generator: http://www.retep.org.uk/pdf
Bruce Momjian wrote on Mon, 16 Aug 1999 14:24:57 EDT
[. . .]
Currently, pgsql 6.5.x breaks up the files containing
tables into roughly 1 GB chunks. My question is: will
pgsql do the same for the files containing the indices?Correction to info in my previous post: my index files are
approaching 1GB not 2GB.I think so.
Peter Mount wrote on Mon, 16 Aug 1999 14:37:06 EDT
It should do, as it's the StorageManager that does the splitting, and
tables/indices both use the StorageManager.This also includes the current LargeObject implementation, as they are
currently implemented as a table/index pair.
I build a large database and index to test this and, yes, indeed
it *DOES WORK*.
Thanks to Peter Mount and Bruce Momjian for their quick replies
and info.
I will be contructing 100 GB database in the next few weeks. I
try to post some scaling stats when it's up and running.
--Martin
===========================================================================
Martin Weinberg Phone: (413) 545-3821
Dept. of Physics and Astronomy FAX: (413) 545-2117/0648
530 Graduate Research Tower
University of Massachusetts
Amherst, MA 01003-4525