How many billion rows of data I can store in PostgreSQL RDS.

Started by github kranabout 7 years ago7 messagesgeneral
Jump to latest
#1github kran
githubkran@gmail.com

Hello Pgsql-General,

We have currently have around 6 TB of data and have plans to move some
historic datainto RDS of about close to 1 TB of data. The total rows in
partitioned tables is around 6 billion rows today and have plans to keep
the data long term which would be around 5-8 billion rows per year.

So i short my use case is to keep data of 8 billion rows of data every year
and store atleast 16 billion of rows for every 2 years.

1. How many billion rows does RDS handle ?. This data would be exposed
by AP's accessing this data.

Appreciate you reply on this.
Thank you.

#2Adrian Klaver
adrian.klaver@aklaver.com
In reply to: github kran (#1)
Re: How many billion rows of data I can store in PostgreSQL RDS.

On 2/21/19 9:08 PM, github kran wrote:

Hello Pgsql-General,

We have currently have around 6 TB of data and have plans to move some
historic datainto RDS of about close to 1 TB of data. The total rows in
partitioned tables is around 6 billion rows today and have plans to keep
the data long term which would be around 5-8 billion rows per year.

So i short my use case is to keep data of 8 billion rows of data every
year and store atleast 16 billion of rows for every 2 years.

1. How many billion rows does RDS handle ?. This data would be exposed
by AP's accessing this data.

Appreciate you reply on this.

This would be a question for AWS RDS support.

Thank you.

--
Adrian Klaver
adrian.klaver@aklaver.com

#3Michael Paquier
michael@paquier.xyz
In reply to: Adrian Klaver (#2)
Re: How many billion rows of data I can store in PostgreSQL RDS.

On Thu, Feb 21, 2019 at 09:14:24PM -0800, Adrian Klaver wrote:

This would be a question for AWS RDS support.

And this depends also a lot on your schema, your column alignment and
the level of bloat of your relations..
--
Michael

#4Samuel Teixeira Santos
arcanosam@gmail.com
In reply to: Michael Paquier (#3)
Re: How many billion rows of data I can store in PostgreSQL RDS.

Hi all.

Taking advantage of the topic I would like to know the recommendations
about how to update to a newer Postgres version having all that amount of
data.

Anyone one could share your experience about?

Thanks in advance.

Regards,

Samuel

#5Samuel Teixeira Santos
arcanosam@gmail.com
In reply to: Samuel Teixeira Santos (#4)
Re: How many billion rows of data I can store in PostgreSQL RDS.

Just adding that my case it's not a Amazon RDS, it's common server, if I
can say like that...

#6github kran
githubkran@gmail.com
In reply to: Samuel Teixeira Santos (#5)
Re: How many billion rows of data I can store in PostgreSQL RDS.

On Fri, Feb 22, 2019 at 5:48 AM Samuel Teixeira Santos <arcanosam@gmail.com>
wrote:

Just adding that my case it's not a Amazon RDS, it's common server, if I
can say like that...

Aplologies I missed the point to mention that this is a question to
PostgreSQL community. We are currently using PostgreSQL. ( Aurora Postgres
RDS). I want to know what postgresql can handle in terms of limitations.

Thanks.

#7Adrian Klaver
adrian.klaver@aklaver.com
In reply to: github kran (#6)
Re: How many billion rows of data I can store in PostgreSQL RDS.

On 2/22/19 4:46 AM, github kran wrote:

On Fri, Feb 22, 2019 at 5:48 AM Samuel Teixeira Santos
<arcanosam@gmail.com <mailto:arcanosam@gmail.com>> wrote:

Just adding that my case it's not a Amazon RDS, it's common server,
if I can say like that...

Aplologies I missed the point to mention that this is a question to
PostgreSQL community. We are currently using PostgreSQL. (  Aurora
Postgres RDS). I want to know what postgresql can handle in terms of
limitations.

Aurora Postgres is a fork of the community version:

https://aws.amazon.com/rds/aurora/

"Amazon Aurora is a MySQL and PostgreSQL-compatible relational database
built for the cloud, ..."

You will need to ask the folks that created the fork(AWS) what it's
capabilities are.

Thanks.

--
Adrian Klaver
adrian.klaver@aklaver.com