memory consumption of memory for postgres db container

Started by M Tarkeshwar Raoover 4 years ago5 messagesgeneral
Jump to latest
#1M Tarkeshwar Rao
m.tarkeshwar.rao@ericsson.com

Hi all,

We did a stability test for our product, where we continuously inserting data into postgres tables. We did this for three days continuously.
Memory utilization of our Postgres container continuously increasing.

[cid:image001.jpg@01D7A035.D9017060]

Can you please provide us the clue why it is not constant and continuously increasing?

Regards
Tarkeshwar

Attachments:

image001.jpgimage/jpeg; name=image001.jpgDownload
#2Ninad Shah
nshah.postgres@gmail.com
In reply to: M Tarkeshwar Rao (#1)
Re: memory consumption of memory for postgres db container

No need to worry. This isn't really a concern.

No operating system releases memory upon using it, but caches it once the
program finishes. This actually saves time as memory blocks can be
allocated in less time than loading new blocks.
However, if it's required to release memory, it can be performed via a few
commands.

Regards,
Ninad Shah

On Thu, 2 Sept 2021 at 20:05, M Tarkeshwar Rao <
m.tarkeshwar.rao@ericsson.com> wrote:

Show quoted text

Hi all,

We did a stability test for our product, where we continuously inserting
data into postgres tables. We did this for three days continuously.

Memory utilization of our Postgres container continuously increasing.

Can you please provide us the clue why it is not constant and continuously
increasing?

Regards

Tarkeshwar

Attachments:

image001.jpgimage/jpeg; name=image001.jpgDownload
#3M Tarkeshwar Rao
m.tarkeshwar.rao@ericsson.com
In reply to: Ninad Shah (#2)
RE: memory consumption of memory for postgres db container

Can you please suggest few commands?

Regards
Tarkeshwar

From: Ninad Shah <nshah.postgres@gmail.com>
Sent: Thursday, September 2, 2021 8:30 PM
To: M Tarkeshwar Rao <m.tarkeshwar.rao@ericsson.com>
Cc: pgsql-general@postgresql.org
Subject: Re: memory consumption of memory for postgres db container

No need to worry. This isn't really a concern.

No operating system releases memory upon using it, but caches it once the program finishes. This actually saves time as memory blocks can be allocated in less time than loading new blocks.
However, if it's required to release memory, it can be performed via a few commands.

Regards,
Ninad Shah

On Thu, 2 Sept 2021 at 20:05, M Tarkeshwar Rao <m.tarkeshwar.rao@ericsson.com<mailto:m.tarkeshwar.rao@ericsson.com>> wrote:
Hi all,

We did a stability test for our product, where we continuously inserting data into postgres tables. We did this for three days continuously.
Memory utilization of our Postgres container continuously increasing.

[cid:image001.jpg@01D7A03A.E4BE8F00]

Can you please provide us the clue why it is not constant and continuously increasing?

Regards
Tarkeshwar

Attachments:

image001.jpgimage/jpeg; name=image001.jpgDownload+0-1
#4Ninad Shah
nshah.postgres@gmail.com
In reply to: M Tarkeshwar Rao (#3)
Re: memory consumption of memory for postgres db container

You may checkout using "free -m" and may see how much memory is cache.

If you are using RHEL, you may clear cache using below commands.

sync; echo 1 > /proc/sys/vm/drop_caches; sync

Though this is going to release some memory from the cache, it may fill up
the cache again.

Regards,
Ninad Shah

On Thu, 2 Sept 2021 at 20:41, M Tarkeshwar Rao <
m.tarkeshwar.rao@ericsson.com> wrote:

Show quoted text

Can you please suggest few commands?

Regards

Tarkeshwar

*From:* Ninad Shah <nshah.postgres@gmail.com>
*Sent:* Thursday, September 2, 2021 8:30 PM
*To:* M Tarkeshwar Rao <m.tarkeshwar.rao@ericsson.com>
*Cc:* pgsql-general@postgresql.org
*Subject:* Re: memory consumption of memory for postgres db container

No need to worry. This isn't really a concern.

No operating system releases memory upon using it, but caches it once the
program finishes. This actually saves time as memory blocks can be
allocated in less time than loading new blocks.

However, if it's required to release memory, it can be performed via a few
commands.

Regards,

Ninad Shah

On Thu, 2 Sept 2021 at 20:05, M Tarkeshwar Rao <
m.tarkeshwar.rao@ericsson.com> wrote:

Hi all,

We did a stability test for our product, where we continuously inserting
data into postgres tables. We did this for three days continuously.

Memory utilization of our Postgres container continuously increasing.

Can you please provide us the clue why it is not constant and continuously
increasing?

Regards

Tarkeshwar

Attachments:

image001.jpgimage/jpeg; name=image001.jpgDownload+0-1
#5Stephan Knauss
pgsql@stephans-server.de
In reply to: M Tarkeshwar Rao (#1)
Re: memory consumption of memory for postgres db container

On 02.09.2021 16:35, M Tarkeshwar Rao wrote:

We did a stability test for our product, where we continuously
inserting data into postgres tables. We did this for three days
continuously.

Memory utilization of our Postgres container continuously increasing.

I am not certain whether it is related, but you might want to check. I
had a similar issue where the anonymous memory was sort of leaking with
a rate of 2 GiB per hour.

it was resolved by doing a "set jit=off". You can see the full thread
including some hints on how to check where memory is allocated here:

/messages/by-id/9f73e655-14b8-feaf-bd66-c0f506224b9e@stephans-server.de

Stephan