Invalid WAL segment size. Allowed values are 1,2,4,8,16,32,64

Started by Cocco Gianfrancoalmost 9 years ago7 messagesbugs
Jump to latest
#1Cocco Gianfranco
Gianfranco.Cocco@eng.it

Hi,
We have a big problem with managing the number of WAL products, during database activity, so I would try to write to you.
With pg_rman utility, we can't save thousands of WAL files every few hours, to be used for a possible recovery.
We are using a production environment 9.2 PostgreSQL server which processes a database of about 260 GB
Is there a way to fix "wal_segsize" to about 1 Gb in 9.2. version, and "rebuild" postgreSQL server?
The goal is to drastically reduce the number of WALs.

Upgrading to 9.5, is the only way to fix this issue?

Thank you.

[Descrizione: cid:image001.jpg@01CE4109.E9653C00]
_______________________________

Gianfranco Cocco
Gruppo DBA Torino
Managed Operations - Data Center Factory
gianfranco.cocco@eng.it<mailto:gianfranco.cocco@eng.it>
Engineering.MO S.p.A
Corso Mortara, 22 - 10149 Torino
Tel. 011 19449548 (SHORT CODE: 676548)
www.eng.it<http://www.eng.it&gt;

___________________________

Attachments:

image001.jpgimage/jpeg; name=image001.jpgDownload
#2Michael Paquier
michael@paquier.xyz
In reply to: Cocco Gianfranco (#1)
Re: Invalid WAL segment size. Allowed values are 1,2,4,8,16,32,64

On Fri, Jun 9, 2017 at 10:55 PM, Cocco Gianfranco
<Gianfranco.Cocco@eng.it> wrote:

Is there a way to fix “wal_segsize” to about 1 Gb in 9.2. version, and “rebuild” postgreSQL server?

As long as you are able to compile your own version of Postgres and
your distribution does not allow that, there is nothing preventing you
to do so.

The goal is to drastically reduce the number of WALs.
Upgrading to 9.5, is the only way to fix this issue?

Note that a server initialized with a segment size of X won't work
with a binary compiled with a size of Y. But you can always take a
logical dump of the server before the upgrade, and reload it in the
version of the server with a larger segment size. The cost here is
more downtime.
--
Michael

--
Sent via pgsql-bugs mailing list (pgsql-bugs@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-bugs

#3Jeff Janes
jeff.janes@gmail.com
In reply to: Michael Paquier (#2)
Re: Invalid WAL segment size. Allowed values are 1,2,4,8,16,32,64

On Fri, Jun 9, 2017 at 3:43 PM, Michael Paquier <michael.paquier@gmail.com>
wrote:

On Fri, Jun 9, 2017 at 10:55 PM, Cocco Gianfranco
<Gianfranco.Cocco@eng.it> wrote:

Is there a way to fix “wal_segsize” to about 1 Gb in 9.2. version, and

“rebuild” postgreSQL server?

As long as you are able to compile your own version of Postgres and
your distribution does not allow that, there is nothing preventing you
to do so.

But there is something preventing it. wal_segsize cannot exceed 64MB in
9.2. v10 will be the first version which will allow sizes above 64MB.

Cheers,

Jeff

#4Michael Paquier
michael@paquier.xyz
In reply to: Jeff Janes (#3)
Re: Invalid WAL segment size. Allowed values are 1,2,4,8,16,32,64

On Tue, Jun 13, 2017 at 2:27 AM, Jeff Janes <jeff.janes@gmail.com> wrote:

But there is something preventing it. wal_segsize cannot exceed 64MB in
9.2. v10 will be the first version which will allow sizes above 64MB.

Yes, indeed. I have misread --with-segsize and --with-wal-segsize in
the docs. Sorry for the confusion.
--
Michael

--
Sent via pgsql-bugs mailing list (pgsql-bugs@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-bugs

#5Cocco Gianfranco
Gianfranco.Cocco@eng.it
In reply to: Michael Paquier (#4)
R: Invalid WAL segment size. Allowed values are 1,2,4,8,16,32,64

Thank you.

If I understand it well, we can build a new postgreSQL server, by setting this value into "configure" file?

--with-wal-segsize=SEGSIZE becomes --with-wal-segsize=1024 ??

_______________________________

Gianfranco Cocco

Gruppo DBA Torino

Managed Operations - Data Center Factory

gianfranco.cocco@eng.it

Engineering.MO S.p.A

Corso Mortara, 22 - 10149 Torino

Tel. 011 19449548 (SHORT CODE: 676548)

www.eng.it

___________________________

-----Messaggio originale-----
Da: Michael Paquier [mailto:michael.paquier@gmail.com]
Inviato: lunedì 12 giugno 2017 23:26
A: Jeff Janes <jeff.janes@gmail.com>
Cc: Cocco Gianfranco <Gianfranco.Cocco@eng.it>; pgsql-performance@postgresql.org; pgsql-bugs@postgresql.org; DBA <DBA@italiaonline.it>
Oggetto: Re: [BUGS] Invalid WAL segment size. Allowed values are 1,2,4,8,16,32,64

On Tue, Jun 13, 2017 at 2:27 AM, Jeff Janes <jeff.janes@gmail.com<mailto:jeff.janes@gmail.com>> wrote:

But there is something preventing it. wal_segsize cannot exceed 64MB

in 9.2. v10 will be the first version which will allow sizes above 64MB.

Yes, indeed. I have misread --with-segsize and --with-wal-segsize in the docs. Sorry for the confusion.

--

Michael

#6Michael Paquier
michael@paquier.xyz
In reply to: Cocco Gianfranco (#5)
Re: [BUGS] Invalid WAL segment size. Allowed values are 1,2,4,8,16,32,64

On Tue, Jun 13, 2017 at 6:10 PM, Cocco Gianfranco
<Gianfranco.Cocco@eng.it> wrote:

If I understand it well, we can build a new postgreSQL server, by setting
this value into "configure" file?

--with-wal-segsize=SEGSIZE becomes --with-wal-segsize=1024 ??

Yes, but as Jeff has pointed out upthread, this value can just go up
to 64 when using 9.5.
--
Michael

--
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance

#7Michael Paquier
michael@paquier.xyz
In reply to: Cocco Gianfranco (#1)
Re: [BUGS] Invalid WAL segment size. Allowed values are 1,2,4,8,16,32,64

On Tue, Jun 13, 2017 at 10:39 PM, Cocco Gianfranco
<Gianfranco.Cocco@eng.it> wrote:

./configure --with-wal-segsize=1024

checking for WAL segment size... configure: error: Invalid WAL segment size.
Allowed values are 1,2,4,8,16,32,64.

Please, how can I do?

When trying to compile Postgres 9.6, the maximum value is 64. If you
want to allow 1GB of WAL segment size you will need to wait for 10, or
just use 64MB.
--
Michael

--
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance