Rounding strategy

Started by PG Bug reporting formalmost 5 years ago7 messagesdocs
Jump to latest
#1PG Bug reporting form
noreply@postgresql.org

The following documentation comment has been logged on the website:

Page: https://www.postgresql.org/docs/13/functions-math.html
Description:

The 'round' mathematical function documentation doesn't specify its rounding
strategy. If this would be documented then users can rely on its rounding
behavior. For double precision the rounding probably depends on your
platform. For numeric the function seems to round to nearest with ties going
away from zero (sometimes referred to as "round half up). 6.5 -> 7.0 and
-6.5 -> -7.0.

#2Laurenz Albe
laurenz.albe@cybertec.at
In reply to: PG Bug reporting form (#1)
Re: Rounding strategy

On Mon, 2021-04-19 at 08:00 +0000, PG Doc comments form wrote:

The following documentation comment has been logged on the website:

Page: https://www.postgresql.org/docs/13/functions-math.html
Description:

The 'round' mathematical function documentation doesn't specify its rounding
strategy. If this would be documented then users can rely on its rounding
behavior. For double precision the rounding probably depends on your
platform. For numeric the function seems to round to nearest with ties going
away from zero (sometimes referred to as "round half up). 6.5 -> 7.0 and
-6.5 -> -7.0.

+1

Yours,
Laurenz Albe

#3Laurenz Albe
laurenz.albe@cybertec.at
In reply to: Laurenz Albe (#2)
Re: Rounding strategy

On Mon, 2021-04-19 at 08:00 +0000, PG Doc comments form wrote:

The 'round' mathematical function documentation doesn't specify its rounding
strategy. If this would be documented then users can rely on its rounding
behavior. For double precision the rounding probably depends on your
platform. For numeric the function seems to round to nearest with ties going
away from zero (sometimes referred to as "round half up). 6.5 -> 7.0 and
-6.5 -> -7.0.

Here is a proposed patch.

Yours,
Laurenz Albe

Attachments:

0001-Document-tie-breaking-behavior-of-round.patchtext/x-patch; charset=UTF-8; name=0001-Document-tie-breaking-behavior-of-round.patchDownload+4-3
#4Tom Lane
tgl@sss.pgh.pa.us
In reply to: Laurenz Albe (#3)
Re: Rounding strategy

Laurenz Albe <laurenz.albe@cybertec.at> writes:

On Mon, 2021-04-19 at 08:00 +0000, PG Doc comments form wrote:

The 'round' mathematical function documentation doesn't specify its rounding
strategy. If this would be documented then users can rely on its rounding
behavior. For double precision the rounding probably depends on your
platform. For numeric the function seems to round to nearest with ties going
away from zero (sometimes referred to as "round half up). 6.5 -> 7.0 and
-6.5 -> -7.0.

Here is a proposed patch.

LGTM, although I think we can be a bit more specific about the float
case. I suggest

... by rounding away from 0. For <type>double precision</type>,
the tie-breaking behavior is platform dependent, but
<quote>round to nearest even</quote> is the most common rule.

regards, tom lane

#5Laurenz Albe
laurenz.albe@cybertec.at
In reply to: Tom Lane (#4)
Re: Rounding strategy

On Thu, 2021-04-22 at 13:50 -0400, Tom Lane wrote:

Laurenz Albe <laurenz.albe@cybertec.at> writes:

On Mon, 2021-04-19 at 08:00 +0000, PG Doc comments form wrote:

The 'round' mathematical function documentation doesn't specify its rounding
strategy. If this would be documented then users can rely on its rounding
behavior. For double precision the rounding probably depends on your
platform. For numeric the function seems to round to nearest with ties going
away from zero (sometimes referred to as "round half up). 6.5 -> 7.0 and
-6.5 -> -7.0.

Here is a proposed patch.

LGTM, although I think we can be a bit more specific about the float
case. I suggest

... by rounding away from 0. For <type>double precision</type>,
the tie-breaking behavior is platform dependent, but
<quote>round to nearest even</quote> is the most common rule.

Makes sense. Here is an updated patch.

Yours,
Laurenz Albe

Attachments:

0001-Document-tie-breaking-behavior-of-round.v2.patchtext/x-patch; charset=UTF-8; name=0001-Document-tie-breaking-behavior-of-round.v2.patchDownload+6-3
#6Laurenz Albe
laurenz.albe@cybertec.at
In reply to: Laurenz Albe (#5)
Re: Rounding strategy

On Fri, 2021-04-23 at 09:40 +0200, Laurenz Albe wrote:

Makes sense. Here is an updated patch.

I see that you have already committed your proposed version.
Thanks!

Yours,
Laurenz Albe

#7Rudolph Froger
rudolphfroger@dreamsolution.nl
In reply to: Laurenz Albe (#6)
Re: Rounding strategy

Thanks a lot!

Cheers, Rudolph

Show quoted text

On 23-04-2021 10:51, Laurenz Albe wrote:

On Fri, 2021-04-23 at 09:40 +0200, Laurenz Albe wrote:

Makes sense. Here is an updated patch.

I see that you have already committed your proposed version.
Thanks!

Yours,
Laurenz Albe