FP precision

Started by Kevin Grittnerover 12 years ago2 messages
#1Kevin Grittner
kgrittn@ymail.com

test=# select '1000000'::real + '5'::real;
 ?column?
----------
    1e+06
(1 row)

test=# select '1000000'::real + '6'::real;
  ?column?  
-------------
 1.00001e+06
(1 row)

test=# select '0.1'::real + 0.0;
     ?column?     
-------------------
 0.100000001490116
(1 row)

--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers

#2Kevin Grittner
kgrittn@ymail.com
In reply to: Kevin Grittner (#1)
Re: FP precision

Sorry folks.  That email was misdirected by accident.

--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers