pgsql: Support parallel aggregation.

Started by Robert Haasalmost 10 years ago5 messages
#1Robert Haas
rhaas@postgresql.org

Support parallel aggregation.

Parallel workers can now partially aggregate the data and pass the
transition values back to the leader, which can combine the partial
results to produce the final answer.

David Rowley, based on earlier work by Haribabu Kommi. Reviewed by
Álvaro Herrera, Tomas Vondra, Amit Kapila, James Sewell, and me.

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/e06a38965b3bcdaa881e7e06892d4d8ab6c2c980

Modified Files
--------------
src/backend/executor/execQual.c | 8 +
src/backend/nodes/copyfuncs.c | 1 +
src/backend/nodes/equalfuncs.c | 1 +
src/backend/nodes/nodeFuncs.c | 2 +-
src/backend/nodes/outfuncs.c | 1 +
src/backend/nodes/readfuncs.c | 1 +
src/backend/optimizer/path/allpaths.c | 3 +-
src/backend/optimizer/path/costsize.c | 12 +-
src/backend/optimizer/plan/createplan.c | 4 +-
src/backend/optimizer/plan/planner.c | 520 ++++++++++++++++++++++++++++----
src/backend/optimizer/plan/setrefs.c | 251 ++++++++++++++-
src/backend/optimizer/prep/prepunion.c | 4 +-
src/backend/optimizer/util/clauses.c | 79 +++++
src/backend/optimizer/util/pathnode.c | 16 +-
src/backend/optimizer/util/tlist.c | 45 +++
src/backend/parser/parse_func.c | 3 +-
src/include/catalog/catversion.h | 2 +-
src/include/nodes/primnodes.h | 11 +-
src/include/nodes/relation.h | 2 +
src/include/optimizer/clauses.h | 18 ++
src/include/optimizer/cost.h | 2 +-
src/include/optimizer/pathnode.h | 7 +-
src/include/optimizer/tlist.h | 1 +
23 files changed, 911 insertions(+), 83 deletions(-)

--
Sent via pgsql-committers mailing list (pgsql-committers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-committers

#2David Fetter
david@fetter.org
In reply to: Robert Haas (#1)
Re: [COMMITTERS] pgsql: Support parallel aggregation.

On Mon, Mar 21, 2016 at 01:33:28PM +0000, Robert Haas wrote:

Support parallel aggregation.

...and there was much rejoicing!

Cheers,
David.
--
David Fetter <david@fetter.org> http://fetter.org/
Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter
Skype: davidfetter XMPP: david.fetter@gmail.com

Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate

--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers

#3Robert Haas
robertmhaas@gmail.com
In reply to: David Fetter (#2)
Re: [COMMITTERS] pgsql: Support parallel aggregation.

On Mon, Mar 21, 2016 at 10:35 AM, David Fetter <david@fetter.org> wrote:

On Mon, Mar 21, 2016 at 01:33:28PM +0000, Robert Haas wrote:

Support parallel aggregation.

...and there was much rejoicing!

I know *I* am!

--
Robert Haas
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company

--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers

#4Simon Riggs
simon@2ndQuadrant.com
In reply to: David Fetter (#2)
Re: [COMMITTERS] pgsql: Support parallel aggregation.

On 21 March 2016 at 14:35, David Fetter <david@fetter.org> wrote:

On Mon, Mar 21, 2016 at 01:33:28PM +0000, Robert Haas wrote:

Support parallel aggregation.

...and there was much rejoicing!

+1

Well done all.

--
Simon Riggs http://www.2ndQuadrant.com/
<http://www.2ndquadrant.com/&gt;
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services

#5Bert
biertie@gmail.com
In reply to: Simon Riggs (#4)
Re: [COMMITTERS] pgsql: Support parallel aggregation.

#woopwoop! :-D great work, all!

On Mon, Mar 21, 2016 at 3:43 PM, Simon Riggs <simon@2ndquadrant.com> wrote:

On 21 March 2016 at 14:35, David Fetter <david@fetter.org> wrote:

On Mon, Mar 21, 2016 at 01:33:28PM +0000, Robert Haas wrote:

Support parallel aggregation.

...and there was much rejoicing!

+1

Well done all.

--
Simon Riggs http://www.2ndQuadrant.com/
<http://www.2ndquadrant.com/&gt;
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services

--
Bert Desmet
0477/305361