WIP: unique hash indexes

Started by Neil Conwayalmost 23 years ago5 messagespatches
Jump to latest
#1Neil Conway
neilc@samurai.com

Attached is a patch that implements unique hash indexes. Regression
tests and docs have been updated (with the exception of
src/backend/access/hash/README).

This patches implements an improved version of the concurrency changes I
outlined on -hackers a couple days ago: the separate lock for
"right-of-insertion" into a bucket chain has been replaced by making use
of existing lmgr lockmodes to get the behavior we need.

I also took the opportunity to refactor the hash index code in a couple
places by moving duplicated code into separate functions, fixed some
typos in the README file, etc.

I've tested this a little bit (it survives 100,000 single-user pgbench
transactions, and 10 concurrent clients doing 1000 transactions each),
but I need to do more testing in the future.

As far as I know, the unique hash index code is functionally complete,
but don't add this to the patch queue (it is obviously for 7.5, anyway),
since I'm about to get started on some related hash index work, for
which I'll submit a mega-patch containing everything. I just posted this
here so that anyone who's interested can take a look at it -- comments
are welcome.

Thanks to Tom Lane, who was very helpful when I asked him code
questions, including suggesting the improved concurrency design I
mentioned above.

Cheers,

Neil

Attachments:

index_cleanup-17.patchtext/x-patch; charset=ANSI_X3.4-1968; name=index_cleanup-17.patchDownload+858-654
#2Bruce Momjian
bruce@momjian.us
In reply to: Neil Conway (#1)
Re: WIP: unique hash indexes

Your patch has been added to the PostgreSQL unapplied patches list at:

http://momjian.postgresql.org/cgi-bin/pgpatches

I will try to apply it within the next 48 hours.

---------------------------------------------------------------------------

Neil Conway wrote:

Attached is a patch that implements unique hash indexes. Regression
tests and docs have been updated (with the exception of
src/backend/access/hash/README).

This patches implements an improved version of the concurrency changes I
outlined on -hackers a couple days ago: the separate lock for
"right-of-insertion" into a bucket chain has been replaced by making use
of existing lmgr lockmodes to get the behavior we need.

I also took the opportunity to refactor the hash index code in a couple
places by moving duplicated code into separate functions, fixed some
typos in the README file, etc.

I've tested this a little bit (it survives 100,000 single-user pgbench
transactions, and 10 concurrent clients doing 1000 transactions each),
but I need to do more testing in the future.

As far as I know, the unique hash index code is functionally complete,
but don't add this to the patch queue (it is obviously for 7.5, anyway),
since I'm about to get started on some related hash index work, for
which I'll submit a mega-patch containing everything. I just posted this
here so that anyone who's interested can take a look at it -- comments
are welcome.

Thanks to Tom Lane, who was very helpful when I asked him code
questions, including suggesting the improved concurrency design I
mentioned above.

Cheers,

Neil

[ Attachment, skipping... ]

---------------------------(end of broadcast)---------------------------
TIP 9: the planner will ignore your desire to choose an index scan if your
joining column's datatypes do not match

-- 
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073
#3Tom Lane
tgl@sss.pgh.pa.us
In reply to: Bruce Momjian (#2)
Re: WIP: unique hash indexes

Bruce Momjian <pgman@candle.pha.pa.us> writes:

I will try to apply it within the next 48 hours.

My impression was that Neil didn't think this was ready yet:

As far as I know, the unique hash index code is functionally complete,
but don't add this to the patch queue (it is obviously for 7.5, anyway),
since I'm about to get started on some related hash index work, for
which I'll submit a mega-patch containing everything.

regards, tom lane

#4Bruce Momjian
bruce@momjian.us
In reply to: Tom Lane (#3)
Re: WIP: unique hash indexes

Tom Lane wrote:

Bruce Momjian <pgman@candle.pha.pa.us> writes:

I will try to apply it within the next 48 hours.

My impression was that Neil didn't think this was ready yet:

As far as I know, the unique hash index code is functionally complete,
but don't add this to the patch queue (it is obviously for 7.5, anyway),
since I'm about to get started on some related hash index work, for
which I'll submit a mega-patch containing everything.

Oops, sorry.

-- 
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073
#5Bruce Momjian
bruce@momjian.us
In reply to: Neil Conway (#1)
Re: WIP: unique hash indexes

Patch removed.

---------------------------------------------------------------------------

Neil Conway wrote:

Attached is a patch that implements unique hash indexes. Regression
tests and docs have been updated (with the exception of
src/backend/access/hash/README).

This patches implements an improved version of the concurrency changes I
outlined on -hackers a couple days ago: the separate lock for
"right-of-insertion" into a bucket chain has been replaced by making use
of existing lmgr lockmodes to get the behavior we need.

I also took the opportunity to refactor the hash index code in a couple
places by moving duplicated code into separate functions, fixed some
typos in the README file, etc.

I've tested this a little bit (it survives 100,000 single-user pgbench
transactions, and 10 concurrent clients doing 1000 transactions each),
but I need to do more testing in the future.

As far as I know, the unique hash index code is functionally complete,
but don't add this to the patch queue (it is obviously for 7.5, anyway),
since I'm about to get started on some related hash index work, for
which I'll submit a mega-patch containing everything. I just posted this
here so that anyone who's interested can take a look at it -- comments
are welcome.

Thanks to Tom Lane, who was very helpful when I asked him code
questions, including suggesting the improved concurrency design I
mentioned above.

Cheers,

Neil

[ Attachment, skipping... ]

---------------------------(end of broadcast)---------------------------
TIP 9: the planner will ignore your desire to choose an index scan if your
joining column's datatypes do not match

-- 
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073