[PATCH] Extending FK check skipping on replicas to ADD FK and TRUNCATE
Hackorum builds and tests every patch posted to the lists, not only commitfest submissions. This is Hackorum's own CI rather than the PostgreSQL project's, and it is still under testing - please report anything that looks wrong.
You can run a PostgreSQL built from this patch straight from Docker, with no checkout and no build:
docker run --rm -p 5432:5432 ghcr.io/hackorum-dev/postgres-patch:t51631psql -h localhost -U postgresBuilt from patchset v6 (message #6), August 23, 2026 at 01:49 AM.
Every patchset is also pushed to a branch of our PostgreSQL fork, so you can check out the same tree CI built. Without a PostgreSQL checkout:
git clone --branch t51631_6 https://github.com/hackorum-dev/postgres.gitIn a checkout you already have, add the fork once:
git remote add hackorum https://github.com/hackorum-dev/postgres.gitthen, for this patchset and every later one:
git fetch hackorum t51631_6 && git checkout t51631_6Patchset v6 (message #6) is on t51631_6
Hello Everybody,
Currently setting `session_replication_role` to `replica` disables
foreign key checks allowing, among other things, free table copy order
and faster CDC apply in logical replication.
But two other cases of foreign keys are still restricted or blocked
even with this setting
1. Foreign Key checks during `ALTER TABLE <fkt> ADD FOREIGN KEY
(<fkcol>) REFERENCES <pkt>(<pkcol>);`
These can be really, Really, REALLY slow when the PK table is huge
(hundreds of billions of rows). And here I mean taking-tens-of-days
slow in extreme cases.
And they are also completely unnecessary when the table data comes
from a known good source.
2. `TRUNCATE <referenced table>` is blocked when there are any foreign
keys referencing the <referenced table>
But you still can mess up your database in exactly the same way by
running `DELETE FROM <referenced table>`, just a little (or a lot)
slower.
The attached patch fixes this, allowing both cases to work when `SET
session_replication_role=replica;` is in force:
### Test for `ALTER TABLE <fkt> ADD FOREIGN KEY (<fkcol>) REFERENCES
<pkt>(<pkcol>);`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1);
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- fails
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- now succeeds
### Test for `TRUNCATE <referenced table>`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));
TRUNCATE pkt; -- fails
SET session_replication_role=replica;
TRUNCATE pkt; -- now succeeds
The patch just wraps two sections of code in
if (SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA) {
...
}
and the rest is added indentation for the wrapped.
Plus I added tests, including the until now missing test for
explicitly the foreign key checks (which can be argued to already be
covered by generic trigger tests)
I am not sure if we need to add anything to current documentation[*]
which says just this about foreign keys and
`session_replication_role=replica`
Since foreign keys are implemented as triggers, setting this parameter to replica also disables all foreign key checks, which can leave data in an inconsistent state if improperly used.
[*] https://www.postgresql.org/docs/17/runtime-config-client.html#GUC-SESSION-REPLICATION-ROLE
Any comments and suggestions are welcome
Attachments:
v1-0001-Skip-FK-Validations-when-Role-is-Replica.patchtext/x-patch; charset=US-ASCII; name=v1-0001-Skip-FK-Validations-when-Role-is-Replica.patchDownload+131-33
I would also argue for treating this as a bug and back-porting to all
supported versions - a quick look at v13 seems to confirm that the
wrapped code has not changed at least since then.
I don't think we can claim the current state is Working As Intended
unless someone stands up and says they really intended it to work this
way :)
Show quoted text
On Sat, May 24, 2025 at 3:47 PM Hannu Krosing <hannuk@google.com> wrote:
Hello Everybody,
Currently setting `session_replication_role` to `replica` disables
foreign key checks allowing, among other things, free table copy order
and faster CDC apply in logical replication.But two other cases of foreign keys are still restricted or blocked
even with this setting1. Foreign Key checks during `ALTER TABLE <fkt> ADD FOREIGN KEY
(<fkcol>) REFERENCES <pkt>(<pkcol>);`These can be really, Really, REALLY slow when the PK table is huge
(hundreds of billions of rows). And here I mean taking-tens-of-days
slow in extreme cases.And they are also completely unnecessary when the table data comes
from a known good source.2. `TRUNCATE <referenced table>` is blocked when there are any foreign
keys referencing the <referenced table>But you still can mess up your database in exactly the same way by
running `DELETE FROM <referenced table>`, just a little (or a lot)
slower.The attached patch fixes this, allowing both cases to work when `SET
session_replication_role=replica;` is in force:### Test for `ALTER TABLE <fkt> ADD FOREIGN KEY (<fkcol>) REFERENCES
<pkt>(<pkcol>);`CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1);ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- fails
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- now succeeds### Test for `TRUNCATE <referenced table>`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));TRUNCATE pkt; -- fails
SET session_replication_role=replica;
TRUNCATE pkt; -- now succeedsThe patch just wraps two sections of code in
if (SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA) {
...
}and the rest is added indentation for the wrapped.
Plus I added tests, including the until now missing test for
explicitly the foreign key checks (which can be argued to already be
covered by generic trigger tests)I am not sure if we need to add anything to current documentation[*]
which says just this about foreign keys and
`session_replication_role=replica`Since foreign keys are implemented as triggers, setting this parameter to replica also disables all foreign key checks, which can leave data in an inconsistent state if improperly used.
[*] https://www.postgresql.org/docs/17/runtime-config-client.html#GUC-SESSION-REPLICATION-ROLE
Any comments and suggestions are welcome
Here is a rebased patch
this time I did not indent the part under
if(SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA)
{
... (<did not add indent>
}
so it is immediately obviuos from the patch what is added.
I can add the indent later, or just let pg_ident take care of this in due time
Show quoted text
On Sat, May 24, 2025 at 4:02 PM Hannu Krosing <hannuk@google.com> wrote:
I would also argue for treating this as a bug and back-porting to all
supported versions - a quick look at v13 seems to confirm that the
wrapped code has not changed at least since then.I don't think we can claim the current state is Working As Intended
unless someone stands up and says they really intended it to work this
way :)On Sat, May 24, 2025 at 3:47 PM Hannu Krosing <hannuk@google.com> wrote:
Hello Everybody,
Currently setting `session_replication_role` to `replica` disables
foreign key checks allowing, among other things, free table copy order
and faster CDC apply in logical replication.But two other cases of foreign keys are still restricted or blocked
even with this setting1. Foreign Key checks during `ALTER TABLE <fkt> ADD FOREIGN KEY
(<fkcol>) REFERENCES <pkt>(<pkcol>);`These can be really, Really, REALLY slow when the PK table is huge
(hundreds of billions of rows). And here I mean taking-tens-of-days
slow in extreme cases.And they are also completely unnecessary when the table data comes
from a known good source.2. `TRUNCATE <referenced table>` is blocked when there are any foreign
keys referencing the <referenced table>But you still can mess up your database in exactly the same way by
running `DELETE FROM <referenced table>`, just a little (or a lot)
slower.The attached patch fixes this, allowing both cases to work when `SET
session_replication_role=replica;` is in force:### Test for `ALTER TABLE <fkt> ADD FOREIGN KEY (<fkcol>) REFERENCES
<pkt>(<pkcol>);`CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1);ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- fails
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- now succeeds### Test for `TRUNCATE <referenced table>`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));TRUNCATE pkt; -- fails
SET session_replication_role=replica;
TRUNCATE pkt; -- now succeedsThe patch just wraps two sections of code in
if (SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA) {
...
}and the rest is added indentation for the wrapped.
Plus I added tests, including the until now missing test for
explicitly the foreign key checks (which can be argued to already be
covered by generic trigger tests)I am not sure if we need to add anything to current documentation[*]
which says just this about foreign keys and
`session_replication_role=replica`Since foreign keys are implemented as triggers, setting this parameter to replica also disables all foreign key checks, which can leave data in an inconsistent state if improperly used.
[*] https://www.postgresql.org/docs/17/runtime-config-client.html#GUC-SESSION-REPLICATION-ROLE
Any comments and suggestions are welcome
Attachments:
v2-0001-Skip-FK-Validations-when-Role-is-Replica.patchtext/x-patch; charset=US-ASCII; name=v2-0001-Skip-FK-Validations-when-Role-is-Replica.patchDownload+101-4
Managed to send wrong patch earlier, this one actually compiles
Show quoted text
On Sun, Jul 6, 2025 at 1:48 PM Hannu Krosing <hannuk@google.com> wrote:
Here is a rebased patch
this time I did not indent the part under
if(SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA)
{
... (<did not add indent>
}so it is immediately obviuos from the patch what is added.
I can add the indent later, or just let pg_ident take care of this in due time
On Sat, May 24, 2025 at 4:02 PM Hannu Krosing <hannuk@google.com> wrote:
I would also argue for treating this as a bug and back-porting to all
supported versions - a quick look at v13 seems to confirm that the
wrapped code has not changed at least since then.I don't think we can claim the current state is Working As Intended
unless someone stands up and says they really intended it to work this
way :)On Sat, May 24, 2025 at 3:47 PM Hannu Krosing <hannuk@google.com> wrote:
Hello Everybody,
Currently setting `session_replication_role` to `replica` disables
foreign key checks allowing, among other things, free table copy order
and faster CDC apply in logical replication.But two other cases of foreign keys are still restricted or blocked
even with this setting1. Foreign Key checks during `ALTER TABLE <fkt> ADD FOREIGN KEY
(<fkcol>) REFERENCES <pkt>(<pkcol>);`These can be really, Really, REALLY slow when the PK table is huge
(hundreds of billions of rows). And here I mean taking-tens-of-days
slow in extreme cases.And they are also completely unnecessary when the table data comes
from a known good source.2. `TRUNCATE <referenced table>` is blocked when there are any foreign
keys referencing the <referenced table>But you still can mess up your database in exactly the same way by
running `DELETE FROM <referenced table>`, just a little (or a lot)
slower.The attached patch fixes this, allowing both cases to work when `SET
session_replication_role=replica;` is in force:### Test for `ALTER TABLE <fkt> ADD FOREIGN KEY (<fkcol>) REFERENCES
<pkt>(<pkcol>);`CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1);ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- fails
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- now succeeds### Test for `TRUNCATE <referenced table>`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));TRUNCATE pkt; -- fails
SET session_replication_role=replica;
TRUNCATE pkt; -- now succeedsThe patch just wraps two sections of code in
if (SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA) {
...
}and the rest is added indentation for the wrapped.
Plus I added tests, including the until now missing test for
explicitly the foreign key checks (which can be argued to already be
covered by generic trigger tests)I am not sure if we need to add anything to current documentation[*]
which says just this about foreign keys and
`session_replication_role=replica`Since foreign keys are implemented as triggers, setting this parameter to replica also disables all foreign key checks, which can leave data in an inconsistent state if improperly used.
[*] https://www.postgresql.org/docs/17/runtime-config-client.html#GUC-SESSION-REPLICATION-ROLE
Any comments and suggestions are welcome
Attachments:
v3-0001-Skip-FK-Validations-when-Role-is-Replica.patchtext/x-patch; charset=US-ASCII; name=v3-0001-Skip-FK-Validations-when-Role-is-Replica.patchDownload+101-4
And now it also passes tests.
Still learning about the git way of generating PostgreSQL patches,
that's why there are two separate ones
Show quoted text
On Sun, Jul 6, 2025 at 4:30 PM Hannu Krosing <hannuk@google.com> wrote:
Managed to send wrong patch earlier, this one actually compiles
On Sun, Jul 6, 2025 at 1:48 PM Hannu Krosing <hannuk@google.com> wrote:
Here is a rebased patch
this time I did not indent the part under
if(SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA)
{
... (<did not add indent>
}so it is immediately obviuos from the patch what is added.
I can add the indent later, or just let pg_ident take care of this in due time
On Sat, May 24, 2025 at 4:02 PM Hannu Krosing <hannuk@google.com> wrote:
I would also argue for treating this as a bug and back-porting to all
supported versions - a quick look at v13 seems to confirm that the
wrapped code has not changed at least since then.I don't think we can claim the current state is Working As Intended
unless someone stands up and says they really intended it to work this
way :)On Sat, May 24, 2025 at 3:47 PM Hannu Krosing <hannuk@google.com> wrote:
Hello Everybody,
Currently setting `session_replication_role` to `replica` disables
foreign key checks allowing, among other things, free table copy order
and faster CDC apply in logical replication.But two other cases of foreign keys are still restricted or blocked
even with this setting1. Foreign Key checks during `ALTER TABLE <fkt> ADD FOREIGN KEY
(<fkcol>) REFERENCES <pkt>(<pkcol>);`These can be really, Really, REALLY slow when the PK table is huge
(hundreds of billions of rows). And here I mean taking-tens-of-days
slow in extreme cases.And they are also completely unnecessary when the table data comes
from a known good source.2. `TRUNCATE <referenced table>` is blocked when there are any foreign
keys referencing the <referenced table>But you still can mess up your database in exactly the same way by
running `DELETE FROM <referenced table>`, just a little (or a lot)
slower.The attached patch fixes this, allowing both cases to work when `SET
session_replication_role=replica;` is in force:### Test for `ALTER TABLE <fkt> ADD FOREIGN KEY (<fkcol>) REFERENCES
<pkt>(<pkcol>);`CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1);ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- fails
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- now succeeds### Test for `TRUNCATE <referenced table>`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));TRUNCATE pkt; -- fails
SET session_replication_role=replica;
TRUNCATE pkt; -- now succeedsThe patch just wraps two sections of code in
if (SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA) {
...
}and the rest is added indentation for the wrapped.
Plus I added tests, including the until now missing test for
explicitly the foreign key checks (which can be argued to already be
covered by generic trigger tests)I am not sure if we need to add anything to current documentation[*]
which says just this about foreign keys and
`session_replication_role=replica`Since foreign keys are implemented as triggers, setting this parameter to replica also disables all foreign key checks, which can leave data in an inconsistent state if improperly used.
[*] https://www.postgresql.org/docs/17/runtime-config-client.html#GUC-SESSION-REPLICATION-ROLE
Any comments and suggestions are welcome
rebased to latest
On Sun, Jul 6, 2025 at 4:48 PM Hannu Krosing <hannuk@google.com> wrote:
Show quoted text
And now it also passes tests.
Still learning about the git way of generating PostgreSQL patches,
that's why there are two separate onesOn Sun, Jul 6, 2025 at 4:30 PM Hannu Krosing <hannuk@google.com> wrote:
Managed to send wrong patch earlier, this one actually compiles
On Sun, Jul 6, 2025 at 1:48 PM Hannu Krosing <hannuk@google.com> wrote:
Here is a rebased patch
this time I did not indent the part under
if(SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA)
{
... (<did not add indent>
}so it is immediately obviuos from the patch what is added.
I can add the indent later, or just let pg_ident take care of this in
due time
On Sat, May 24, 2025 at 4:02 PM Hannu Krosing <hannuk@google.com>
wrote:
I would also argue for treating this as a bug and back-porting to all
supported versions - a quick look at v13 seems to confirm that the
wrapped code has not changed at least since then.I don't think we can claim the current state is Working As Intended
unless someone stands up and says they really intended it to workthis
way :)
On Sat, May 24, 2025 at 3:47 PM Hannu Krosing <hannuk@google.com>
wrote:
Hello Everybody,
Currently setting `session_replication_role` to `replica` disables
foreign key checks allowing, among other things, free table copyorder
and faster CDC apply in logical replication.
But two other cases of foreign keys are still restricted or blocked
even with this setting1. Foreign Key checks during `ALTER TABLE <fkt> ADD FOREIGN KEY
(<fkcol>) REFERENCES <pkt>(<pkcol>);`These can be really, Really, REALLY slow when the PK table is huge
(hundreds of billions of rows). And here I mean taking-tens-of-days
slow in extreme cases.And they are also completely unnecessary when the table data comes
from a known good source.2. `TRUNCATE <referenced table>` is blocked when there are any
foreign
keys referencing the <referenced table>
But you still can mess up your database in exactly the same way by
running `DELETE FROM <referenced table>`, just a little (or a lot)
slower.The attached patch fixes this, allowing both cases to work when
`SET
session_replication_role=replica;` is in force:
### Test for `ALTER TABLE <fkt> ADD FOREIGN KEY (<fkcol>)
REFERENCES
<pkt>(<pkcol>);`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1);ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- fails
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- nowsucceeds
### Test for `TRUNCATE <referenced table>`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));TRUNCATE pkt; -- fails
SET session_replication_role=replica;
TRUNCATE pkt; -- now succeedsThe patch just wraps two sections of code in
if (SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA) {
...
}and the rest is added indentation for the wrapped.
Plus I added tests, including the until now missing test for
explicitly the foreign key checks (which can be argued to alreadybe
covered by generic trigger tests)
I am not sure if we need to add anything to current
documentation[*]
which says just this about foreign keys and
`session_replication_role=replica`Since foreign keys are implemented as triggers, setting this
parameter to replica also disables all foreign key checks, which can leave
data in an inconsistent state if improperly used.[*]
https://www.postgresql.org/docs/17/runtime-config-client.html#GUC-SESSION-REPLICATION-ROLE
Any comments and suggestions are welcome
On Sun, 11 Jan 2026 at 14:29, Hannu Krosing <hannuk@google.com> wrote:
rebased to latest
On Sun, Jul 6, 2025 at 4:48 PM Hannu Krosing <hannuk@google.com> wrote:
And now it also passes tests.
Still learning about the git way of generating PostgreSQL patches,
that's why there are two separate onesOn Sun, Jul 6, 2025 at 4:30 PM Hannu Krosing <hannuk@google.com> wrote:
Managed to send wrong patch earlier, this one actually compiles
On Sun, Jul 6, 2025 at 1:48 PM Hannu Krosing <hannuk@google.com> wrote:
Here is a rebased patch
this time I did not indent the part under
if(SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA)
{
... (<did not add indent>
}so it is immediately obviuos from the patch what is added.
I can add the indent later, or just let pg_ident take care of this in
due time
On Sat, May 24, 2025 at 4:02 PM Hannu Krosing <hannuk@google.com>
wrote:
I would also argue for treating this as a bug and back-porting to
all
supported versions - a quick look at v13 seems to confirm that the
wrapped code has not changed at least since then.I don't think we can claim the current state is Working As Intended
unless someone stands up and says they really intended it to workthis
way :)
On Sat, May 24, 2025 at 3:47 PM Hannu Krosing <hannuk@google.com>
wrote:
Hello Everybody,
Currently setting `session_replication_role` to `replica` disables
foreign key checks allowing, among other things, free table copyorder
and faster CDC apply in logical replication.
But two other cases of foreign keys are still restricted or
blocked
even with this setting
1. Foreign Key checks during `ALTER TABLE <fkt> ADD FOREIGN KEY
(<fkcol>) REFERENCES <pkt>(<pkcol>);`These can be really, Really, REALLY slow when the PK table is huge
(hundreds of billions of rows). And here I meantaking-tens-of-days
slow in extreme cases.
And they are also completely unnecessary when the table data comes
from a known good source.2. `TRUNCATE <referenced table>` is blocked when there are any
foreign
keys referencing the <referenced table>
But you still can mess up your database in exactly the same way by
running `DELETE FROM <referenced table>`, just a little (or a lot)
slower.The attached patch fixes this, allowing both cases to work when
`SET
session_replication_role=replica;` is in force:
### Test for `ALTER TABLE <fkt> ADD FOREIGN KEY (<fkcol>)
REFERENCES
<pkt>(<pkcol>);`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1);ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- fails
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- nowsucceeds
### Test for `TRUNCATE <referenced table>`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));TRUNCATE pkt; -- fails
SET session_replication_role=replica;
TRUNCATE pkt; -- now succeedsThe patch just wraps two sections of code in
if (SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA) {
...
}and the rest is added indentation for the wrapped.
Plus I added tests, including the until now missing test for
explicitly the foreign key checks (which can be argued to alreadybe
covered by generic trigger tests)
I am not sure if we need to add anything to current
documentation[*]
which says just this about foreign keys and
`session_replication_role=replica`Since foreign keys are implemented as triggers, setting this
parameter to replica also disables all foreign key checks, which can leave
data in an inconsistent state if improperly used.[*]
https://www.postgresql.org/docs/17/runtime-config-client.html#GUC-SESSION-REPLICATION-ROLE
Any comments and suggestions are welcome
I looked into this patch and found a case which doesn't look right,
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1); -- no matching pkt row
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id);
The Alter command goes through successfully. So, basically, fkt has one row
which doesn't follow the constraint.
--
Regards,
Rafia Sabih
CYBERTEC PostgreSQL International GmbH
Hi Rafia
This is exactly how this is supposed to work.
It allows the replication setup to avoid expensive checks when the
user knows that they are not needed.
It also allows you to mess up.
You can currently get the same result by
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));
INSERT INTO pkt VALUES(1);
INSERT INTO fkt VALUES(1); -- no matching pkt row
SET session_replication_role=replica;
DELETE FROM pkt;
Show quoted text
On Mon, Jul 20, 2026 at 1:18 PM Rafia Sabih <rafia.pghackers@gmail.com> wrote:
On Sun, 11 Jan 2026 at 14:29, Hannu Krosing <hannuk@google.com> wrote:
rebased to latest
On Sun, Jul 6, 2025 at 4:48 PM Hannu Krosing <hannuk@google.com> wrote:
And now it also passes tests.
Still learning about the git way of generating PostgreSQL patches,
that's why there are two separate onesOn Sun, Jul 6, 2025 at 4:30 PM Hannu Krosing <hannuk@google.com> wrote:
Managed to send wrong patch earlier, this one actually compiles
On Sun, Jul 6, 2025 at 1:48 PM Hannu Krosing <hannuk@google.com> wrote:
Here is a rebased patch
this time I did not indent the part under
if(SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA)
{
... (<did not add indent>
}so it is immediately obviuos from the patch what is added.
I can add the indent later, or just let pg_ident take care of this in due time
On Sat, May 24, 2025 at 4:02 PM Hannu Krosing <hannuk@google.com> wrote:
I would also argue for treating this as a bug and back-porting to all
supported versions - a quick look at v13 seems to confirm that the
wrapped code has not changed at least since then.I don't think we can claim the current state is Working As Intended
unless someone stands up and says they really intended it to work this
way :)On Sat, May 24, 2025 at 3:47 PM Hannu Krosing <hannuk@google.com> wrote:
Hello Everybody,
Currently setting `session_replication_role` to `replica` disables
foreign key checks allowing, among other things, free table copy order
and faster CDC apply in logical replication.But two other cases of foreign keys are still restricted or blocked
even with this setting1. Foreign Key checks during `ALTER TABLE <fkt> ADD FOREIGN KEY
(<fkcol>) REFERENCES <pkt>(<pkcol>);`These can be really, Really, REALLY slow when the PK table is huge
(hundreds of billions of rows). And here I mean taking-tens-of-days
slow in extreme cases.And they are also completely unnecessary when the table data comes
from a known good source.2. `TRUNCATE <referenced table>` is blocked when there are any foreign
keys referencing the <referenced table>But you still can mess up your database in exactly the same way by
running `DELETE FROM <referenced table>`, just a little (or a lot)
slower.The attached patch fixes this, allowing both cases to work when `SET
session_replication_role=replica;` is in force:### Test for `ALTER TABLE <fkt> ADD FOREIGN KEY (<fkcol>) REFERENCES
<pkt>(<pkcol>);`CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1);ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- fails
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- now succeeds### Test for `TRUNCATE <referenced table>`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));TRUNCATE pkt; -- fails
SET session_replication_role=replica;
TRUNCATE pkt; -- now succeedsThe patch just wraps two sections of code in
if (SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA) {
...
}and the rest is added indentation for the wrapped.
Plus I added tests, including the until now missing test for
explicitly the foreign key checks (which can be argued to already be
covered by generic trigger tests)I am not sure if we need to add anything to current documentation[*]
which says just this about foreign keys and
`session_replication_role=replica`Since foreign keys are implemented as triggers, setting this parameter to replica also disables all foreign key checks, which can leave data in an inconsistent state if improperly used.
[*] https://www.postgresql.org/docs/17/runtime-config-client.html#GUC-SESSION-REPLICATION-ROLE
Any comments and suggestions are welcome
I looked into this patch and found a case which doesn't look right,
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1); -- no matching pkt row
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id);
The Alter command goes through successfully. So, basically, fkt has one row which doesn't follow the constraint.--
Regards,
Rafia Sabih
CYBERTEC PostgreSQL International GmbH
Hi Álvaro,
Can you take a look at this?
This is the one I mentioned to you at the PgConf.dev, allowing the
extension of FK check bypassing from the current "don't check on DML"
to also include TRUNCATE and ADD FOREIGN KEY.
This will especially improve replica setup cases where you would want
to create the PK index and Foreign Keys after the initial copy. This
speeds up the copy in extreme cases where the index presence slows
down the initial data transfer.
---
Best regards
Hannu
Show quoted text
On Thu, Aug 6, 2026 at 3:10 PM Hannu Krosing <hannuk@google.com> wrote:
Hi Rafia
This is exactly how this is supposed to work.
It allows the replication setup to avoid expensive checks when the
user knows that they are not needed.
It also allows you to mess up.You can currently get the same result by
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));
INSERT INTO pkt VALUES(1);
INSERT INTO fkt VALUES(1); -- no matching pkt row
SET session_replication_role=replica;
DELETE FROM pkt;On Mon, Jul 20, 2026 at 1:18 PM Rafia Sabih <rafia.pghackers@gmail.com> wrote:
On Sun, 11 Jan 2026 at 14:29, Hannu Krosing <hannuk@google.com> wrote:
rebased to latest
On Sun, Jul 6, 2025 at 4:48 PM Hannu Krosing <hannuk@google.com> wrote:
And now it also passes tests.
Still learning about the git way of generating PostgreSQL patches,
that's why there are two separate onesOn Sun, Jul 6, 2025 at 4:30 PM Hannu Krosing <hannuk@google.com> wrote:
Managed to send wrong patch earlier, this one actually compiles
On Sun, Jul 6, 2025 at 1:48 PM Hannu Krosing <hannuk@google.com> wrote:
Here is a rebased patch
this time I did not indent the part under
if(SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA)
{
... (<did not add indent>
}so it is immediately obviuos from the patch what is added.
I can add the indent later, or just let pg_ident take care of this in due time
On Sat, May 24, 2025 at 4:02 PM Hannu Krosing <hannuk@google.com> wrote:
I would also argue for treating this as a bug and back-porting to all
supported versions - a quick look at v13 seems to confirm that the
wrapped code has not changed at least since then.I don't think we can claim the current state is Working As Intended
unless someone stands up and says they really intended it to work this
way :)On Sat, May 24, 2025 at 3:47 PM Hannu Krosing <hannuk@google.com> wrote:
Hello Everybody,
Currently setting `session_replication_role` to `replica` disables
foreign key checks allowing, among other things, free table copy order
and faster CDC apply in logical replication.But two other cases of foreign keys are still restricted or blocked
even with this setting1. Foreign Key checks during `ALTER TABLE <fkt> ADD FOREIGN KEY
(<fkcol>) REFERENCES <pkt>(<pkcol>);`These can be really, Really, REALLY slow when the PK table is huge
(hundreds of billions of rows). And here I mean taking-tens-of-days
slow in extreme cases.And they are also completely unnecessary when the table data comes
from a known good source.2. `TRUNCATE <referenced table>` is blocked when there are any foreign
keys referencing the <referenced table>But you still can mess up your database in exactly the same way by
running `DELETE FROM <referenced table>`, just a little (or a lot)
slower.The attached patch fixes this, allowing both cases to work when `SET
session_replication_role=replica;` is in force:### Test for `ALTER TABLE <fkt> ADD FOREIGN KEY (<fkcol>) REFERENCES
<pkt>(<pkcol>);`CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1);ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- fails
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id); -- now succeeds### Test for `TRUNCATE <referenced table>`
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int REFERENCES pkt(id));TRUNCATE pkt; -- fails
SET session_replication_role=replica;
TRUNCATE pkt; -- now succeedsThe patch just wraps two sections of code in
if (SessionReplicationRole != SESSION_REPLICATION_ROLE_REPLICA) {
...
}and the rest is added indentation for the wrapped.
Plus I added tests, including the until now missing test for
explicitly the foreign key checks (which can be argued to already be
covered by generic trigger tests)I am not sure if we need to add anything to current documentation[*]
which says just this about foreign keys and
`session_replication_role=replica`Since foreign keys are implemented as triggers, setting this parameter to replica also disables all foreign key checks, which can leave data in an inconsistent state if improperly used.
[*] https://www.postgresql.org/docs/17/runtime-config-client.html#GUC-SESSION-REPLICATION-ROLE
Any comments and suggestions are welcome
I looked into this patch and found a case which doesn't look right,
CREATE TABLE pkt(id int PRIMARY KEY);
CREATE TABLE fkt(fk int);
INSERT INTO fkt VALUES(1); -- no matching pkt row
SET session_replication_role=replica;
ALTER TABLE fkt ADD FOREIGN KEY (fk) REFERENCES pkt(id);
The Alter command goes through successfully. So, basically, fkt has one row which doesn't follow the constraint.--
Regards,
Rafia Sabih
CYBERTEC PostgreSQL International GmbH
On 2026-08-06 15:17:15 +0200, Hannu Krosing wrote:
Hi Álvaro,
Can you take a look at this?
This is the one I mentioned to you at the PgConf.dev, allowing the
extension of FK check bypassing from the current "don't check on DML"
to also include TRUNCATE and ADD FOREIGN KEY.This will especially improve replica setup cases where you would want
to create the PK index and Foreign Keys after the initial copy. This
speeds up the copy in extreme cases where the index presence slows
down the initial data transfer.
You have been around long enough that this kind of reply style (at the top,
leaving everything below) is not considered ok. Yet you consistently do it.
Greetings,
Andres Freund
Hi Andres,
You have been around long enough that this kind of reply style (at the top,
leaving everything below) is not considered ok. Yet you consistently do it.
Very sorry about this.
I really need to figure out a way to make it obvious to me when I do
this, as GMail is very good at hiding it from me.
I'll spend some time on this right now.
Hi,
On Thu, 6 Aug 2026 at 16:59, Hannu Krosing <hannuk@google.com> wrote:
You have been around long enough that this kind of reply style (at the top,
leaving everything below) is not considered ok. Yet you consistently do it.Very sorry about this.
I really need to figure out a way to make it obvious to me when I do
this, as GMail is very good at hiding it from me.
I was bothered by the same before. The solution for me was to enable
'Plain text mode' in Gmail.
--
Regards,
Nazir Bilal Yavuz
Microsoft