pl/pgsql problem with search_path

Started by Eugene Chowover 22 years ago8 messagesbugs
Jump to latest
#1Eugene Chow
gene@paragonam.com

My plpgsql function seems to be ignoring search_path when looking for
the right table to select from. I'm running 7.3.4. Below is my test
code. Am I doing something wrong?

TIA, Gene Chow

test=> create or replace function getval() returns varchar as '
test'> declare val varchar;
test'> begin
test'> select into val value from bar limit 1;
test'> return val;
test'> end;' language 'plpgsql';
CREATE FUNCTION

test=> create table public.bar ( value varchar );
CREATE TABLE

test=> insert into public.bar values ('public value');
INSERT 4012748 1

test=> create schema foo;
CREATE SCHEMA

test=> create table foo.bar ( value varchar );
CREATE TABLE

test=> insert into foo.bar values ('foo value');
INSERT 4012754 1

test=> set search_path to foo, public;
SET

test=> select *, getval() from bar;
value | getval
-----------+-----------
foo value | foo value
(1 row)

test=> set search_path to public;
SET

test=> select *, getval() from bar;
value | getval
--------------+-----------
public value | foo value
(1 row)

#2Bruce Momjian
bruce@momjian.us
In reply to: Eugene Chow (#1)
Re: pl/pgsql problem with search_path

I think the problem is that the first time the function is called, it is
compiled and cached for later use. At that time the function is bound
to the table oid, so even though you change the search path, the cached
copy still calls the old table.

If you exit psql and re-enter, or change the schema _before_ you call
the function for the first time, it should be fine.

This highlights another problem with our plpgsql function caching.

---------------------------------------------------------------------------

Eugene Chow wrote:

My plpgsql function seems to be ignoring search_path when looking for
the right table to select from. I'm running 7.3.4. Below is my test
code. Am I doing something wrong?

TIA, Gene Chow

test=> create or replace function getval() returns varchar as '
test'> declare val varchar;
test'> begin
test'> select into val value from bar limit 1;
test'> return val;
test'> end;' language 'plpgsql';
CREATE FUNCTION

test=> create table public.bar ( value varchar );
CREATE TABLE

test=> insert into public.bar values ('public value');
INSERT 4012748 1

test=> create schema foo;
CREATE SCHEMA

test=> create table foo.bar ( value varchar );
CREATE TABLE

test=> insert into foo.bar values ('foo value');
INSERT 4012754 1

test=> set search_path to foo, public;
SET

test=> select *, getval() from bar;
value | getval
-----------+-----------
foo value | foo value
(1 row)

test=> set search_path to public;
SET

test=> select *, getval() from bar;
value | getval
--------------+-----------
public value | foo value
(1 row)

---------------------------(end of broadcast)---------------------------
TIP 7: don't forget to increase your free space map settings

-- 
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073
#3Eugene Chow
gene@paragonam.com
In reply to: Bruce Momjian (#2)
Re: pl/pgsql problem with search_path

Thanks. If I had only read the manual before posting. I solved it by
using 'execute' instead of 'select into' since the search_path is not
static in my system.

Gene

On Saturday, September 6, 2003, at 04:21 PM, Bruce Momjian wrote:

Show quoted text

I think the problem is that the first time the function is called, it
is
compiled and cached for later use. At that time the function is bound
to the table oid, so even though you change the search path, the cached
copy still calls the old table.

If you exit psql and re-enter, or change the schema _before_ you call
the function for the first time, it should be fine.

This highlights another problem with our plpgsql function caching.

-----------------------------------------------------------------------
----

Eugene Chow wrote:

My plpgsql function seems to be ignoring search_path when looking for
the right table to select from. I'm running 7.3.4. Below is my test
code. Am I doing something wrong?

TIA, Gene Chow

test=> create or replace function getval() returns varchar as '
test'> declare val varchar;
test'> begin
test'> select into val value from bar limit 1;
test'> return val;
test'> end;' language 'plpgsql';
CREATE FUNCTION

test=> create table public.bar ( value varchar );
CREATE TABLE

test=> insert into public.bar values ('public value');
INSERT 4012748 1

test=> create schema foo;
CREATE SCHEMA

test=> create table foo.bar ( value varchar );
CREATE TABLE

test=> insert into foo.bar values ('foo value');
INSERT 4012754 1

test=> set search_path to foo, public;
SET

test=> select *, getval() from bar;
value | getval
-----------+-----------
foo value | foo value
(1 row)

test=> set search_path to public;
SET

test=> select *, getval() from bar;
value | getval
--------------+-----------
public value | foo value
(1 row)

---------------------------(end of
broadcast)---------------------------
TIP 7: don't forget to increase your free space map settings

-- 
Bruce Momjian                        |  http://candle.pha.pa.us
pgman@candle.pha.pa.us               |  (610) 359-1001
+  If your life is a hard drive,     |  13 Roberts Road
+  Christ can be your backup.        |  Newtown Square, Pennsylvania  
19073
#4Tom Lane
tgl@sss.pgh.pa.us
In reply to: Bruce Momjian (#2)
Re: pl/pgsql problem with search_path

Bruce Momjian <pgman@candle.pha.pa.us> writes:

This highlights another problem with our plpgsql function caching.

It's a little disturbing to think that any change in SEARCH_PATH might
force us to discard all cached plans. That could be expensive; and
consider a function that deliberately sets SEARCH_PATH to ensure that
it gets the tables it wants. You wouldn't want such a function to be
unable to cache any plans across calls (not to mention blowing away
every other function's plans, too).

We'd probably better record with each plan the SEARCH_PATH it was
generated with. Then, as long as that matches the current setting,
we can re-use the plan.

Of course, none of this is going to happen until someone gets around to
creating infrastructure for flushing cached plans at need. Right at the
moment the answer is going to have to be "don't do that".

regards, tom lane

#5Bruce Momjian
bruce@momjian.us
In reply to: Eugene Chow (#3)
Re: pl/pgsql problem with search_path

Eugene Chow wrote:

Thanks. If I had only read the manual before posting. I solved it by
using 'execute' instead of 'select into' since the search_path is not
static in my system.

Yep, that's the workaround mentioned in the FAQ.

-- 
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073
#6Bruce Momjian
bruce@momjian.us
In reply to: Tom Lane (#4)
Re: pl/pgsql problem with search_path

Tom Lane wrote:

Bruce Momjian <pgman@candle.pha.pa.us> writes:

This highlights another problem with our plpgsql function caching.

It's a little disturbing to think that any change in SEARCH_PATH might
force us to discard all cached plans. That could be expensive; and
consider a function that deliberately sets SEARCH_PATH to ensure that
it gets the tables it wants. You wouldn't want such a function to be
unable to cache any plans across calls (not to mention blowing away
every other function's plans, too).

We'd probably better record with each plan the SEARCH_PATH it was
generated with. Then, as long as that matches the current setting,
we can re-use the plan.

Of course, none of this is going to happen until someone gets around to
creating infrastructure for flushing cached plans at need. Right at the
moment the answer is going to have to be "don't do that".

Yep. I was just surprised it highlighted another failure of cached
plans.

-- 
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073
#7Gaetano Mendola
mendola@bigfoot.com
In reply to: Tom Lane (#4)
Re: pl/pgsql problem with search_path

"Bruce Momjian" <pgman@candle.pha.pa.us> wrote:

Tom Lane wrote:

Bruce Momjian <pgman@candle.pha.pa.us> writes:

This highlights another problem with our plpgsql function caching.

It's a little disturbing to think that any change in SEARCH_PATH might
force us to discard all cached plans. That could be expensive; and
consider a function that deliberately sets SEARCH_PATH to ensure that
it gets the tables it wants. You wouldn't want such a function to be
unable to cache any plans across calls (not to mention blowing away
every other function's plans, too).

We'd probably better record with each plan the SEARCH_PATH it was
generated with. Then, as long as that matches the current setting,
we can re-use the plan.

Of course, none of this is going to happen until someone gets around to
creating infrastructure for flushing cached plans at need. Right at the
moment the answer is going to have to be "don't do that".

Yep. I was just surprised it highlighted another failure of cached
plans.

There is already a TODO for it ?

Regards
Gaetano Mendola

#8Bruce Momjian
bruce@momjian.us
In reply to: Gaetano Mendola (#7)
Re: pl/pgsql problem with search_path

Gaetano Mendola wrote:

"Bruce Momjian" <pgman@candle.pha.pa.us> wrote:

Tom Lane wrote:

Bruce Momjian <pgman@candle.pha.pa.us> writes:

This highlights another problem with our plpgsql function caching.

It's a little disturbing to think that any change in SEARCH_PATH might
force us to discard all cached plans. That could be expensive; and
consider a function that deliberately sets SEARCH_PATH to ensure that
it gets the tables it wants. You wouldn't want such a function to be
unable to cache any plans across calls (not to mention blowing away
every other function's plans, too).

We'd probably better record with each plan the SEARCH_PATH it was
generated with. Then, as long as that matches the current setting,
we can re-use the plan.

Of course, none of this is going to happen until someone gets around to
creating infrastructure for flushing cached plans at need. Right at the
moment the answer is going to have to be "don't do that".

Yep. I was just surprised it highlighted another failure of cached
plans.

There is already a TODO for it ?

Yep:

o Fix problems with complex temporary table creation/destruction
without using PL/PgSQL EXECUTE, needs cache prevention/invalidation

-- 
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073