File size consideration of file_fdw in PostgreSQL
Hi,
We have very large files in size will be created as external tables in
PostgreSQL via file_fdw, we have the following considerations:
1. Can file_fdw handle files with size large than the size of RAM in the
server.
2. Will file_fdw scan the full file every time when the external table is
queried, even we have "where" clause to narrow to a subset of rows , as the
file_fdw doesn't have a server engine.
Can you help with this, thanks.
Xiaobo
Xiaobo Gu wrote:
We have very large files in size will be created as external tables in PostgreSQL via file_fdw, we
have the following considerations:
1. Can file_fdw handle files with size large than the size of RAM in the server.
That shouldn't be a problem.
2. Will file_fdw scan the full file every time when the external table is queried, even we have
"where" clause to narrow to a subset of rows , as the file_fdw doesn't have a server engine.
Yes, the complete file will be read whenever the foreign
table is queried.
Yours,
Laurenz Albe
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general