Re: pgsql and streams
Back to this thread - I realize that in the "COPY TO" documentation, it
states the CSV file used for loading must be on the server's disk. If I
can't put files on the server's disk, I'm curious if I can use the STDIN
option from my JDBC client to load the data to the server? Using psql I
can stream data after the call. Is there anyway to accomplish the same
thing with JDBC?
Thanks!
Chris
-----Original Message-----
From: pgsql-general-owner@postgresql.org
[mailto:pgsql-general-owner@postgresql.org] On Behalf Of Christopher
Condit
Sent: Tuesday, March 14, 2006 4:10 PM
To: pgsql-general
Subject: [GENERAL] pgsql and streams
Hi All-
I'm new to Postgres and have a question about bulk loading from streams.
I know that I can bulk load from a file using COPY. Is it possible to
use a stream instead of a file? If so, and I limited to stdin? I'm
attempting to stream data from a remote database into my Postgres
instance. I don't want to insert each tuple individually using jdbc
since that would be horribly slow...
Thanks,
Chris
---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match
Christopher Condit schrieb:
Back to this thread - I realize that in the "COPY TO" documentation, it
states the CSV file used for loading must be on the server's disk. If I
can't put files on the server's disk, I'm curious if I can use the STDIN
option from my JDBC client to load the data to the server? Using psql I
can stream data after the call. Is there anyway to accomplish the same
thing with JDBC?
Not sure about JDBC but you can in fact stream your data to COPY via
STDIN - which is the network socket of your database connection.
I'm using this with python for example.
Regards
Tino
Hi Tino - thanks for your response.
Do you think that's the best way to go - just use Java to launch an
external load command to psql.exe? Does anyone else know of a way to
accomplish this with Java?
Thanks,
Chris
-----Original Message-----
From: Tino Wildenhain [mailto:tino@wildenhain.de]
Sent: Thursday, March 30, 2006 1:07 AM
To: Christopher Condit
Cc: pgsql-general
Subject: Re: [GENERAL] pgsql and streams
Christopher Condit schrieb:
Back to this thread - I realize that in the "COPY TO" documentation,
it
states the CSV file used for loading must be on the server's disk. If
I
can't put files on the server's disk, I'm curious if I can use the
STDIN
option from my JDBC client to load the data to the server? Using psql
I
can stream data after the call. Is there anyway to accomplish the same
thing with JDBC?
Not sure about JDBC but you can in fact stream your data to COPY via
STDIN - which is the network socket of your database connection.
I'm using this with python for example.
Regards
Tino
Import Notes
Resolved by subject fallback
OK - Now I see the COPY patch, adding the CopyManager class to the jdbc
driver. This is exactly the functionality I'm looking for. Has anyone
gotten this to work with the latest codebase? Is there a new patch
available?
Thanks for your help,
Chris
-----Original Message-----
From: Tino Wildenhain [mailto:tino@wildenhain.de]
Sent: Thursday, March 30, 2006 1:07 AM
To: Christopher Condit
Cc: pgsql-general
Subject: Re: [GENERAL] pgsql and streams
Christopher Condit schrieb:
Back to this thread - I realize that in the "COPY TO" documentation,
it
states the CSV file used for loading must be on the server's disk. If
I
can't put files on the server's disk, I'm curious if I can use the
STDIN
option from my JDBC client to load the data to the server? Using psql
I
can stream data after the call. Is there anyway to accomplish the same
thing with JDBC?
Not sure about JDBC but you can in fact stream your data to COPY via
STDIN - which is the network socket of your database connection.
I'm using this with python for example.
Regards
Tino
Import Notes
Resolved by subject fallback