JDBC and insert - stack overflow
Hi,
I am afraid I am a newbie. Forgive me if this is a silly question-
I'm trying to create a large database using JDBC to load the tables by
calling executeUpdate with the statement "SQL INSERT INTO" + tableName +
" VALUES (" etc...
After 14 and a half thousand rows the java virtual machine crashes with:
Exception in thread "main" java.lang.StackOverflowError
at java.lang.Class.newInstance0(Native Method)
at java.lang.Class.newInstance(Compiled Code)
at sun.io.Converters.newConverter(Compiled Code)
at sun.io.Converters.newDefaultConverter(Compiled Code)
at sun.io.ByteToCharConverter.getDefault(Compiled Code)
at java.lang.String.<init>(Compiled Code)
at postgresql.PG_Stream.ReceiveString(Compiled Code)
at postgresql.Connection.ExecSQL(Compiled Code)
at postgresql.Statement.execute(Compiled Code)
at postgresql.Statement.executeUpdate(Compiled Code)
My first question is:
Am I doing things in a really stupid way?
If not, how do I fix the problem - I have tried increasing the default
stack and memory size for the JVM...
Crispin
At 17:09 +0300 on 24/05/1999, Crispin Miller wrote:
Hi,
I am afraid I am a newbie. Forgive me if this is a silly question-
I'm trying to create a large database using JDBC to load the tables by
calling executeUpdate with the statement "SQL INSERT INTO" + tableName +
" VALUES (" etc...
JDBC questions belong in the Interfaces list, where I have now redirected
this thread.
The proper way to perform inserts is using a PreparedStatement, like this:
PreparedStatement pstmt = con.prepareStatement(
"INSERT INTO my_table (num,str,dt) VALUES (?,?,?)"
);
Then you loop, and in each iteration you do:
pstmt.setInt( 1, myIntVariable);
pstmt.setString( 2, myStringVariable);
pstmt.setDate( 3, mySQLDateVariable);
int rowCount = pstmt.executeUpdate();
Try this method. I'm not sure it will solve your stack problems. Usually,
stack overflow is due to deep recursion. But once you use this, you should
be wasting less memory anyway.
By the way, use con.setAutoCommit( false ) to have all the inserts in one
big transaction. It saves a lot of time.
Herouth
--
Herouth Maoz, Internet developer.
Open University of Israel - Telem project
http://telem.openu.ac.il/~herutma
On Tue, 25 May 1999, Herouth Maoz wrote:
At 17:09 +0300 on 24/05/1999, Crispin Miller wrote:
Hi,
I am afraid I am a newbie. Forgive me if this is a silly question-
I'm trying to create a large database using JDBC to load the tables by
calling executeUpdate with the statement "SQL INSERT INTO" + tableName +
" VALUES (" etc...JDBC questions belong in the Interfaces list, where I have now redirected
this thread.The proper way to perform inserts is using a PreparedStatement, like this:
PreparedStatement pstmt = con.prepareStatement(
"INSERT INTO my_table (num,str,dt) VALUES (?,?,?)"
);Then you loop, and in each iteration you do:
pstmt.setInt( 1, myIntVariable);
pstmt.setString( 2, myStringVariable);
pstmt.setDate( 3, mySQLDateVariable);int rowCount = pstmt.executeUpdate();
Try this method. I'm not sure it will solve your stack problems. Usually,
stack overflow is due to deep recursion. But once you use this, you should
be wasting less memory anyway.
If at some point we can store the query plan when the prepared statement
is created, the updates will speed up tremendously, as the backend isn't
parsing every line. Obviously this is a future item...
By the way, use con.setAutoCommit( false ) to have all the inserts in one
big transaction. It saves a lot of time.
Don't forget to commit() at the end, as you can't guarantee that a
transaction will be committed when the connection closes.
Peter
--
Peter T Mount peter@retep.org.uk
Main Homepage: http://www.retep.org.uk
PostgreSQL JDBC Faq: http://www.retep.org.uk/postgres
Java PDF Generator: http://www.retep.org.uk/pdf