Can not input large text data

Started by Nonameover 24 years ago11 messagesgeneral
Jump to latest
#1Noname
qk22@gmx.co.uk

I am using PostgreSQL 7.1.3. I found that I can not input text data
for more than 7MB. When I tried to input text data more than about
7MB, I got the error message:" Network error: Connect reset by peer).
I don't know why.
Can anybody help me with the problem?

#2Tom Lane
tgl@sss.pgh.pa.us
In reply to: Noname (#1)
Re: Can not input large text data

qk22@gmx.co.uk (qk22) writes:

I am using PostgreSQL 7.1.3. I found that I can not input text data
for more than 7MB. When I tried to input text data more than about
7MB, I got the error message:" Network error: Connect reset by peer).
I don't know why.

Neither will anyone else, with only that much information. What are
you doing *exactly* to input this data? What client software are you
using?

regards, tom lane

#3Noname
roypgsqlgen@xemaps.com
In reply to: Tom Lane (#2)
Re: Can not input large text data

Hi

-----Original Message-----
From: qk22@gmx.co.uk [mailto:qk22@gmx.co.uk]
Subject: [GENERAL] Can not input large text data

I am using PostgreSQL 7.1.3. I found that I can not input text data
for more than 7MB. When I tried to input text data more than about
7MB, I got the error message:" Network error: Connect reset by peer).
I don't know why.
Can anybody help me with the problem?

You have to at least tell us how you're connecting to the server. Are you using plsql? Are you using jdbc? php?

Roy.

#4Noname
qk22@gmx.co.uk
In reply to: Tom Lane (#2)
Re: Can not input large text data

tgl@sss.pgh.pa.us (Tom Lane) wrote in message news:<25124.1003431283@sss.pgh.pa.us>...

qk22@gmx.co.uk (qk22) writes:

I am using PostgreSQL 7.1.3. I found that I can not input text data
for more than 7MB. When I tried to input text data more than about
7MB, I got the error message:" Network error: Connect reset by peer).
I don't know why.

Neither will anyone else, with only that much information. What are
you doing *exactly* to input this data? What client software are you
using?

regards, tom lane

---------------------------(end of broadcast)---------------------------
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to majordomo@postgresql.org so that your
message can get through to the mailing list cleanly

I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
input data within Netscape Navigator, in fact the text fields can
input data very well exceed the 8k and 32k limits. The problem is that
you still can not input data with fairly large size such as 7MB or
above, and I don't know if there is anything wrong with the database.

#5Aasmund Midttun Godal
postgresql@envisity.com
In reply to: Tom Lane (#2)
Re: Can not input large text data

Maybe this is a problem - take a look at your watch. See how long time it takes. then check out httpd.conf look for timeout (probably 300 secs).

Reagards,

Aasmund

On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:

tgl@sss.pgh.pa.us (Tom Lane) wrote in message news:<25124.1003431283@sss.pgh.pa.us>...

I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
input data within Netscape Navigator, in fact the text fields can
input data very well exceed the 8k and 32k limits. The problem is that
you still can not input data with fairly large size such as 7MB or
above, and I don't know if there is anything wrong with the database.

---------------------------(end of broadcast)---------------------------
TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/users-lounge/docs/faq.html

Aasmund Midttun Godal

aasmund@godal.com - http://www.godal.com/
+47 40 45 20 46

#6Noname
qk22@gmx.co.uk
In reply to: Aasmund Midttun Godal (#5)
Re: Can not input large text data

postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message news:<20011024001923.22212.qmail@ns.krot.org>...

Maybe this is a problem - take a look at your watch. See how long time it takes. then check out httpd.conf look for timeout (probably 300 secs).

Reagards,

Aasmund

On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:

tgl@sss.pgh.pa.us (Tom Lane) wrote in message news:<25124.1003431283@sss.pgh.pa.us>...

I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
input data within Netscape Navigator, in fact the text fields can
input data very well exceed the 8k and 32k limits. The problem is that
you still can not input data with fairly large size such as 7MB or
above, and I don't know if there is anything wrong with the database.

---------------------------(end of broadcast)---------------------------
TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/users-lounge/docs/faq.html

Aasmund Midttun Godal

aasmund@godal.com - http://www.godal.com/
+47 40 45 20 46

---------------------------(end of broadcast)---------------------------
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to majordomo@postgresql.org so that your
message can get through to the mailing list cleanly

I checked httpd.conf and found the "timeout" setting is 300, I tried
again and the error message in netscape appears immediately as
following:
______________________________________
A network error occurred while netscape
was sending data.
(Network Error: Connection reset by peer)

Try connection again
______________________________________
I want to know if there are some configuration changes that can be
made in order to enable the input of large text data though web
server.

Thank you

qk22

#7Tom Lane
tgl@sss.pgh.pa.us
In reply to: Noname (#6)
Re: Can not input large text data

qk22@gmx.co.uk (qk22) writes:

I checked httpd.conf and found the "timeout" setting is 300, I tried
again and the error message in netscape appears immediately as
following:
______________________________________
A network error occurred while netscape
was sending data.
(Network Error: Connection reset by peer)

Hmm. What shows up in the postmaster's log (stderr output)?

regards, tom lane

#8"Johnny Jørgensen"
johnny@halfahead.dk
In reply to: Noname (#6)
Re: Can not input large text data

That sounds very much like the POST maximum file size, set in php.ini. try phpinfo(), and see what your size is, the default is somewhere pretty near 7MB

*********** REPLY SEPARATOR ***********

On 24-10-2001 at 07:23 qk22@gmx.co.uk wrote:

postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message
news:<20011024001923.22212.qmail@ns.krot.org>...

Maybe this is a problem - take a look at your watch. See how long time

it takes. then check out httpd.conf look for timeout (probably 300 secs).

Reagards,

Aasmund

On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:

tgl@sss.pgh.pa.us (Tom Lane) wrote in message

news:<25124.1003431283@sss.pgh.pa.us>...

I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
input data within Netscape Navigator, in fact the text fields can
input data very well exceed the 8k and 32k limits. The problem is that
you still can not input data with fairly large size such as 7MB or
above, and I don't know if there is anything wrong with the database.

---------------------------(end of

broadcast)---------------------------

TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/users-lounge/docs/faq.html

Aasmund Midttun Godal

aasmund@godal.com - http://www.godal.com/
+47 40 45 20 46

---------------------------(end of broadcast)---------------------------
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to majordomo@postgresql.org so that your
message can get through to the mailing list cleanly

I checked httpd.conf and found the "timeout" setting is 300, I tried
again and the error message in netscape appears immediately as
following:
______________________________________
A network error occurred while netscape
was sending data.
(Network Error: Connection reset by peer)

Try connection again
______________________________________
I want to know if there are some configuration changes that can be
made in order to enable the input of large text data though web
server.

Thank you

qk22

---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org

Mvh,

Johnny J�rgensen

johnny@halfahead.dk
+45 6315 7328

#9Aasmund Midttun Godal
postgresql@envisity.com
In reply to: Aasmund Midttun Godal (#5)
Re: Can not input large text data

Well did you wait 300 secs or did it come immediately? because if you did then it is the webserver that cuts the connection because you have surpassed the timeout. Simply increasing the 300 value may work. however some browsers have a timeout on their side too.

I believe that the problem is probably caused by something other than postgres, (it may be any number of things) just try swapping around a lot of different things and settings - try storing the file to disk instead - does that work? try reading the post input directly and see if it is all there? if it comes immediately - has it already transferred the 7 mb? try setting boobie-traps in your script - what is the size of the actual post? have you remembered to set the appropriate enctype in the form ('multipart/form-data') there are simply too many things that can cause this. Try to narrow the problem down - and if it turns out to be postgres, then I do not know what the problem might be - somebody else here might though. I just uploaded a 10mb file through http into postgres - no problem.
On 24 Oct 2001 07:23:59 -0700, qk22@gmx.co.uk (qk22) wrote:

postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message news:<20011024001923.22212.qmail@ns.krot.org>...

I checked httpd.conf and found the "timeout" setting is 300, I tried
again and the error message in netscape appears immediately as
following:
______________________________________
A network error occurred while netscape
was sending data.
(Network Error: Connection reset by peer)

Try connection again
______________________________________
I want to know if there are some configuration changes that can be
made in order to enable the input of large text data though web
server.

Thank you

qk22

---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org

Aasmund Midttun Godal

aasmund@godal.com - http://www.godal.com/
+47 40 45 20 46

#10Noname
qk22@gmx.co.uk
In reply to: Aasmund Midttun Godal (#5)
Re: Can not input large text data -- problem solved --Thank you!

Johnny J�rgensen wrote:

That sounds very much like the POST maximum file size, set in php.ini. try phpinfo(), and see what your size is, the default is somewhere pretty near 7MB

*********** REPLY SEPARATOR ***********

On 24-10-2001 at 07:23 qk22@gmx.co.uk wrote:

postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message
news:<20011024001923.22212.qmail@ns.krot.org>...

Maybe this is a problem - take a look at your watch. See how long time

it takes. then check out httpd.conf look for timeout (probably 300 secs).

Reagards,

Aasmund

On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:

tgl@sss.pgh.pa.us (Tom Lane) wrote in message

news:<25124.1003431283@sss.pgh.pa.us>...

I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
input data within Netscape Navigator, in fact the text fields can
input data very well exceed the 8k and 32k limits. The problem is that
you still can not input data with fairly large size such as 7MB or
above, and I don't know if there is anything wrong with the database.

---------------------------(end of

broadcast)---------------------------

TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/users-lounge/docs/faq.html

Aasmund Midttun Godal

aasmund@godal.com - http://www.godal.com/
+47 40 45 20 46

---------------------------(end of broadcast)---------------------------
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to majordomo@postgresql.org so that your
message can get through to the mailing list cleanly

I checked httpd.conf and found the "timeout" setting is 300, I tried
again and the error message in netscape appears immediately as
following:
______________________________________
A network error occurred while netscape
was sending data.
(Network Error: Connection reset by peer)

Try connection again
______________________________________
I want to know if there are some configuration changes that can be
made in order to enable the input of large text data though web
server.

Thank you

qk22

---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org

Mvh,

Johnny J�rgensen

johnny@halfahead.dk
+45 6315 7328

You are right! I checked and realized the line "post_max_size 8M " in
"phpinfo.php" test page, so I changed the "post_max_size" to 800M in
"php.ini" and "Timeout" value to 3000 in httpd.conf. Then everything is
ok now. So that was the Apache and PHP configuration problem.
Thank you for all.

Best regards

qk22

#11Noname
qk22@gmx.co.uk
In reply to: "Johnny Jørgensen" (#8)
Re: Can not input large text data

johnny@halfahead.dk (=?ISO-8859-1?Q?=22Johnny_J=F8rgensen=22?=) wrote in message news:<200110242321330793.0215978B@mail.halfahead.dk>...

That sounds very much like the POST maximum file size, set in php.ini. try phpinfo(), and see what your size is, the default is somewhere pretty near 7MB

*********** REPLY SEPARATOR ***********

On 24-10-2001 at 07:23 qk22@gmx.co.uk wrote:

postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message

news:<20011024001923.22212.qmail@ns.krot.org>...

Maybe this is a problem - take a look at your watch. See how long time

it takes. then check out httpd.conf look for timeout (probably 300 secs).

Reagards,

Aasmund

On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:

tgl@sss.pgh.pa.us (Tom Lane) wrote in message

news:<25124.1003431283@sss.pgh.pa.us>...

I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to

input data within Netscape Navigator, in fact the text fields can

input data very well exceed the 8k and 32k limits. The problem is that

you still can not input data with fairly large size such as 7MB or

above, and I don't know if there is anything wrong with the database.

---------------------------(end of

broadcast)---------------------------

TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/users-lounge/docs/faq.html

Aasmund Midttun Godal

aasmund@godal.com - http://www.godal.com/

+47 40 45 20 46

---------------------------(end of broadcast)---------------------------

TIP 3: if posting/reading through Usenet, please send an appropriate

subscribe-nomail command to majordomo@postgresql.org so that your

message can get through to the mailing list cleanly

I checked httpd.conf and found the "timeout" setting is 300, I tried

again and the error message in netscape appears immediately as

following:

______________________________________

A network error occurred while netscape

was sending data.

(Network Error: Connection reset by peer)

Try connection again

______________________________________

I want to know if there are some configuration changes that can be

made in order to enable the input of large text data though web

server.

Thank you

qk22

---------------------------(end of broadcast)---------------------------

TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org

Mvh,

Johnny J�rgensen

johnny@halfahead.dk

+45 6315 7328

---------------------------(end of broadcast)---------------------------

TIP 4: Don't 'kill -9' the postmaster

You are right! I checked and realized the line "post_max_size 8M " in
"phpinfo.php" test page, so I changed the "post_max_size" to 800M in
"php.ini" and "Timeout" value to 3000 in httpd.conf. Then everything
is ok now. So that was the Apache and PHP configuration problem.
Thank you for all.

Best regards

qk22