INSERTs slow

Started by Dominique ROUSSEAUabout 24 years ago6 messagesgeneral
Jump to latest
#1Dominique ROUSSEAU
d.rousseau@nnx.com

Hi,

I have a table with around 1.5 millions entries, and INSERTs are very
slowwwww.
This table has 3 indices on "char(32)" fields.

Without indices, the INSERTs are fluent, with indices, it crawls :/

Any idea ?

As a sidenote, it was going rather well when the table contained only 1
million entries.

Dom

--
Dominique Rousseau <d.rousseau@nnx.com>
Neuronnexion - http://www.neuronnexion.com

#2PG Explorer
pgmail@pgexplorer.com
In reply to: Dominique ROUSSEAU (#1)
Re: INSERTs slow

1) Do you have constraints on the index ie Unique or Primary Key?

2) Do you have any triggers or rules on the table.

3) How often do you do a VACUUM ANALYZE

All these will influence the speed

http://www.pgexplorer.com

GUI Frontend for PostgreSQL

----- Original Message -----

From: "Dominique ROUSSEAU" <d.rousseau@nnx.com>
To: <pgsql-general@postgresql.org>
Sent: Tuesday, March 26, 2002 11:07 AM
Subject: [GENERAL] INSERTs slow

Show quoted text

Hi,

I have a table with around 1.5 millions entries, and INSERTs are very
slowwwww.
This table has 3 indices on "char(32)" fields.

Without indices, the INSERTs are fluent, with indices, it crawls :/

Any idea ?

As a sidenote, it was going rather well when the table contained only 1
million entries.

Dom

--
Dominique Rousseau <d.rousseau@nnx.com>
Neuronnexion - http://www.neuronnexion.com

---------------------------(end of broadcast)---------------------------
TIP 6: Have you searched our list archives?

http://archives.postgresql.org

#3Dominique ROUSSEAU
d.rousseau@nnx.com
In reply to: PG Explorer (#2)
Re: INSERTs slow

Le Tue, Mar 26, 2002 at 03:30:58PM +0200, PGMailList [pgmail@pgexplorer.com] a ᅵcrit:

1) Do you have constraints on the index ie Unique or Primary Key?

they are just :
CREATE INDEX idx1 ON table(field1);

2) Do you have any triggers or rules on the table.

3) How often do you do a VACUUM ANALYZE

that's what I started doing, but doesn't change much :/
once a day
(there are thousands of INSERTs each day)

Dom

----- Original Message -----

From: "Dominique ROUSSEAU" <d.rousseau@nnx.com>
To: <pgsql-general@postgresql.org>
Sent: Tuesday, March 26, 2002 11:07 AM
Subject: [GENERAL] INSERTs slow

I have a table with around 1.5 millions entries, and INSERTs are very
slowwwww.
This table has 3 indices on "char(32)" fields.

Without indices, the INSERTs are fluent, with indices, it crawls :/

Any idea ?

As a sidenote, it was going rather well when the table contained only 1
million entries.

Dom

--
Dominique Rousseau <d.rousseau@nnx.com>
Neuronnexion - http://www.neuronnexion.com

---------------------------(end of broadcast)---------------------------
TIP 6: Have you searched our list archives?

http://archives.postgresql.org

--
Dominique Rousseau <d.rousseau@nnx.com>
Neuronnexion - http://www.neuronnexion.com

#4PG Explorer
pgmail@pgexplorer.com
In reply to: Dominique ROUSSEAU (#1)
Re: INSERTs slow

Have you tried dropping and recreating the index.

or

REINDEX { TABLE | DATABASE | INDEX } name [ FORCE ]

Maybe that index of yours is not so kosher

http://www.pgexplorer.com

----- Original Message -----
From: "Dominique ROUSSEAU" <d.rousseau@nnx.com>
To: <pgsql-general@postgresql.org>
Sent: Tuesday, March 26, 2002 3:40 PM
Subject: Re: [GENERAL] INSERTs slow

Le Tue, Mar 26, 2002 at 03:30:58PM +0200, PGMailList

[pgmail@pgexplorer.com] a ᅵcrit:

1) Do you have constraints on the index ie Unique or Primary Key?

they are just :
CREATE INDEX idx1 ON table(field1);

2) Do you have any triggers or rules on the table.

3) How often do you do a VACUUM ANALYZE

that's what I started doing, but doesn't change much :/
once a day
(there are thousands of INSERTs each day)

Dom

----- Original Message -----

From: "Dominique ROUSSEAU" <d.rousseau@nnx.com>
To: <pgsql-general@postgresql.org>
Sent: Tuesday, March 26, 2002 11:07 AM
Subject: [GENERAL] INSERTs slow

I have a table with around 1.5 millions entries, and INSERTs are very
slowwwww.
This table has 3 indices on "char(32)" fields.

Without indices, the INSERTs are fluent, with indices, it crawls :/

Any idea ?

As a sidenote, it was going rather well when the table contained only

1

million entries.

Dom

--
Dominique Rousseau <d.rousseau@nnx.com>
Neuronnexion - http://www.neuronnexion.com

---------------------------(end of

broadcast)---------------------------

Show quoted text

TIP 6: Have you searched our list archives?

http://archives.postgresql.org

--
Dominique Rousseau <d.rousseau@nnx.com>
Neuronnexion - http://www.neuronnexion.com

---------------------------(end of broadcast)---------------------------
TIP 2: you can get off all lists at once with the unregister command
(send "unregister YourEmailAddressHere" to majordomo@postgresql.org)

#5PG Explorer
pgmail@pgexplorer.com
In reply to: Dominique ROUSSEAU (#1)
Re: INSERTs slow

You can also start the server with
-F
[Disables fsync calls for performance improvement, at the risk of data
corruption in event of a system crash. Read the detailed documentation
before using this! ]

But your server HAS TO BE ON A VERY GOOD UPS...

http://www.pgexplorer.com

----- Original Message -----
From: "Dominique ROUSSEAU" <d.rousseau@nnx.com>
To: <pgsql-general@postgresql.org>
Sent: Tuesday, March 26, 2002 3:40 PM
Subject: Re: [GENERAL] INSERTs slow

Le Tue, Mar 26, 2002 at 03:30:58PM +0200, PGMailList

[pgmail@pgexplorer.com] a ᅵcrit:

1) Do you have constraints on the index ie Unique or Primary Key?

they are just :
CREATE INDEX idx1 ON table(field1);

2) Do you have any triggers or rules on the table.

3) How often do you do a VACUUM ANALYZE

that's what I started doing, but doesn't change much :/
once a day
(there are thousands of INSERTs each day)

Dom

----- Original Message -----

From: "Dominique ROUSSEAU" <d.rousseau@nnx.com>
To: <pgsql-general@postgresql.org>
Sent: Tuesday, March 26, 2002 11:07 AM
Subject: [GENERAL] INSERTs slow

I have a table with around 1.5 millions entries, and INSERTs are very
slowwwww.
This table has 3 indices on "char(32)" fields.

Without indices, the INSERTs are fluent, with indices, it crawls :/

Any idea ?

As a sidenote, it was going rather well when the table contained only

1

million entries.

Dom

--
Dominique Rousseau <d.rousseau@nnx.com>
Neuronnexion - http://www.neuronnexion.com

---------------------------(end of

broadcast)---------------------------

Show quoted text

TIP 6: Have you searched our list archives?

http://archives.postgresql.org

--
Dominique Rousseau <d.rousseau@nnx.com>
Neuronnexion - http://www.neuronnexion.com

---------------------------(end of broadcast)---------------------------
TIP 2: you can get off all lists at once with the unregister command
(send "unregister YourEmailAddressHere" to majordomo@postgresql.org)

#6Dominique ROUSSEAU
d.rousseau@nnx.com
In reply to: Dominique ROUSSEAU (#1)
Re: INSERTs slow

Le Wed, Mar 27, 2002 at 07:22:01AM +0200, Dirk Broodryk [dirkb%ferreiragroup.co.za@ferreiragroup.co.za] a ᅵcrit:

Just a notion.. try varchar . .read someware that it's faster accessing it
than normal char.. I have a table with 8 mill records, and find it not to
bad..

you mean that indices on VARCHAR() would be faster than indices on
CHAR() ??

Dom

--
Dominique Rousseau <d.rousseau@nnx.com>
Neuronnexion - http://www.neuronnexion.com