What encoding to use for this error?

Started by Patrick Hatcherabout 21 years ago3 messagesgeneral
Jump to latest
#1Patrick Hatcher
pathat@comcast.net

We're testing moving our data to UNICODE from LATIN1, but when I try to
import my data, I get the following error:

DBD::Pg::st execute failed: ERROR: Unicode characters greater than or
equal to
0x10000 are not supported
CONTEXT: COPY bcp_mdc_products, line 120, column description: "Lladr�
"Ducks in
a Basket""

What encoding should I be using for characters like this? I thought
unicode was supposed to handle these types of characters?

TIA

Patrick Hatcher

#2Tom Lane
tgl@sss.pgh.pa.us
In reply to: Patrick Hatcher (#1)
Re: What encoding to use for this error?

Patrick Hatcher <pathat@comcast.net> writes:

We're testing moving our data to UNICODE from LATIN1, but when I try to
import my data, I get the following error:

DBD::Pg::st execute failed: ERROR: Unicode characters greater than or
equal to
0x10000 are not supported
CONTEXT: COPY bcp_mdc_products, line 120, column description: "Lladr�
"Ducks in
a Basket""

Do you have client_encoding set properly while doing the import?
If the incoming data is LATIN1, you need to say so, so that the backend
knows how to convert it to UNICODE.

regards, tom lane

#3Patrick Hatcher
pathat@comcast.net
In reply to: Tom Lane (#2)
Re: What encoding to use for this error?

Thank you. I'll take a look at our data export function.

Tom Lane wrote:

Show quoted text

Patrick Hatcher <pathat@comcast.net> writes:

We're testing moving our data to UNICODE from LATIN1, but when I try to
import my data, I get the following error:

DBD::Pg::st execute failed: ERROR: Unicode characters greater than or
equal to
0x10000 are not supported
CONTEXT: COPY bcp_mdc_products, line 120, column description: "Lladr�
"Ducks in
a Basket""

Do you have client_encoding set properly while doing the import?
If the incoming data is LATIN1, you need to say so, so that the backend
knows how to convert it to UNICODE.

regards, tom lane