UTF8 and KOI8 mini-howto

Started by Oleg Bartunovabout 23 years ago9 messageshackersgeneral

oleg@sai.msu.su

about 23 years ago

hackersgeneral

Hi there,

I've managed to get postgresql working with UTF8 and KOI8.
Here is some mini-howto:
http://www.sai.msu.su/~megera/postgres/utf8.html

Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83

Markus Bertheau

twanger@bluetwanger.de

about 23 years ago

In reply to: Oleg Bartunov (#1)

hackersgeneral

Re: [HACKERS] UTF8 and KOI8 mini-howto

В Птн, 13.06.2003, в 20:02, Oleg Bartunov пишет:

Hi there,

I've managed to get postgresql working with UTF8 and KOI8.
Here is some mini-howto:
http://www.sai.msu.su/~megera/postgres/utf8.html

The correct name for UTF-8 locales is xx_XX.UTF-8, not upper case and
the minus.

--
Markus Bertheau.
Berlin, Berlin.
Germany.

Markus Bertheau

twanger@bluetwanger.de

about 23 years ago

In reply to: Markus Bertheau (#2)

hackersgeneral

Re: [HACKERS] UTF8 and KOI8 mini-howto

В Вск, 15.06.2003, в 21:08, Markus Bertheau пишет:

The correct name for UTF-8 locales is xx_XX.UTF-8, not upper case and

s/not/note/

the minus.

--
Markus Bertheau.
Berlin, Berlin.
Germany.

Markus Bertheau

twanger@bluetwanger.de

about 23 years ago

In reply to: Oleg Bartunov (#1)

hackersgeneral

Re: [HACKERS] UTF8 and KOI8 mini-howto

В Птн, 13.06.2003, в 20:02, Oleg Bartunov пишет:

Hi there,

I've managed to get postgresql working with UTF8 and KOI8.
Here is some mini-howto:
http://www.sai.msu.su/~megera/postgres/utf8.html

select lower('АВЫАВЫА'); returns 'АВЫАВЫА' with this setup here, any
idea why this is the case?

--
Markus Bertheau.
Berlin, Berlin.
Germany.

Oleg Bartunov

oleg@sai.msu.su

about 23 years ago

In reply to: Markus Bertheau (#3)

hackersgeneral

Re: [HACKERS] UTF8 and KOI8 mini-howto

Markus,

I have used ru_RU.utf8 which recognized by system, at least that name
was generated by localedef program.

Oleg
On Sun, 15 Jun 2003, Markus Bertheau wrote:

О©╫О©╫ О©╫О©╫б╨О©╫О©╫, 15.06.2003, О©╫О©╫ 21:08, Markus Bertheau О©╫О©╫О©╫О©╫б╙О©╫О©╫б╤:

The correct name for UTF-8 locales is xx_XX.UTF-8, not upper case and

s/not/note/

the minus.

Oleg Bartunov

oleg@sai.msu.su

about 23 years ago

In reply to: Markus Bertheau (#4)

hackersgeneral

Re: [HACKERS] UTF8 and KOI8 mini-howto

On Sun, 15 Jun 2003, Markus Bertheau wrote:

О©╫О©╫ О©╫О©╫б╤О©╫О©╫, 13.06.2003, О©╫О©╫ 20:02, Oleg Bartunov О©╫О©╫О©╫О©╫б╙О©╫О©╫б╤:

Hi there,

I've managed to get postgresql working with UTF8 and KOI8.
Here is some mini-howto:
http://www.sai.msu.su/~megera/postgres/utf8.html

select lower('О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫'); returns 'О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫' with this setup here, any
idea why this is the case?

No idea :-) I just tested sorting and didn't even tried upper,lower.
I suspect the problem is real. At least, perl (5.6.1) handles uc,lc function
using special pragma 'use utf8'.

Let me know if you get any success.

Oleg

Oleg Bartunov

oleg@sai.msu.su

about 23 years ago

In reply to: Oleg Bartunov (#6)

hackersgeneral

Re: [HACKERS] UTF8 and KOI8 mini-howto

Marcus,

I suspect lower,upper will not works with Unicode.
Read thread http://fts.postgresql.org/db/msg.html?mid=1070198
Tatsuo is the right person to ask.

Oleg
On Mon, 16 Jun 2003, Oleg Bartunov wrote:

On Sun, 15 Jun 2003, Markus Bertheau wrote:

О©╫О©╫ О©╫О©╫б╤О©╫О©╫, 13.06.2003, О©╫О©╫ 20:02, Oleg Bartunov О©╫О©╫О©╫О©╫б╙О©╫О©╫б╤:

Hi there,

I've managed to get postgresql working with UTF8 and KOI8.
Here is some mini-howto:
http://www.sai.msu.su/~megera/postgres/utf8.html

select lower('О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫'); returns 'О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫' with this setup here, any
idea why this is the case?

No idea :-) I just tested sorting and didn't even tried upper,lower.
I suspect the problem is real. At least, perl (5.6.1) handles uc,lc function
using special pragma 'use utf8'.

Let me know if you get any success.

Oleg

Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83

---------------------------(end of broadcast)---------------------------
TIP 9: the planner will ignore your desire to choose an index scan if your
joining column's datatypes do not match

Markus Bertheau

twanger@bluetwanger.de

about 23 years ago

In reply to: Oleg Bartunov (#7)

hackersgeneral

Re: [HACKERS] UTF8 and KOI8 mini-howto

В Пнд, 16.06.2003, в 01:26, Oleg Bartunov пишет:

Markus,

I suspect lower,upper will not works with Unicode.

It doesn't work with KOI8-R here, too.

--
Markus Bertheau.
Berlin, Berlin.
Germany.

Oleg Bartunov

oleg@sai.msu.su

about 23 years ago

In reply to: Markus Bertheau (#8)

hackersgeneral

Re: [HACKERS] UTF8 and KOI8 mini-howto

On Mon, 16 Jun 2003, Markus Bertheau wrote:

О©╫О©╫ О©╫О©╫О©╫О©╫О©╫О©╫, 16.06.2003, О©╫О©╫ 01:26, Oleg Bartunov О©╫О©╫О©╫О©╫б╙О©╫О©╫б╤:

Markus,

I suspect lower,upper will not works with Unicode.

It doesn't work with KOI8-R here, too.

What ? It works for me for years ! Did you check your system locale ?