[BUGS] \w doesn't match non-ASCII letters

#1

oocms=3D# select '=D1=84' ~ '^\\w$';
?column?
----------
f
(1 =D0=B7=D0=B0=D0=BF=D0=B8=D1=81=D1=8C)

or

oocms=3D# select '=C3=A4' ~ '^\\w$';
?column?
----------
f
(1 =D0=B7=D0=B0=D0=BF=D0=B8=D1=81=D1=8C)

both should return true, as does=20

oocms=3D# select 'n' ~ '^\\w$';
?column?
----------
t
(1 =D0=B7=D0=B0=D0=BF=D0=B8=D1=81=D1=8C)

Thanks.

--=20
Markus Bertheau <twanger (AT) bluetwanger (DOT) de>

---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to majordomo (AT) postgresql (DOT) org

#2

Markus Bertheau wrote:

Quote:

oocms=# select 'ф' ~ '^\\w$';
?column?
----------
f
(1 запись)

What locale are you using for LC_COLLATE? If it's C or POSIX, you need
to change it and re-initdb.

---------------------------(end of broadcast)---------------------------
TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faqs/FAQ.html

#3

Peter Eisentraut <peter_e (AT) gmx (DOT) net> writes:

Quote:

Markus Bertheau wrote:
oocms=# select 'ф' ~ '^\\w$';
?column?
----------
f
(1 запись)

What locale are you using for LC_COLLATE? If it's C or POSIX, you need
to change it and re-initdb.

Another likely cause of trouble is that the regexp character
classification stuff is presently based on <ctype.h> functions and thus
cannot work in multibyte encodings.

regards, tom lane

---------------------------(end of broadcast)---------------------------
TIP 7: don't forget to increase your free space map settings

#4

=D0=92 =D0=9F=D0=BD=D0=B4, 14.06.2004, =D0=B2 17:25, Tom Lane =D0=BF=D0=B8=
=D1=88=D0=B5=D1=82:

Quote:

Peter Eisentraut <peter_e (AT) gmx (DOT) net> writes:
Markus Bertheau wrote:
oocms=3D# select '=D1=84' ~ '^\\w$';
?column?
----------
f
(1 =D0=B7=D0=B0=D0=BF=D0=B8=D1=81=D1=8C)
=20
What locale are you using for LC_COLLATE? If it's C or POSIX, you need=
=20
to change it and re-initdb.
=20
Another likely cause of trouble is that the regexp character
classification stuff is presently based on <ctype.h> functions and thus
cannot work in multibyte encodings.

This is in a UTF-8 database, so yes, these are multibyte characters. Is
there something planned to support UTF-8 in regexps?

--=20
Markus Bertheau <twanger (AT) bluetwanger (DOT) de>

---------------------------(end of broadcast)---------------------------
TIP 4: Don't 'kill -9' the postmaster

#5

Markus Bertheau <twanger (AT) bluetwanger (DOT) de> writes:

Quote:

Is there something planned to support UTF-8 in regexps?

It'd be relatively easy to use the <wctype.h> functions here if we
were convinced that pg_mb2wchar() generated exactly the same
wide-character encoding as the C library is expecting for the current
LC_CTYPE setting. In the absence of such a guarantee I think we'd
have to convert the pg_wchar back to multibyte form and then apply
mbstowcs(), which is rather painful, not least because our wide
character support doesn't seem to have any function for converting
back to multibyte form ...

Tatsuo, any thoughts here?

regards, tom lane

---------------------------(end of broadcast)---------------------------
TIP 4: Don't 'kill -9' the postmaster

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

[BUGS] \w doesn't match non-ASCII letters

mailing.database.pgsql-bugs mailing.database.pgsql-bugs

[BUGS] \w doesn't match non-ASCII letters - 06-14-2004 , 10:01 AM

Re: [BUGS] \w doesn't match non-ASCII letters - 06-14-2004 , 10:20 AM

Re: [BUGS] \w doesn't match non-ASCII letters - 06-14-2004 , 10:31 AM

Re: [BUGS] \w doesn't match non-ASCII letters - 06-14-2004 , 11:42 AM

Re: [BUGS] \w doesn't match non-ASCII letters - 06-14-2004 , 11:55 AM