Unicode and such

Thread view:

EdwardH - 20 Oct 2005 12:39 GMT

The file "höhö" is shown as "h?h?" when I get a file.getName().

java.nio.charset.Charset.defaultCharset().name()
US-ASCII

System.getProperty("file.encoding")
ANSI_X3.4-1968

I've played around and set file.encoding to ascii, utf-8, utf-16, cp437
and iso-8859-1. Nothing helps.

Can anyone tell me what to do to fix this?

(I'm running and amd64 linux system, btw).

Reply to this Message

Roedy Green - 20 Oct 2005 12:45 GMT

>Can anyone tell me what to do to fix this?

Try setting the encoding specifically at file open.

Signature

Canadian Mind Products, Roedy Green.
http://mindprod.com Again taking new Java programming contracts.

Reply to this Message

EdwardH - 20 Oct 2005 13:03 GMT

> Try setting the encoding specifically at file open.

Where would one do that?

File doesn't take a (String filename, String encoding) constructor.

Reply to this Message

EdwardH - 20 Oct 2005 14:23 GMT

>> Try setting the encoding specifically at file open.
>
> Where would one do that?
>
> File doesn't take a (String filename, String encoding) constructor.

Fixed!

export LC_CTYPE=en_US

It was previously POSIX, which I'm sure is short for "Piece of sh.t IX".

Reply to this Message

Roedy Green - 20 Oct 2005 23:58 GMT

>Where would one do that?
>
>File doesn't take a (String filename, String encoding) constructor.

The file class has nothing to do with contents or reading or writing.
It is about file names and existence.

You need to look elsewhere. In regular file i/o it is the Readers and
Writers.

In nio look at the Charset, CharsetDecoder

Signature

Canadian Mind Products, Roedy Green.
http://mindprod.com Again taking new Java programming contracts.

Reply to this Message

Chris Uppal - 20 Oct 2005 13:47 GMT

> The file "höhö" is shown as "h?h?" when I get a file.getName().
>
> java.nio.charset.Charset.defaultCharset().name()
> US-ASCII

So the system has no way of printing out the name using the default charset.
If you check the four chars in the name then they, presumably, will not include
63 (the question mark), but will have the correct Unicode code point for ö
(whatever that might be).

You don't say how you are viewing the filename, but whatever it is (debugger,
System.out.println(), ...) will need to be told to use a charset that can
represent ö.

> System.getProperty("file.encoding")
> ANSI_X3.4-1968
>
> I've played around and set file.encoding to ascii, utf-8, utf-16, cp437
> and iso-8859-1. Nothing helps.

I don't know (off the top of my head) what the 'file.encoding' property is used
for, but I very much doubt if it's relevant here. At a guess it's used as the
default charset for interpreting the /contents/ of files -- but that's a guess.

-- chris

Reply to this Message

Mike Schilling - 21 Oct 2005 02:29 GMT

> I don't know (off the top of my head) what the 'file.encoding' property is
> used
> for, but I very much doubt if it's relevant here. At a guess it's used as
> the
> default charset for interpreting the /contents/ of files -- but that's a
> guess.

You're right; it's the default encoding used by FileReader and FileWriter.

Reply to this Message

Thomas Fritsch - 21 Oct 2005 20:59 GMT

>> I don't know (off the top of my head) what the 'file.encoding' property
>> is used for, [...] At a guess it's used as the
>> default charset for interpreting the /contents/ of files -- but that's a
>> guess.
>
> You're right; it's the default encoding used by FileReader and FileWriter.

Even more: it's the default encoding used by
InputStreamReader, OutputStreamWriter
String ( constructor String(byte[]), method getBytes() )

Signature

"TFritsch$t-online:de".replace(':','.').replace('$','@')

Reply to this Message

Mike Schilling - 21 Oct 2005 22:52 GMT

>>> I don't know (off the top of my head) what the 'file.encoding' property
>>> is used for, [...] At a guess it's used as the
[quoted text clipped - 7 lines]
> InputStreamReader, OutputStreamWriter
> String ( constructor String(byte[]), method getBytes() )

So it is. That is, it's the "defaut encoding", period. Misleadingly named,
if you ask me.

Reply to this Message

zero - 20 Oct 2005 14:39 GMT

EdwardH <edwardh@N:O:S:P:A:M:edward.dyndns.org> wrote in news:nnL5f.148696
$dP1.506571@newsc.telia.net:

> The file "höhö" is shown as "h?h?" when I get a file.getName().
>
[quoted text clipped - 10 lines]
>
> (I'm running and amd64 linux system, btw).

omg I'm getting nightmares again... I had a similar problem with
retreiving a name from a Clipper database in an internship (I had to
convert an old Clipper program to Java). In the end I just gave up and
added some code that replaced the ö characters with their Unicode
equivalent.

Reply to this Message

Unicode and such

Free Magazines