Thursday, March 11, 2010

Issue: Non-ASCII characters change to inverted question mark (“¿”) after save

I was recently entering some content into a Confluence wiki page that included some non-ASCII characters, such as “→” (U+2192, "RIGHTWARDS ARROW") and “←” (U+2190, LEFTWARDS ARROW).  (I can easily type those characters using Alt+Numpad 26 and Alt+Numpad 27 respectively, since my Windows XP machine is set to Code page 437.) However, after saving the document and coming back and looking at it later, all such characters had been changed to inverted (upside down) question mark characters, “¿”.

Investigation revealed that the problem was that the underlying Oracle database to which the content was being saved was set to use the Western European character set ISO-8859-1, as opposed to a more comprehensive character encoding such as UTF-8.  Since ISO-8859-1 doesn’t include the “leftwards arrow” or “rightwards arrow” characters, Oracle converted those characters to the inverted question mark instead.

I wanted to share this here since this information might be helpful to anyone encountering a similar issue in a variety of different possible applications, not necessarily just Confluence.

3 comments:

  1. Well, you taught your Dad something new this morning. I always knew about the numbers on the keyboard with the activation of the NmLk key, but never knew about the 'numpad' option. I tried it and it worked, but unfortunately it did not work for my Tetris game. I still have to use the cursor keys which I find a bit annoying and clumsy.... But thanks for the 'numpad' education.

    ReplyDelete
  2. :-) thanks a lot man, even I was facing the same problem

    ReplyDelete
  3. If the multi lingual characters stored or retrieved are appearing as inverted question marks, follow this blog for how to resolve it - http://tech-turf.blogspot.com/2015/09/oracle-multi-lingual-data-being-saved.html

    ReplyDelete

Hi spammers! No need to waste your time here; comments are heavily moderated, so if you like, you can save us both a little time and just move on to the next site. :-)

For everyone else: Thanks for visiting! Your comments are more than welcome!