Thursday, March 11, 2010

Issue: Non-ASCII characters change to inverted question mark (“¿”) after save

I was recently entering some content into a Confluence wiki page that included some non-ASCII characters, such as “→” (U+2192, "RIGHTWARDS ARROW") and “←” (U+2190, LEFTWARDS ARROW).  (I can easily type those characters using Alt+Numpad 26 and Alt+Numpad 27 respectively, since my Windows XP machine is set to Code page 437.) However, after saving the document and coming back and looking at it later, all such characters had been changed to inverted (upside down) question mark characters, “¿”.

Investigation revealed that the problem was that the underlying Oracle database to which the content was being saved was set to use the Western European character set ISO-8859-1, as opposed to a more comprehensive character encoding such as UTF-8.  Since ISO-8859-1 doesn’t include the “leftwards arrow” or “rightwards arrow” characters, Oracle converted those characters to the inverted question mark instead.

I wanted to share this here since this information might be helpful to anyone encountering a similar issue in a variety of different possible applications, not necessarily just Confluence.

3 comments:

  1. Well, you taught your Dad something new this morning. I always knew about the numbers on the keyboard with the activation of the NmLk key, but never knew about the 'numpad' option. I tried it and it worked, but unfortunately it did not work for my Tetris game. I still have to use the cursor keys which I find a bit annoying and clumsy.... But thanks for the 'numpad' education.

    ReplyDelete
  2. :-) thanks a lot man, even I was facing the same problem

    ReplyDelete
  3. If the multi lingual characters stored or retrieved are appearing as inverted question marks, follow this blog for how to resolve it - http://tech-turf.blogspot.com/2015/09/oracle-multi-lingual-data-being-saved.html

    ReplyDelete

Non-spammers: Thanks for visiting! Please go ahead and leave a comment; I read them all!

Attention SPAMMERS: I review all comments before they get posted, and I REPORT 100% of spam comments to Google as spam! Why not avoid getting your account banned as quickly -- and save us both a little time -- by skipping this comment form and moving on to the next one on your list? Thanks, and I hope you have a great day!