Hi,<br><br><a href="http://public.m-plify.net/mysql/MySQL_Charset_Handling.pdf">http://public.m-plify.net/mysql/MySQL_Charset_Handling.pdf</a><br><br><a href="http://dev.mysql.com/doc/refman/5.0/en/charset-connection.html">http://dev.mysql.com/doc/refman/5.0/en/charset-connection.html</a><br>
<br>May be these links can de-mistfy some of your doubts.<br><br>if you see the some of the postings on this page, then you might be able to even resolve this issue and make the DB behave in a standard way.<br><br>Regards,<br>
Satya<br><a href="http://www.osslabs.biz">www.osslabs.biz</a><br><br><div class="gmail_quote">On Sun, Feb 22, 2009 at 10:21 PM, ZHANG, YIN <span dir="ltr">&lt;<a href="mailto:yzhang4@kent.edu">yzhang4@kent.edu</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">









<div link="blue" vlink="purple" lang="EN-US">

<div>

<div>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">Hello
All, </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">&nbsp;</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">We
are using Koha 3.0 in Ubuntu 8 for a collection with many items in foreign
languages. It is our understanding that Koha 3.0 should be able to handle
Unicode. However, we have problems to insert any some special characters in
non-English. </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">&nbsp;</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">Basically,
the database will chop anything followed a special character. If the string we
try to insert is "Den økonomiske", only "Den " gets in. If a special character
starts a string, it ends up with an empty string in the database. </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">&nbsp;</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">Here
is our Koha database configuration as created: </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">+--------------------------+----------------------------+</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
Variable_name&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
|
Value&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
|</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">+--------------------------+----------------------------+</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_client&nbsp;&nbsp;&nbsp;&nbsp; |
utf8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_connection |
utf8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_database&nbsp;&nbsp; |
utf8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_filesystem |
binary&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_results&nbsp;&nbsp;&nbsp; |
utf8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_server&nbsp;&nbsp;&nbsp;&nbsp; |
utf8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_system&nbsp;&nbsp;&nbsp;&nbsp; |
utf8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_sets_dir&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |
/usr/share/mysql/charsets/ | </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">+--------------------------+----------------------------+</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">&nbsp;</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">There
is a twist that we can't understand. When we temporally set the font to latin1
(e.g., set names latin1), the database can take the special characters without
problem: </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">&nbsp;</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">+--------------------------+----------------------------+</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
Variable_name&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| Value&nbsp;&nbsp;&nbsp;
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;|</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">+--------------------------+----------------------------+</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_client&nbsp;&nbsp;&nbsp;&nbsp; |
latin1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_connection |
latin1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_database&nbsp;&nbsp; |
utf8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_filesystem |
binary&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_results&nbsp;&nbsp;&nbsp; |
latin1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_server&nbsp;&nbsp;&nbsp;&nbsp; |
utf8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_set_system&nbsp;&nbsp;&nbsp;&nbsp; |
utf8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">|
character_sets_dir &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;| /usr/share/mysql/charsets/
| </span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">+--------------------------+----------------------------+</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">&nbsp;</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">Any
idea what is going on? Thanks so much for your help in advance! <span style="color: rgb(0, 51, 153);"></span></span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">&nbsp;</span></p>

<p><span style="font-size: 10pt; font-family: &quot;Courier New&quot;;">Yin</span></p>

</div>

<div>

<p><span style="color: rgb(0, 51, 153);">&nbsp;</span></p>

</div>

<p><i><span style="font-size: 8pt; color: rgb(0, 51, 153);">Yin Zhang</span></i></p>

<p><i><span style="font-size: 8pt; color: rgb(0, 51, 153);">School of Library and Information Science<br>
Kent State University, Kent, OH 44242<br>
email: <a href="mailto:yzhang4@kent.edu" target="_blank">yzhang4@kent.edu</a></span></i><i><span style="font-size: 8pt; color: rgb(0, 51, 153);"></span></i></p>

<p style="margin-left: 0.5in;"><span style="color: rgb(0, 51, 153);">&nbsp;</span></p>

<p style="margin-left: 0.5in;">&nbsp;</p>

</div>

</div>


<br>_______________________________________________<br>
Koha mailing list<br>
<a href="mailto:Koha@lists.katipo.co.nz">Koha@lists.katipo.co.nz</a><br>
<a href="http://lists.katipo.co.nz/mailman/listinfo/koha" target="_blank">http://lists.katipo.co.nz/mailman/listinfo/koha</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br>Regards,<br>Satyanarayana H.S.<br>Development Head<br>-- <br>&quot;A small group of determined spirits, with an unquenchable thirst for their mission, can alter the course of history.&quot; -Mahatma Gandhi<br>