Help needed to ensure MARC export is in UTF-8 encoding
Recently I was showing off what Koha and Zotero (www.zotero.org) can do, and I realized that when Zotero scrapes data it does not come into Zotero as UTF-8 text. The encoding and hence anything in Vietnamese gets jumbled up. With help from the Zotero community I learned that my instance of Koha was exporting MARC records in ISO-8859-1 not UTF-8. For the forum discussion, see https://forums.zotero.org/discussion/39395/koha-translator-encoding-problem/.... As an example, you can look up the record at http://koha.theology-vietnam.org/cgi-bin/koha/opac-detail.pl?biblionumber=11&query_desc=kw%2Cwrdl%3A%20Kinh%20Th%C3%A1nh. The title is *Để Hiểu Kinh Thánh Cựu Ước*, but in Zotero it comes over as *Äể Hiểu Kinh ThaÌnh Cựu*. I checked several other libraries running Koha and saw that they were configured in such a way that this problem does not occur. The odd thing is that a manually exported MARC record is read by my text editor as UTF-8, but web browsers and hence Zotero read them as ISO-8859-1. I am wondering if anyone can help me figure out how to configure Koha to export MARC records in UTF-8. Daniel
Hello Daniel, I think that in the past I run into the same problemand I solved it. But for what I remember it an Apache Mysql problem. Try this: http://wiki.koha-community.org/wiki/Encoding_and_Character_Sets_in_Koha Hope it helps. Kind regards, Francisco 2014-08-21 14:28 GMT+08:00 Daniel Owens <dcowens76@gmail.com>:
Recently I was showing off what Koha and Zotero (www.zotero.org) can do, and I realized that when Zotero scrapes data it does not come into Zotero as UTF-8 text. The encoding and hence anything in Vietnamese gets jumbled up. With help from the Zotero community I learned that my instance of Koha was exporting MARC records in ISO-8859-1 not UTF-8. For the forum discussion, see https://forums.zotero.org/discussion/39395/koha- translator-encoding-problem/#Item_10.
As an example, you can look up the record at http://koha.theology-vietnam. org/cgi-bin/koha/opac-detail.pl?biblionumber=11&query_desc= kw%2Cwrdl%3A%20Kinh%20Th%C3%A1nh. The title is *Để Hiểu Kinh Thánh Cựu Ước*, but in Zotero it comes over as *Ä ể Hiểu Kinh ThaÌ nh Cựu*.
I checked several other libraries running Koha and saw that they were configured in such a way that this problem does not occur. The odd thing is that a manually exported MARC record is read by my text editor as UTF-8, but web browsers and hence Zotero read them as ISO-8859-1.
I am wondering if anyone can help me figure out how to configure Koha to export MARC records in UTF-8.
Daniel
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
-- Francisco Peixoto
Hello Daniel, Zeno fixed something like that recently on bug 12174. The patch has not been backported on 3.16 yet. Regards, Jonathan http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=12174 2014-08-21 8:28 GMT+02:00 Daniel Owens <dcowens76@gmail.com>:
Recently I was showing off what Koha and Zotero (www.zotero.org) can do, and I realized that when Zotero scrapes data it does not come into Zotero as UTF-8 text. The encoding and hence anything in Vietnamese gets jumbled up. With help from the Zotero community I learned that my instance of Koha was exporting MARC records in ISO-8859-1 not UTF-8. For the forum discussion, see https://forums.zotero.org/discussion/39395/koha-translator-encoding-problem/....
As an example, you can look up the record at http://koha.theology-vietnam.org/cgi-bin/koha/opac-detail.pl?biblionumber=11&query_desc=kw%2Cwrdl%3A%20Kinh%20Th%C3%A1nh. The title is *Để Hiểu Kinh Thánh Cựu Ước*, but in Zotero it comes over as *Ä ể Hiểu Kinh ThaÌ nh Cựu*.
I checked several other libraries running Koha and saw that they were configured in such a way that this problem does not occur. The odd thing is that a manually exported MARC record is read by my text editor as UTF-8, but web browsers and hence Zotero read them as ISO-8859-1.
I am wondering if anyone can help me figure out how to configure Koha to export MARC records in UTF-8.
Daniel
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Okay, good to know. Thanks. Daniel On 8/21/14 2:38 PM, Jonathan Druart wrote:
Hello Daniel,
Zeno fixed something like that recently on bug 12174. The patch has not been backported on 3.16 yet.
Regards, Jonathan
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=12174
2014-08-21 8:28 GMT+02:00 Daniel Owens <dcowens76@gmail.com>:
Recently I was showing off what Koha and Zotero (www.zotero.org) can do, and I realized that when Zotero scrapes data it does not come into Zotero as UTF-8 text. The encoding and hence anything in Vietnamese gets jumbled up. With help from the Zotero community I learned that my instance of Koha was exporting MARC records in ISO-8859-1 not UTF-8. For the forum discussion, see https://forums.zotero.org/discussion/39395/koha-translator-encoding-problem/....
As an example, you can look up the record at http://koha.theology-vietnam.org/cgi-bin/koha/opac-detail.pl?biblionumber=11&query_desc=kw%2Cwrdl%3A%20Kinh%20Th%C3%A1nh. The title is *Để Hiểu Kinh Thánh Cựu Ước*, but in Zotero it comes over as *Ä ể Hiểu Kinh ThaÌ nh Cựu*.
I checked several other libraries running Koha and saw that they were configured in such a way that this problem does not occur. The odd thing is that a manually exported MARC record is read by my text editor as UTF-8, but web browsers and hence Zotero read them as ISO-8859-1.
I am wondering if anyone can help me figure out how to configure Koha to export MARC records in UTF-8.
Daniel
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Hi Daniel, My name is Lan. I’m Vice Director of D&L Technology (www.dlcorp.com.vn / www.koha.vn) We are service provider for Koha in Vietnam ( http://wiki.koha-community.org/wiki/Category:Support_Companies) To answer your question, it seems that you forgot to configure encoding during the installation. To make koha use UTF-8 as default encoding, you need setup following parameter: *1. *Setup Mysql to use UTF-8: by modifying file: */etc/mysql/my.cnf * *init-connect='SET NAMES utf8' * * character-set-server=utf8 collation-server=utf8_general_ci* 2. Update local language to UTF-8 by running command: *update-locale LANG=en_IN.UTF-8* Please note that you need to perform these tasks before creating database in Mysql. Hope that help, Duy Lan 2014-08-21 14:47 GMT+07:00 Daniel Owens <dcowens76@gmail.com>:
Okay, good to know. Thanks.
Daniel
On 8/21/14 2:38 PM, Jonathan Druart wrote:
Hello Daniel,
Zeno fixed something like that recently on bug 12174. The patch has not been backported on 3.16 yet.
Regards, Jonathan
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=12174
2014-08-21 8:28 GMT+02:00 Daniel Owens <dcowens76@gmail.com>:
Recently I was showing off what Koha and Zotero (www.zotero.org) can do, and I realized that when Zotero scrapes data it does not come into Zotero as UTF-8 text. The encoding and hence anything in Vietnamese gets jumbled up. With help from the Zotero community I learned that my instance of Koha was exporting MARC records in ISO-8859-1 not UTF-8. For the forum discussion, see https://forums.zotero.org/discussion/39395/koha- translator-encoding-problem/#Item_10.
As an example, you can look up the record at http://koha.theology-vietnam.org/cgi-bin/koha/opac-detail. pl?biblionumber=11&query_desc=kw%2Cwrdl%3A%20Kinh%20Th%C3%A1nh. The title is *Để Hiểu Kinh Thánh Cựu Ước*, but in Zotero it comes over as *Ä ể Hiểu Kinh ThaÌ nh Cựu*.
I checked several other libraries running Koha and saw that they were configured in such a way that this problem does not occur. The odd thing is that a manually exported MARC record is read by my text editor as UTF-8, but web browsers and hence Zotero read them as ISO-8859-1.
I am wondering if anyone can help me figure out how to configure Koha to export MARC records in UTF-8.
Daniel
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Thanks, this patch was just waht I needed! On 8/21/14 2:38 PM, Jonathan Druart wrote:
Hello Daniel,
Zeno fixed something like that recently on bug 12174. The patch has not been backported on 3.16 yet.
Regards, Jonathan
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=12174
2014-08-21 8:28 GMT+02:00 Daniel Owens <dcowens76@gmail.com>:
Recently I was showing off what Koha and Zotero (www.zotero.org) can do, and I realized that when Zotero scrapes data it does not come into Zotero as UTF-8 text. The encoding and hence anything in Vietnamese gets jumbled up. With help from the Zotero community I learned that my instance of Koha was exporting MARC records in ISO-8859-1 not UTF-8. For the forum discussion, see https://forums.zotero.org/discussion/39395/koha-translator-encoding-problem/....
As an example, you can look up the record at http://koha.theology-vietnam.org/cgi-bin/koha/opac-detail.pl?biblionumber=11&query_desc=kw%2Cwrdl%3A%20Kinh%20Th%C3%A1nh. The title is *Để Hiểu Kinh Thánh Cựu Ước*, but in Zotero it comes over as *Ä ể Hiểu Kinh ThaÌ nh Cựu*.
I checked several other libraries running Koha and saw that they were configured in such a way that this problem does not occur. The odd thing is that a manually exported MARC record is read by my text editor as UTF-8, but web browsers and hence Zotero read them as ISO-8859-1.
I am wondering if anyone can help me figure out how to configure Koha to export MARC records in UTF-8.
Daniel
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
participants (4)
-
Daniel Owens -
Francisco de Abreu Peixoto -
Jonathan Druart -
Lan Vu Duy