Z39.50 import loses UTF8 enconding?
Dear all, Whenever I try to import via Z39.50 search from the LOC a record containing Asian charachters the imported record splits up the doublebyte code characters into single characters. Since I am able to query the LOC using UTF8-strings, I guess this might be a sign that the UTF8 encoding was probably lost while doing the import. The encoding problem actually shows even before I import a record and just click the preview options "MARC" or "CARD" in the results window. Going for the "Card" option, I get the following attached error message. Is there somewhere in the perlfiles a fixed encoding setting that I have to change from e.g. iso-5426 to UTF8? I would very much appreciate any hints, where to look. Best regards, Marc Error Message from "Card" preview Koha error The following fatal error has occurred: :87: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!7Z!4I"KF(B.</subfield> ^ :87: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!7Z!4I"KF(B.</subfield> ^ :91: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!3W!:M!YF'XL(B /</subfield> ^ :91: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!3W!:M!YF'XL(B /</subfield> ^ :92: parser error : PCDATA invalid Char value 27 <subfield code="c">$1!7Z!4I"KF(B, $1!7Z!@|!YF'XL(B.</subfield> ^ :92: parser error : PCDATA invalid Char value 27 <subfield code="c">$1!7Z!4I"KF(B, $1!7Z!@|!YF'XL(B.</subfield> ^ :92: parser error : PCDATA invalid Char value 27 <subfield code="c">$1!7Z!4I"KF(B, $1!7Z!@|!YF'XL(B.</subfield> ^ :92: parser error : PCDATA invalid Char value 27 <subfield code="c">$1!7Z!4I"KF(B, $1!7Z!@|!YF'XL(B.</subfield> ^ :96: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!Os(B1$1!JH(B.</subfield> ^ :96: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!Os(B1$1!JH(B.</subfield> ^ :96: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!Os(B1$1!JH(B.</subfield> ^ :96: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!Os(B1$1!JH(B.</subfield> ^ :100: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!0&!GW(B :</subfield> ^ :100: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!0&!GW(B :</subfield> ^ :101: parser error : PCDATA invalid Char value 27 <subfield code="b">$1!0&!GW!5.!PN!3K!JH!Na(B :</subfield> ^ :101: parser error : PCDATA invalid Char value 27 <subfield code="b">$1!0&!GW!5.!PN!3K!JH!Na(B :</subfield> ^ :102: parser error : PCDATA invalid Char value 27 <subfield code="b">$1!Be!U<!CU!<p!0&!GW!L{!WD!?u!L{!WD(B,</subfi ^ :102: parser error : PCDATA invalid Char value 27 <subfield code="b">$1!Be!U<!CU!<p!0&!GW!L{!WD!?u!L{!WD(B,</subfi ^ :107: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!3W!:M(B,</subfield> ^ :107: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!3W!:M(B,</subfield> ^ :109: parser error : PCDATA invalid Char value 27 <subfield code="t">$1!3W!:M(B.</subfield> ^ :109: parser error : PCDATA invalid Char value 27 <subfield code="t">$1!3W!:M(B.</subfield> ^ :113: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!7Z!@|(B.</subfield> ^ :113: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!7Z!@|(B.</subfield> ^ :117: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!3W!:M(B,</subfield> ^ :117: parser error : PCDATA invalid Char value 27 <subfield code="a">$1!3W!:M(B,</subfield> ^ :119: parser error : PCDATA invalid Char value 27 <subfield code="t">$1!3W!:M(B.</subfield> ^ :119: parser error : PCDATA invalid Char value 27 <subfield code="t">$1!3W!:M(B.</subfield> ^ at /usr/share/koha/intranet/cgi-bin/catalogue/showmarc.pl line 76 Apache Server version: Apache/2.2.3 Server built: Apr 16 2008 21:14:34 Koha 3.01.00.002 Koha DB 3.0100002 MySQL mysql Ver 14.12 Distrib 5.0.32, for pc-linux-gnu (x86_64) using readline 5.2 OS Linux sinokoha 2.6.18-6-amd64 #1 SMP Tue Aug 19 04:30:56 UTC 2008 x86_64 GNU/Linux Perl 5.008008
Try searching the LOC via their own web interface. You may find that the record itself contains the error. If not, please send us a link to it so we can try to import the same record on test systems. --Joe Atzberger 2008/9/10 Marc Nürnberger <marc.nuernberger@gmx.de>
Dear all,
Whenever I try to import via Z39.50 search from the LOC a record containing Asian charachters the imported record splits up the doublebyte code characters into single characters.
Since I am able to query the LOC using UTF8-strings, I guess this might be a sign that the UTF8 encoding was probably lost while doing the import.
The encoding problem actually shows even before I import a record and just click the preview options "MARC" or "CARD" in the results window. Going for the "Card" option, I get the following attached error message.
Is there somewhere in the perlfiles a fixed encoding setting that I have to change from e.g. iso-5426 to UTF8?
I would very much appreciate any hints, where to look.
Best regards, Marc
Error Message from "Card" preview
Koha error
The following fatal error has occurred:
:87: parser error : PCDATA invalid Char value 27 <subfield code="a">�!7Z!4I"KF.</subfield> ^ :87: parser error : PCDATA invalid Char value 27 <subfield code="a">�!7Z!4I"KF.</subfield> ^ :91: parser error : PCDATA invalid Char value 27 <subfield code="a">�!3W!:M!YF'XL /</subfield> ^ :91: parser error : PCDATA invalid Char value 27 <subfield code="a">�!3W!:M!YF'XL /</subfield> ^ :92: parser error : PCDATA invalid Char value 27 <subfield code="c">�!7Z!4I"KF, �!7Z!@|!YF'XL.</subfield> ^ :92: parser error : PCDATA invalid Char value 27 <subfield code="c">�!7Z!4I"KF, �!7Z!@|!YF'XL.</subfield> ^ :92: parser error : PCDATA invalid Char value 27 <subfield code="c">�!7Z!4I"KF, �!7Z!@|!YF'XL.</subfield> ^ :92: parser error : PCDATA invalid Char value 27 <subfield code="c">�!7Z!4I"KF, �!7Z!@|!YF'XL.</subfield> ^ :96: parser error : PCDATA invalid Char value 27 <subfield code="a">�!Os1�!JH.</subfield> ^ :96: parser error : PCDATA invalid Char value 27 <subfield code="a">�!Os1�!JH.</subfield> ^ :96: parser error : PCDATA invalid Char value 27 <subfield code="a">�!Os1�!JH.</subfield> ^ :96: parser error : PCDATA invalid Char value 27 <subfield code="a">�!Os1�!JH.</subfield> ^ :100: parser error : PCDATA invalid Char value 27 <subfield code="a">�!0&!GW :</subfield> ^ :100: parser error : PCDATA invalid Char value 27 <subfield code="a">�!0&!GW :</subfield> ^ :101: parser error : PCDATA invalid Char value 27 <subfield code="b">�!0&!GW!5.!PN!3K!JH!Na :</subfield> ^ :101: parser error : PCDATA invalid Char value 27 <subfield code="b">�!0&!GW!5.!PN!3K!JH!Na :</subfield> ^ :102: parser error : PCDATA invalid Char value 27 <subfield code="b">�!Be!U<!CU!<p!0&!GW!L{!WD!?u!L{!WD,</subfi ^ :102: parser error : PCDATA invalid Char value 27 <subfield code="b">�!Be!U<!CU!<p!0&!GW!L{!WD!?u!L{!WD,</subfi ^ :107: parser error : PCDATA invalid Char value 27 <subfield code="a">�!3W!:M,</subfield> ^ :107: parser error : PCDATA invalid Char value 27 <subfield code="a">�!3W!:M,</subfield> ^ :109: parser error : PCDATA invalid Char value 27 <subfield code="t">�!3W!:M.</subfield> ^ :109: parser error : PCDATA invalid Char value 27 <subfield code="t">�!3W!:M.</subfield> ^ :113: parser error : PCDATA invalid Char value 27 <subfield code="a">�!7Z!@|.</subfield> ^ :113: parser error : PCDATA invalid Char value 27 <subfield code="a">�!7Z!@|.</subfield> ^ :117: parser error : PCDATA invalid Char value 27 <subfield code="a">�!3W!:M,</subfield> ^ :117: parser error : PCDATA invalid Char value 27 <subfield code="a">�!3W!:M,</subfield> ^ :119: parser error : PCDATA invalid Char value 27 <subfield code="t">�!3W!:M.</subfield> ^ :119: parser error : PCDATA invalid Char value 27 <subfield code="t">�!3W!:M.</subfield> ^ at /usr/share/koha/intranet/cgi-bin/catalogue/showmarc.pl line 76
Apache Server version: Apache/2.2.3 Server built: Apr 16 2008 21:14:34 Koha 3.01.00.002 Koha DB 3.0100002 MySQL mysql Ver 14.12 Distrib 5.0.32, for pc-linux-gnu (x86_64) using readline 5.2 OS Linux sinokoha 2.6.18-6-amd64 #1 SMP Tue Aug 19 04:30:56 UTC 2008 x86_64 GNU/Linux Perl 5.008008 _______________________________________________ Koha mailing list Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
participants (2)
-
Joe Atzberger -
Marc Nürnberger