Koha reindex with Zebra doesn't work
Hi everybody! I have installed Koha 3.6.4 on ubuntu 11.10. All seems to work fine, i can create records and so on, but when i try to reindex the the Zebra database i get the following error: /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -b -r -v Zebra configuration information ================================ Zebra biblio directory = /var/lib/koha/zebradb/biblios Zebra authorities directory = /var/lib/koha/zebradb/authorities Koha directory = /usr/share/koha/intranet/cgi-bin BIBLIONUMBER in : 001$@ BIBLIOITEMNUMBER in : 090$a ================================ skipping authorities ==================== exporting biblio ==================== 1 Records exported: 1 ==================== REINDEXING zebra ==================== 01:50:58-16/04 zebraidx(5748) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== CLEANING ==================== And the records that i have creaate can't be find in the catalogue. I have the following settings: in /etc/koha/zebradb/marc_defs/unimarc/biblios/record.abs /all any melm 001 Local-number,Local-number:n # Local-number (biblionumber can be either in 090$9 or, on some setup, on 001) melm 009 Identifier-standard:w,Identifier-standard:n melm 090$9 Local-number,Local-number:n melm 099$c date-entered-on-file:s,date-entered-on-file:n,date-entered-on-file:y,Date-of-acquisition,Date-of-acquisition:d,Date-of-acquisition:s melm 099$d Date/time-last-modified:s,Date/time-last-modified:n,Date/time-last-modified:y melm 099$t ccode:w/ And the marc record in the Administration panel of Koha are settings as you can see: http://koha.1045719.n5.nabble.com/file/n5642993/koha_marc_mapping.png http://koha.1045719.n5.nabble.com/file/n5642993/koah_mapping.png http://koha.1045719.n5.nabble.com/file/n5642993/marc_001.png Also if i run a Marc Test in the Administration panel i get this error regarding biblio and biblioitem (maybe relating with the problem with Zebra reindexing?): http://koha.1045719.n5.nabble.com/file/n5642993/biblio_error.png Do you konw how to fix this problem? Thank you very much for your help Alex -- View this message in context: http://koha.1045719.n5.nabble.com/Koha-reindex-with-Zebra-doesn-t-work-tp564... Sent from the Koha-general mailing list archive at Nabble.com.
Hi Alex,
REINDEXING zebra ==================== 01:50:58-16/04 zebraidx(5748) [warn] Record didn't contain match fields in (bib1,Local-number)
There is something wrong in Koha English UNIMARC framework. Take a look at: http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=6172 Kind regards, -- Frédéric DEMIANS http://www.tamil.fr/u/fdemians.html
Hi Frédéric, thank you very much for your answer, now i look at the link, and let you konw. Thanks and kind regards. Alex -- View this message in context: http://koha.1045719.n5.nabble.com/Koha-reindex-with-Zebra-doesn-t-work-tp564... Sent from the Koha-general mailing list archive at Nabble.com.
I read the bug report regarding, but in this case, as you can see in the images of Administration panel, seems that the records are matching in a correct way 001$@ e 090$a. So what do you suggest to do? Change the UTF Language? Thanks and kind regards Alex -- View this message in context: http://koha.1045719.n5.nabble.com/Koha-reindex-with-Zebra-doesn-t-work-tp564... Sent from the Koha-general mailing list archive at Nabble.com.
Alex, you have to find out why Zebra can't find Koha record unique identifier (biblionumber) in your biblio records. Use rebuild_zebra.pl and ask to keep exported records: ./rebuild_zebra.pl -r -b -x -k -d ./ In the current directory, you will have a 'biblio' subdirectory containing exported biblio records. Look at them: less biblio/exported_records One field must contain biblionumber. Is it conform to you record.abs Zebra configuration file? -- Frédéric DEMIANS http://www.tamil.fr/u/fdemians.html
Alex, you have to find out why Zebra can't find Koha record unique identifier (biblionumber) in your biblio records. Use rebuild_zebra.pl and ask to keep exported records: ./rebuild_zebra.pl -r -b -x -k -d ./ In the current directory, you will have a 'biblio' subdirectory containing exported biblio records. Look at them: less biblio/exported_records One field must contain biblionumber. Is it conform to you record.abs Zebra configuration file?
Frédéric, thank you for you support. If i reubild i get this: /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -r -b -x -k -d 10:31:35-16/04 zebraidx(9868) [warn] Record didn't contain match fields in (bib1,Local-number) NOTHING cleaned : the export /tmp/vV2omyxDRq has been kept. You can re-run this script with the -s and -d /tmp/vV2omyxDRq parameters if you just want to rebuild zebra after changing the record.abs or another zebra config file Then i go to /tmp/TzhgjKzlXF/biblio/exported_records /<?xml version="1.0" encoding="UTF-8"?> <record xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.loc.gov/MARC21/slim http://www.loc.gov/standards/marcxml/schema/MARC21slim.xsd" xmlns="http://www.loc.gov/MARC21/slim"> <leader> 1111122 1114500</leader> <controlfield tag="001">16</controlfield> <controlfield tag="001">16</controlfield> <datafield tag="090" ind1=" " ind2=" "> <subfield code="a">16</subfield> </datafield> <datafield tag="100" ind1=" " ind2=" "> <subfield code="a">20120416 frey50 </subfield> </datafield> <datafield tag="200" ind1=" " ind2=" "> <subfield code="5">Institute</subfield> <subfield code="a">Institute</subfield> <subfield code="e">Institute</subfield> </datafield> <datafield tag="210" ind1=" " ind2=" "> <subfield code="b">Institute</subfield> </datafield> <datafield tag="500" ind1=" " ind2=" "> <subfield code="a">Title</subfield> </datafield> <datafield tag="517" ind1=" " ind2=" "> <subfield code="e">Title</subfield> </datafield> <datafield tag="606" ind1=" " ind2=" "> <subfield code="a">Subject</subfield> </datafield> <datafield tag="610" ind1=" " ind2=" "> <subfield code="a">Subject</subfield> </datafield> <datafield tag="942" ind1=" " ind2=" "> <subfield code="c">BK</subfield> </datafield> </record>/ My record.abs is set as follow: /all any melm 001 Local-number,Local-number:n # Local-number (biblionumber can be either in 090$9 or, on some setup, on 001) melm 009 Identifier-standard:w,Identifier-standard:n melm 090$9 Local-number,Local-number:n melm 099$c date-entered-on-file:s,date-entered-on-file:n,date-entered-on-file:y,Date-of-acquisition,Date-of-acquisition:d,Date-of-acquisition:s melm 099$d Date/time-last-modified:s,Date/time-last-modified:n,Date/time-last-modified:y melm 099$t ccode:w/ Is it correct? Thanks -- View this message in context: http://koha.1045719.n5.nabble.com/Koha-reindex-with-Zebra-doesn-t-work-tp564... Sent from the Koha-general mailing list archive at Nabble.com.
<record xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.loc.gov/MARC21/slim http://www.loc.gov/standards/marcxml/schema/MARC21slim.xsd" xmlns="http://www.loc.gov/MARC21/slim">
<leader> 1111122 1114500</leader> <controlfield tag="001">16</controlfield> <controlfield tag="001">16</controlfield>
Two 001 tags: that sounds strange.
<datafield tag="090" ind1=" " ind2=" "> <subfield code="a">16</subfield> </datafield>
In records.abs:
melm 090$9 Local-number,Local-number:n
Try replacing with: melm 090$a Local-number,Local-number:n
I have change the record.abs, but i still get the error: /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -b -r -v Zebra configuration information ================================ Zebra biblio directory = /var/lib/koha/zebradb/biblios Zebra authorities directory = /var/lib/koha/zebradb/authorities Koha directory = /usr/share/koha/intranet/cgi-bin BIBLIONUMBER in : 001$@ BIBLIOITEMNUMBER in : 090$a ================================ skipping authorities ==================== exporting biblio ==================== 1 Records exported: 1 ==================== REINDEXING zebra ==================== 11:22:39-16/04 zebraidx(10087) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== CLEANING ==================== -- View this message in context: http://koha.1045719.n5.nabble.com/Koha-reindex-with-Zebra-doesn-t-work-tp564... Sent from the Koha-general mailing list archive at Nabble.com.
I have solved in this way: Administration> System Preferences> Don't use the Zebra search engine. and then running: //usr/share/koha/bin/migration_tools/rebuild_nozebra.pl -s *********************************** ***** building BIBLIO indexes ***** *********************************** 2 Inserting records... 20 biblios done *********************************** ***** building AUTHORITIES indexes ***** *********************************** Inserting... authorities done/ i'm not sure if this way is the correct way, cause in the Adminstration panel i read: /It is recommended to use Zebra; the option to not use Zebra is deprecated and is not guaranteed to work. / What do you suggest? Thanks and regards Alex -- View this message in context: http://koha.1045719.n5.nabble.com/Koha-reindex-with-Zebra-doesn-t-work-tp564... Sent from the Koha-general mailing list archive at Nabble.com.
Can this problem with the Zebra indexing be caused by the 2 errors show in the Administrator Panel of the MARC record? http://koha.1045719.n5.nabble.com/file/n5646312/biblio_error.png Thanks and kind regards -- View this message in context: http://koha.1045719.n5.nabble.com/Koha-reindex-with-Zebra-doesn-t-work-tp564... Sent from the Koha-general mailing list archive at Nabble.com.
Can this problem with the Zebra indexing be caused by the 2 errors show in the Administrator Panel of the MARC record?
No, it can't be that. I've just tried to do an English UNIMARC installation: it works. So there is something weird in your installation. Are you sure you haven't for example done a MARC21 installation and then switched to UNIMARC via Koha system preferences? In this case, your koha-conf.xml file points to MARC21 Zebra configuration files, and your Koha instance send to Zebra UNIMARC records. You can see if it is the case in this config file: etc/zebra/zebra-biblios.cfg in parameter profilePath. In any case, I recommend you to redo a complete installation from scratch. Kind regards, -- Frédéric DEMIANS http://www.tamil.fr/u/fdemians.html
Hi,
Can this problem with the Zebra indexing be caused by the 2 errors show in the Administrator Panel of the MARC record?
No, it can't be that. I've just tried to do an English UNIMARC installation: it works. So there is something weird in your installation. Hmm. I'm having similar problems... I installed koha from the squeeze apt-repository, and imported a database from an old 2.2.6 install. (converted to 3.6 format by Paul Poulain)
I too get the following error: 17:19:06-17/04 zebraidx(2295) [warn] Record didn't contain match fields in (bib1,Local-number) Did you also use the "apt-get install koha-common" mehtod to install koha? Regards! MJ
Hi Frédéric, thank you very muche you have the reason, I have made a new installation of koha, setting the zebra indexing in unimarc and koha also in unimarc, and now i can reindex my records. Thanks and Kind Regards Alex -- View this message in context: http://koha.1045719.n5.nabble.com/Koha-reindex-with-Zebra-doesn-t-work-tp564... Sent from the Koha-general mailing list archive at Nabble.com.
I've created a new database with "--marc-flavor unimarc" option. I've changed the following files in /etc/koha: zebra-authorities-dom-site.cfg.in zebra-authorities-site.cfg.in zebra-biblios-dom-site.cfg.in zebra-biblios-site.cfg.in set the correct path in "profilePath" for unimarc e language. Then in koha: Home › Administration › Koha to MARC mapping choose biblioitems in biblioitemnumber set: TAG 090, Subfidles 9. for creating Subfields: MARC frameworks -> click on "MARC structure" beside Default framework -> 090 subfield -> edit subfileds -> add 9. See: /etc/koha/zebradb/marc_defs/unimarc/biblios/record.abs ############ IDENTIFICATION NUMBERS ################## melm 001 Local-number,Local-number:n # Local-number (biblionumber can be either in 090$9 or, on some setup, on 001) melm 009 Identifier-standard:w,Identifier-standard:n melm 090$9 Local-number,Local-number:n melm 099$c date-entered-on-file:s,date-entered-on-file:n,date-entered-on-file:y,Date-of-acquisition,Date-of-acquisition:d,Date-of-acquisition:s melm 099$d Date/time-last-modified:s,Date/time-last-modified:n,Date/time-last-modified:y melm 099$t ccode:w I don't know excatly what I made, BUT NOW KOHA CATALOGUE SEARCHING WORKS! (But not advanced searching). Running rebuild-zebra.pl gives a lot of warnings (see below) but check this: http://lists.katipo.co.nz/public/koha/2013-May.txt http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8252 Gook Luck! ==================== REINDEXING zebra ==================== 16:11:27-03/05 zebraidx(3490) [warn] Index 'Music-number' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Music-number' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'UPC' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'UPC' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'tpubdate' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Modified-code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'char-encoding' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'char-encoding' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'char-encoding' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'script-Title' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Country-heading' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Illustration-code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Content-type' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Content-type' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Content-type' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Content-type' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Conference-code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Festschrift-indicator' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Index-indicator' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Literature-Code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Biography-Code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Type-Of-Serial' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Frequency-code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Regularity-code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Content-type' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Content-type' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Conference-publication-Code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Title-Page-availability-Code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Index-availability-Code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Cumulative-Index-availability-Code' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Video-mt' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Graphics-type' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Graphics-support' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Graphics-support' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Serials' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Serials' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Printed-music' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Printed-music' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Electronic-ressource' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Title-host' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'title-host' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'Title-host' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'title-host' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'lcn' not found in attset(s) 16:11:27-03/05 zebraidx(3490) [warn] Index 'lcn' not found in attset(s) ==================== CLEANING ==================== -- View this message in context: http://koha.1045719.n5.nabble.com/Koha-reindex-with-Zebra-doesn-t-work-tp564... Sent from the Koha-general mailing list archive at Nabble.com.
Thanks Frédéric!
Are you sure you haven't for example done a MARC21 installation and then switched to UNIMARC via Koha system preferences? In this case, your koha-conf.xml file points to MARC21 Zebra configuration files, and your Koha instance send to Zebra UNIMARC records. You can see if it is the case in this config file:
That was it! I followed to wiki pages to install koha from the apt repository, and they say to use 'koha-create' to create your site. Nowhere they mention marc21/unimarc, or anything... Following your suggestion above, I looked at koha-conf.xml, and found that my system was not unimarc, but my database and koha were unimarc. I'll try creating a new site, and this time add a "--marc-flavor unimarc" to my command. :-) Thanks!
participants (5)
-
Alex87 -
andrea.furin -
Frédéric Demians -
Frédéric Demians -
mourik jan c heupink