Re: [Koha] Cannot find records created in KoHa
Hi Patric
==================== exporting biblio ==================== 1......error retrieving biblio 7 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. ..error retrieving biblio 9 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 10 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 11 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 12 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 13 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 14 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 15 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681.
Records exported: 7 ==================== REINDEXING zebra ==================== 08:48:30-07/06 zebraidx(39989) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== CLEANING ====================
---- 8< ----
And yes, I have 7 records;-)
Since the above output looks like there is something wrong - can you now successfully search your Zebra index? Best wishes: Michael -- Geschäftsführer · Diplombibliothekar BBS, Informatiker eidg. Fachausweis Admin Kuhn GmbH · Pappelstrasse 20 · 4123 Allschwil · Schweiz T 0041 (0)61 261 55 61 · E mik@adminkuhn.ch · W www.adminkuhn.ch Am 07.06.19 um 09:25 schrieb Lichtsteiner Patric (lici):
Hi Michael
Thanks a lot for detailed answer and sorry for the delay.
It seems like you don't have an index that you could search. You should probably build one. I reindexed our koha instance and got the following error message:
---- 8< ---- # koha-rebuild-zebra -b -f -v ausleihe-test
Zebra configuration information ================================ Zebra biblio directory = /var/lib/koha/ausleihe-test/biblios Zebra authorities directory = /var/lib/koha/ausleihe-test/authorities Koha directory = /usr/share/koha/intranet/cgi-bin Lockfile = /var/lock/koha/ausleihe-test/rebuild/rebuild..LCK BIBLIONUMBER in : 001$@ BIBLIOITEMNUMBER in : 090$a ================================ skipping authorities ==================== exporting biblio ==================== 1......error retrieving biblio 7 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. ..error retrieving biblio 9 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 10 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 11 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 12 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 13 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 14 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 15 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681.
Records exported: 7 ==================== REINDEXING zebra ==================== 08:48:30-07/06 zebraidx(39989) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== CLEANING ====================
---- 8< ----
And yes, I have 7 records;-)
As you see there are two processes more than in your installation. Maybe you should just restart Zebra or if you don't know how, restart all of Koha (including Zebra), or restart your host with everything (including Koha, Zebra and the rest). To make sure everything is clean, I restarted the whole server. When I use the same ps command "ps -ef | grep zebra” I get just 4 processes. I have only one “zebrasrv”, you have two of them.
The following MARC fields are "mandatory" by default: LEADER ("000" in the Koha framework) 003 008 040$c 245$a 942$c - in the framework they are marked with a very small red asterisk. Whatever "mandatory" means:
I tried to destroy a framework like you have one - exporting the standard framework, importing it as a new framework TEST, then deleting the MARC LEADER ("000"). In Koha menu "Administration > MARC Bibliographic framework test" it still says for this mutilated framework: "Configuration OK, you don't have errors in your MARC parameters table". This seems like some kind of higher nonsense to me.
Interestingly enough even without the "mandatory" MARC LEADER ("000") in the framework a test record can be saved - it will then just insert some default values (as can be seen in the "MARC view"). However, as said, such a record can be saved and also be searched. See http://koha.adminkuhn.ch/cgi-bin/koha/opac-MARCdetail.pl?biblionumber=469 (but only until about 04:00 AM tomorrow)
So the mutilated framework is probably not the initial reason for your problem. Still, I wouldn't ever advise to delete the MARC LEADER in any framework. As I wrote above, I assume you don't have a (correct) Zebra index at all. Ok, thanks a lot for this testing and for all these suggestions.
Hope this helps. Definitely, thanks a lot for your time.
Best, Patric
Hi Michael, No, I still do not find anything. From the output I understand that something goes wrong while building the index? Patric
On 7 Jun 2019, at 09:37, Michael Kuhn <mik@adminkuhn.ch> wrote:
Hi Patric
==================== exporting biblio ==================== 1......error retrieving biblio 7 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. ..error retrieving biblio 9 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 10 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 11 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 12 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 13 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 14 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 15 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681.
Records exported: 7 ==================== REINDEXING zebra ==================== 08:48:30-07/06 zebraidx(39989) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== CLEANING ====================
---- 8< ----
And yes, I have 7 records;-)
Since the above output looks like there is something wrong - can you now successfully search your Zebra index?
Best wishes: Michael -- Geschäftsführer · Diplombibliothekar BBS, Informatiker eidg. Fachausweis Admin Kuhn GmbH · Pappelstrasse 20 · 4123 Allschwil · Schweiz T 0041 (0)61 261 55 61 · E mik@adminkuhn.ch · W www.adminkuhn.ch
Am 07.06.19 um 09:25 schrieb Lichtsteiner Patric (lici):
Hi Michael Thanks a lot for detailed answer and sorry for the delay.
It seems like you don't have an index that you could search. You should probably build one. I reindexed our koha instance and got the following error message: ---- 8< ---- # koha-rebuild-zebra -b -f -v ausleihe-test Zebra configuration information ================================ Zebra biblio directory = /var/lib/koha/ausleihe-test/biblios Zebra authorities directory = /var/lib/koha/ausleihe-test/authorities Koha directory = /usr/share/koha/intranet/cgi-bin Lockfile = /var/lock/koha/ausleihe-test/rebuild/rebuild..LCK BIBLIONUMBER in : 001$@ BIBLIOITEMNUMBER in : 090$a ================================ skipping authorities ==================== exporting biblio ==================== 1......error retrieving biblio 7 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. ..error retrieving biblio 9 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 10 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 11 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 12 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 13 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 14 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 15 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. Records exported: 7 ==================== REINDEXING zebra ==================== 08:48:30-07/06 zebraidx(39989) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== CLEANING ==================== ---- 8< ---- And yes, I have 7 records;-) As you see there are two processes more than in your installation. Maybe you should just restart Zebra or if you don't know how, restart all of Koha (including Zebra), or restart your host with everything (including Koha, Zebra and the rest). To make sure everything is clean, I restarted the whole server. When I use the same ps command "ps -ef | grep zebra” I get just 4 processes. I have only one “zebrasrv”, you have two of them. The following MARC fields are "mandatory" by default: LEADER ("000" in the Koha framework) 003 008 040$c 245$a 942$c - in the framework they are marked with a very small red asterisk. Whatever "mandatory" means:
I tried to destroy a framework like you have one - exporting the standard framework, importing it as a new framework TEST, then deleting the MARC LEADER ("000"). In Koha menu "Administration > MARC Bibliographic framework test" it still says for this mutilated framework: "Configuration OK, you don't have errors in your MARC parameters table". This seems like some kind of higher nonsense to me.
Interestingly enough even without the "mandatory" MARC LEADER ("000") in the framework a test record can be saved - it will then just insert some default values (as can be seen in the "MARC view"). However, as said, such a record can be saved and also be searched. See http://koha.adminkuhn.ch/cgi-bin/koha/opac-MARCdetail.pl?biblionumber=469 (but only until about 04:00 AM tomorrow)
So the mutilated framework is probably not the initial reason for your problem. Still, I wouldn't ever advise to delete the MARC LEADER in any framework. As I wrote above, I assume you don't have a (correct) Zebra index at all. Ok, thanks a lot for this testing and for all these suggestions. Hope this helps. Definitely, thanks a lot for your time. Best, Patric
Hi Patric Since I don't know how you tried to rebuild your index: In one of your earlier e-mails I saw this - it is NOT a good idea to rebuild your index as user "root" (or doing most anything on a Linux machine, for various reasons, among them permission problems and missing environments): # koha-rebuild-zebra -b -f -v ausleihe-test Thus: 1. Be sure (once again) you got the correct permissions. # ls -al /var/lib/koha/ausleihe-test/{authorities,biblios}/* # ls -al /var/lock/koha/ausleihe-test/{authorities,biblios,rebuild} If they are not correct - correct them. 2. Rebuild your index (assuming your unprivileged Linux user is named "koha"): # su - koha $ sudo koha-rebuild-zebra -b -f -v ausleihe-test 3. Or if you really need to do it as user "root" then set the following variables first: # export PERL5LIB="/usr/share/koha/lib" # export KOHA_CONF="/etc/koha/sites/ausleihe-test/koha-conf.xml" # koha-rebuild-zebra -b -f -v ausleihe-test Hope this helps. Best wishes: Michael -- Geschäftsführer · Diplombibliothekar BBS, Informatiker eidg. Fachausweis Admin Kuhn GmbH · Pappelstrasse 20 · 4123 Allschwil · Schweiz T 0041 (0)61 261 55 61 · E mik@adminkuhn.ch · W www.adminkuhn.ch Am 11.06.19 um 18:11 schrieb Lichtsteiner Patric (lici):
Hi Michael,
No, I still do not find anything. From the output I understand that something goes wrong while building the index?
Patric
On 7 Jun 2019, at 09:37, Michael Kuhn <mik@adminkuhn.ch> wrote:
Hi Patric
==================== exporting biblio ==================== 1......error retrieving biblio 7 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. ..error retrieving biblio 9 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 10 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 11 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 12 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 13 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 14 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 15 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681.
Records exported: 7 ==================== REINDEXING zebra ==================== 08:48:30-07/06 zebraidx(39989) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== CLEANING ====================
---- 8< ----
And yes, I have 7 records;-)
Since the above output looks like there is something wrong - can you now successfully search your Zebra index?
Best wishes: Michael -- Geschäftsführer · Diplombibliothekar BBS, Informatiker eidg. Fachausweis Admin Kuhn GmbH · Pappelstrasse 20 · 4123 Allschwil · Schweiz T 0041 (0)61 261 55 61 · E mik@adminkuhn.ch · W www.adminkuhn.ch
Am 07.06.19 um 09:25 schrieb Lichtsteiner Patric (lici):
Hi Michael Thanks a lot for detailed answer and sorry for the delay.
It seems like you don't have an index that you could search. You should probably build one. I reindexed our koha instance and got the following error message: ---- 8< ---- # koha-rebuild-zebra -b -f -v ausleihe-test Zebra configuration information ================================ Zebra biblio directory = /var/lib/koha/ausleihe-test/biblios Zebra authorities directory = /var/lib/koha/ausleihe-test/authorities Koha directory = /usr/share/koha/intranet/cgi-bin Lockfile = /var/lock/koha/ausleihe-test/rebuild/rebuild..LCK BIBLIONUMBER in : 001$@ BIBLIOITEMNUMBER in : 090$a ================================ skipping authorities ==================== exporting biblio ==================== 1......error retrieving biblio 7 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. ..error retrieving biblio 9 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 10 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 11 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 12 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 13 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 14 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 15 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. Records exported: 7 ==================== REINDEXING zebra ==================== 08:48:30-07/06 zebraidx(39989) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== CLEANING ==================== ---- 8< ---- And yes, I have 7 records;-) As you see there are two processes more than in your installation. Maybe you should just restart Zebra or if you don't know how, restart all of Koha (including Zebra), or restart your host with everything (including Koha, Zebra and the rest). To make sure everything is clean, I restarted the whole server. When I use the same ps command "ps -ef | grep zebra” I get just 4 processes. I have only one “zebrasrv”, you have two of them. The following MARC fields are "mandatory" by default: LEADER ("000" in the Koha framework) 003 008 040$c 245$a 942$c - in the framework they are marked with a very small red asterisk. Whatever "mandatory" means:
I tried to destroy a framework like you have one - exporting the standard framework, importing it as a new framework TEST, then deleting the MARC LEADER ("000"). In Koha menu "Administration > MARC Bibliographic framework test" it still says for this mutilated framework: "Configuration OK, you don't have errors in your MARC parameters table". This seems like some kind of higher nonsense to me.
Interestingly enough even without the "mandatory" MARC LEADER ("000") in the framework a test record can be saved - it will then just insert some default values (as can be seen in the "MARC view"). However, as said, such a record can be saved and also be searched. See http://koha.adminkuhn.ch/cgi-bin/koha/opac-MARCdetail.pl?biblionumber=469 (but only until about 04:00 AM tomorrow)
So the mutilated framework is probably not the initial reason for your problem. Still, I wouldn't ever advise to delete the MARC LEADER in any framework. As I wrote above, I assume you don't have a (correct) Zebra index at all. Ok, thanks a lot for this testing and for all these suggestions. Hope this helps. Definitely, thanks a lot for your time. Best, Patric
Hi Michael, I double checked the filesystem rights and everything is still correct. I still get the same error message when I run the index process with sudo (I had to make a sudoers configuration): $ sudo koha-rebuild-zebra -b -f -v ausleihe-test Zebra configuration information ================================ Zebra biblio directory = /var/lib/koha/ausleihe-test/biblios Zebra authorities directory = /var/lib/koha/ausleihe-test/authorities Koha directory = /usr/share/koha/intranet/cgi-bin Lockfile = /var/lock/koha/ausleihe-test/rebuild/rebuild..LCK BIBLIONUMBER in : 001$@ BIBLIOITEMNUMBER in : 090$a ================================ skipping authorities ==================== exporting biblio ==================== 1......error retrieving biblio 7 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. ..error retrieving biblio 9 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 10 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 11 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 12 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 13 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 14 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. .error retrieving biblio 15 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. Records exported: 7 ==================== REINDEXING zebra ==================== 12:35:55-13/06 zebraidx(72882) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== CLEANING ==================== I think the index does not write any file due to this error. That’s why the ownership of the index files was not altered. I will be on holidays for the next 2 weeks, so I won’t answer during this time. Thanks a lot for all the help, Patric
Hi Patric You wrote:
I double checked the filesystem rights and everything is still correct.
I still get the same error message when I run the index process with sudo (I had to make a sudoers configuration): ... 1......error retrieving biblio 7 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 681. ... ==================== REINDEXING zebra ==================== 12:35:55-13/06 zebraidx(72882) [warn] Record didn't contain match fields in (bib1,Local-number) ==================== ... I think the index does not write any file due to this error. That’s why the ownership of the index files was not altered.
In one of your earlier e-mails you wrote "that somebody introduced some frameworks that do not include the field '000 - Record Label'." Maybe because of this (and maybe other reasons) your records are not conforming to MARC 21 and thus not indexable. Is it possible to show the MARCXML of one or more of your bibliographic records? For example in Koha 18.11 you will find it in field "metadata" of table "biblio_metadata". I would then try to import your MARCXML in my demo installation and see if it is correctly indexed. Like this we could find out if the error has its cause in the record or in the indexing process. Best wishes: Michael -- Geschäftsführer · Diplombibliothekar BBS, Informatiker eidg. Fachausweis Admin Kuhn GmbH · Pappelstrasse 20 · 4123 Allschwil · Schweiz T 0041 (0)61 261 55 61 · E mik@adminkuhn.ch · W www.adminkuhn.ch
Hi Patric, I think the line below gives the right cue: You are missing the biblionumber in one or more of your records. This problem probably comes from your changes frameworks and the records created using them. If you are using Koha with MARC21, Koha expects you to have a 999 $c and $d for storing the biblionumber and biblioitemnumber. These fields and subfields should not be changed from the default configuration in the frameworks, as it can break things badly. When you look at your existing records, are 990 $c $d correctly set? Hope this helps, Katrin On 13.06.19 13:11, Michael Kuhn wrote:
12:35:55-13/06 zebraidx(72882) [warn] Record didn't contain match fields in (bib1,Local-number)
participants (3)
-
Katrin Fischer -
Lichtsteiner Patric (lici) -
Michael Kuhn