No Zebra indexing - missing field "biblioitems.marc"
Hi I have a new installation of Koha 16.11.01 on Debian GNU/Linux 8, using Koha instance "phsh". I was able to successfully load 76'216 data records in format MARCXML using script "bulkmarcimport.pl". "select count(*) from biblio" shows 76'216 hits in my database. Now I try to index these records in Zebra. To be sure I have restarted the Koha daemon as follows. $ sudo /etc/init.d/koha-common stop $ sudo /etc/init.d/koha-common start Then I try to index my records using the following command: $ sudo koha-rebuild-zebra -f -v phsh But all I get is 76'216 lines like the following: ... .error retrieving biblio 76215 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713. .error retrieving biblio 76216 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713. Records exported: 0 Actually absolutely NOTHING is exported and consequently, nothing is indexed by Zebra. I looked into script "rebuild_zebra.pl" at line 713 - some lines before I found the statement "SELECT marc FROM biblioitems WHERE biblionumber = ?" but in the current database schema http://schema.koha-community.org/16_11/tables/biblioitems.html there is no such field "marc" in table "biblioitems"! There was such a field in Koha 16.05 and older versions though. Can anyone please tell me what's wrong here and how to overcome this problem? Best wishes: Michael
Hi Michael I have a 16.11.01 with 97224 records in, that is indexing fine (without the marc column) so the good news is there should be an easy solution. Try it with an -x sudo koha-rebuild-zebra -x -f -v phsh Does that work better? Chris On 17 January 2017 at 12:12, Michael Kuhn <mik@adminkuhn.ch> wrote:
Hi
I have a new installation of Koha 16.11.01 on Debian GNU/Linux 8, using Koha instance "phsh".
I was able to successfully load 76'216 data records in format MARCXML using script "bulkmarcimport.pl".
"select count(*) from biblio" shows 76'216 hits in my database.
Now I try to index these records in Zebra. To be sure I have restarted the Koha daemon as follows.
$ sudo /etc/init.d/koha-common stop $ sudo /etc/init.d/koha-common start
Then I try to index my records using the following command:
$ sudo koha-rebuild-zebra -f -v phsh
But all I get is 76'216 lines like the following:
... .error retrieving biblio 76215 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713. .error retrieving biblio 76216 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713.
Records exported: 0
Actually absolutely NOTHING is exported and consequently, nothing is indexed by Zebra.
I looked into script "rebuild_zebra.pl" at line 713 - some lines before I found the statement "SELECT marc FROM biblioitems WHERE biblionumber = ?" but in the current database schema http://schema.koha-community.org/16_11/tables/biblioitems.html there is no such field "marc" in table "biblioitems"! There was such a field in Koha 16.05 and older versions though.
Can anyone please tell me what's wrong here and how to overcome this problem?
Best wishes: Michael _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Hi Michael, It sounds like you are usinga gitified install but the Koha scripts have not been updated. /usr/share/koha/bin/migration_tools/rebuild_zebra.pl is certainly refering to an old version of this script. Cheers, Jonathan On Tue, 17 Jan 2017 at 01:19 Chris Cormack <chris@bigballofwax.co.nz> wrote:
Hi Michael
I have a 16.11.01 with 97224 records in, that is indexing fine (without the marc column) so the good news is there should be an easy solution.
Try it with an -x sudo koha-rebuild-zebra -x -f -v phsh
Does that work better?
Chris
Hi
I have a new installation of Koha 16.11.01 on Debian GNU/Linux 8, using Koha instance "phsh".
I was able to successfully load 76'216 data records in format MARCXML using script "bulkmarcimport.pl".
"select count(*) from biblio" shows 76'216 hits in my database.
Now I try to index these records in Zebra. To be sure I have restarted
On 17 January 2017 at 12:12, Michael Kuhn <mik@adminkuhn.ch> wrote: the
Koha daemon as follows.
$ sudo /etc/init.d/koha-common stop $ sudo /etc/init.d/koha-common start
Then I try to index my records using the following command:
$ sudo koha-rebuild-zebra -f -v phsh
But all I get is 76'216 lines like the following:
... .error retrieving biblio 76215 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713. .error retrieving biblio 76216 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713.
Records exported: 0
Actually absolutely NOTHING is exported and consequently, nothing is indexed by Zebra.
I looked into script "rebuild_zebra.pl" at line 713 - some lines before I found the statement "SELECT marc FROM biblioitems WHERE biblionumber = ?" but in the current database schema http://schema.koha-community.org/16_11/tables/biblioitems.html there is no such field "marc" in table "biblioitems"! There was such a field in Koha 16.05 and older versions though.
Can anyone please tell me what's wrong here and how to overcome this problem?
Best wishes: Michael _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Hi Chris and Jonathan
I have a 16.11.01 with 97224 records in, that is indexing fine (without the marc column) so the good news is there should be an easy solution.
Try it with an -x sudo koha-rebuild-zebra -x -f -v phsh
Does that work better?
No, unfortunately exactly the same happens: All I get is 76'216 lines like the following (but with an additional warning about "-x"): ... .error retrieving biblio 76215 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713. .error retrieving biblio 76216 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713. Records exported: 0 ==================== REINDEXING zebra ==================== ==================== CLEANING ==================== Warning: You passed -x which is already the default and is now deprecated ... Actually absolutely NOTHING is exported and consequently, nothing is indexed by Zebra. Jonathan wrote:
It sounds like you are usinga gitified install but the Koha scripts have not been updated. /usr/share/koha/bin/migration_tools/rebuild_zebra.pl is certainly refering to an old version of this script.
I don't know what is "a gitified install" - in fact I have installed Koha 16.11.00 using the Debian package "koha-common" which was updated to Koha 16.11.01 yesterday. Definitely no git involved. The file "rebuild_zebra.pl" actually installed has the date of 23 November 2016 16:44 and the MD5 sum 3eaa1b977286a507f9c5a75b5a7092e3 Best wishes: Michael
Hi Michael Very odd, I have the exact same set up, 16.11.01 from debian packages on jessie. With 97244 records, and a reindex works just fine. md5sum /usr/share/koha/bin/migration_tools/rebuild_zebra.pl 3eaa1b977286a507f9c5a75b5a7092e3 /usr/share/koha/bin/migration_tools/rebuild_zebra.pl Same file select marc from biblioitems; ERROR 1054 (42S22): Unknown column 'marc' in 'field list' So no marc column either. So I dont think it is that, in fact if we look at the file } else { eval { $marc = GetMarcBiblio($record_number, 1); }; if ($@ || !$marc) { # here we do warn since catching an exception # means that the bib was found but failed # to be parsed warn "error retrieving biblio $record_number"; return; } } We can see that it is not trying to select the marc column, see the warn is error retrieving So it is not using that sql query you pasted before, if it was, it would be this error warn "error creating MARC::Record from $blob"; So for some reason GetMarcBiblio is not returning a record for you. What I would do is edit warn "error retrieving biblio $record_number"; and make it be warn "error retrieving biblio $record_number the error is $@"; And see if you get some more information that way Chris On 17 January 2017 at 22:26, Michael Kuhn <mik@adminkuhn.ch> wrote:
Hi Chris and Jonathan
I have a 16.11.01 with 97224 records in, that is indexing fine (without the marc column) so the good news is there should be an easy solution.
Try it with an -x sudo koha-rebuild-zebra -x -f -v phsh
Does that work better?
No, unfortunately exactly the same happens: All I get is 76'216 lines like the following (but with an additional warning about "-x"):
... .error retrieving biblio 76215 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713. .error retrieving biblio 76216 at /usr/share/koha/bin/migration_tools/rebuild_zebra.pl line 713.
Records exported: 0 ==================== REINDEXING zebra ==================== ==================== CLEANING ==================== Warning: You passed -x which is already the default and is now deprecated ...
Actually absolutely NOTHING is exported and consequently, nothing is indexed by Zebra.
Jonathan wrote:
It sounds like you are usinga gitified install but the Koha scripts have not been updated. /usr/share/koha/bin/migration_tools/rebuild_zebra.pl is certainly refering to an old version of this script.
I don't know what is "a gitified install" - in fact I have installed Koha 16.11.00 using the Debian package "koha-common" which was updated to Koha 16.11.01 yesterday. Definitely no git involved.
The file "rebuild_zebra.pl" actually installed has the date of 23 November 2016 16:44 and the MD5 sum 3eaa1b977286a507f9c5a75b5a7092e3
Best wishes: Michael
Hi Chris
So for some reason GetMarcBiblio is not returning a record for you.
What I would do is edit warn "error retrieving biblio $record_number"; and make it be warn "error retrieving biblio $record_number the error is $@";
And see if you get some more information that way
Yes, I did that and I have got lines like the following: .error retrieving biblio 76216 the error is No biblionumber tag for framework "DZ" at /usr/share/koha/lib/C4/Biblio.pm line 3093. I had loaded my records with "bulkmarcimport.pl" using option "-framework=DZ". The framework "DZ" was actually there but it wasn't yet populated - I have now created it using the Default (and I made a note about this). The Zebra indexing works now as expected: ... 76201.................... Records exported: 76216 Thank you so much for helping me! Best wishes: Michael
participants (3)
-
Chris Cormack -
Jonathan Druart -
Michael Kuhn