Authorities lost during upgrade to 3.6.1
Hoping someone can help, please. We recently upgraded from 3.2 to 3.6.1 and nearly everything went well during import of ~15,000 biblios, but something has happened to the "authorities" -- only newly catalogued (i.e. using 3.6.1) authorities appear in the staff search from <http://koha-admin/cgi-bin/koha/authorities/authorities-home.pl>. All the others are still there: exportauth.pl finds all PERSO_NAME, TOPIC_TERM etc as expected, e.g.: 00389nz a2200133o 4500001000200000003000700002005001700009008003900026040001900065100001700084667004000101670009900141942001500240 8 OPIACS 20110310122059.0 110310|||a|||||| | ||| d aOPIACS cOPIACS aAbbass, D.K. aMachine generated authority record. aWork cat.: (OPIACS)3: Abbass, D.K., Radeau Land Tortoise, North America's oldest warship, 1993 aPERSO_NAME but Koha no longer appears to "cross reference" them as far as staff is concerned. For example, when a cataloguer attempts to enter another title by Abbass, D.K. (the "authority" I quote above), she cannot find it in the drop-down for 100a I'm sure there's a simple fix, but at the moment I'm tearing my hair out -- thanks in advance. Paul
On 2012-01-3, at 10:09 AM, Paul wrote:
Hoping someone can help, please.
We recently upgraded from 3.2 to 3.6.1 and nearly everything went well during import of ~15,000 biblios, but something has happened to the "authorities" -- only newly catalogued (i.e. using 3.6.1) authorities appear in the staff search from <http://koha-admin/cgi-bin/koha/authorities/authorities-home.pl>.
have you tried rebuilding the zebra 'authorities' indexes/database?
At 02:56 AM 1/5/2012 +1300, Mason James wrote:
On 2012-01-3, at 10:09 AM, Paul wrote:
Hoping someone can help, please.
We recently upgraded from 3.2 to 3.6.1 and nearly everything went well during import of ~15,000 biblios, but something has happened to the "authorities" -- only newly catalogued (i.e. using 3.6.1) authorities appear in the staff search from <http://koha-admin/cgi-bin/koha/authorities/authorities-home.pl>.
have you tried rebuilding the zebra 'authorities' indexes/database?
koha@nelson:/usr/share/koha$ KOHA_CONF=/etc/koha/koha-conf.xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_zebra.pl -b -a -r 19:12:09-04/01 zebraidx(9447) [warn] MARC: Bad offsets in data. Skipping rest 19:12:09-04/01 zebraidx(9447) [warn] Record didn't contain match fields in (bib1,Local-number) So -- just the two "warns". Can anyone tell me if the "skipping rest" refers *only* to the one record, or if it aborted the whole re-indexing? I'm guessing it aborted the process, as a quick look shows that none of the "missing" authorities have magically re-appeared. Also, is the zebraidx(9447) referenced to the Koha biblio # 9447 (nothing appears amiss in it) or if there is some other way of finding which record is giving it indigestion? I have no experience with zebra. Many thanks - Paul
On 5 January 2012 13:53, Paul <paul.a@aandc.org> wrote:
At 02:56 AM 1/5/2012 +1300, Mason James wrote:
On 2012-01-3, at 10:09 AM, Paul wrote:
Hoping someone can help, please.
We recently upgraded from 3.2 to 3.6.1 and nearly everything went well during import of ~15,000 biblios, but something has happened to the "authorities" -- only newly catalogued (i.e. using 3.6.1) authorities appear in the staff search from <http://koha-admin/cgi-bin/koha/authorities/authorities-home.pl>.
have you tried rebuilding the zebra 'authorities' indexes/database?
koha@nelson:/usr/share/koha$ KOHA_CONF=/etc/koha/koha-conf.xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_zebra.pl -b -a -r 19:12:09-04/01 zebraidx(9447) [warn] MARC: Bad offsets in data. Skipping rest 19:12:09-04/01 zebraidx(9447) [warn] Record didn't contain match fields in (bib1,Local-number)
So -- just the two "warns". Can anyone tell me if the "skipping rest" refers *only* to the one record, or if it aborted the whole re-indexing? I'm guessing it aborted the process, as a quick look shows that none of the "missing" authorities have magically re-appeared.
How about trying it without the -b, just -a to reindex authorities. Id add -v for verbose too Then you are much more likely to see whats going on with authorities. You can come back to your biblio problem above. Chris
On 2012-01-5, at 1:56 PM, Chris Cormack wrote:
On 5 January 2012 13:53, Paul <paul.a@aandc.org> wrote:
At 02:56 AM 1/5/2012 +1300, Mason James wrote:
On 2012-01-3, at 10:09 AM, Paul wrote:
Hoping someone can help, please.
We recently upgraded from 3.2 to 3.6.1 and nearly everything went well during import of ~15,000 biblios, but something has happened to the "authorities" -- only newly catalogued (i.e. using 3.6.1) authorities appear in the staff search from <http://koha-admin/cgi-bin/koha/authorities/authorities-home.pl>.
have you tried rebuilding the zebra 'authorities' indexes/database?
koha@nelson:/usr/share/koha$ KOHA_CONF=/etc/koha/koha-conf.xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_zebra.pl -b -a -r 19:12:09-04/01 zebraidx(9447) [warn] MARC: Bad offsets in data. Skipping rest 19:12:09-04/01 zebraidx(9447) [warn] Record didn't contain match fields in (bib1,Local-number)
So -- just the two "warns". Can anyone tell me if the "skipping rest" refers *only* to the one record, or if it aborted the whole re-indexing?
its skipping *all* records after. looks like you have a bad bib record
I'm guessing it aborted the process, as a quick look shows that none of the "missing" authorities have magically re-appeared.
How about trying it without the -b, just -a to reindex authorities. Id add -v for verbose too
yes indeed - there was an small bug with rebuild_zebra.pl script when indexing both bibs and auth records using the xml switch (not sure if its fixed yet?) for best results, use the -x (for xml option) on authority records alone, like this... $ ./bin/migration_tools/rebuild_zebra.pl -a -r -v -x
At 06:26 PM 1/5/2012 +1300, Mason James wrote:
On 2012-01-5, at 1:56 PM, Chris Cormack wrote: [snip] its skipping *all* records after. looks like you have a bad bib record
I'm guessing it aborted the process, as a quick look shows that none of the "missing" authorities have magically re-appeared.
How about trying it without the -b, just -a to reindex authorities. Id add -v for verbose too
yes indeed - there was an small bug with rebuild_zebra.pl script when indexing both bibs and auth records using the xml switch (not sure if its fixed yet?)
for best results, use the -x (for xml option) on authority records alone, like this...
$ ./bin/migration_tools/rebuild_zebra.pl -a -r -v -x
Thank you both very much. In fact the -a is incompatible with -x, but using -a -r -v, : 09:56:26-05/01 zebraidx(2947) [log] Iterations: isam/dict 885740/153588 09:56:26-05/01 zebraidx(2947) [log] Dict: inserts/updates/deletions: 153588/0/0 09:56:27-05/01 zebraidx(2947) [log] Records: 10398 i/u/d 10398/0/0 so the authorities are now (I *think* properly and completely) indexed. However, for the biblios, using only -b -r -v, the indexing failed after 12,835 records: 09:58:45-05/01 zebraidx(3048) [warn] MARC: Bad offsets in data. Skipping rest 09:58:45-05/01 zebraidx(3048) [warn] Record didn't contain match fields in (bib1,Local-number) 09:58:45-05/01 zebraidx(3048) [log] error grs.marcxml.record /tmp/5H7Hpo5SlB/biblio/exported_records 8741259 09:58:51-05/01 zebraidx(3048) [log] Iterations: isam/dict 12930648/373712 09:58:51-05/01 zebraidx(3048) [log] Dict: inserts/updates/deletions: 373712/0/0 09:58:57-05/01 zebraidx(3048) [log] Records: 12835 i/u/d 12835/0/0 yet using -x it re-indexed all 14,899 biblios 10:00:49-05/01 zebraidx(4857) [log] Iterations: isam/dict 16437721/481418 10:00:49-05/01 zebraidx(4857) [log] Dict: inserts/updates/deletions: 481418/0/0 10:00:55-05/01 zebraidx(4857) [log] Records: 14899 i/u/d 14899/0/0 QUESTION: Does this warning "Record didn't contain match fields in (bib1,Local-number)" have a specific cause that has been seen before? And is there a way in staff-client to find the record matching (presumably biblio #, but I can't find it even in "advanced search) 12,836? [Or is it easier to work directly from the mysql?] Again, many thanks - Paul
participants (3)
-
Chris Cormack -
Mason James -
Paul