[Koha] Zebra not updating biblios automatically in koha 3.8
Doug Kingston
dpk at randomnotes.org
Sun Sep 2 05:11:38 NZST 2012
On 1 September 2012 09:46, Jared Camins-Esakov
<jcamins at cpbibliography.com>wrote:
> Doug,
>
> So environment variables are not the issue. We are carefully managing
>> those.
>>
>
> Make sure when you are using cron jobs that you set the environment
> variables IN YOUR CRONTAB. Setting environment variables elsewhere is a
> recipe for confusion and misery down the road. However, this is -- as you
> say -- not the problem.
>
>
>> I have tried using the new tool checkNonIndexedBiblios.pl (from patch
>> 6566)
>> and it indeed finds a few recent biblios that are not indexed. Using the
>> -z option to mark them for indexing followed by a manual run of
>> rebuild_zebra -b -v -z did not get the biblios indexed. I cranked up the
>> debugging on zebraidx (by modifying rebuild_zebra.pl and using -v -v) and
>> did not see any obvious errors in the output that would suggest why
>> indexing was failing.
>>
>
> Did you change your bibliographic frameworks? It could be a matter of the
> biblionumber not being stored properly. The other thing to do is to confirm
> that the non-indexed biblios are *actually* getting added to the zebraqueue
> by the 6566 script. It's kind of a long shot, but it could be an issue with
> the zebraqueue table getting corrupted. I've seen this happen when the
> zebraqueue table got too large, and disk space was low.
>
So I think this is working as expected. Disk space is ample on the system
in question, and the catalogue is small by most standards (about 2500
biblios). I ran rebuild_zebra.pl with the -k flag so it left the exported
records and here's the tree I got.
library:/tmp# ls -altR p6tjtKrrK3/
p6tjtKrrK3/:
total 0
drwxrwxrwt 6 root root 1040 Sep 1 17:50 ..
drwx------ 5 koha koha 100 Sep 1 06:36 .
drwxr-xr-x 2 koha koha 60 Sep 1 06:36 upd_biblio
drwxr-xr-x 2 koha koha 60 Sep 1 06:36 del_biblio
drwxr-xr-x 2 koha koha 40 Sep 1 06:36 biblio
p6tjtKrrK3/upd_biblio:
total 16
-rw-r--r-- 1 koha koha 12670 Sep 1 06:36 exported_records
drwxr-xr-x 2 koha koha 60 Sep 1 06:36 .
drwx------ 5 koha koha 100 Sep 1 06:36 ..
p6tjtKrrK3/del_biblio:
total 0
drwx------ 5 koha koha 100 Sep 1 06:36 ..
drwxr-xr-x 2 koha koha 60 Sep 1 06:36 .
-rw-r--r-- 1 koha koha 0 Sep 1 06:36 exported_records
p6tjtKrrK3/biblio:
total 0
drwx------ 5 koha koha 100 Sep 1 06:36 ..
drwxr-xr-x 2 koha koha 40 Sep 1 06:36 .
Using marcprint.py, a small python program built around pymarc package, I
decoded this file and find 13 MARC records, as expected.
Example:
=LDR 00871nam a22002417a 4500
=001 201112071555.ls
=003 UkLoVW
=005 20111209110116.0
=008 111207t1982\\\\enkg\\\\r\\\\\001\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aQS 40
=100 1\$aSheffield, Ken$92330
=245 \0$aTen country dances :$bmainly from Thompson, Wright & Wilson.
=260 \\$aOxford :$b[The Author],$c1982.
=300 \\$a12 p. :$bmusic ;$c30 cm.
=490 1\$aFrom two barns ;$vv. 1
=650 \\$9117$aCountry dances
=650 \\$9127$aDance music
=830 \5$aFrom two barns$92331
=942 \\$2VWML$cBK$hQS 40$n0$6QS_00040
=999 \\$c14879$d14879
=952 \\$w2011-12-07$p10914$r2011-12-07$40$00$6QS_00040$915083$bVWML$10$oQS
40$d2011-12-07$70$cBOX$2VWML$yBK$aVWML
=952 \\$w2011-12-07$p11121$r2011-12-07$40$00$6QS_00040$915084$bVWML$10$oQS
40$d2011-12-07$71$cBOX$2VWML$yBK$aVWML
I have attached an ascii printout of all 13 records in case someone wants
to look for a pattern in these records.
The problem is either in the format/contents of those records, or in
zebraidx/zebrasrv or their config files. My suspicion is with the later
since we have already had to fix one problem there with for bug 6566.
-Doug-
>
> Regards,
> Jared
>
> --
> Jared Camins-Esakov
> Bibliographer, C & P Bibliography Services, LLC
> (phone) +1 (917) 727-3445
> (e-mail) jcamins at cpbibliography.com
> (web) http://www.cpbibliography.com/
>
>
-------------- next part --------------
opts = [], args = ['/tmp/exported_records']
=LDR 01203nam a22002417a 4500
=001 201204111533.ls
=003 UkLoVW
=005 20120502165940.0
=008 120411s1796\\\\enkg\\\\r\\\\\000\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aQS 35.4
=245 \0$aThompson's twenty four country dances for the year 1796 :$bwith figures to each dance as they are performed at court, Bath, & all publick assemblys.
=260 \\$aLondon :$b[Thompson],$c[1796].
=300 \\$a1 v. :$bmusic ;$c13 cm.
=500 \\$aPagination commences at p. 85, tune no. 169.
=530 \\$3Available on microfilm, Country dances published by Thompson and Rutherford from 1756-1817, reel no. 8.
=650 \\$9117$aCountry dances
=650 \\$9127$aDance music
=650 \\$9159$aEighteenth century
=942 \\$2VWML$cBK$hQS 35.4$n0$6QS_00035_4
=999 \\$c15260$d15260
=952 \\$w2012-04-11$p3051 c$r2012-04-11$41$00$6QS_00035_4$915612$bVWML$10$oQS 35.4$d2012-04-11$zIn Thompson box II. Some pages missing - contains pp. 85-94.$71$cLC$2VWML$yBK$aVWML
=952 \\$w2012-04-11$p3052$r2012-04-11$41$00$6QS_00035_4$915613$bVWML$10$oQS 35.4$d2012-04-11$zIn Thompson box II. Some pages missing - contains pp. 89-96. $71$cLC$2VWML$yBK$aVWML
---------------------
=LDR 00844nam a22002177a 4500
=001 201203211127.ls
=003 UkLoVW
=005 20120321144114.0
=008 120321s1781\\\\enkg\\\\r\\\\\000\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aQS 35.4
=245 \0$aTwenty four country dances for the year 1781 :$bwith proper directions to each dance as they are performed at court, Almack's, Bath, Pantheon, and all public assemblies.
=260 \\$aLondon :$bT. Skillern,$c[1781].
=300 \\$a12 p. :$bmusic,$c13 cm.
=650 \\$9117$aCountry dances
=650 \\$9127$aDance music
=650 \\$9542$aTune-books
=650 \\$9159$aEighteenth century
=942 \\$2VWML$cBK$hQS 35.4$n0$6QS_00035_4
=999 \\$c15206$d15206
=952 \\$w2012-03-21$p2277 j$r2012-03-21$40$00$6QS_00035_4$915537$bVWML$10$oQS 35.4$d2012-03-21$zStored in box.$71$cLC$2VWML$yBK$aVWML
---------------------
=LDR 00844nam a22002177a 4500
=001 201203211040.ls
=003 UkLoVW
=005 20120321144320.0
=008 120321s1799\\\\enkg\\\\r\\\\\000\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aQS 35.4
=245 \0$aTwenty four country dances for the year 1799 :$bwith proper directions to each dance as they are performed at court, Almack's, Bath, Pantheon, and all public assemblies.
=260 \\$aLondon :$bT. Skillern,$c[1799].
=300 \\$a12 p. :$bmusic,$c13 cm.
=650 \\$9117$aCountry dances
=650 \\$9127$aDance music
=650 \\$9542$aTune-books
=650 \\$9159$aEighteenth century
=942 \\$2VWML$cBK$hQS 35.4$n0$6QS_00035_4
=999 \\$c15204$d15204
=952 \\$w2012-03-21$p2192 d$r2012-03-21$40$00$6QS_00035_4$915535$bVWML$10$oQS 35.4$d2012-03-21$zStored in box.$71$cLC$2VWML$yBK$aVWML
---------------------
=LDR 00839nam a22002057a 4500
=001 201203121633.ls
=003 UkLoVW
=005 20120313142348.0
=008 120312s1798\\\\enkg\\\\r\\\\\000\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aQS 35.4
=245 \9$aPreston's twenty four country dances for the year 1798 :$bwith proper tunes and directions to each dance as they are performed at Court, Bath, and all public assemblys.
=260 \\$aLondon :$bPreston & Son,$c[1798].
=300 \\$a[14 p.] :$bmusic ;$c13 cm.
=650 \\$9117$aCountry dances
=650 \\$9127$aDance music
=650 \\$9159$aEighteenth century
=942 \\$2VWML$cBK$hQS 35.4$n0$6QS_00035_4
=999 \\$c15158$d15158
=952 \\$w2012-03-12$p2192 a$r2012-03-12$40$00$6QS_00035_4$915466$bVWML$10$oQS 35.4$d2012-03-12$zStored with other tune books in box.$71$cLC$2VWML$yBK$aVWML
---------------------
=LDR 00690nam a22002177a 4500
=001 201202091646.ls
=003 UkLoVW
=005 20120210150604.0
=008 120209s1872\\\\enkf\\\\r\\\\\000\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aGO 25(31)
=100 1\$92504$aRoby, John
=245 \\$aTraditions of Lancashire. Vol 1 /$cby John Roby.
=250 \\$a5th ed.
=260 \\$aLondon :$bRoutledge,$c1872.
=300 \\$a468 p., 13 p. of plates :$b18 cm.
=650 \\$9277$aLancashire
=650 \\$9281$aLegends
=942 \\$2VWML$cBK$hGO (25)31$n0$6GO_0002531
=999 \\$c15052$d15052
=952 \\$w2012-02-09$p6952$r2012-02-09$40$00$6GO_0002531$915343$bVWML$10$oGO 25(31)$d2012-02-09$71$2VWML$yBK$aVWML
---------------------
=LDR 01415nam a22003017a 4500
=001 201202071158.ls
=003 UkLoVW
=005 20120210131404.0
=008 120207s1969\\\\enkfg\\|r\\\\\001\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aMPQ 40
=100 1\$92487$aMacCormick, Donald
=245 \0$aHebridean folksongs. Vol. I : $ba collection of waulking songs /$cby Donald MacCormick ; some of them translated by the late Fr. Allan McDonald ; completed and edited by J.L. Campbell ; tunes transcribed, from recordings, by Francis Collinson.
=260 \\$aOxford :$bOxford University Press,$c1969.
=300 \\$a375 p., 3 p. of plates :$bmusic ;$c22 cm.
=500 \\$aVolume 1 of 3.
=500 \\$aSongs collected in Kilphedir in South Uist in the year 1893.
=504 \\$aBibliography p. 345-349. Includes indexes.
=650 \\$9569$aWaulking songs
=650 \\$9202$aFolk songs
=650 \\$9234$aHebrides
=700 \\$92488$aMcDonald, Allan
=700 \\$9698$aCampbell, John Lorne
=700 \\$92486$aCollinson, Francis M.
=942 \\$2VWML$cBK$hMPQ 40$n0$6MPQ_00040
=999 \\$c15038$d15038
=952 \\$w2012-02-07$p6433$r2012-02-07$40$00$6MPQ_00040$915326$bVWML$10$oMPQ 40$d2012-02-07$71$2VWML$yBK$aVWML
=952 \\$w2012-02-07$p6606$r2012-02-07$40$00$6MPQ_00040$915327$bVWML$10$oMPQ 40$d2012-02-07$zPresented to the Vaughan Williams Memorial Library by Mr. Frank Howes, October 1969.$71$cST$2VWML$yBK$aVWML
---------------------
=LDR 00853nam a22002412a 4500
=001 201112141640.ls
=003 UkOxU
=005 20111215101342.0
=008 500101s1921\\\\enka\\\\\\\\\\000\0\eng\d
=035 \\$aOCLC ocm16473143 from D950803M
=040 \\$aDPL$cDPL$dEQO
=092 \\$aD0502834800
=099 \\$aQR 5 App 1
=100 1\$aBell, Elizabeth Turner$92358
=245 10$aFifty figure and character dances for schools /$cby Elizabeth Turner Bell.
=260 \\$aLondon :$bHarrap,$c1921.
=300 \\$a222 p. :$bplates ;$c26 cm.
=650 \0$aDances$9130
=650 \0$aEducation$91612
=740 0\$aMusic for fifty figure and character dances for schools
=942 \\$2VWML$cBK$hQR 5 App 1$n0$6QR_00005_APP_1
=999 \\$c14920$d14920
=952 \\$w2011-12-14$p4446$r2011-12-14$40$00$6QR_00005_APP_1$915145$bVWML$10$oQR 5 App 1$d2011-12-14$70$cST$2VWML$yBK$aVWML
---------------------
=LDR 00791nam a22002297a 4500
=001 201112081033.ls
=003 UkLoVW
=005 20111209110557.0
=008 111207t1995\\\\enkg\\\\r\\\\\001\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aQS 40
=100 1\$aSheffield, Ken$92330
=245 \0$aTen country dances for 1995 :$bfrom the collections of Playford, Thompson, Wright, Johnson and Walsh.
=260 \\$aOxford :$b[The Author],$c1995.
=300 \\$a12 p. :$bmusic ;$c30 cm.
=490 1\$aFrom two barns ;$vv. 7
=650 \\$9117$aCountry dances
=650 \\$9127$aDance music
=830 \5$aFrom two barns$92331
=942 \\$2VWML$cBK$hQS 40$n0$6QS_00040
=999 \\$c14885$d14885
=952 \\$w2011-12-08$p18198$r2011-12-08$40$00$6QS_00040$915095$bVWML$10$oQS 40$d2011-12-08$71$cBOX$2VWML$yBK$aVWML
---------------------
=LDR 00911nam a22002417a 4500
=001 201112081033.ls
=003 UkLoVW
=005 20111209110508.0
=008 111207t1992\\\\enkg\\\\r\\\\\001\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aQS 40
=100 1\$aSheffield, Ken$92330
=245 \0$aTen country dances for 1992 :$bfrom the collections of Playford, Thompson, Wright, Johnson and Walsh
=260 \\$aOxford :$b[The Author],$c1992.
=300 \\$a12 p. :$bmusic ;$c30 cm.
=490 1\$aFrom two barns ;$vv. 6
=650 \\$9117$aCountry dances
=650 \\$9127$aDance music
=830 \5$aFrom two barns$92331
=942 \\$2VWML$cBK$hQS 40$n0$6QS_00040
=999 \\$c14884$d14884
=952 \\$w2011-12-08$p12748$r2011-12-08$40$00$6QS_00040$915093$bVWML$10$oQS 40$d2011-12-08$70$cBOX$2VWML$yBK$aVWML
=952 \\$w2011-12-08$p18197$r2011-12-08$40$00$6QS_00040$915094$bVWML$10$oQS 40$d2011-12-08$71$cBOX$2VWML$yBK$aVWML
---------------------
=LDR 00874nam a22002417a 4500
=001 201112081033.ls
=003 UkLoVW
=005 20111209110334.0
=008 111207t1987\\\\enkg\\\\r\\\\\001\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aQS 40
=100 1\$aSheffield, Ken$92330
=245 \0$aTen country dances for 1987 :$bmainly from Thompson and Walsh.
=260 \\$aOxford :$b[The Author],$c1987.
=300 \\$a12 p. :$bmusic ;$c30 cm.
=490 1\$aFrom two barns ; $vv. 4
=650 \\$9117$aCountry dances
=650 \\$9127$aDance music
=830 \5$aFrom two barns$92331
=942 \\$2VWML$cBK$hQS 40$n0$6QS_00040
=999 \\$c14882$d14882
=952 \\$w2011-12-08$p11987$r2011-12-08$40$00$6QS_00040$915089$bVWML$10$oQS 40$d2011-12-08$70$cBOX$2VWML$yBK$aVWML
=952 \\$w2011-12-08$p11988$r2011-12-08$40$00$6QS_00040$915090$bVWML$10$oQS 40$d2011-12-08$71$cBOX$2VWML$yBK$aVWML
---------------------
=LDR 00871nam a22002417a 4500
=001 201112071555.ls
=003 UkLoVW
=005 20111209110116.0
=008 111207t1982\\\\enkg\\\\r\\\\\001\0\eng\d
=040 \\$aUkLoVW$cUkLoVW
=099 \\$aQS 40
=100 1\$aSheffield, Ken$92330
=245 \0$aTen country dances :$bmainly from Thompson, Wright & Wilson.
=260 \\$aOxford :$b[The Author],$c1982.
=300 \\$a12 p. :$bmusic ;$c30 cm.
=490 1\$aFrom two barns ;$vv. 1
=650 \\$9117$aCountry dances
=650 \\$9127$aDance music
=830 \5$aFrom two barns$92331
=942 \\$2VWML$cBK$hQS 40$n0$6QS_00040
=999 \\$c14879$d14879
=952 \\$w2011-12-07$p10914$r2011-12-07$40$00$6QS_00040$915083$bVWML$10$oQS 40$d2011-12-07$70$cBOX$2VWML$yBK$aVWML
=952 \\$w2011-12-07$p11121$r2011-12-07$40$00$6QS_00040$915084$bVWML$10$oQS 40$d2011-12-07$71$cBOX$2VWML$yBK$aVWML
---------------------
=LDR 00980nam a22003012a 4500
=001 201110271312.ls
=003 UkOxU
=005 20111027151609.0
=008 500101s1978\\\\enka\\\\\b\\\\000\0\eng\d
=020 \\$a0245532080
=035 \\$aOCLC ocm11116132 from D941122M
=040 \\$aAZS$cAZS$dEQO$dUkLoVW
=090 \\$aPN1979.P9$bA3x
=092 \\$aD0502008990
=099 \\$aGRQ 15
=100 1\$aAdams, Anthony$92190
=245 14$aThe world of Punch & Judy /$cAnthony Adams and Robert Leach
=260 \\$aLondon :$bHarrap,$c1978.
=300 \\$a40 p. :$bill. ;$c25 cm.
=440 \\$92191$aHarrap's theatre workshop
=504 \\$aBibliography: p. 40
=630 00$aPunch and Judy$92192
=650 \0$aPuppets$92193
=700 1\$aLeach, Robert$91888
=740 04$aThe world of Punch and Judy
=942 \\$2VWML$cBK$hGRQ 15$n0$6GRQ_00015
=999 \\$c14768$d14768
=952 \\$w2011-10-27$p11353$r2011-10-27$40$00$6GRQ_00015_BOX$914902$bVWML$10$oGRQ 15 Box$d2011-10-27$70$cBOX$2VWML$yBK$aVWML
---------------------
=LDR 01555cam a22003251 4500
=001 201109261500.ls
=003 UkLoVW
=005 20111003164210.0
=008 770502s1957\\\\enkagh\\\b\\\\000\0\eng\\
=010 \\$a 57004332
=040 \\$aDLC$cDLC$dDLC
=050 00$aML160$b.N44 vol. 1
=082 00$a781.8$a780.93*
=099 \\$aMG 20
=100 1\$aWellesz, Egon.$92114
=245 10$aAncient and oriental music$cedited by Egon Wellesz.
=260 \\$aLondon :$bOxford University Press,$c1957.
=300 \\$a530 p.$billus., facsims., music.$c26 cm.
=440 \0$aNew Oxford history of music,$vv. 1$92116
=504 \\$aBibliography: p. [479]-503.
=505 \\$aPrimitive music / by Marius Schneider -- The music of far Eastern Asia 1 : China / by Laurence Picken -- The music of far Eastern Asia 2 : other countries / by Laurence Picken -- The music of India / by Arnold Bake -- The music of ancient Mesopotamia / by Henry George Farmer -- The music of ancient Egypt / by Henry George Farmer -- Music in the bible / by Carl H. Kraeling -- The music of post-biblical Judaism / by Eric Werner -- Ancient Greek music / by Isobel Henderson -- Roman music / by Rev. J.E. Scott -- The music of Islam / by Henry George Farmer.
=650 \0$aMusic$9335
=650 \0$aAsia$926
=650 \0$aGreece$9225
=650 \0$aBible$947
=650 \0$aJewish music$9269
=650 \0$aIslam$92115
=942 \\$2VWML$cBK$hMG 20$n0$6MG_00020
=999 \\$c14696$d14696
=952 \\$w2011-09-26$p4571$r2011-09-26$40$00$6MG_00020$914774$bVWML$10$oMG 20$d2011-09-26$71$2VWML$yBK$aVWML
---------------------
More information about the Koha
mailing list