rebuild_zebra: Biblios aren't displayed anymore
Hi all Since I have done a rebuild of the zebra index with /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -a -r the biblios and items aren't displayed anymore with the search results. You can try it at http://bibliothek.ksobwalden.ch/ using for instancs the author Thomas Mann. The result shows 7 hints (witch is likely the number of Thomas Mann as an author or co-author). But alle the seven hints are marked with "Kein Titel" If I use the inventory tool then the biblios are shown an I can even edit them. /var/log/koha/koha-opac-error.log shows some errors like: [Mon Oct 22 14:43:23 2012] [error] [client 180.76.5.146] [Mon Oct 22 14:43:23 2012] opac-detail.pl: Use of uninitialized value in concatenation (.) or string at /usr/share/koha/opac/htdocs/opac-tmpl/prog/en/modules/opac-detail.tt line 746. What's wrong? It's Koha 3.08.05 with Perl 5.010001 Zebra 2.0.52 on debian squeeze. Beda
At 03:13 PM 10/22/2012 +0200, Beda Szukics wrote:
Hi all Since I have done a rebuild of the zebra index with /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -a -r the biblios and items aren't displayed anymore with the search results.
Two points: - do you have any duplicate 001 Control Numbers? [1] This was our biggest difficulty after upgrade from 3.6.1 to 3.8.5 [001 should be unique when taken in conjunction with 003, but zebra does not respect this.] - did you follow reindexing the authorities with the biblios? ./bin/migration_tools/rebuild_zebra.pl -b -r -x Best - Paul [1] You can verify this in mysql with: SELECT GROUP_CONCAT(biblionumber SEPARATOR ', ') AS biblionumbers, EXTRACTVALUE(marcxml,'//controlfield[@tag="001"]') AS id FROM biblioitems GROUP BY id HAVING count(id) > 1
Am 22.10.2012 16:43, schrieb Paul:
At 03:13 PM 10/22/2012 +0200, Beda Szukics wrote:
Hi all Since I have done a rebuild of the zebra index with /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -a -r the biblios and items aren't displayed anymore with the search results.
Two points:
- do you have any duplicate 001 Control Numbers? [1] This was our biggest difficulty after upgrade from 3.6.1 to 3.8.5 [001 should be unique when taken in conjunction with 003, but zebra does not respect this.]
- did you follow reindexing the authorities with the biblios? ./bin/migration_tools/rebuild_zebra.pl -b -r -x
Best - Paul
[1] You can verify this in mysql with:
SELECT GROUP_CONCAT(biblionumber SEPARATOR ', ') AS biblionumbers, EXTRACTVALUE(marcxml,'//controlfield[@tag="001"]') AS id FROM biblioitems GROUP BY id HAVING count(id) > 1
It seems so: Your instruction tells me: | biblionumbers | id | | 256, 512, 768, 1024, 1280, 1536, 1792, 2048, 2304, 2560, 2816, 3072, 3328, 3584, 4864, 5120, 5376, 5632, 5888, 6144, 6400, 6912, 7168, 7424, 7680, 7936, 8704, 8960, 9472, 513, 769, 1025, 1281, 1537, 1793, 2049, 2305, 2561, 2817, 3073, 3329, 3585, 5121, 5377, 5633, 5889, 6145, 7169, 7425, 7681, 7937, 8961, 9473, 9729, 2, 514, 770, 1026, 1282, 1538, 1794, 2050, 2306, 2562, 2818, 3074, 3330, 3586, 5122, 5378, 5634, 5890, 6146, 6914, 7170, 7426, 7682, 7938, 8962, 9474, 259, 515, 771, 1027, 1283, 1539, 1795, 2051, 2307, 2563, 2819, 3075, 3331, 5123, 5379, 5635, 5891, 6147, 6915, 7171, 7427, 7939, 8707, 8963, 9475, 4, 516, 772, 1028, 1284, 1540, 1796, 2052, 2308, 2564, 2820, 3076, 3332, 5124, 5380, 5636, 5892, 6148, 6916, 7172, 7428, 7940, 8452, 10244, 261, 517, 773, 1029, 1285, 1541, 2053, 2309, 2565, 2821, 3077, 3333, 5125, 5381, 5637, 5893, 6149, 6405, 6917, 7173, 7429, 7685, 7941, 8197, 9221, 774, 1030, 1286, 1542, 1798, 2054, 2310, 2566, 2822, 3078, 3334, 3590, 4614, 4870, 5126, 5382, 5638, 5894, 6150, 6918, 7 | | [and some more rows] 15 rows in set, 1 warning (2.22 sec) What can I do about that? I didn't do a rebuild of the authority indexes. Thank you Beda
Greetings,
Since I have done a rebuild of the zebra index with /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -a -r the biblios and items aren't displayed anymore with the search results.
Did you install with packages or a tarball? If packages, you should use: $ koha-rebuild_zebra -v -f {instance name} (where you replace {instance name} with what you called your instance) If tarball, you should run: $ sudo -i # su - {user that does the indexing} (the tarball instructions usually suggestion koha as the user, so it is likely koha, but I make no promises) $ /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -b -a -r (I do the sudo -i and su -, because you more likely know your password than you remember the user's that does the indexing) If you didn't do this, then you may have permissions issues and may need to chown -R the appropriate directories. The errors you gave are not related to to your indexing problem. -- This is another reason the packages are very, very nice. If you use the commands provided by the packages, you will never end up with permission errors. :) If there are still genuine indexing problems afterwards, I would use the script on http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=6566 Place the script in /usr/share/koha/bin/migration_tools/checkNonIndexedBiblios.pl and assuming the user you (or the packages) created for indexing is called library-koha (change it to the user you use for indexing if you use tarball): $ sudo -i # su - library-koha $ echo $KOHA_CONF [this should be set to the proper value] $ echo $PERL5LIB [this should be set to the proper value] $ /usr/share/koha/bin/migration_tools/checkNonIndexedBiblios.pl -c -z In our migration from tarball to packages, we had indexing problems. A full reindex said there was a malformed tag, but I couldn't find it. I started this at night and went to bed: $ while true; do /usr/share/koha/bin/migration_tools/checkNonIndexedBiblios.pl -c -z; sleep 360; done In the morning everything was properly indexed (0 records added), so I just had to kill the process with a CTRL-C. It works knowing that the zebra indexing is triggered automatically every 5 minutes in packages. So, by sleeping 6 minutes, that let's at least some indexing happen before retrying. This, of course, will bloat the zebra queue table, but the packages have a script to automatically clean that up already installed. I tried the sliced reindexing and it just messed up our indexes again. So, this is the method I'm sticking with. Your mileage may vary. GPML, Mark Tompsett
Greetings Am 22.10.2012 16:55, schrieb Mark Tompsett:
Greetings,
Since I have done a rebuild of the zebra index with /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -a -r the biblios and items aren't displayed anymore with the search results.
Did you install with packages or a tarball?
I installed with a tarball. I would like to use the packages. Is there a simple way to change from tarball installation to packages installation?
If tarball, you should run: $ sudo -i # su - {user that does the indexing} (the tarball instructions usually suggestion koha as the user, so it is likely koha, but I make no promises) $ /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -b -a -r (I do the sudo -i and su -, because you more likely know your password than you remember the user's that does the indexing)
koha is an user on my server. So I log in as koha and run the scripts as user koha.
If there are still genuine indexing problems afterwards, I would use the script on http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=6566
Place the script in /usr/share/koha/bin/migration_tools/checkNonIndexedBiblios.pl and assuming the user you (or the packages) created for indexing is called library-koha (change it to the user you use for indexing if you use tarball):
$ sudo -i # su - library-koha $ echo $KOHA_CONF [this should be set to the proper value] $ echo $PERL5LIB [this should be set to the proper value] $ /usr/share/koha/bin/migration_tools/checkNonIndexedBiblios.pl -c -z
In our migration from tarball to packages, we had indexing problems. A full reindex said there was a malformed tag, but I couldn't find it. I started this at night and went to bed: $ while true; do /usr/share/koha/bin/migration_tools/checkNonIndexedBiblios.pl -c -z; sleep 360; done In the morning everything was properly indexed (0 records added), so I just had to kill the process with a CTRL-C.
It works knowing that the zebra indexing is triggered automatically every 5 minutes in packages. So, by sleeping 6 minutes, that let's at least some indexing happen before retrying. This, of course, will bloat the zebra queue table, but the packages have a script to automatically clean that up already installed. I tried the sliced reindexing and it just messed up our indexes again. So, this is the method I'm sticking with. Your mileage may vary.
I will try your suggestion if there isn't an other solution :-) Thank you Beda
Greetings,
I installed with a tarball. I would like to use the packages. Is there a simple way to change from tarball installation to packages installation?
Yes, there is. :) I haven't done this before, but there is a wiki page: http://wiki.koha-community.org/wiki/Moving_an_installation_from_a_regular_in... What I did was: 1) backup my DB (for example -- make sure to change the dbuser and dbname parts): $ mysqldump -u <dbuser> -p <dbname> > mybackup.sql 2) a fresh install of the OS and the packages install up to and including the koha-create. 3) put my old db in place (for example -- make sure to change the instancename part): $ sudo koha-mysql <instancename> < mybackup.sql 4) Then I continued the packages installation. The web install step did the database scheme upgrades. Granted, this is much easier when going from 3.4 or higher to current stable (3.8.x). Prior to 3.4.x, there would be a couple more commands to do. GPML, Mark Tompsett
Greetings Am 22.10.2012 17:37, schrieb Mark Tompsett:
I installed with a tarball. I would like to use the packages. Is there a simple way to change from tarball installation to packages installation?
Yes, there is. :) I haven't done this before, but there is a wiki page: http://wiki.koha-community.org/wiki/Moving_an_installation_from_a_regular_in...
Thank you for your hint. I'll consider it. Cheers Beda
On 23/10/2012, at 24:39 , Beda Szukics wrote:
Greetings
Am 22.10.2012 17:37, schrieb Mark Tompsett:
I installed with a tarball. I would like to use the packages. Is there a simple way to change from tarball installation to packages installation?
Yes, there is. :) I haven't done this before, but there is a wiki page: http://wiki.koha-community.org/wiki/Moving_an_installation_from_a_regular_in...
*That* is an extremely useful wiki page. Many brownie points to Magnus! I would suggest that you make sure that you have another privileged user account other than the kohaadmin before you start this. The package install (rightly) decided that I couldn't use the kohaadmin to access the staff interface. -ramon.
participants (4)
-
Beda Szukics -
Mark Tompsett -
Paul -
Ramon Andiñach