[Koha] Problems with Zebra indexing

[Coehoorn, Joel]

Okay, I can /usr/sbin/koha_rebuild_zebra to run if I use the -f switch.
This makes sense: whatever I did that broke this originally is preventing
that from seeing incremental changes.

However, this breaks my search again, and there are no results. To get
search results back, I have to run the rebuild_zebra.pl script (I know, I
know) with sudo. What could be going on here?


  Joel Coehoorn
Director of Information Technology
York College, Nebraska
402.363.5603
jcoehoorn at york.edu



 *The mission of York College is to transform lives through
Christ-centered education and to equip students for lifelong service to
God, family, and society*



On Wed, Jul 24, 2013 at 7:25 AM, Robin Sheat <robin at catalyst.net.nz> wrote:

> Op 23/07/13 06:22, Coehoorn, Joel schreef:
> > In spite of this, search has been fully working until this week, with the
> > caveat that I would have to manually run the rebuild_zebra.pl script.
> This
> > had always involved using sudo to rebuild the indexes (one part of why I
> > think I must have done something as root).
>
> With the packages, you don't need to touch any of this. It does it all
> for you and it manages the permissions appropriately. By using the
> "internal" commands directly, it is the case that, as you discovered,
> you broke things and the package driven functions fail now.
>
> > When I watch the re-index process, I see a few additional folders that
> > cause permissions issues under /var/lock. I can update permissions on
> these
> > as well, but they are removed and re-created with the bad permissions
> every
> > time the server reboots. Rare enough, but still a problem.
>
> What are you considering good permissions and bad permissions? Can you
> provide some actual examples? Also examples of the errors and what the
> current states are of the files it's complaining about, along with the
> exact commands you are running, including the command prompt.
>
> What you should be seeing is things like this (where the library name
> here is 'catalyst'):
>
> $ ls -ld /var/lock/koha/catalyst
> drwxr-xr-x 4 catalyst-koha catalyst-koha 4096 Sep 13  2012
> /var/lock/koha/catalyst
> $ ls -lR /var/lock/koha/catalyst
> /var/lock/koha/catalyst:
> total 8
> drwxr-xr-x 2 catalyst-koha catalyst-koha 4096 Feb 27 19:55 authorities
> drwxr-xr-x 2 catalyst-koha catalyst-koha 4096 Feb 27 19:55 biblios
>
> /var/lock/koha/catalyst/authorities:
> total 4
> -rw-r--r-- 1 catalyst-koha catalyst-koha 5 Jul 18 10:22 zebrasrv.pid
>
> /var/lock/koha/catalyst/biblios:
> total 4
> -rw-r--r-- 1 catalyst-koha catalyst-koha 5 Jul 18 10:22 zebrasrv.pid
>
> and similar for the stuff in /var/lib/koha. It must all be read/write
> libraryname-koha. You should never use rebuild-zebra. Instead you should
> use /usr/sbin/koha-rebuild-zebra.
>
> > *How can I fix this so that the lock folders get the correct permissions
> > when they are recreated after reboot? Is this something I'll need to
> script?
> > *
>
> They are recreated after reboot with the correct permissions. This
> happens by running /usr/sbin/koha-create-dirs $( koha-list ) during boot.
>
> > *How can I get koha to use handle these large items? *I know it's
> possible,
> > because until this week I was able to search on those records.
>
> Stop doing stuff with rebuild-zebra.pl directly, and it'll just work.
> More specifically, the packages do XML indexing by default, and this is
> how these are handled.
>
> > With just the two bad records, I can then watch zebra index those first
> > 92000 or so records. After the exporting biblios phase, during the
> reindex
> > phase, with extra verbosity set I do see this error:
>
> There's no error there. But try it with koha-rebuild-zebra, it might
> work better.
>
> > I tried re-indexing with the -x switch, in an attempt to use the xml
> format
> > to get around the marc 99999 byte limit. This completes with no errors.
> > However, I still don't see any search results. I know the zebra server is
> > running.
>
> Did you check the error logs (in /var/log/koha/libraryname) for zebra?
>
> --
> Robin Sheat
> Catalyst IT Ltd.
> ✆ +64 4 803 2204
> GPG: 5957 6D23 8B16 EFAB FEF8 7175 14D3 6485 A99C EB6D
> _______________________________________________
> Koha mailing list  http://koha-community.org
> Koha at lists.katipo.co.nz
> http://lists.katipo.co.nz/mailman/listinfo/koha
>