[Koha] Elasticsearch reindex failing for authorities

[Alvaro Cornejo]

Hi Aleisha

Have you tried to lower the batch commit?

see
https://perldoc.koha-community.org/misc/search_tools/rebuild_elasticsearch.html

Regards,

Alvaro



|----------------------------------------------------------------------------------------|
 Stay safe / Cuídate/  Reste sécurisé
*7* Switch off as you go / Apaga lo que no usas /  Débranchez au fur et à
mesure.
 *q *Recycle always / Recicla siempre / Recyclez toujours
 P Print only if absolutely necessary / Imprime solo si es necesario /
Imprimez seulement si nécessaire


Le mer. 28 avr. 2021 à 23:52, Aleisha Amohia <aleisha at catalyst.net.nz> a
écrit :

> Hi all,
>
> We have a site with around 600,000 authority records and have enabled
> elasticsearch. Reindexing and searching has worked easily for biblios
> (there are just over 10,000 biblios) but fails for authorities.
>
> $ sudo koha-elasticsearch --rebuild -d -a -v <instance>
> [19024] Checking state of authorities index
> [19024] Dropping and recreating authorities index
> [19024] Indexing authorities
>
> And then it just hangs there for ages until the server runs out of
> memory and dies.
>
> We're running ES 6.x on Koha 20.05.x.
>
> I tried running the script directly and specifying an authid and that
> worked as expected.
>
> $ perl /usr/share/koha/bin/search_tools/rebuild_elasticsearch.pl -a -d
> -v -ai 2135575
> [17684] Checking state of authorities index
> [17684] Dropping and recreating authorities index
> [17684] Indexing authorities
> [17684] Committing final records...
> [17684] Total 1 records indexed
>
> It feels like this is happening because we have too many authority
> records. Is there a way to fix this? Has anyone come across this before?
>
> Thanks!
>
> --
> *Aleisha Amohia*(she/her)
> _______________________________________________
>
> Koha mailing list  http://koha-community.org
> Koha at lists.katipo.co.nz
> Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha
>