Hi Aleisha Have you tried to lower the batch commit? see https://perldoc.koha-community.org/misc/search_tools/rebuild_elasticsearch.h... Regards, Alvaro |----------------------------------------------------------------------------------------| Stay safe / Cuídate/ Reste sécurisé *7* Switch off as you go / Apaga lo que no usas / Débranchez au fur et à mesure. *q *Recycle always / Recicla siempre / Recyclez toujours P Print only if absolutely necessary / Imprime solo si es necesario / Imprimez seulement si nécessaire Le mer. 28 avr. 2021 à 23:52, Aleisha Amohia <aleisha@catalyst.net.nz> a écrit :
Hi all,
We have a site with around 600,000 authority records and have enabled elasticsearch. Reindexing and searching has worked easily for biblios (there are just over 10,000 biblios) but fails for authorities.
$ sudo koha-elasticsearch --rebuild -d -a -v <instance> [19024] Checking state of authorities index [19024] Dropping and recreating authorities index [19024] Indexing authorities
And then it just hangs there for ages until the server runs out of memory and dies.
We're running ES 6.x on Koha 20.05.x.
I tried running the script directly and specifying an authid and that worked as expected.
$ perl /usr/share/koha/bin/search_tools/rebuild_elasticsearch.pl -a -d -v -ai 2135575 [17684] Checking state of authorities index [17684] Dropping and recreating authorities index [17684] Indexing authorities [17684] Committing final records... [17684] Total 1 records indexed
It feels like this is happening because we have too many authority records. Is there a way to fix this? Has anyone come across this before?
Thanks!
-- *Aleisha Amohia*(she/her) _______________________________________________
Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha