when will koha master work with elastic search 5.X
Nau Mai, I am working with migrating an vtls ILS to koha for a uni library. Mostly I have been recoding and optimizing some old bywater scripts and some koha import utilities to import our 3.2 M+ holdings into koha. We are trying to run koha master with elastic search due to performance issues with zebra. Our initial impression was that koha worked with ES 5.X so we installed 5.3, but we can not get it to work at all with authorities. The indexing processes generates a 7 Gbyte file filled with warnings and several key fields in elastic search contain nulls. It is possible to perform some searches on the biblio index if the sort is turned off, but it does not seem to work fully either. We have been studying bugzilla to try and figure out what is supposed to work. I have tried to apply several new patches to koha ES with out seeing any improvement. My questions are : 1/ Can koha be made to work with elastic search 5.X ? 2/ If not are when will Koha work with ES 5.x ? 3/ Does some version of Koha work with an older version of ES ? Best Regards, Dave
1/ It works, but it is still missing a patch, tough. [1] 2/ 17.05 will certaintly work with 5.x ONLY (the previous versions are deprecated) 3/ 16.11 should Good luck and let us know! [1] https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18434 El mar., 16 may. 2017 a las 9:54, David Holoshka (<david.holoshka@ub.lu.se>) escribió:
Nau Mai,
I am working with migrating an vtls ILS to koha for a uni library. Mostly I have been recoding and optimizing some old bywater scripts and some koha import utilities to import our 3.2 M+ holdings into koha.
We are trying to run koha master with elastic search due to performance issues with zebra. Our initial impression was that koha worked with ES 5.X so we installed 5.3, but we can not get it to work at all with authorities. The indexing processes generates a 7 Gbyte file filled with warnings and several key fields in elastic search contain nulls. It is possible to perform some searches on the biblio index if the sort is turned off, but it does not seem to work fully either.
We have been studying bugzilla to try and figure out what is supposed to work. I have tried to apply several new patches to koha ES with out seeing any improvement.
My questions are :
1/ Can koha be made to work with elastic search 5.X ?
2/ If not are when will Koha work with ES 5.x ?
3/ Does some version of Koha work with an older version of ES ?
Best Regards,
Dave
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
-- Tomás Cohen Arazi Theke Solutions (https://theke.io <http://theke.io/>) ✆ +54 9351 3513384 GPG: B2F3C15F
Hi Dave, Echoing what Tomas said you should find things working on master. If you are having issues please report them here, or better yet, file a bug in the community so that we can investigate and/or fix the issue. It is important to make sure your mappings are updated to the latest version as well to ensure things will work. Sorting will break on indexes where sorting is not defined, but should work for common categories. Can you share some of the warnings you are seeing as well as some info about your environment? i.e. type of Koha install (assuming dev instal) MARC21/UNIMARC, OS, Catmandu/ES dependency versions? -Nick On Tue, May 16, 2017 at 8:54 AM David Holoshka <david.holoshka@ub.lu.se> wrote:
Nau Mai,
I am working with migrating an vtls ILS to koha for a uni library. Mostly I have been recoding and optimizing some old bywater scripts and some koha import utilities to import our 3.2 M+ holdings into koha.
We are trying to run koha master with elastic search due to performance issues with zebra. Our initial impression was that koha worked with ES 5.X so we installed 5.3, but we can not get it to work at all with authorities. The indexing processes generates a 7 Gbyte file filled with warnings and several key fields in elastic search contain nulls. It is possible to perform some searches on the biblio index if the sort is turned off, but it does not seem to work fully either.
We have been studying bugzilla to try and figure out what is supposed to work. I have tried to apply several new patches to koha ES with out seeing any improvement.
My questions are :
1/ Can koha be made to work with elastic search 5.X ?
2/ If not are when will Koha work with ES 5.x ?
3/ Does some version of Koha work with an older version of ES ?
Best Regards,
Dave
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Dave, you can reset your mappings using /cgi-bin/koha/admin/searchengine/elasticsearch/ mappings.pl?op=reset&i_know_what_i_am_doing=1 Regards El mar., 16 may. 2017 a las 10:09, Nick Clemens (<nick@bywatersolutions.com>) escribió:
Hi Dave,
Echoing what Tomas said you should find things working on master. If you are having issues please report them here, or better yet, file a bug in the community so that we can investigate and/or fix the issue.
It is important to make sure your mappings are updated to the latest version as well to ensure things will work.
Sorting will break on indexes where sorting is not defined, but should work for common categories.
Can you share some of the warnings you are seeing as well as some info about your environment? i.e. type of Koha install (assuming dev instal) MARC21/UNIMARC, OS, Catmandu/ES dependency versions?
-Nick
On Tue, May 16, 2017 at 8:54 AM David Holoshka <david.holoshka@ub.lu.se> wrote:
Nau Mai,
I am working with migrating an vtls ILS to koha for a uni library. Mostly I have been recoding and optimizing some old bywater scripts and some koha import utilities to import our 3.2 M+ holdings into koha.
We are trying to run koha master with elastic search due to performance issues with zebra. Our initial impression was that koha worked with ES 5.X so we installed 5.3, but we can not get it to work at all with authorities. The indexing processes generates a 7 Gbyte file filled with warnings and several key fields in elastic search contain nulls. It is possible to perform some searches on the biblio index if the sort is turned off, but it does not seem to work fully either.
We have been studying bugzilla to try and figure out what is supposed to work. I have tried to apply several new patches to koha ES with out seeing any improvement.
My questions are :
1/ Can koha be made to work with elastic search 5.X ?
2/ If not are when will Koha work with ES 5.x ?
3/ Does some version of Koha work with an older version of ES ?
Best Regards,
Dave
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
-- Tomás Cohen Arazi Theke Solutions (https://theke.io <http://theke.io/>) ✆ +54 9351 3513384 GPG: B2F3C15F
Hi, Thank you for your prompt replies. We have tried reseting the mappings (yesterday was the 2nd time we tried) and rebuilt the ES indexes with similar results. Now that I know that koha should work with ES 5 I can re check our configuration. We have been using stuff from the koha unstable main and the koha nightly as per instructions: https://wiki.koha-community.org/wiki/Elasticsearch . I will try to rebuild the indexes with out using these repositories as I see that apt-get complains of some dependency issues. Our system is: Debian, Koha cloned from master into /usr/local/koha using git Mysql ES 5.3 (it seems to be working fine) on oracle java 8 ( I could not find the open jdk 8 on the debian package list). Marc 21 All perl catmandu modules are the latest from cpanm. Best Regards, Dave On 05/16/2017 03:13 PM, Tomas Cohen Arazi wrote:
Dave, you can reset your mappings using /cgi-bin/koha/admin/searchengine/elasticsearch/mappings.pl?op=reset&i_know_what_i_am_doing=1 <http://mappings.pl?op=reset&i_know_what_i_am_doing=1>
Regards
El mar., 16 may. 2017 a las 10:09, Nick Clemens (<nick@bywatersolutions.com <mailto:nick@bywatersolutions.com>>) escribió:
Hi Dave,
Echoing what Tomas said you should find things working on master. If you are having issues please report them here, or better yet, file a bug in the community so that we can investigate and/or fix the issue.
It is important to make sure your mappings are updated to the latest version as well to ensure things will work.
Sorting will break on indexes where sorting is not defined, but should work for common categories.
Can you share some of the warnings you are seeing as well as some info about your environment? i.e. type of Koha install (assuming dev instal) MARC21/UNIMARC, OS, Catmandu/ES dependency versions?
-Nick
On Tue, May 16, 2017 at 8:54 AM David Holoshka <david.holoshka@ub.lu.se <mailto:david.holoshka@ub.lu.se>> wrote:
> Nau Mai, > > I am working with migrating an vtls ILS to koha for a uni library. > Mostly I have been recoding and optimizing some old bywater scripts and > some koha import utilities to import our 3.2 M+ holdings into koha. > > We are trying to run koha master with elastic search due to performance > issues with zebra. Our initial impression was that koha worked with ES > 5.X so we installed 5.3, but we can not get it to work at all with > authorities. The indexing processes generates a 7 Gbyte file filled > with warnings and several key fields in elastic search contain nulls. > It is possible to perform some searches on the biblio index if the sort > is turned off, but it does not seem to work fully either. > > We have been studying bugzilla to try and figure out what is supposed to > work. I have tried to apply several new patches to koha ES with out > seeing any improvement. > > My questions are : > > 1/ Can koha be made to work with elastic search 5.X ? > > 2/ If not are when will Koha work with ES 5.x ? > > 3/ Does some version of Koha work with an older version of ES ? > > Best Regards, > > Dave > > _______________________________________________ > Koha mailing list http://koha-community.org > Koha@lists.katipo.co.nz <mailto:Koha@lists.katipo.co.nz> > https://lists.katipo.co.nz/mailman/listinfo/koha > _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz <mailto:Koha@lists.katipo.co.nz> https://lists.katipo.co.nz/mailman/listinfo/koha
-- Tomás Cohen Arazi Theke Solutions (https://theke.io <http://theke.io/>) ✆ +54 9351 3513384 GPG: B2F3C15F
participants (3)
-
David Holoshka -
Nick Clemens -
Tomas Cohen Arazi