Earlier testing of Koha 19.11.03 with Elasticsearch 7 and 6 both gave errors. There was some suspicion that perhaps Elasticsearch had to be rolled back to V5. So, I did that today, as well as upgrading Koha to 19.11.04. And I am getting a new error. Basically, now, it looks like there might be a configuration error somewhere? Here is my current error when trying to index: PERL5LIB=/usr/share/koha/lib:/usr/local/lib:/usr/local/share/perl5 ./bin/search_tools/rebuild_elasticsearch.pl -d -v -p 4 [7019] Checking state of biblios index [7019] Dropping and recreating biblios index [Request] ** [http://localhost:9200]-[400] [illegal_argument_exception] Custom Analyzer [analyzer_phrase] failed to find filter under name [icu_folding], called from sub Search::Elasticsearch::Role::Client::Direct::__ANON__ at /usr/share/koha/lib/Koha/SearchEngine/Elasticsearch/Indexer.pm line 349. With vars: {'body' => {'status' => 400,'error' => {'root_cause' => [{'reason' => 'Custom Analyzer [analyzer_phrase] failed to find filter under name [icu_folding]','type' => 'illegal_argument_exception'}],'reason' => 'Custom Analyzer [analyzer_phrase] failed to find filter under name [icu_folding]','type' => 'illegal_argument_exception'}},'request' => {'serialize' => 'std','path' => '/koha_london_test_20_biblios','ignore' => [],'mime_type' => 'application/json','body' => {'settings' => {'index' => {'analysis' => {'normalizer' => {'nfkc_cf_normalizer' => {'type' => 'custom','char_filter' => 'icu_normalizer'},'icu_folding_normalizer' => {'filter' => ['icu_folding'],'type' => 'custom'}},'char_filter' => {'punctuation' => {'pattern' => '([\\x00-\\x1F,\\x21-\\x2F,\\x3A-\\x40,\\x5B-\\x60,\\x7B-\\x89,\\x8B,\\x8D,\\x8F,\\x90-\\x99,\\x9B,\\x9D,\\xA0-\\xBF,\\xD7,\\xF7])','type' => 'pattern_replace','replacement' => ''}},'analyzer' => {'analyzer_stdno' => {'filter' => ['icu_folding'],'char_filter' => ['punctuation'],'tokenizer' => 'whitespace'},'analyzer_phrase' => {'filter' => ['icu_folding'],'char_filter' => ['punctuation'],'tokenizer' => 'keyword'},'analyzer_standard' => {'filter' => ['icu_folding'],'tokenizer' => 'icu_tokenizer'}}}},'index.mapping.total_fields.limit' => '10000'}},'qs' => {},'method' => 'PUT'},'status_code' => 400} FWIW, Koha knows what the indices should be but also seems to know that they do not yet exist: Nodes: localhost:9200 | Status: running | Indices: koha_london_test_20_biblios (count: -1), koha_london_test_20_authorities (count: -1) Anyone seen this type of error or have ideas on what might be going on with this particular issue? Thanks, Tom -- *Tom Hanstra* *Sr. Systems Administrator* hanstra@nd.edu
Hi, do you have the analysis-icu plugin [1] installed? [1] https://www.elastic.co/guide/en/elasticsearch/plugins/current/analysis-icu.h... On 31/03/2020 00:35, Tom Hanstra wrote:
Earlier testing of Koha 19.11.03 with Elasticsearch 7 and 6 both gave errors. There was some suspicion that perhaps Elasticsearch had to be rolled back to V5.
So, I did that today, as well as upgrading Koha to 19.11.04. And I am getting a new error. Basically, now, it looks like there might be a configuration error somewhere?
Here is my current error when trying to index:
PERL5LIB=/usr/share/koha/lib:/usr/local/lib:/usr/local/share/perl5 ./bin/search_tools/rebuild_elasticsearch.pl -d -v -p 4 [7019] Checking state of biblios index [7019] Dropping and recreating biblios index [Request] ** [http://localhost:9200]-[400] [illegal_argument_exception] Custom Analyzer [analyzer_phrase] failed to find filter under name [icu_folding], called from sub Search::Elasticsearch::Role::Client::Direct::__ANON__ at /usr/share/koha/lib/Koha/SearchEngine/Elasticsearch/Indexer.pm line 349. With vars: {'body' => {'status' => 400,'error' => {'root_cause' => [{'reason' => 'Custom Analyzer [analyzer_phrase] failed to find filter under name [icu_folding]','type' => 'illegal_argument_exception'}],'reason' => 'Custom Analyzer [analyzer_phrase] failed to find filter under name [icu_folding]','type' => 'illegal_argument_exception'}},'request' => {'serialize' => 'std','path' => '/koha_london_test_20_biblios','ignore' => [],'mime_type' => 'application/json','body' => {'settings' => {'index' => {'analysis' => {'normalizer' => {'nfkc_cf_normalizer' => {'type' => 'custom','char_filter' => 'icu_normalizer'},'icu_folding_normalizer' => {'filter' => ['icu_folding'],'type' => 'custom'}},'char_filter' => {'punctuation' => {'pattern' => '([\\x00-\\x1F,\\x21-\\x2F,\\x3A-\\x40,\\x5B-\\x60,\\x7B-\\x89,\\x8B,\\x8D,\\x8F,\\x90-\\x99,\\x9B,\\x9D,\\xA0-\\xBF,\\xD7,\\xF7])','type' => 'pattern_replace','replacement' => ''}},'analyzer' => {'analyzer_stdno' => {'filter' => ['icu_folding'],'char_filter' => ['punctuation'],'tokenizer' => 'whitespace'},'analyzer_phrase' => {'filter' => ['icu_folding'],'char_filter' => ['punctuation'],'tokenizer' => 'keyword'},'analyzer_standard' => {'filter' => ['icu_folding'],'tokenizer' => 'icu_tokenizer'}}}},'index.mapping.total_fields.limit' => '10000'}},'qs' => {},'method' => 'PUT'},'status_code' => 400}
FWIW, Koha knows what the indices should be but also seems to know that they do not yet exist:
Nodes: localhost:9200 | Status: running | Indices: koha_london_test_20_biblios (count: -1), koha_london_test_20_authorities (count: -1)
Anyone seen this type of error or have ideas on what might be going on with this particular issue?
Thanks, Tom
Thanks. That *was* missing after the downgrade. I was then able to index with a couple of errors. But searches don't want to work still. I get this error, which I think I saw at one point earlier: Software error: Can't locate object method "index_name" via package "Catmandu::Store::ElasticSearch" at /usr/share/koha/lib/Koha/SearchEngine/Elasticsearch/Search.pm line 414. The Catmandu::Store::Elasticsearch package is there. But something else still seems to be missing. Tom On Tue, Mar 31, 2020 at 12:52 AM Joonas Kylmälä <joonas.kylmala@helsinki.fi> wrote:
Hi,
do you have the analysis-icu plugin [1] installed?
[1]
https://www.elastic.co/guide/en/elasticsearch/plugins/current/analysis-icu.h...
On 31/03/2020 00:35, Tom Hanstra wrote:
Earlier testing of Koha 19.11.03 with Elasticsearch 7 and 6 both gave errors. There was some suspicion that perhaps Elasticsearch had to be rolled back to V5.
So, I did that today, as well as upgrading Koha to 19.11.04. And I am getting a new error. Basically, now, it looks like there might be a configuration error somewhere?
Here is my current error when trying to index:
PERL5LIB=/usr/share/koha/lib:/usr/local/lib:/usr/local/share/perl5 ./bin/search_tools/rebuild_elasticsearch.pl -d -v -p 4 [7019] Checking state of biblios index [7019] Dropping and recreating biblios index [Request] ** [http://localhost:9200]-[400] [illegal_argument_exception] Custom Analyzer [analyzer_phrase] failed to find filter under name [icu_folding], called from sub Search::Elasticsearch::Role::Client::Direct::__ANON__ at /usr/share/koha/lib/Koha/SearchEngine/Elasticsearch/Indexer.pm line 349. With vars: {'body' => {'status' => 400,'error' => {'root_cause' => [{'reason' => 'Custom Analyzer [analyzer_phrase] failed to find filter under name [icu_folding]','type' => 'illegal_argument_exception'}],'reason' => 'Custom Analyzer [analyzer_phrase] failed to find filter under name [icu_folding]','type' => 'illegal_argument_exception'}},'request' => {'serialize' => 'std','path' => '/koha_london_test_20_biblios','ignore' => [],'mime_type' => 'application/json','body' => {'settings' => {'index' => {'analysis' => {'normalizer' => {'nfkc_cf_normalizer' => {'type' => 'custom','char_filter' => 'icu_normalizer'},'icu_folding_normalizer' => {'filter' => ['icu_folding'],'type' => 'custom'}},'char_filter' => {'punctuation' => {'pattern' =>
'([\\x00-\\x1F,\\x21-\\x2F,\\x3A-\\x40,\\x5B-\\x60,\\x7B-\\x89,\\x8B,\\x8D,\\x8F,\\x90-\\x99,\\x9B,\\x9D,\\xA0-\\xBF,\\xD7,\\xF7])','type'
=> 'pattern_replace','replacement' => ''}},'analyzer' => {'analyzer_stdno' => {'filter' => ['icu_folding'],'char_filter' => ['punctuation'],'tokenizer' => 'whitespace'},'analyzer_phrase' => {'filter' => ['icu_folding'],'char_filter' => ['punctuation'],'tokenizer' => 'keyword'},'analyzer_standard' => {'filter' => ['icu_folding'],'tokenizer' => 'icu_tokenizer'}}}},'index.mapping.total_fields.limit' => '10000'}},'qs' => {},'method' => 'PUT'},'status_code' => 400}
FWIW, Koha knows what the indices should be but also seems to know that they do not yet exist:
Nodes: localhost:9200 | Status: running | Indices: koha_london_test_20_biblios (count: -1), koha_london_test_20_authorities (count: -1)
Anyone seen this type of error or have ideas on what might be going on with this particular issue?
Thanks, Tom
-- *Tom Hanstra* *Sr. Systems Administrator* hanstra@nd.edu
participants (2)
-
Joonas Kylmälä -
Tom Hanstra