Unable to run the indexing after installing elastic search
Hello all, I have recently installed elastic search but it gvies an error while indexing. What could be the issue? Best Regards Nirmit Krishnatray
Hi, what command are you running in order to index and what is the error message you see? Katrin On 28.07.24 14:39, Nirmit Krishnatray wrote:
Hello all,
I have recently installed elastic search but it gvies an error while indexing. What could be the issue?
Best Regards
Nirmit Krishnatray _______________________________________________
Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha
Hi! Den 28.07.2024 14:39, skrev Nirmit Krishnatray:
Hello all,
I have recently installed elastic search but it gvies an error while indexing. What could be the issue?
What does the error say? Best regards, Magnus
I'm not the OP, but I'm getting error messages too. I'm running Koha 23.11, 4GB RAM, and I deleted elasticsearch 6 and installed 7. I restarted elasticsearch, then ran curl localhost:9200. So far, everything's fine. Next I tried rebuilding elasticsearch. That's when the errors began. Most of them begin with "elasticsearch built-in security features are not enabled." I went to the address in the error message and the page started out with configuring Kibana. Does Koha need/use Kibana? I'm running all this from the Ubuntu command line. After elasticsearch finished puking out code it started indexing, but every time it committed some records I got "no nodes." Then after indexing 20,000 records elasticsearch gave up with "Something went wrong rebuilding indexes for library" and curl is back to the all-too-familiar "Failed to connect to localhost port 9200 after 0 ms: Connection refused." Any ideas? Portions of the error messages are below my signature. Fred King, MSLS, AHIP Medical Librarian, MedStar Washington Hospital Center fred.king@medstar.net 202-877-6670 ORCID 0000-0001-5266-0279 MedStar Authors Catalog: http://medstarauthors.org The greatest enemy of knowledge is not ignorance, it is the illusion of knowledge. —Stephen Hawking root@ubuntukohawhclibrary-20240729:~# service elasticsearch restart root@ubuntukohawhclibrary-20240729:~# curl localhost:9200 { "name" : "ubuntukohawhclibrary-20240729", "cluster_name" : "elasticsearch", "cluster_uuid" : "QEiZZuoSRyi6ixMCxY1PDA", "version" : { "number" : "7.17.22", "build_flavor" : "default", "build_type" : "deb", "build_hash" : "38e9ca2e81304a821c50862dafab089ca863944b", "build_date" : "2024-06-06T07:35:17.876121680Z", "build_snapshot" : false, "lucene_version" : "8.11.3", "minimum_wire_compatibility_version" : "6.8.0", "minimum_index_compatibility_version" : "6.0.0-beta1" }, "tagline" : "You Know, for Search" } root@ubuntukohawhclibrary-20240729:~# koha-elasticsearch --rebuild --commit 1000 -v -d library [2097] Checking state of biblios index [2097] Dropping and recreating biblios index [DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minima... to enable security. - In request: {method => "HEAD",path => "/",timeout => 2} (snip) [DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minima... to enable security. - In request: {body => {settings => {index => {analysis => {analyzer => {analyzer_phrase => {char_filter => ["punctuation"],filter => ["icu_folding"],tokenizer => "keyword"},analyzer_standard => {filter => ["icu_folding"],tokenizer => "icu_tokenizer"},analyzer_stdno => {char_filter => ["punctuation"],filter => ["icu_folding"],tokenizer => "whitespace"}},char_filter => {facet => {pattern => \\s*(?<!\\p{Lu})[.\\-,;]*\\s*\$<file://s*(%3f%3c!/p%7bLu%7d)%5b./-,;%5d*/s*/$>,replacement => "",type => "pattern_replace"},punctuation => {pattern => "([\\x00-\\x1F,\\x21-\\x2F,\\x3A-\\x40,\\x5B-\\x60,\\x7B-\\x89,\\x8B,\\x8D,\\x8F,\\x90-\\x99,\\x9B,\\x9D,\\xA0-\\xBF,\\xD7,\\xF7])",replacement => "",type => "pattern_replace"}},normalizer => {facet_normalizer => {char_filter => "facet"},icu_folding_normalizer => {filter => ["icu_folding"],type => "custom"},nfkc_cf_normalizer => {char_filter => "icu_normalizer",type => "custom"}}}},"index.mapping.total_fields.limit" => 10000,"index.max_result_window" => 1000000,"index.number_of_replicas" => 1,"index.number_of_shards" => 5}},ignore => [],method => "PUT",mime_type => "application/json",path => "/koha_library_biblios",qs => {},serialize => "std"} [DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minima... to enable security. - In request: {body => {properties => {abstract => {analyzer => "analyzer_standard",fields => {ci_raw => {normalizer => "icu_folding_normalizer",type => "keyword"},phrase => {analyzer => "analyzer_phrase",search_analyzer => "analyzer_phrase",type => "text"},raw => {normalizer => "nfkc_cf_normalizer",type => "keyword"}},search_analyzer => "analyzer_standard",type => "text"},abstract__sort => {index => bless( do{\(my $o = 0)}, 'JSON::PP::Boolean' ),numeric => bless( do{\(my $o = 1)}, 'JSON::PP::Boolean' ),type => "icu_collation_keyword"},acqsource => $VAR1->{body}{properties}{abstract},acqsource__sort => $VAR1->{body}{properties}{abstract__sort},arl => $VAR1->{body}{properties}{abstract},arl__sort => $VAR1->{body}{properties}{abstract__sort},arp => $VAR1->{body}{properties}{abstract},arp__sort => $VAR1->{body}{properties}{abstract__sort},author => $VAR1->{body}{properties}{abstract},"author-in-order" => $VAR1->{body}{properties} (snip) "Clinical electrophysiology :"},{input => "electrotherapy and electrophysiologic testing /"}],withdrawn => [0],withdrawn__sort => [0]}],ignore => [],method => "POST",mime_type => "application/json",path => "/koha_library_biblios/_bulk",qs => {},serialize => "bulk"} [2097] Commit complete [2097] 2000 records processed [2097] Committing 1000 records... [2097] Elasticsearch exception thrown: NoNodes [2097] 3000 records processed [2097] Committing 1000 records... [2097] Elasticsearch exception thrown: NoNodes (snip) [2097] 19000 records processed [2097] Committing 1000 records... [2097] Elasticsearch exception thrown: NoNodes [2097] 20000 records processed [2097] Committing 1000 records... [2097] Elasticsearch exception thrown: NoNodes [2097] Committing final records... Exception 'Koha::Exceptions::Elasticsearch::BadResponse' thrown 'Bad response received when submitting request to Elasticsearch' with details => No nodes are available: [http://localhost:9200], type => NoNodes Something went wrong rebuilding indexes for library (and then we're back to) root@ubuntukohawhclibrary-20240729:~# curl localhost:9200/_cluster/health?pretty curl: (7) Failed to connect to localhost port 9200 after 0 ms: Connection refused From: Koha <koha-bounces@lists.katipo.co.nz> On Behalf Of Magnus Enger Sent: Monday, July 29, 2024 12:45 PM To: koha@lists.katipo.co.nz Subject: [EXTERNAL] Re: [Koha] Unable to run the indexing after installing elastic search Hi! Den 28. 07. 2024 14: 39, skrev Nirmit Krishnatray: > Hello all, > > I have recently installed elastic search but it gvies an error while indexing. What could be the issue? What does the error say? Best regards, Magnus _______________________________________________ Hi! Den 28.07.2024 14:39, skrev Nirmit Krishnatray:
Hello all,
I have recently installed elastic search but it gvies an error while indexing. What could be the issue?
What does the error say? Best regards, Magnus _______________________________________________ Koha mailing list https://urldefense.com/v3/__http://koha-community.org__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZJBKLsG8Q$<https://urldefense.com/v3/__http:/koha-community.org__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZJBKLsG8Q$>[koha-community[.]org] Koha@lists.katipo.co.nz<mailto:Koha@lists.katipo.co.nz> Unsubscribe: https://urldefense.com/v3/__https://lists.katipo.co.nz/mailman/listinfo/koha__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZIdSoaSsA$<https://urldefense.com/v3/__https:/lists.katipo.co.nz/mailman/listinfo/koha__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZIdSoaSsA$>[lists[.]katipo[.]co[.]nz]
Hi Fred, to my knowledge Koha doesn't require Kibana. Maybe this gives some clue: *Bug 33563* <https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=33563> - Document Elasticsearch secure mode Hope this helps, Katrin On 29.07.24 20:34, King, Fred wrote:
I'm not the OP, but I'm getting error messages too. I'm running Koha 23.11, 4GB RAM, and I deleted elasticsearch 6 and installed 7. I restarted elasticsearch, then ran curl localhost:9200. So far, everything's fine. Next I tried rebuilding elasticsearch. That's when the errors began. Most of them begin with "elasticsearch built-in security features are not enabled." I went to the address in the error message and the page started out with configuring Kibana. Does Koha need/use Kibana? I'm running all this from the Ubuntu command line. After elasticsearch finished puking out code it started indexing, but every time it committed some records I got "no nodes." Then after indexing 20,000 records elasticsearch gave up with "Something went wrong rebuilding indexes for library" and curl is back to the all-too-familiar "Failed to connect to localhost port 9200 after 0 ms: Connection refused."
Any ideas?
Portions of the error messages are below my signature.
Fred King, MSLS, AHIP Medical Librarian, MedStar Washington Hospital Center fred.king@medstar.net 202-877-6670 ORCID 0000-0001-5266-0279 MedStar Authors Catalog:http://medstarauthors.org
The greatest enemy of knowledge is not ignorance, it is the illusion of knowledge. —Stephen Hawking
root@ubuntukohawhclibrary-20240729:~# service elasticsearch restart root@ubuntukohawhclibrary-20240729:~# curl localhost:9200 { "name" : "ubuntukohawhclibrary-20240729", "cluster_name" : "elasticsearch", "cluster_uuid" : "QEiZZuoSRyi6ixMCxY1PDA", "version" : { "number" : "7.17.22", "build_flavor" : "default", "build_type" : "deb", "build_hash" : "38e9ca2e81304a821c50862dafab089ca863944b", "build_date" : "2024-06-06T07:35:17.876121680Z", "build_snapshot" : false, "lucene_version" : "8.11.3", "minimum_wire_compatibility_version" : "6.8.0", "minimum_index_compatibility_version" : "6.0.0-beta1" }, "tagline" : "You Know, for Search" }
root@ubuntukohawhclibrary-20240729:~# koha-elasticsearch --rebuild --commit 1000 -v -d library [2097] Checking state of biblios index [2097] Dropping and recreating biblios index [DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. Seehttps://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minima... to enable security. - In request: {method => "HEAD",path => "/",timeout => 2}
(snip)
[DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. Seehttps://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minima... to enable security. - In request: {body => {settings => {index => {analysis => {analyzer => {analyzer_phrase => {char_filter => ["punctuation"],filter => ["icu_folding"],tokenizer => "keyword"},analyzer_standard => {filter => ["icu_folding"],tokenizer => "icu_tokenizer"},analyzer_stdno => {char_filter => ["punctuation"],filter => ["icu_folding"],tokenizer => "whitespace"}},char_filter => {facet => {pattern => \\s*(?<!\\p{Lu})[.\\-,;]*\\s*\$<file://s*(%3f%3c!/p%7bLu%7d)%5b./-,;%5d*/s*/$>,replacement => "",type => "pattern_replace"},punctuation => {pattern => "([\\x00-\\x1F,\\x21-\\x2F,\\x3A-\\x40,\\x5B-\\x60,\\x7B-\\x89,\\x8B,\\x8D,\\x8F,\\x90-\\x99,\\x9B,\\x9D,\\xA0-\\xBF,\\xD7,\\xF7])",replacement => "",type => "pattern_replace"}},normalizer => {facet_normalizer => {char_filter => "facet"},icu_folding_normalizer => {filter => ["icu_folding"],type => "custom"},nfkc_cf_normalizer => {char_filter => "icu_normalizer",type => "custom"}}}},"index.mapping.total_fields.limit" => 10000,"index.max_result_window" => 1000000,"index.number_of_replicas" => 1,"index.number_of_shards" => 5}},ignore => [],method => "PUT",mime_type => "application/json",path => "/koha_library_biblios",qs => {},serialize => "std"} [DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. Seehttps://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minima... to enable security. - In request: {body => {properties => {abstract => {analyzer => "analyzer_standard",fields => {ci_raw => {normalizer => "icu_folding_normalizer",type => "keyword"},phrase => {analyzer => "analyzer_phrase",search_analyzer => "analyzer_phrase",type => "text"},raw => {normalizer => "nfkc_cf_normalizer",type => "keyword"}},search_analyzer => "analyzer_standard",type => "text"},abstract__sort => {index => bless( do{\(my $o = 0)}, 'JSON::PP::Boolean' ),numeric => bless( do{\(my $o = 1)}, 'JSON::PP::Boolean' ),type => "icu_collation_keyword"},acqsource => $VAR1->{body}{properties}{abstract},acqsource__sort => $VAR1->{body}{properties}{abstract__sort},arl => $VAR1->{body}{properties}{abstract},arl__sort => $VAR1->{body}{properties}{abstract__sort},arp => $VAR1->{body}{properties}{abstract},arp__sort => $VAR1->{body}{properties}{abstract__sort},author => $VAR1->{body}{properties}{abstract},"author-in-order" => $VAR1->{body}{properties}
(snip)
"Clinical electrophysiology :"},{input => "electrotherapy and electrophysiologic testing /"}],withdrawn => [0],withdrawn__sort => [0]}],ignore => [],method => "POST",mime_type => "application/json",path => "/koha_library_biblios/_bulk",qs => {},serialize => "bulk"} [2097] Commit complete [2097] 2000 records processed [2097] Committing 1000 records... [2097] Elasticsearch exception thrown: NoNodes [2097] 3000 records processed [2097] Committing 1000 records... [2097] Elasticsearch exception thrown: NoNodes
(snip)
[2097] 19000 records processed [2097] Committing 1000 records... [2097] Elasticsearch exception thrown: NoNodes [2097] 20000 records processed [2097] Committing 1000 records... [2097] Elasticsearch exception thrown: NoNodes [2097] Committing final records... Exception 'Koha::Exceptions::Elasticsearch::BadResponse' thrown 'Bad response received when submitting request to Elasticsearch' with details => No nodes are available: [http://localhost:9200], type => NoNodes Something went wrong rebuilding indexes for library
(and then we're back to)
root@ubuntukohawhclibrary-20240729:~# curl localhost:9200/_cluster/health?pretty curl: (7) Failed to connect to localhost port 9200 after 0 ms: Connection refused
From: Koha<koha-bounces@lists.katipo.co.nz> On Behalf Of Magnus Enger Sent: Monday, July 29, 2024 12:45 PM To:koha@lists.katipo.co.nz Subject: [EXTERNAL] Re: [Koha] Unable to run the indexing after installing elastic search
Hi! Den 28. 07. 2024 14: 39, skrev Nirmit Krishnatray: > Hello all, > > I have recently installed elastic search but it gvies an error while indexing. What could be the issue? What does the error say? Best regards, Magnus _______________________________________________
Hi!
Den 28.07.2024 14:39, skrev Nirmit Krishnatray:
Hello all, I have recently installed elastic search but it gvies an error while indexing. What could be the issue?
What does the error say?
Best regards,
Magnus
_______________________________________________
Koha@lists.katipo.co.nz<mailto:Koha@lists.katipo.co.nz>
Unsubscribe:https://urldefense.com/v3/__https://lists.katipo.co.nz/mailman/listinfo/koha__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZIdSoaSsA$<https://urldefense.com/v3/__https:/lists.katipo.co.nz/mailman/listinfo/koha__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZIdSoaSsA$>[lists[.]katipo[.]co[.]nz] _______________________________________________
Koha mailing listhttp://koha-community.org Koha@lists.katipo.co.nz Unsubscribe:https://lists.katipo.co.nz/mailman/listinfo/koha
Hi all, Please find the error below which I'm getting while indexing: [NoNodes] ** No nodes are available: [http://localhost:9200], called from sub Search::Elasticsearch::Role::Client::Direct::_ANON_ at /usr/share/koha/lib/Koha/SearchEngine/Elasticsearch/Indexer.pm line 437.Something went wrong rebuilding indexes for library Best Regards Nirmit Krishnatray -----Original Message----- From: Koha [mailto:koha-bounces@lists.katipo.co.nz] On Behalf Of Magnus Enger Sent: 29 July 2024 22:15 To: koha@lists.katipo.co.nz Subject: Re: [Koha] Unable to run the indexing after installing elastic search Hi! Den 28.07.2024 14:39, skrev Nirmit Krishnatray:
Hello all,
I have recently installed elastic search but it gvies an error while indexing. What could be the issue?
What does the error say? Best regards, Magnus _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha
participants (4)
-
Katrin Fischer -
King, Fred -
Magnus Enger -
Nirmit Krishnatray