[Koha] [EXTERNAL] Re: Unable to run the indexing after installing elastic search

Sun Aug 4 23:21:06 NZST 2024

Hi Fred,

to my knowledge Koha doesn't require Kibana.

Maybe this gives some clue:

*Bug 33563* 
<https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=33563> - 
Document Elasticsearch secure mode

Hope this helps,

Katrin

On 29.07.24 20:34, King, Fred wrote:
> I'm not the OP, but I'm getting error messages too. I'm running Koha 23.11, 4GB RAM, and I deleted elasticsearch 6 and installed 7. I restarted elasticsearch, then ran curl localhost:9200. So far, everything's fine. Next I tried rebuilding elasticsearch. That's when the errors began. Most of them begin with "elasticsearch built-in security features are not enabled." I went to the address in the error message and the page started out with configuring Kibana. Does Koha need/use Kibana? I'm running all this from the Ubuntu command line. After elasticsearch finished puking out code it started indexing, but every time it committed some records I got "no nodes." Then after indexing 20,000 records elasticsearch gave up with "Something went wrong rebuilding indexes for library" and curl is back to the all-too-familiar "Failed to connect to localhost port 9200 after 0 ms: Connection refused."
>
> Any ideas?
>
> Portions of the error messages are below my signature.
>
> Fred King, MSLS, AHIP
> Medical Librarian, MedStar Washington Hospital Center
> fred.king at medstar.net
> 202-877-6670
> ORCID 0000-0001-5266-0279
> MedStar Authors Catalog:http://medstarauthors.org
>
> The greatest enemy of knowledge is not ignorance, it is the illusion of knowledge.
> —Stephen Hawking
>
> root at ubuntukohawhclibrary-20240729:~# service elasticsearch restart
> root at ubuntukohawhclibrary-20240729:~# curl localhost:9200
> {
>    "name" : "ubuntukohawhclibrary-20240729",
>    "cluster_name" : "elasticsearch",
>    "cluster_uuid" : "QEiZZuoSRyi6ixMCxY1PDA",
>    "version" : {
>      "number" : "7.17.22",
>      "build_flavor" : "default",
>      "build_type" : "deb",
>      "build_hash" : "38e9ca2e81304a821c50862dafab089ca863944b",
>      "build_date" : "2024-06-06T07:35:17.876121680Z",
>      "build_snapshot" : false,
>      "lucene_version" : "8.11.3",
>      "minimum_wire_compatibility_version" : "6.8.0",
>      "minimum_index_compatibility_version" : "6.0.0-beta1"
>    },
>    "tagline" : "You Know, for Search"
> }
>
>
> root at ubuntukohawhclibrary-20240729:~# koha-elasticsearch --rebuild --commit 1000 -v -d library
> [2097] Checking state of biblios index
> [2097] Dropping and recreating biblios index
> [DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. Seehttps://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minimal-setup.html  to enable security. - In request: {method => "HEAD",path => "/",timeout => 2}
>
> (snip)
>
> [DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. Seehttps://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minimal-setup.html  to enable security. - In request: {body => {settings => {index => {analysis => {analyzer => {analyzer_phrase => {char_filter => ["punctuation"],filter => ["icu_folding"],tokenizer => "keyword"},analyzer_standard => {filter => ["icu_folding"],tokenizer => "icu_tokenizer"},analyzer_stdno => {char_filter => ["punctuation"],filter => ["icu_folding"],tokenizer => "whitespace"}},char_filter => {facet => {pattern => \\s*(?<!\\p{Lu})[.\\-,;]*\\s*\$<file://s*(%3f%3c!/p%7bLu%7d)%5b./-,;%5d*/s*/$>,replacement => "",type => "pattern_replace"},punctuation => {pattern => "([\\x00-\\x1F,\\x21-\\x2F,\\x3A-\\x40,\\x5B-\\x60,\\x7B-\\x89,\\x8B,\\x8D,\\x8F,\\x90-\\x99,\\x9B,\\x9D,\\xA0-\\xBF,\\xD7,\\xF7])",replacement => "",type => "pattern_replace"}},normalizer => {facet_normalizer => {char_filter => "facet"},icu_folding_normalizer => {filter => ["icu_folding"],type => "custom"},nfkc_cf_normalizer => {char_filter => "icu_normalizer",type => "custom"}}}},"index.mapping.total_fields.limit" => 10000,"index.max_result_window" => 1000000,"index.number_of_replicas" => 1,"index.number_of_shards" => 5}},ignore => [],method => "PUT",mime_type => "application/json",path => "/koha_library_biblios",qs => {},serialize => "std"}
> [DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. Seehttps://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minimal-setup.html  to enable security. - In request: {body => {properties => {abstract => {analyzer => "analyzer_standard",fields => {ci_raw => {normalizer => "icu_folding_normalizer",type => "keyword"},phrase => {analyzer => "analyzer_phrase",search_analyzer => "analyzer_phrase",type => "text"},raw => {normalizer => "nfkc_cf_normalizer",type => "keyword"}},search_analyzer => "analyzer_standard",type => "text"},abstract__sort => {index => bless( do{\(my $o = 0)}, 'JSON::PP::Boolean' ),numeric => bless( do{\(my $o = 1)}, 'JSON::PP::Boolean' ),type => "icu_collation_keyword"},acqsource => $VAR1->{body}{properties}{abstract},acqsource__sort => $VAR1->{body}{properties}{abstract__sort},arl => $VAR1->{body}{properties}{abstract},arl__sort => $VAR1->{body}{properties}{abstract__sort},arp => $VAR1->{body}{properties}{abstract},arp__sort => $VAR1->{body}{properties}{abstract__sort},author => $VAR1->{body}{properties}{abstract},"author-in-order" => $VAR1->{body}{properties}
>
> (snip)
>
> "Clinical electrophysiology :"},{input => "electrotherapy and electrophysiologic testing /"}],withdrawn => [0],withdrawn__sort => [0]}],ignore => [],method => "POST",mime_type => "application/json",path => "/koha_library_biblios/_bulk",qs => {},serialize => "bulk"}
> [2097] Commit complete
> [2097] 2000 records processed
> [2097] Committing 1000 records...
> [2097] Elasticsearch exception thrown: NoNodes
> [2097] 3000 records processed
> [2097] Committing 1000 records...
> [2097] Elasticsearch exception thrown: NoNodes
>
> (snip)
>
> [2097] 19000 records processed
> [2097] Committing 1000 records...
> [2097] Elasticsearch exception thrown: NoNodes
> [2097] 20000 records processed
> [2097] Committing 1000 records...
> [2097] Elasticsearch exception thrown: NoNodes
> [2097] Committing final records...
> Exception 'Koha::Exceptions::Elasticsearch::BadResponse' thrown 'Bad response received when submitting request to Elasticsearch' with details => No nodes are available: [http://localhost:9200], type => NoNodes
> Something went wrong rebuilding indexes for library
>
> (and then we're back to)
>
> root at ubuntukohawhclibrary-20240729:~# curl localhost:9200/_cluster/health?pretty
> curl: (7) Failed to connect to localhost port 9200 after 0 ms: Connection refused
>
> From: Koha<koha-bounces at lists.katipo.co.nz>  On Behalf Of Magnus Enger
> Sent: Monday, July 29, 2024 12:45 PM
> To:koha at lists.katipo.co.nz
> Subject: [EXTERNAL] Re: [Koha] Unable to run the indexing after installing elastic search
>
> Hi! Den 28. 07. 2024 14: 39, skrev Nirmit Krishnatray: > Hello all, > > I have recently installed elastic search but it gvies an error while indexing. What could be the issue? What does the error say? Best regards, Magnus _______________________________________________
>
>
> Hi!
>
>
>
> Den 28.07.2024 14:39, skrev Nirmit Krishnatray:
>
>> Hello all,
>> I have recently installed elastic search but it gvies an error while indexing. What could be the issue?
>
>
> What does the error say?
>
>
>
> Best regards,
>
> Magnus
>
> _______________________________________________
>
>
>
> Koha mailing listhttps://urldefense.com/v3/__http://koha-community.org__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZJBKLsG8Q$<https://urldefense.com/v3/__http:/koha-community.org__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZJBKLsG8Q$>[koha-community[.]org]
>
> Koha at lists.katipo.co.nz<mailto:Koha at lists.katipo.co.nz>
>
> Unsubscribe:https://urldefense.com/v3/__https://lists.katipo.co.nz/mailman/listinfo/koha__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZIdSoaSsA$<https://urldefense.com/v3/__https:/lists.katipo.co.nz/mailman/listinfo/koha__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZIdSoaSsA$>[lists[.]katipo[.]co[.]nz]
> _______________________________________________
>
> Koha mailing listhttp://koha-community.org
> Koha at lists.katipo.co.nz
> Unsubscribe:https://lists.katipo.co.nz/mailman/listinfo/koha