[Koha] [EXTERNAL] Re: Unable to run the indexing after installing elastic search

Tue Jul 30 06:34:28 NZST 2024

I'm not the OP, but I'm getting error messages too. I'm running Koha 23.11, 4GB RAM, and I deleted elasticsearch 6 and installed 7. I restarted elasticsearch, then ran curl localhost:9200. So far, everything's fine. Next I tried rebuilding elasticsearch. That's when the errors began. Most of them begin with "elasticsearch built-in security features are not enabled." I went to the address in the error message and the page started out with configuring Kibana. Does Koha need/use Kibana? I'm running all this from the Ubuntu command line. After elasticsearch finished puking out code it started indexing, but every time it committed some records I got "no nodes." Then after indexing 20,000 records elasticsearch gave up with "Something went wrong rebuilding indexes for library" and curl is back to the all-too-familiar "Failed to connect to localhost port 9200 after 0 ms: Connection refused."

Any ideas?

Portions of the error messages are below my signature.

Fred King, MSLS, AHIP
Medical Librarian, MedStar Washington Hospital Center
fred.king at medstar.net
202-877-6670
ORCID 0000-0001-5266-0279
MedStar Authors Catalog: http://medstarauthors.org

The greatest enemy of knowledge is not ignorance, it is the illusion of knowledge.
—Stephen Hawking

root at ubuntukohawhclibrary-20240729:~# service elasticsearch restart
root at ubuntukohawhclibrary-20240729:~# curl localhost:9200
{
  "name" : "ubuntukohawhclibrary-20240729",
  "cluster_name" : "elasticsearch",
  "cluster_uuid" : "QEiZZuoSRyi6ixMCxY1PDA",
  "version" : {
    "number" : "7.17.22",
    "build_flavor" : "default",
    "build_type" : "deb",
    "build_hash" : "38e9ca2e81304a821c50862dafab089ca863944b",
    "build_date" : "2024-06-06T07:35:17.876121680Z",
    "build_snapshot" : false,
    "lucene_version" : "8.11.3",
    "minimum_wire_compatibility_version" : "6.8.0",
    "minimum_index_compatibility_version" : "6.0.0-beta1"
  },
  "tagline" : "You Know, for Search"
}

root at ubuntukohawhclibrary-20240729:~# koha-elasticsearch --rebuild --commit 1000 -v -d library
[2097] Checking state of biblios index
[2097] Dropping and recreating biblios index
[DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minimal-setup.html to enable security. - In request: {method => "HEAD",path => "/",timeout => 2}

(snip)

[DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minimal-setup.html to enable security. - In request: {body => {settings => {index => {analysis => {analyzer => {analyzer_phrase => {char_filter => ["punctuation"],filter => ["icu_folding"],tokenizer => "keyword"},analyzer_standard => {filter => ["icu_folding"],tokenizer => "icu_tokenizer"},analyzer_stdno => {char_filter => ["punctuation"],filter => ["icu_folding"],tokenizer => "whitespace"}},char_filter => {facet => {pattern => \\s*(?<!\\p{Lu})[.\\-,;]*\\s*\$<file://s*(%3f%3c!/p%7bLu%7d)%5b./-,;%5d*/s*/$>,replacement => "",type => "pattern_replace"},punctuation => {pattern => "([\\x00-\\x1F,\\x21-\\x2F,\\x3A-\\x40,\\x5B-\\x60,\\x7B-\\x89,\\x8B,\\x8D,\\x8F,\\x90-\\x99,\\x9B,\\x9D,\\xA0-\\xBF,\\xD7,\\xF7])",replacement => "",type => "pattern_replace"}},normalizer => {facet_normalizer => {char_filter => "facet"},icu_folding_normalizer => {filter => ["icu_folding"],type => "custom"},nfkc_cf_normalizer => {char_filter => "icu_normalizer",type => "custom"}}}},"index.mapping.total_fields.limit" => 10000,"index.max_result_window" => 1000000,"index.number_of_replicas" => 1,"index.number_of_shards" => 5}},ignore => [],method => "PUT",mime_type => "application/json",path => "/koha_library_biblios",qs => {},serialize => "std"}
[DEPRECATION] Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minimal-setup.html to enable security. - In request: {body => {properties => {abstract => {analyzer => "analyzer_standard",fields => {ci_raw => {normalizer => "icu_folding_normalizer",type => "keyword"},phrase => {analyzer => "analyzer_phrase",search_analyzer => "analyzer_phrase",type => "text"},raw => {normalizer => "nfkc_cf_normalizer",type => "keyword"}},search_analyzer => "analyzer_standard",type => "text"},abstract__sort => {index => bless( do{\(my $o = 0)}, 'JSON::PP::Boolean' ),numeric => bless( do{\(my $o = 1)}, 'JSON::PP::Boolean' ),type => "icu_collation_keyword"},acqsource => $VAR1->{body}{properties}{abstract},acqsource__sort => $VAR1->{body}{properties}{abstract__sort},arl => $VAR1->{body}{properties}{abstract},arl__sort => $VAR1->{body}{properties}{abstract__sort},arp => $VAR1->{body}{properties}{abstract},arp__sort => $VAR1->{body}{properties}{abstract__sort},author => $VAR1->{body}{properties}{abstract},"author-in-order" => $VAR1->{body}{properties}

(snip)

"Clinical electrophysiology :"},{input => "electrotherapy and electrophysiologic testing /"}],withdrawn => [0],withdrawn__sort => [0]}],ignore => [],method => "POST",mime_type => "application/json",path => "/koha_library_biblios/_bulk",qs => {},serialize => "bulk"}
[2097] Commit complete
[2097] 2000 records processed
[2097] Committing 1000 records...
[2097] Elasticsearch exception thrown: NoNodes
[2097] 3000 records processed
[2097] Committing 1000 records...
[2097] Elasticsearch exception thrown: NoNodes

(snip)

[2097] 19000 records processed
[2097] Committing 1000 records...
[2097] Elasticsearch exception thrown: NoNodes
[2097] 20000 records processed
[2097] Committing 1000 records...
[2097] Elasticsearch exception thrown: NoNodes
[2097] Committing final records...
Exception 'Koha::Exceptions::Elasticsearch::BadResponse' thrown 'Bad response received when submitting request to Elasticsearch' with details => No nodes are available: [http://localhost:9200], type => NoNodes
Something went wrong rebuilding indexes for library

(and then we're back to)

root at ubuntukohawhclibrary-20240729:~# curl localhost:9200/_cluster/health?pretty
curl: (7) Failed to connect to localhost port 9200 after 0 ms: Connection refused

From: Koha <koha-bounces at lists.katipo.co.nz> On Behalf Of Magnus Enger
Sent: Monday, July 29, 2024 12:45 PM
To: koha at lists.katipo.co.nz
Subject: [EXTERNAL] Re: [Koha] Unable to run the indexing after installing elastic search

Hi! Den 28. 07. 2024 14: 39, skrev Nirmit Krishnatray: > Hello all, > > I have recently installed elastic search but it gvies an error while indexing. What could be the issue? What does the error say? Best regards, Magnus _______________________________________________

Hi!

Den 28.07.2024 14:39, skrev Nirmit Krishnatray:

> Hello all,

>

> I have recently installed elastic search but it gvies an error while indexing. What could be the issue?

What does the error say?

Best regards,

Magnus

_______________________________________________

Koha mailing list  https://urldefense.com/v3/__http://koha-community.org__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZJBKLsG8Q$<https://urldefense.com/v3/__http:/koha-community.org__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZJBKLsG8Q$>[koha-community[.]org]

Koha at lists.katipo.co.nz<mailto:Koha at lists.katipo.co.nz>

Unsubscribe: https://urldefense.com/v3/__https://lists.katipo.co.nz/mailman/listinfo/koha__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZIdSoaSsA$<https://urldefense.com/v3/__https:/lists.katipo.co.nz/mailman/listinfo/koha__;!!D7IIWT94AA!-5F7C4-Jpe2_K4B4kUv7hFCaq9YWZEVLrph-J-6Pwl6CGq4ot5c_1yHOQ4CwrRgf6PHPT3J2ZdRSaZIdSoaSsA$>[lists[.]katipo[.]co[.]nz]