[Koha] zebra indexer crashing - *** stack smashing detected ***: zebraidx terminated

"Γιάννης Κουρμούλη "Γιάννης Κουρμούλη
Tue Oct 20 23:09:21 NZDT 2009


Dear list

After several problems with the import of records to our freshly 
installed koha system, we are stuck to the following point:

Using the intranet web interface (staging - managing staged records) we 
managed to import a large file (100000 bib records with item information 
embedded - exported from a dynix horizon 7.3 system). When we try to 
reindex (./koha-3.00.03/misc/migration_tools/rebuild_zebra.pl -b -r -v) 
we get the following results (see below). Any ideas on what might cause 
this crashing of the zebra indexer?

thank you

[...]
12:40:11-20/10 zebraidx(17016) [log] Records: 94000 i/u/d 94000/0/0
12:40:18-20/10 zebraidx(17016) [log] Records: 95000 i/u/d 95000/0/0
12:40:25-20/10 zebraidx(17016) [log] Records: 96000 i/u/d 96000/0/0
12:40:31-20/10 zebraidx(17016) [log] Records: 97000 i/u/d 97000/0/0
12:40:40-20/10 zebraidx(17016) [log] Records: 98000 i/u/d 98000/0/0
12:40:53-20/10 zebraidx(17016) [log] Merge 2.8% completed; 5 minutes 
remaining
12:41:05-20/10 zebraidx(17016) [log] Merge 5.0% completed; 7 minutes 
remaining
12:41:15-20/10 zebraidx(17016) [log] Merge 7.0% completed; 7 minutes 
remaining
12:41:25-20/10 zebraidx(17016) [log] Merge 7.8% completed; 8 minutes 
remaining
12:41:35-20/10 zebraidx(17016) [log] Merge 9.1% completed; 8 minutes 
remaining
12:41:45-20/10 zebraidx(17016) [log] Merge 11.6% completed; 7 minutes 
remaining
12:41:55-20/10 zebraidx(17016) [log] Merge 15.6% completed; 6 minutes 
remaining
12:42:05-20/10 zebraidx(17016) [log] Merge 19.2% completed; 5 minutes 
remaining
12:42:15-20/10 zebraidx(17016) [log] Merge 23.2% completed; 5 minutes 
remaining
12:42:25-20/10 zebraidx(17016) [log] Merge 27.8% completed; 4 minutes 
remaining
12:42:35-20/10 zebraidx(17016) [log] Merge 31.0% completed; 4 minutes 
remaining
12:42:45-20/10 zebraidx(17016) [log] Merge 33.9% completed; 3 minutes 
remaining
12:42:55-20/10 zebraidx(17016) [log] Merge 37.1% completed; 3 minutes 
remaining
12:43:05-20/10 zebraidx(17016) [log] Merge 40.2% completed; 3 minutes 
remaining
12:43:15-20/10 zebraidx(17016) [log] Merge 44.4% completed; 3 minutes 
remaining
12:43:25-20/10 zebraidx(17016) [log] Merge 48.4% completed; 2 minutes 
remaining
12:43:35-20/10 zebraidx(17016) [log] Merge 54.1% completed; 2 minutes 
remaining
12:43:45-20/10 zebraidx(17016) [log] Merge 58.9% completed; 127 seconds 
remaining
12:43:55-20/10 zebraidx(17016) [log] Merge 63.5% completed; 110 seconds 
remaining
12:44:05-20/10 zebraidx(17016) [log] Merge 69.2% completed; 89 seconds 
remaining
12:44:15-20/10 zebraidx(17016) [log] Merge 74.1% completed; 74 seconds 
remaining


*** stack smashing detected ***: zebraidx terminated


======= Backtrace: =========
/lib/libc.so.6(__fortify_fail+0x37)[0x7fb8a58302c7]
/lib/libc.so.6(__fortify_fail+0x0)[0x7fb8a5830290]
/usr/lib/libidzebra-2.0.so.0[0x7fb8a93b1c17]
/usr/lib/libidzebra-2.0.so.0[0x7fb8a93b1c9c]
/usr/lib/libidzebra-2.0.so.0(heap_cread_item2+0xea)[0x7fb8a93b1e8a]
/usr/lib/libidzebra-2.0.so.0(insert_leaf+0x278)[0x7fb8a93de118]
/usr/lib/libidzebra-2.0.so.0(isamb_merge+0x10f)[0x7fb8a93df4ef]
/usr/lib/libidzebra-2.0.so.0(heap_inpb+0x1a4)[0x7fb8a93b2234]
/usr/lib/libidzebra-2.0.so.0(zebra_index_merge+0x233)[0x7fb8a93b26c3]
/usr/lib/libidzebra-2.0.so.0[0x7fb8a93c52cf]
/usr/lib/libidzebra-2.0.so.0(zebra_end_transaction+0x13d)[0x7fb8a93c563d]
/usr/lib/libidzebra-2.0.so.0(zebra_end_trans+0x31)[0x7fb8a93c5791]
zebraidx[0x401aa4]
/lib/libc.so.6(__libc_start_main+0xe6)[0x7fb8a574f5a6]
zebraidx[0x401389]
======= Memory map: ========
00400000-00403000 r-xp 00000000 08:11 56804930                           
/usr/bin/zebraidx-2.0
00602000-00603000 r--p 00002000 08:11 56804930                           
/usr/bin/zebraidx-2.0
00603000-00604000 rw-p 00003000 08:11 56804930                           
/usr/bin/zebraidx-2.0
00604000-00d5e000 rw-p 00604000 00:00 0                                  
[heap]
7fb894000000-7fb8942ca000 rw-p 7fb894000000 00:00 0
7fb8942ca000-7fb898000000 ---p 7fb8942ca000 00:00 0
7fb89c000000-7fb89cbef000 rw-p 7fb89c000000 00:00 0
7fb89cbef000-7fb8a0000000 ---p 7fb89cbef000 00:00 0
7fb8a02d5000-7fb8a1bd6000 rw-p 7fb8a02d5000 00:00 0
7fb8a1bd6000-7fb8a1bd7000 ---p 7fb8a1bd6000 00:00 0
7fb8a1bd7000-7fb8a3cd8000 rw-p 7fb8a1bd7000 00:00 0
7fb8a3cd8000-7fb8a3cdd000 r-xp 00000000 08:11 56985463                   
/usr/lib/idzebra-2.0/modules/mod-grs-marc.so
7fb8a3cdd000-7fb8a3edc000 ---p 00005000 08:11 56985463                   
/usr/lib/idzebra-2.0/modules/mod-grs-marc.so
7fb8a3edc000-7fb8a3edd000 r--p 00004000 08:11 56985463                   
/usr/lib/idzebra-2.0/modules/mod-grs-marc.so
7fb8a3edd000-7fb8a3ede000 rw-p 00005000 08:11 56985463                   
/usr/lib/idzebra-2.0/modules/mod-grs-marc.so
7fb8a3ede000-7fb8a3ee3000 r-xp 00000000 08:11 56985462                   
/usr/lib/idzebra-2.0/modules/mod-dom.so
7fb8a3ee3000-7fb8a40e3000 ---p 00005000 08:11 56985462                   
/usr/lib/idzebra-2.0/modules/mod-dom.so
7fb8a40e3000-7fb8a40e4000 r--p 00005000 08:11 56985462                   
/usr/lib/idzebra-2.0/modules/mod-dom.so
7fb8a40e4000-7fb8a40e5000 rw-p 00006000 08:11 56985462                   
/usr/lib/idzebra-2.0/modules/mod-dom.so
7fb8a40e5000-7fb8a41a2000 r-xp 00000000 08:11 56985355                   
/usr/lib/libtcl8.4.so.0
7fb8a41a2000-7fb8a43a2000 ---p 000bd000 08:11 56985355                   
/usr/lib/libtcl8.4.so.0
7fb8a43a2000-7fb8a43a3000 r--p 000bd000 08:11 56985355                   
/usr/lib/libtcl8.4.so.0
7fb8a43a3000-7fb8a43b0000 rw-p 000be000 08:11 56985355                   
/usr/lib/libtcl8.4.so.0
7fb8a43b0000-7fb8a43b1000 rw-p 7fb8a43b0000 00:00 0
7fb8a43b1000-7fb8a43b7000 r-xp 00000000 08:11 56985461                   
/usr/lib/idzebra-2.0/modules/mod-grs-regx.so
7fb8a43b7000-7fb8a45b7000 ---p 00006000 08:11 56985461                   
/usr/lib/idzebra-2.0/modules/mod-grs-regx.so
7fb8a45b7000-7fb8a45b8000 r--p 00006000 08:11 56985461                   
/usr/lib/idzebra-2.0/modules/mod-grs-regx.so
7fb8a45b8000-7fb8a45b9000 rw-p 00007000 08:11 56985461                   
/usr/lib/idzebra-2.0/modules/mod-grs-regx.so
7fb8a45b9000-7fb8a45bb000 r-xp 00000000 08:11 56985460                   
/usr/lib/idzebra-2.0/modules/mod-text.so
7fb8a45bb000-7fb8a47ba000 ---p 00002000 08:11 56985460                   
/usr/lib/idzebra-2.0/modules/mod-text.so
7fb8a47ba000-7fb8a47bb000 r--p 00001000 08:11 56985460                   
/usr/lib/idzebra-2.0/modules/mod-text.so
7fb8a47bb000-7fb8a47bc000 rw-p 00002000 08:11 56985460                   
/usr/lib/idzebra-2.0/modules/mod-text.so
7fb8a47bc000-7fb8a47e3000 r-xp 00000000 08:11 56985353                   
/usr/lib/libexpat.so.1.5.2
7fb8a47e3000-7fb8a49e3000 ---p 00027000 08:11 56985353                   
/usr/lib/libexpat.so.1.5.2
7fb8a49e3000-7fb8a49e5000 r--p 00027000 08:11 56985353                   
/usr/lib/libexpat.so.1.5.2
7fb8a49e5000-7fb8a49e6000 rw-p 00029000 08:11 56985353                   
/usr/lib/libexpat.so.1.5.2
7fb8a49e6000-7fb8a49e9000 r-xp 00000000 08:11 56985459                   
/usr/lib/idzebra-2.0/modules/mod-grs-xml.so
7fb8a49e9000-7fb8a4be8000 ---p 00003000 08:11 56985459                   
/usr/lib/idzebra-2.0/modules/mod-grs-xml.so
7fb8a4be8000-7fb8a4be9000 r--p 00002000 08:11 56985459                   
/usr/lib/idzebra-2.0/modules/mod-grs-xml.so
7fb8a4be9000-7fb8a4bea000 rw-p 00003000 08:11 56985459                   
/usr/lib/idzebra-2.0/modules/mod-grs-xml.so
7fb8a4bea000-7fb8a4bed000 r-xp 00000000 08:11 56985458                   
/usr/lib/idzebra-2.0/modules/mod-alvis.so
7fb8a4bed000-7fb8a4ded000 ---p 00003000 08:11 56985458                   
/usr/lib/idzebra-2.0/modules/mod-alvis.so
7fb8a4ded000-7fb8a4dee000 r--p 00003000 08:11 56985458                   
/usr/lib/idzebra-2.0/modules/mod-alvis.so
7fb8a4dee000-7fb8a4def000 rw-p 00004000 08:11 56985458                   
/usr/lib/idzebra-2.0/modules/mod-alvis.so
7fb8a4def000-7fb8a4e05000 r-xp 00000000 08:11 57714027                   
/lib/libgcc_s.so.1
7fb8a4e05000-7fb8a5005000 ---p 00016000 08:11 57714027                   
/lib/libgcc_s.so.1
7fb8a5005000-7fb8a5006000 r--p 00016000 08:11 57714027                   
/lib/libgcc_s.so.1
7fb8a5006000-7fb8a5007000 rw-p 00017000 08:11 57714027                   
/lib/libgcc_s.so.1
7fb8a5007000-7fb8a50f8000 r-xp 00000000 08:11 56985607                   
/usr/lib/libstdc++.so.6.0.10
7fb8a50f8000-7fb8a52f8000 ---p 000f1000 08:11 56985607                   
/usr/lib/libstdc++.so.6.0.10
7fb8a52f8000-7fb8a52ff000 r--p 000f1000 08:11 56985607                   
/usr/lib/libstdc++.so.6.0.10
7fb8a52ff000-7fb8a5301000 rw-p 000f8000 08:11 56985607                   
/usr/lib/libstdc++.so.6.0.10
7fb8a5301000-7fb8a5314000 rw-p 7fb8a5301000 00:00 0
7fb8a5314000-7fb8a532a000 r-xp 00000000 08:11 57713979                   
/lib/libnsl-2.9.so
7fb8a532a000-7fb8a552a000 ---p 00016000 08:11 57713979                   
/lib/libnsl-2.9.so
7fb8a552a000-7fb8a552b000 r--p 00016000 08:11 57713979                   
/lib/libnsl-2.9.so
7fb8a552b000-7fb8a552c000 rw-p 00017000 08:11 57713979                   
/lib/libnsl-2.9.so
7fb8a552c000-7fb8a552e000 rw-p 7fb8a552c000 00:00 0
7fb8a552e000-7fb8a5531000 r-xp 00000000 08:11 57713971                   
/lib/libgpg-error.so.0.3.0
7fb8a5531000-7fb8a5730000 ---p 00003000 08:11 57713971                   
/lib/libgpg-error.so.0.3.0
7fb8a5730000-7fb8a5731000 rw-p 00002000 08:11 57713971                   
/lib/libgpg-error.so.0.3.0
7fb8a5731000-7fb8a5899000 r-xp 00000000 08:11 57714386                   
/lib/libc-2.9.so
7fb8a5899000-7fb8a5a99000 ---p 00168000 08:11 57714386                   
/lib/libc-2.9.so
7fb8a5a99000-7fb8a5a9d000 r--p 00168000 08:11 57714386                   
/lib/libc-2.9.so
7fb8a5a9d000-7fb8a5a9e000 rw-p 0016c000 08:11 57714386                   
/lib/libc-2.9.so
7fb8a5a9e000-7fb8a5aa3000 rw-p 7fb8a5a9e000 00:00 0
7fb8a5aa3000-7fb8a5aac000 r-xp 00000000 08:11 57714392                   
/lib/libcrypt-2.9.so
7fb8a5aac000-7fb8a5cab000 ---p 00009000 08:11 57714392                   
/lib/libcrypt-2.9.so
7fb8a5cab000-7fb8a5cac000 r--p 00008000 08:11 57714392                   
/lib/libcrypt-2.9.so
7fb8a5cac000-7fb8a5cad000 rw-p 00009000 08:11 57714392                   
/lib/libcrypt-2.9.so
7fb8a5cad000-7fb8a5cdb000 rw-p 7fb8a5cad000 00:00 0
7fb8a5cdb000-7fb8a5cea000 r-xp 00000000 08:11 57713926                   
/lib/libbz2.so.1.0.4
7fb8a5cea000-7fb8a5eea000 ---p 0000f000 08:11 57713926                   
/lib/libbz2.so.1.0.4
7fb8a5eea000-7fb8a5eeb000 r--p 0000f000 08:11 57713926                   
/lib/libbz2.so.1.0.4
7fb8a5eeb000-7fb8a5eec000 rw-p 00010000 08:11 57713926                   
/lib/libbz2.so.1.0.4
7fb8a5eec000-7fb8a5f03000 r-xp 00000000 08:11 57714101                   
/lib/libz.so.1.2.3.3
7fb8a5f03000-7fb8a6102000 ---p 00017000 08:11 57714101                   
/lib/libz.so.1.2.3.3
7fb8a6102000-7fb8a6103000 r--p 00016000 08:11 57714101                   
/lib/libz.so.1.2.3.3
7fb8a6103000-7fb8a6104000 rw-p 00017000 08:11 57714101                   
/lib/libz.so.1.2.3.3
7fb8a6104000-7fb8a6188000 r-xp 00000000 08:11 57713967                   
/lib/libm-2.9.so
7fb8a6188000-7fb8a6387000 ---p 00084000 08:11 57713967                   
/lib/libm-2.9.so
7fb8a6387000-7fb8a6388000 r--p 00083000 08:11 57713967                   
/lib/libm-2.9.so
7fb8a6388000-7fb8a6389000 rw-p 00084000 08:11 57713967                   
/lib/libm-2.9.so
7fb8a6389000-7fb8a638b000 r-xp 00000000 08:11 57714098                   
/lib/libdl-2.9.so
7fb8a638b000-7fb8a658b000 ---p 00002000 08:11 57714098                   
/lib/libdl-2.9.so
7fb8a658b000-7fb8a658c000 r--p 00002000 08:11 57714098                   
/lib/libdl-2.9.so
7fb8a658c000-7fb8a658d000 rw-p 00003000 08:11 57714098                   
/lib/libdl-2.9.so
7fb8a658d000-7fb8a7063000 r--p 00000000 08:11 56986010                   
/usr/lib/libicudata.so.38.1
7fb8a7063000-7fb8a7262000 ---p 00ad6000 08:11 56986010                   
/usr/lib/libicudata.so.38.1
7fb8a7262000-7fb8a7263000 r--p 00ad5000 08:11 56986010                   
/usr/lib/libicudata.so.38.1
7fb8a7263000-7fb8a7394000 r-xp 00000000 08:11 56985949                   
/usr/lib/libicuuc.so.38.1
7fb8a7394000-7fb8a7594000 ---p 00131000 08:11 56985949                   
/usr/lib/libicuuc.so.38.1
7fb8a7594000-7fb8a75a2000 r--p 00131000 08:11 56985949                   
/usr/lib/libicuuc.so.38.1
7fb8a75a2000-7fb8a75a4000 rw-p 0013f000 08:11 56985949                   
/usr/lib/libicuuc.so.38.1
7fb8a75a4000-7fb8a75a6000 rw-p 7fb8a75a4000 00:00 0
7fb8a75a6000-7fb8a76f9000 r-xp 00000000 08:11 56985316                   
/usr/lib/libicui18n.so.38.1
7fb8a76f9000-7fb8a78f8000 ---p 00153000 08:11 56985316                   
/usr/lib/libicui18n.so.38.1
7fb8a78f8000-7fb8a7901000 r--p 00152000 08:11 56985316                   
/usr/lib/libicui18n.so.38.1
7fb8a7901000-7fb8a7904000 rw-p 0015b000 08:11 56985316                   
/usr/lib/libicui18n.so.38.1
7fb8a7904000-7fb8a791b000 r-xp 00000000 08:11 57714253                   
/lib/libpthread-2.9.so
7fb8a791b000-7fb8a7b1a000 ---p 00017000 08:11 57714253                   
/lib/libpthread-2.9.so
7fb8a7b1a000-7fb8a7b1b000 r--p 00016000 08:11 57714253                   
/lib/libpthread-2.9.so
7fb8a7b1b000-7fb8a7b1c000 rw-p 00017000 08:11 57714253                   
/lib/libpthread-2.9.so
7fb8a7b1c000-7fb8a7b20000 rw-p 7fb8a7b1c000 00:00 0
7fb8a7b20000-7fb8a7b29000 r-xp 00000000 08:11 57713923                   
/lib/libwrap.so.0.7.6
7fb8a7b29000-7fb8a7d28000 ---p 00009000 08:11 57713923                   
/lib/libwrap.so.0.7.6
7fb8a7d28000-7fb8a7d29000 r--p 00008000 08:11 57713923                   
/lib/libwrap.so.0.7.6
7fb8a7d29000-7fb8a7d2a000 rw-p 00009000 08:11 57713923                   
/lib/libwrap.so.0.7.6
7fb8a7d2a000-7fb8a7d2b000 rw-p 7fb8a7d2a000 00:00 0
7fb8a7d2b000-7fb8a7e7e000 r-xp 00000000 08:11 56985454                   
/usr/lib/libxml2.so.2.6.32
7fb8a7e7e000-7fb8a807d000 ---p 00153000 08:11 56985454                   
/usr/lib/libxml2.so.2.6.32
7fb8a807d000-7fb8a8085000 r--p 00152000 08:11 56985454                   
/usr/lib/libxml2.so.2.6.32
7fb8a8085000-7fb8a8087000 rw-p 0015a000 08:11 56985454                   
/usr/lib/libxml2.so.2.6.32
7fb8a8087000-7fb8a8088000 rw-p 7fb8a8087000 00:00 0
7fb8a8088000-7fb8a80c0000 r-xp 00000000 08:11 56985925                   
/usr/lib/libxslt.so.1.1.24
7fb8a80c0000-7fb8a82bf000 ---p 00038000 08:11 56985925                   
/usr/lib/libxslt.so.1.1.24
7fb8a82bf000-7fb8a82c0000 r--p 00037000 08:11 56985925                   
/usr/lib/libxslt.so.1.1.24
7fb8a82c0000-7fb8a82c1000 rw-p 00038000 08:11 56985925                   
/usr/lib/libxslt.so.1.1.24
7fb8a82c1000-7fb8a82d4000 r-xp 00000000 08:11 56986018                   
/usr/lib/libexslt.so.0.8.13
7fb8a82d4000-7fb8a84d3000 ---p 00013000 08:11 56986018                   
/usr/lib/libexslt.so.0.8.13
7fb8a84d3000-7fb8a84d4000 r--p 00012000 08:11 56986018                   
/usr/lib/libexslt.so.0.8.13
7fb8a84d4000-7fb8a84d5000 rw-p 00013000 08:11 56986018                   
/usr/lib/libexslt.so.0.8.13
7fb8a84d5000-7fb8a853a000 r-xp 00000000 08:1

12:44:23-20/10 zebraidx(17046) [log] zebra_start 2.0.42 
4ff9ad25e172e7bdcf2d8d94ea6a606ab53bcfe9
12:44:23-20/10 zebraidx(17046) [log] config 
/etc/koha/zebradb/zebra-biblios.cfg
12:44:23-20/10 zebraidx(17046) [log] Loaded filter module 
/usr/lib/idzebra-2.0/modules/mod-alvis.so
12:44:23-20/10 zebraidx(17046) [log] Loaded filter module 
/usr/lib/idzebra-2.0/modules/mod-grs-xml.so
12:44:23-20/10 zebraidx(17046) [log] Loaded filter module 
/usr/lib/idzebra-2.0/modules/mod-text.so
12:44:23-20/10 zebraidx(17046) [log] Loaded filter module 
/usr/lib/idzebra-2.0/modules/mod-grs-regx.so
12:44:23-20/10 zebraidx(17046) [log] Loaded filter module 
/usr/lib/idzebra-2.0/modules/mod-dom.so
12:44:23-20/10 zebraidx(17046) [log] Loaded filter module 
/usr/lib/idzebra-2.0/modules/mod-grs-marc.so
12:44:23-20/10 zebraidx(17046) [warn] previous transaction didn't reach 
commit
12:44:23-20/10 zebraidx(17046) [log] enabling shadow 
spec=/var/lib/koha/zebradb/biblios/shadow:4G
12:44:23-20/10 zebraidx(17046) [log] cache_fname = 
/var/lib/koha/zebradb/biblios/shadow/cache
12:44:24-20/10 zebraidx(17046) [log] zebra_stop: 1.19 0.00 0.93
====================
CLEANING
====================

-- 
Γιάννης Κουρμούλης		|	Giannis Kourmoulis
Σύστημα Βιβλιοθηκών Α.Π.Θ.	|	Library System A.U.Th. 

Ομάδα Τεχνικής Υποστήριξης	|	Technical Support Team
Τηλ. :(2310)99-5368		|	Tel. +302310995368
Fax  :(2310)99-5364		|	Fax +302310995364
email:libsupport at lib.auth.gr




More information about the Koha mailing list