Dear list After several problems with the import of records to our freshly installed koha system, we are stuck to the following point: Using the intranet web interface (staging - managing staged records) we managed to import a large file (100000 bib records with item information embedded - exported from a dynix horizon 7.3 system). When we try to reindex (./koha-3.00.03/misc/migration_tools/rebuild_zebra.pl -b -r -v) we get the following results (see below). Any ideas on what might cause this crashing of the zebra indexer? thank you [...] 12:40:11-20/10 zebraidx(17016) [log] Records: 94000 i/u/d 94000/0/0 12:40:18-20/10 zebraidx(17016) [log] Records: 95000 i/u/d 95000/0/0 12:40:25-20/10 zebraidx(17016) [log] Records: 96000 i/u/d 96000/0/0 12:40:31-20/10 zebraidx(17016) [log] Records: 97000 i/u/d 97000/0/0 12:40:40-20/10 zebraidx(17016) [log] Records: 98000 i/u/d 98000/0/0 12:40:53-20/10 zebraidx(17016) [log] Merge 2.8% completed; 5 minutes remaining 12:41:05-20/10 zebraidx(17016) [log] Merge 5.0% completed; 7 minutes remaining 12:41:15-20/10 zebraidx(17016) [log] Merge 7.0% completed; 7 minutes remaining 12:41:25-20/10 zebraidx(17016) [log] Merge 7.8% completed; 8 minutes remaining 12:41:35-20/10 zebraidx(17016) [log] Merge 9.1% completed; 8 minutes remaining 12:41:45-20/10 zebraidx(17016) [log] Merge 11.6% completed; 7 minutes remaining 12:41:55-20/10 zebraidx(17016) [log] Merge 15.6% completed; 6 minutes remaining 12:42:05-20/10 zebraidx(17016) [log] Merge 19.2% completed; 5 minutes remaining 12:42:15-20/10 zebraidx(17016) [log] Merge 23.2% completed; 5 minutes remaining 12:42:25-20/10 zebraidx(17016) [log] Merge 27.8% completed; 4 minutes remaining 12:42:35-20/10 zebraidx(17016) [log] Merge 31.0% completed; 4 minutes remaining 12:42:45-20/10 zebraidx(17016) [log] Merge 33.9% completed; 3 minutes remaining 12:42:55-20/10 zebraidx(17016) [log] Merge 37.1% completed; 3 minutes remaining 12:43:05-20/10 zebraidx(17016) [log] Merge 40.2% completed; 3 minutes remaining 12:43:15-20/10 zebraidx(17016) [log] Merge 44.4% completed; 3 minutes remaining 12:43:25-20/10 zebraidx(17016) [log] Merge 48.4% completed; 2 minutes remaining 12:43:35-20/10 zebraidx(17016) [log] Merge 54.1% completed; 2 minutes remaining 12:43:45-20/10 zebraidx(17016) [log] Merge 58.9% completed; 127 seconds remaining 12:43:55-20/10 zebraidx(17016) [log] Merge 63.5% completed; 110 seconds remaining 12:44:05-20/10 zebraidx(17016) [log] Merge 69.2% completed; 89 seconds remaining 12:44:15-20/10 zebraidx(17016) [log] Merge 74.1% completed; 74 seconds remaining *** stack smashing detected ***: zebraidx terminated ======= Backtrace: ========= /lib/libc.so.6(__fortify_fail+0x37)[0x7fb8a58302c7] /lib/libc.so.6(__fortify_fail+0x0)[0x7fb8a5830290] /usr/lib/libidzebra-2.0.so.0[0x7fb8a93b1c17] /usr/lib/libidzebra-2.0.so.0[0x7fb8a93b1c9c] /usr/lib/libidzebra-2.0.so.0(heap_cread_item2+0xea)[0x7fb8a93b1e8a] /usr/lib/libidzebra-2.0.so.0(insert_leaf+0x278)[0x7fb8a93de118] /usr/lib/libidzebra-2.0.so.0(isamb_merge+0x10f)[0x7fb8a93df4ef] /usr/lib/libidzebra-2.0.so.0(heap_inpb+0x1a4)[0x7fb8a93b2234] /usr/lib/libidzebra-2.0.so.0(zebra_index_merge+0x233)[0x7fb8a93b26c3] /usr/lib/libidzebra-2.0.so.0[0x7fb8a93c52cf] /usr/lib/libidzebra-2.0.so.0(zebra_end_transaction+0x13d)[0x7fb8a93c563d] /usr/lib/libidzebra-2.0.so.0(zebra_end_trans+0x31)[0x7fb8a93c5791] zebraidx[0x401aa4] /lib/libc.so.6(__libc_start_main+0xe6)[0x7fb8a574f5a6] zebraidx[0x401389] ======= Memory map: ======== 00400000-00403000 r-xp 00000000 08:11 56804930 /usr/bin/zebraidx-2.0 00602000-00603000 r--p 00002000 08:11 56804930 /usr/bin/zebraidx-2.0 00603000-00604000 rw-p 00003000 08:11 56804930 /usr/bin/zebraidx-2.0 00604000-00d5e000 rw-p 00604000 00:00 0 [heap] 7fb894000000-7fb8942ca000 rw-p 7fb894000000 00:00 0 7fb8942ca000-7fb898000000 ---p 7fb8942ca000 00:00 0 7fb89c000000-7fb89cbef000 rw-p 7fb89c000000 00:00 0 7fb89cbef000-7fb8a0000000 ---p 7fb89cbef000 00:00 0 7fb8a02d5000-7fb8a1bd6000 rw-p 7fb8a02d5000 00:00 0 7fb8a1bd6000-7fb8a1bd7000 ---p 7fb8a1bd6000 00:00 0 7fb8a1bd7000-7fb8a3cd8000 rw-p 7fb8a1bd7000 00:00 0 7fb8a3cd8000-7fb8a3cdd000 r-xp 00000000 08:11 56985463 /usr/lib/idzebra-2.0/modules/mod-grs-marc.so 7fb8a3cdd000-7fb8a3edc000 ---p 00005000 08:11 56985463 /usr/lib/idzebra-2.0/modules/mod-grs-marc.so 7fb8a3edc000-7fb8a3edd000 r--p 00004000 08:11 56985463 /usr/lib/idzebra-2.0/modules/mod-grs-marc.so 7fb8a3edd000-7fb8a3ede000 rw-p 00005000 08:11 56985463 /usr/lib/idzebra-2.0/modules/mod-grs-marc.so 7fb8a3ede000-7fb8a3ee3000 r-xp 00000000 08:11 56985462 /usr/lib/idzebra-2.0/modules/mod-dom.so 7fb8a3ee3000-7fb8a40e3000 ---p 00005000 08:11 56985462 /usr/lib/idzebra-2.0/modules/mod-dom.so 7fb8a40e3000-7fb8a40e4000 r--p 00005000 08:11 56985462 /usr/lib/idzebra-2.0/modules/mod-dom.so 7fb8a40e4000-7fb8a40e5000 rw-p 00006000 08:11 56985462 /usr/lib/idzebra-2.0/modules/mod-dom.so 7fb8a40e5000-7fb8a41a2000 r-xp 00000000 08:11 56985355 /usr/lib/libtcl8.4.so.0 7fb8a41a2000-7fb8a43a2000 ---p 000bd000 08:11 56985355 /usr/lib/libtcl8.4.so.0 7fb8a43a2000-7fb8a43a3000 r--p 000bd000 08:11 56985355 /usr/lib/libtcl8.4.so.0 7fb8a43a3000-7fb8a43b0000 rw-p 000be000 08:11 56985355 /usr/lib/libtcl8.4.so.0 7fb8a43b0000-7fb8a43b1000 rw-p 7fb8a43b0000 00:00 0 7fb8a43b1000-7fb8a43b7000 r-xp 00000000 08:11 56985461 /usr/lib/idzebra-2.0/modules/mod-grs-regx.so 7fb8a43b7000-7fb8a45b7000 ---p 00006000 08:11 56985461 /usr/lib/idzebra-2.0/modules/mod-grs-regx.so 7fb8a45b7000-7fb8a45b8000 r--p 00006000 08:11 56985461 /usr/lib/idzebra-2.0/modules/mod-grs-regx.so 7fb8a45b8000-7fb8a45b9000 rw-p 00007000 08:11 56985461 /usr/lib/idzebra-2.0/modules/mod-grs-regx.so 7fb8a45b9000-7fb8a45bb000 r-xp 00000000 08:11 56985460 /usr/lib/idzebra-2.0/modules/mod-text.so 7fb8a45bb000-7fb8a47ba000 ---p 00002000 08:11 56985460 /usr/lib/idzebra-2.0/modules/mod-text.so 7fb8a47ba000-7fb8a47bb000 r--p 00001000 08:11 56985460 /usr/lib/idzebra-2.0/modules/mod-text.so 7fb8a47bb000-7fb8a47bc000 rw-p 00002000 08:11 56985460 /usr/lib/idzebra-2.0/modules/mod-text.so 7fb8a47bc000-7fb8a47e3000 r-xp 00000000 08:11 56985353 /usr/lib/libexpat.so.1.5.2 7fb8a47e3000-7fb8a49e3000 ---p 00027000 08:11 56985353 /usr/lib/libexpat.so.1.5.2 7fb8a49e3000-7fb8a49e5000 r--p 00027000 08:11 56985353 /usr/lib/libexpat.so.1.5.2 7fb8a49e5000-7fb8a49e6000 rw-p 00029000 08:11 56985353 /usr/lib/libexpat.so.1.5.2 7fb8a49e6000-7fb8a49e9000 r-xp 00000000 08:11 56985459 /usr/lib/idzebra-2.0/modules/mod-grs-xml.so 7fb8a49e9000-7fb8a4be8000 ---p 00003000 08:11 56985459 /usr/lib/idzebra-2.0/modules/mod-grs-xml.so 7fb8a4be8000-7fb8a4be9000 r--p 00002000 08:11 56985459 /usr/lib/idzebra-2.0/modules/mod-grs-xml.so 7fb8a4be9000-7fb8a4bea000 rw-p 00003000 08:11 56985459 /usr/lib/idzebra-2.0/modules/mod-grs-xml.so 7fb8a4bea000-7fb8a4bed000 r-xp 00000000 08:11 56985458 /usr/lib/idzebra-2.0/modules/mod-alvis.so 7fb8a4bed000-7fb8a4ded000 ---p 00003000 08:11 56985458 /usr/lib/idzebra-2.0/modules/mod-alvis.so 7fb8a4ded000-7fb8a4dee000 r--p 00003000 08:11 56985458 /usr/lib/idzebra-2.0/modules/mod-alvis.so 7fb8a4dee000-7fb8a4def000 rw-p 00004000 08:11 56985458 /usr/lib/idzebra-2.0/modules/mod-alvis.so 7fb8a4def000-7fb8a4e05000 r-xp 00000000 08:11 57714027 /lib/libgcc_s.so.1 7fb8a4e05000-7fb8a5005000 ---p 00016000 08:11 57714027 /lib/libgcc_s.so.1 7fb8a5005000-7fb8a5006000 r--p 00016000 08:11 57714027 /lib/libgcc_s.so.1 7fb8a5006000-7fb8a5007000 rw-p 00017000 08:11 57714027 /lib/libgcc_s.so.1 7fb8a5007000-7fb8a50f8000 r-xp 00000000 08:11 56985607 /usr/lib/libstdc++.so.6.0.10 7fb8a50f8000-7fb8a52f8000 ---p 000f1000 08:11 56985607 /usr/lib/libstdc++.so.6.0.10 7fb8a52f8000-7fb8a52ff000 r--p 000f1000 08:11 56985607 /usr/lib/libstdc++.so.6.0.10 7fb8a52ff000-7fb8a5301000 rw-p 000f8000 08:11 56985607 /usr/lib/libstdc++.so.6.0.10 7fb8a5301000-7fb8a5314000 rw-p 7fb8a5301000 00:00 0 7fb8a5314000-7fb8a532a000 r-xp 00000000 08:11 57713979 /lib/libnsl-2.9.so 7fb8a532a000-7fb8a552a000 ---p 00016000 08:11 57713979 /lib/libnsl-2.9.so 7fb8a552a000-7fb8a552b000 r--p 00016000 08:11 57713979 /lib/libnsl-2.9.so 7fb8a552b000-7fb8a552c000 rw-p 00017000 08:11 57713979 /lib/libnsl-2.9.so 7fb8a552c000-7fb8a552e000 rw-p 7fb8a552c000 00:00 0 7fb8a552e000-7fb8a5531000 r-xp 00000000 08:11 57713971 /lib/libgpg-error.so.0.3.0 7fb8a5531000-7fb8a5730000 ---p 00003000 08:11 57713971 /lib/libgpg-error.so.0.3.0 7fb8a5730000-7fb8a5731000 rw-p 00002000 08:11 57713971 /lib/libgpg-error.so.0.3.0 7fb8a5731000-7fb8a5899000 r-xp 00000000 08:11 57714386 /lib/libc-2.9.so 7fb8a5899000-7fb8a5a99000 ---p 00168000 08:11 57714386 /lib/libc-2.9.so 7fb8a5a99000-7fb8a5a9d000 r--p 00168000 08:11 57714386 /lib/libc-2.9.so 7fb8a5a9d000-7fb8a5a9e000 rw-p 0016c000 08:11 57714386 /lib/libc-2.9.so 7fb8a5a9e000-7fb8a5aa3000 rw-p 7fb8a5a9e000 00:00 0 7fb8a5aa3000-7fb8a5aac000 r-xp 00000000 08:11 57714392 /lib/libcrypt-2.9.so 7fb8a5aac000-7fb8a5cab000 ---p 00009000 08:11 57714392 /lib/libcrypt-2.9.so 7fb8a5cab000-7fb8a5cac000 r--p 00008000 08:11 57714392 /lib/libcrypt-2.9.so 7fb8a5cac000-7fb8a5cad000 rw-p 00009000 08:11 57714392 /lib/libcrypt-2.9.so 7fb8a5cad000-7fb8a5cdb000 rw-p 7fb8a5cad000 00:00 0 7fb8a5cdb000-7fb8a5cea000 r-xp 00000000 08:11 57713926 /lib/libbz2.so.1.0.4 7fb8a5cea000-7fb8a5eea000 ---p 0000f000 08:11 57713926 /lib/libbz2.so.1.0.4 7fb8a5eea000-7fb8a5eeb000 r--p 0000f000 08:11 57713926 /lib/libbz2.so.1.0.4 7fb8a5eeb000-7fb8a5eec000 rw-p 00010000 08:11 57713926 /lib/libbz2.so.1.0.4 7fb8a5eec000-7fb8a5f03000 r-xp 00000000 08:11 57714101 /lib/libz.so.1.2.3.3 7fb8a5f03000-7fb8a6102000 ---p 00017000 08:11 57714101 /lib/libz.so.1.2.3.3 7fb8a6102000-7fb8a6103000 r--p 00016000 08:11 57714101 /lib/libz.so.1.2.3.3 7fb8a6103000-7fb8a6104000 rw-p 00017000 08:11 57714101 /lib/libz.so.1.2.3.3 7fb8a6104000-7fb8a6188000 r-xp 00000000 08:11 57713967 /lib/libm-2.9.so 7fb8a6188000-7fb8a6387000 ---p 00084000 08:11 57713967 /lib/libm-2.9.so 7fb8a6387000-7fb8a6388000 r--p 00083000 08:11 57713967 /lib/libm-2.9.so 7fb8a6388000-7fb8a6389000 rw-p 00084000 08:11 57713967 /lib/libm-2.9.so 7fb8a6389000-7fb8a638b000 r-xp 00000000 08:11 57714098 /lib/libdl-2.9.so 7fb8a638b000-7fb8a658b000 ---p 00002000 08:11 57714098 /lib/libdl-2.9.so 7fb8a658b000-7fb8a658c000 r--p 00002000 08:11 57714098 /lib/libdl-2.9.so 7fb8a658c000-7fb8a658d000 rw-p 00003000 08:11 57714098 /lib/libdl-2.9.so 7fb8a658d000-7fb8a7063000 r--p 00000000 08:11 56986010 /usr/lib/libicudata.so.38.1 7fb8a7063000-7fb8a7262000 ---p 00ad6000 08:11 56986010 /usr/lib/libicudata.so.38.1 7fb8a7262000-7fb8a7263000 r--p 00ad5000 08:11 56986010 /usr/lib/libicudata.so.38.1 7fb8a7263000-7fb8a7394000 r-xp 00000000 08:11 56985949 /usr/lib/libicuuc.so.38.1 7fb8a7394000-7fb8a7594000 ---p 00131000 08:11 56985949 /usr/lib/libicuuc.so.38.1 7fb8a7594000-7fb8a75a2000 r--p 00131000 08:11 56985949 /usr/lib/libicuuc.so.38.1 7fb8a75a2000-7fb8a75a4000 rw-p 0013f000 08:11 56985949 /usr/lib/libicuuc.so.38.1 7fb8a75a4000-7fb8a75a6000 rw-p 7fb8a75a4000 00:00 0 7fb8a75a6000-7fb8a76f9000 r-xp 00000000 08:11 56985316 /usr/lib/libicui18n.so.38.1 7fb8a76f9000-7fb8a78f8000 ---p 00153000 08:11 56985316 /usr/lib/libicui18n.so.38.1 7fb8a78f8000-7fb8a7901000 r--p 00152000 08:11 56985316 /usr/lib/libicui18n.so.38.1 7fb8a7901000-7fb8a7904000 rw-p 0015b000 08:11 56985316 /usr/lib/libicui18n.so.38.1 7fb8a7904000-7fb8a791b000 r-xp 00000000 08:11 57714253 /lib/libpthread-2.9.so 7fb8a791b000-7fb8a7b1a000 ---p 00017000 08:11 57714253 /lib/libpthread-2.9.so 7fb8a7b1a000-7fb8a7b1b000 r--p 00016000 08:11 57714253 /lib/libpthread-2.9.so 7fb8a7b1b000-7fb8a7b1c000 rw-p 00017000 08:11 57714253 /lib/libpthread-2.9.so 7fb8a7b1c000-7fb8a7b20000 rw-p 7fb8a7b1c000 00:00 0 7fb8a7b20000-7fb8a7b29000 r-xp 00000000 08:11 57713923 /lib/libwrap.so.0.7.6 7fb8a7b29000-7fb8a7d28000 ---p 00009000 08:11 57713923 /lib/libwrap.so.0.7.6 7fb8a7d28000-7fb8a7d29000 r--p 00008000 08:11 57713923 /lib/libwrap.so.0.7.6 7fb8a7d29000-7fb8a7d2a000 rw-p 00009000 08:11 57713923 /lib/libwrap.so.0.7.6 7fb8a7d2a000-7fb8a7d2b000 rw-p 7fb8a7d2a000 00:00 0 7fb8a7d2b000-7fb8a7e7e000 r-xp 00000000 08:11 56985454 /usr/lib/libxml2.so.2.6.32 7fb8a7e7e000-7fb8a807d000 ---p 00153000 08:11 56985454 /usr/lib/libxml2.so.2.6.32 7fb8a807d000-7fb8a8085000 r--p 00152000 08:11 56985454 /usr/lib/libxml2.so.2.6.32 7fb8a8085000-7fb8a8087000 rw-p 0015a000 08:11 56985454 /usr/lib/libxml2.so.2.6.32 7fb8a8087000-7fb8a8088000 rw-p 7fb8a8087000 00:00 0 7fb8a8088000-7fb8a80c0000 r-xp 00000000 08:11 56985925 /usr/lib/libxslt.so.1.1.24 7fb8a80c0000-7fb8a82bf000 ---p 00038000 08:11 56985925 /usr/lib/libxslt.so.1.1.24 7fb8a82bf000-7fb8a82c0000 r--p 00037000 08:11 56985925 /usr/lib/libxslt.so.1.1.24 7fb8a82c0000-7fb8a82c1000 rw-p 00038000 08:11 56985925 /usr/lib/libxslt.so.1.1.24 7fb8a82c1000-7fb8a82d4000 r-xp 00000000 08:11 56986018 /usr/lib/libexslt.so.0.8.13 7fb8a82d4000-7fb8a84d3000 ---p 00013000 08:11 56986018 /usr/lib/libexslt.so.0.8.13 7fb8a84d3000-7fb8a84d4000 r--p 00012000 08:11 56986018 /usr/lib/libexslt.so.0.8.13 7fb8a84d4000-7fb8a84d5000 rw-p 00013000 08:11 56986018 /usr/lib/libexslt.so.0.8.13 7fb8a84d5000-7fb8a853a000 r-xp 00000000 08:1 12:44:23-20/10 zebraidx(17046) [log] zebra_start 2.0.42 4ff9ad25e172e7bdcf2d8d94ea6a606ab53bcfe9 12:44:23-20/10 zebraidx(17046) [log] config /etc/koha/zebradb/zebra-biblios.cfg 12:44:23-20/10 zebraidx(17046) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-alvis.so 12:44:23-20/10 zebraidx(17046) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-grs-xml.so 12:44:23-20/10 zebraidx(17046) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-text.so 12:44:23-20/10 zebraidx(17046) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-grs-regx.so 12:44:23-20/10 zebraidx(17046) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-dom.so 12:44:23-20/10 zebraidx(17046) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-grs-marc.so 12:44:23-20/10 zebraidx(17046) [warn] previous transaction didn't reach commit 12:44:23-20/10 zebraidx(17046) [log] enabling shadow spec=/var/lib/koha/zebradb/biblios/shadow:4G 12:44:23-20/10 zebraidx(17046) [log] cache_fname = /var/lib/koha/zebradb/biblios/shadow/cache 12:44:24-20/10 zebraidx(17046) [log] zebra_stop: 1.19 0.00 0.93 ==================== CLEANING ==================== -- Γιάννης Κουρμούλης | Giannis Kourmoulis Σύστημα Βιβλιοθηκών Α.Π.Θ. | Library System A.U.Th. Ομάδα Τεχνικής Υποστήριξης | Technical Support Team Τηλ. :(2310)99-5368 | Tel. +302310995368 Fax :(2310)99-5364 | Fax +302310995364 email:libsupport@lib.auth.gr