Well I upped register and shadow and changed the last line of this file from 50 to 100, reran rebuild_zebra.pl -r -b -w - and it got to about 34000 again and said - Out of memory and then died. oy! David Schuster I'm going to attempt the -k to see if that helps this round... Shouldn't but doesn't hurt when you are stuck. Galen Charlton wrote:

Hi,

On Thu, Sep 4, 2008 at 12:10 PM, David Schuster <dschust1@tx.rr.com> wrote:

...

1 - OK so when I run the reindex_zebra.pl with -r -w -b (I think those are the switches) I'm getting up to almost 34,000 records indexed and then getting Out of memory!

I've loaded - I believe - about 250,000 records. Surely I can reindex without loading it all into memory...?? What am I missing?

You probably need to bump up the maximum size that Zebra allows for its register and shadow. These are set in zebra-biblios.cfg, Look for entries like this:

register: /path/to/biblios/register:4G shadow: /path/to/biblios/shadow:4G

The "4G" indicates that the register's maximum size is 4 gigabytes.

...

2 - what sql or? can I run to actually verify how many Biblio and items I have loaded into Koha?

select count(*) from biblio; select count(*) from items;

Regards,

Galen -- Galen Charlton VP, Research & Development, LibLime galen.charlton@liblime.com p: 1-888-564-2457 x709 skype: gmcharlt _______________________________________________ Koha mailing list Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha

-- View this message in context: http://www.nabble.com/reindex_zebra.pl---out-of-memory-tp19315345p19338637.h... Sent from the Koha - Discuss mailing list archive at Nabble.com.

On 2008/09/6, at 8:24 AM, Brendan Gallagher wrote:

I had a similar problem and up'd/changed the last line to 4G and it went through fine. The first time I ran it I too switched it to 100M and it didn't work.

-Brendan

+++++++++++++++++++++++++++++++++++++++++++ Brendan A. Gallagher Software Services Coordinator Bibliomation, INC. Middlebury, CT 06762 (203)577-4070 x119 +++++++++++++++++++++++++++++++++++++++++++

On Sep 5, 2008, at 4:13 PM, David Schuster wrote:

...

Well I upped register and shadow and changed the last line of this file from 50 to 100, reran rebuild_zebra.pl -r -b -w - and it got to about 34000 again and said - Out of memory and then died.

Hi David, Just another 2 cents.. 1) Does your system have a big enough swap file?? 2) Is your system's swap usage getting high when your index crashes at 34k? try running a top to monitor this, during your rebuild... $ top |grep Swap Swap: 2650684k total, 1224176k used, 1426508k free, 270932k cached Swap: 2650684k total, 1224176k used, 1426508k free, 270932k cached if so , increase your swap partition.. It sounds like you might be hitting the limits of your system's ram +swap.??? Mason.