Koha 3, bulk imported records not showing up in search
I just installed Koha 3 on a Ubuntu system. It's up and running and now I need to import some MARC records. I have a lot, so I am trying to use bulkimport.pl to do the job. I ran it on a file with about 89000 records and it seemed to run ok. Then I ran rebuild_zebra.pl with the command 'perl -I /usr/share/koha/lib /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -v -b -w'. It gave me an error message about being unable to unlock some files, so I ran it again using sudo. This time it seemed to go without a problem, but when I go to search the OPAC I only get 'no records found' messages. I checked the log viewer and it shows 89000 records added, but they don't seem to be searchable. Any help will be greatly appreciated. //SIGNED// PERRY OTIS Systems Librarian Muir S. Fairchild Research Information Center DSN 493-6498 Comm 334-953-8081
Hi, On Mar 3, 2010, at 5:10 PM, Otis, Perry W Civ USAF AETC AUL/LTIA wrote:
I just installed Koha 3 on a Ubuntu system. It’s up and running and now I need to import some MARC records. I have a lot, so I am trying to use bulkimport.pl to do the job. I ran it on a file with about 89000 records and it seemed to run ok. Then I ran rebuild_zebra.pl with the command ‘perl –I /usr/share/koha/lib /usr/share/koha/bin/migration_tools/rebuild_zebra.pl –v –b –w’. It gave me an error message about being unable to unlock some files, so I ran it again using sudo. This time it seemed to go without a problem, but when I go to search the OPAC I only get ‘no records found’ messages. I checked the log viewer and it shows 89000 records added, but they don’t seem to be searchable. Any help will be greatly appreciated.
A couple things to check: [1] Is zebrasrv running? ps -ef | grep zebrasrv will show whether it is. [2] I recommend that you change the ownership of Zebra's data files (which will likely be found in /var/lib/koha/zebradb on your system) to the koha user. If you do that, you can run rebuild_zebra.pl without using sudo. Note that if you change the ownership, you don't need to rebuild the indexes - just stop and restart zebrasrv. Regards, Galen -- Galen Charlton VP, Data Services Equinox Software, Inc. / Your Library's Guide to Open Source email: gmc@esilibrary.com direct: +1 352-215-7548 skype: gmcharlt web: http://www.esilibrary.com/
Thanks for your reply. I checked and zebrasrv was not running. It turned out that I need to install daemon before I could run the start command. I did and was able to start zebrasrv. I am still getting no results when I search the OPAC. I ran rebuild_zebra.pl again and still no results when I search. Do I need to run bulkimport.pl again? //SIGNED// PERRY OTIS Systems Librarian Muir S. Fairchild Research Information Center DSN 493-6498 Comm 334-953-8081 -----Original Message----- From: Galen Charlton [mailto:gmc@esilibrary.com] Sent: Wednesday, March 03, 2010 4:22 PM To: Otis, Perry W Civ USAF AETC AUL/LTIA Cc: koha@lists.katipo.co.nz Subject: Re: [Koha] Koha 3, bulk imported records not showing up in search Hi, On Mar 3, 2010, at 5:10 PM, Otis, Perry W Civ USAF AETC AUL/LTIA wrote:
I just installed Koha 3 on a Ubuntu system. It's up and running and now I need to import some MARC records. I have a lot, so I am trying to use bulkimport.pl to do the job. I ran it on a file with about 89000 records and it seemed to run ok. Then I ran rebuild_zebra.pl with the command 'perl -I /usr/share/koha/lib /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -v -b -w'. It gave me an error message about being unable to unlock some files, so I ran it again using sudo. This time it seemed to go without a problem, but when I go to search the OPAC I only get 'no records found' messages. I checked the log viewer and it shows 89000 records added, but they don't seem to be searchable. Any help will be greatly appreciated.
A couple things to check: [1] Is zebrasrv running? ps -ef | grep zebrasrv will show whether it is. [2] I recommend that you change the ownership of Zebra's data files (which will likely be found in /var/lib/koha/zebradb on your system) to the koha user. If you do that, you can run rebuild_zebra.pl without using sudo. Note that if you change the ownership, you don't need to rebuild the indexes - just stop and restart zebrasrv. Regards, Galen -- Galen Charlton VP, Data Services Equinox Software, Inc. / Your Library's Guide to Open Source email: gmc@esilibrary.com direct: +1 352-215-7548 skype: gmcharlt web: http://www.esilibrary.com/
Hi, On Mar 4, 2010, at 11:41 AM, Otis, Perry W Civ USAF AETC AUL/LTIA wrote:
Thanks for your reply. I checked and zebrasrv was not running. It turned out that I need to install daemon before I could run the start command. I did and was able to start zebrasrv. I am still getting no results when I search the OPAC. I ran rebuild_zebra.pl again and still no results when I search. Do I need to run bulkimport.pl again?
It's unlikely that you need to run bulkmarcimport.pl again, but to double-check, try the following SQL statement from the guided reports editor or the mysql prompt: select count(*) from biblio; Check the the zebrasrv log file to see if it reports anything interesting, and also try running rebuild_zebra.pl with the -v (verbose) option. Regards, Galen -- Galen Charlton VP, Data Services Equinox Software, Inc. / Your Library's Guide to Open Source email: gmc@esilibrary.com direct: +1 352-215-7548 skype: gmcharlt web: http://www.esilibrary.com/
Thanks again for replying. I noticed that after running rebuild_zebra.pl, there was a message saying "[warn] No such record type: grs.marcxml.record". I did some research and found the answer here: http://lists.katipo.co.nz/public/koha/2009-February/017096.html. It seems there was an error in the zebra-biblios.cfg file, located at /etc/koha/zebradb. The line /modulePath: /usr/lib/idzebra-2.0/modules/ should have been /modulePath: /usr/local/lib/idzebra-2.0/modules/ I changed it and re-ran rebuild_zebra.pl and can now successfully search the OPAC. I appreciate your suggestion to check to make sure the zebrasrv was running as it was one more thing that needed to be corrected before I could get this working. //SIGNED// PERRY OTIS Systems Librarian Muir S. Fairchild Research Information Center DSN 493-6498 Comm 334-953-8081 -----Original Message----- From: Galen Charlton [mailto:gmc@esilibrary.com] Sent: Thursday, March 04, 2010 3:12 PM To: Otis, Perry W Civ USAF AETC AUL/LTIA Cc: koha@lists.katipo.co.nz Subject: Re: [Koha] Koha 3, bulk imported records not showing up in search Hi, On Mar 4, 2010, at 11:41 AM, Otis, Perry W Civ USAF AETC AUL/LTIA wrote:
Thanks for your reply. I checked and zebrasrv was not running. It turned out that I need to install daemon before I could run the start command. I did and was able to start zebrasrv. I am still getting no results when I search the OPAC. I ran rebuild_zebra.pl again and still no results when I search. Do I need to run bulkimport.pl again?
It's unlikely that you need to run bulkmarcimport.pl again, but to double-check, try the following SQL statement from the guided reports editor or the mysql prompt: select count(*) from biblio; Check the the zebrasrv log file to see if it reports anything interesting, and also try running rebuild_zebra.pl with the -v (verbose) option. Regards, Galen -- Galen Charlton VP, Data Services Equinox Software, Inc. / Your Library's Guide to Open Source email: gmc@esilibrary.com direct: +1 352-215-7548 skype: gmcharlt web: http://www.esilibrary.com/
"Otis, Perry W Civ USAF AETC AUL/LTIA" <perry.otis@MAXWELL.AF.MIL>
It seems there was an error in the zebra-biblios.cfg file, located at /etc/koha/zebradb. The line /modulePath: /usr/lib/idzebra-2.0/modules/ should have been /modulePath: /usr/local/lib/idzebra-2.0/modules/
That's strange. Where did you install idzebra-2.0 from? Thanks, -- MJ Ray (slef) Webmaster and LMS developer at | software www.software.coop http://mjr.towers.org.uk | .... co IMO only: see http://mjr.towers.org.uk/email.html | .... op
On Fri, Mar 5, 2010 at 6:44 AM, MJ Ray <mjr@phonecoop.coop> wrote:
"Otis, Perry W Civ USAF AETC AUL/LTIA" <perry.otis@MAXWELL.AF.MIL>
It seems there was an error in the zebra-biblios.cfg file, located at /etc/koha/zebradb. The line /modulePath: /usr/lib/idzebra-2.0/modules/ should have been /modulePath: /usr/local/lib/idzebra-2.0/modules/
That's strange. Where did you install idzebra-2.0 from?
That is the latest version. http://www.indexdata.com/zebra Kind Regards, Chris
Chris Nighswonger <cnighswonger@foundations.edu>
On Fri, Mar 5, 2010 at 6:44 AM, MJ Ray <mjr@phonecoop.coop> wrote:
"Otis, Perry W Civ USAF AETC AUL/LTIA" <perry.otis@MAXWELL.AF.MIL>
should have been /modulePath: /usr/local/lib/idzebra-2.0/modules/
That's strange. Where did you install idzebra-2.0 from?
That is the latest version.
Sure. I was meaning tarball, packages or whatever, from indexdata or another source. Packages for various ubuntu versions should install under /usr/lib, but tarball will usually install under /usr/local by default. Hope that clarifies, -- MJ Ray (slef) Webmaster and LMS developer at | software www.software.coop http://mjr.towers.org.uk | .... co IMO only: see http://mjr.towers.org.uk/email.html | .... op
I downloaded the tar file from indexdata.com. //SIGNED// PERRY OTIS Systems Librarian Muir S. Fairchild Research Information Center DSN 493-6498 Comm 334-953-8081 -----Original Message----- From: MJ Ray [mailto:mjr@phonecoop.coop] Sent: Friday, March 05, 2010 5:45 AM To: Otis, Perry W Civ USAF AETC AUL/LTIA Cc: koha@lists.katipo.co.nz Subject: Re: [Koha] Koha 3, bulk imported records not showing up in search "Otis, Perry W Civ USAF AETC AUL/LTIA" <perry.otis@MAXWELL.AF.MIL>
It seems there was an error in the zebra-biblios.cfg file, located at /etc/koha/zebradb. The line /modulePath: /usr/lib/idzebra-2.0/modules/ should have been /modulePath: /usr/local/lib/idzebra-2.0/modules/
That's strange. Where did you install idzebra-2.0 from? Thanks, -- MJ Ray (slef) Webmaster and LMS developer at | software www.software.coop http://mjr.towers.org.uk | .... co IMO only: see http://mjr.towers.org.uk/email.html | .... op
Otis, Perry W Civ USAF AETC AUL/LTIA wrote:
I downloaded the tar file from indexdata.com.
OK, that's OK then. If you install manually from tar file instead of deb package, those lines will need updating and that's expected behaviour. Thanks for clearing that up, -- MJ Ray (slef) Webmaster and LMS developer at | software www.software.coop http://mjr.towers.org.uk | .... co IMO only: see http://mjr.towers.org.uk/email.html | .... op
participants (5)
-
Chris Nighswonger -
Galen Charlton -
MJ Ray -
MJ Ray -
Otis, Perry W Civ USAF AETC AUL/LTIA