Re: [Koha] Staging of import stalls
If I use the perl script does that mean I don't have to stage them? Thanks Ed Edward J. Roche Network Administrator Solanco School District 717.786.2151 x2437 "At the End of the Day, Did You Play to Win or Not to Lose?" -----Original Message----- From: Doug Dearden [mailto:dearden@sarsf.org] Sent: Friday, February 27, 2009 11:41 AM To: Roche III, Edward Cc: koha@lists.katipo.co.nz Subject: Re: [Koha] Staging of import stalls Hi Ed, I had the same problem. Take a look at the last import (Home > Tools > Manage Staged MARC Records > Batch Figure out the last record in the batch that went in, then edit the import file you are using and remove the record immediately after that one in the file. It has some kind of problem. Try again and see if you get further. It is either that record, or the last one that actually worked, I can't remember exactly which. Also, there is a command line tool that you can use to import. You will find it at /usr/share/koha/bin/migration_tools/bulkmarcimport.pl
From the migration tools subdirectory enter: perl bulkmarcimport.pl and you will get the syntax and parameter info. It has a test mode you can run against the file.
Best, Doug
"Roche III, Edward" <edward_roche@solanco.k12.pa.us> 2/27/2009 9:20 AM >>> Good Morning All
I am trying stage my MARC import data but it keeps stalling. I broke it down into 4 individual files of about 4000 records each. But it still stalls at about 15%. Has anyone had this issue? Can it be done from the terminal instead of through the browser? Every time I start the process it pins my cpu at 95 to 100% which is why it is probably stalling but not sure why. My Config ---------------------------------- Ubuntu 8.1 1.5gb memory Pentium 4 - 2.5ghz dual core Koha 3.0 NoZebra Basic LAMP install Any thoughts would be great. Thanks Ed Edward J. Roche Network Administrator Solanco School District 717.786.2151 x2437 "At the End of the Day, Did You Play to Win or Not to Lose?"
no need to stage them. Savitra Sirohi Nucsoft OSS Labs www.osslabs.biz On Fri, Feb 27, 2009 at 11:14 PM, Roche III, Edward <edward_roche@solanco.k12.pa.us> wrote:
If I use the perl script does that mean I don't have to stage them?
Thanks Ed
Edward J. Roche Network Administrator Solanco School District 717.786.2151 x2437
"At the End of the Day, Did You Play to Win or Not to Lose?"
-----Original Message----- From: Doug Dearden [mailto:dearden@sarsf.org] Sent: Friday, February 27, 2009 11:41 AM To: Roche III, Edward Cc: koha@lists.katipo.co.nz Subject: Re: [Koha] Staging of import stalls
Hi Ed,
I had the same problem. Take a look at the last import (Home > Tools > Manage Staged MARC Records > Batch
Figure out the last record in the batch that went in, then edit the import file you are using and remove the record immediately after that one in the file. It has some kind of problem. Try again and see if you get further. It is either that record, or the last one that actually worked, I can't remember exactly which.
Also, there is a command line tool that you can use to import. You will find it at /usr/share/koha/bin/migration_tools/bulkmarcimport.pl
From the migration tools subdirectory enter: perl bulkmarcimport.pl and you will get the syntax and parameter info. It has a test mode you can run against the file.
Best,
Doug
"Roche III, Edward" <edward_roche@solanco.k12.pa.us> 2/27/2009 9:20 AM >>> Good Morning All
I am trying stage my MARC import data but it keeps stalling. I broke it down into 4 individual files of about 4000 records each. But it still stalls at about 15%. Has anyone had this issue? Can it be done from the terminal instead of through the browser? Every time I start the process it pins my cpu at 95 to 100% which is why it is probably stalling but not sure why.
My Config
----------------------------------
Ubuntu 8.1
1.5gb memory
Pentium 4 - 2.5ghz dual core
Koha 3.0
NoZebra
Basic LAMP install
Any thoughts would be great.
Thanks
Ed
Edward J. Roche
Network Administrator
Solanco School District
717.786.2151 x2437
"At the End of the Day, Did You Play to Win or Not to Lose?"
_______________________________________________ Koha mailing list Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
From the migration_tools directory I am running: perl bulkmarcimport.pl -file <file location> -n 1000 -commit 1000
And it keeps telling that it imported 0 marc records done. Any ideas? Thanks Ed Edward J. Roche Network Administrator Solanco School District 717.786.2151 x2437 "At the End of the Day, Did You Play to Win or Not to Lose?" -----Original Message----- From: savitra sirohi [mailto:savitra.sirohi@osslabs.biz] Sent: Friday, February 27, 2009 1:10 PM To: Roche III, Edward Cc: Doug Dearden; koha@lists.katipo.co.nz Subject: Re: [Koha] Staging of import stalls no need to stage them. Savitra Sirohi Nucsoft OSS Labs www.osslabs.biz On Fri, Feb 27, 2009 at 11:14 PM, Roche III, Edward <edward_roche@solanco.k12.pa.us> wrote:
If I use the perl script does that mean I don't have to stage them?
Thanks Ed
Edward J. Roche Network Administrator Solanco School District 717.786.2151 x2437
"At the End of the Day, Did You Play to Win or Not to Lose?"
-----Original Message----- From: Doug Dearden [mailto:dearden@sarsf.org] Sent: Friday, February 27, 2009 11:41 AM To: Roche III, Edward Cc: koha@lists.katipo.co.nz Subject: Re: [Koha] Staging of import stalls
Hi Ed,
I had the same problem. Take a look at the last import (Home > Tools > Manage Staged MARC Records > Batch
Figure out the last record in the batch that went in, then edit the import file you are using and remove the record immediately after that one in the file. It has some kind of problem. Try again and see if you get further. It is either that record, or the last one that actually worked, I can't remember exactly which.
Also, there is a command line tool that you can use to import. You will find it at /usr/share/koha/bin/migration_tools/bulkmarcimport.pl
From the migration tools subdirectory enter: perl bulkmarcimport.pl and you will get the syntax and parameter info. It has a test mode you can run against the file.
Best,
Doug
"Roche III, Edward" <edward_roche@solanco.k12.pa.us> 2/27/2009 9:20 AM >>> Good Morning All
I am trying stage my MARC import data but it keeps stalling. I broke it down into 4 individual files of about 4000 records each. But it still stalls at about 15%. Has anyone had this issue? Can it be done from the terminal instead of through the browser? Every time I start the process it pins my cpu at 95 to 100% which is why it is probably stalling but not sure why.
My Config
----------------------------------
Ubuntu 8.1
1.5gb memory
Pentium 4 - 2.5ghz dual core
Koha 3.0
NoZebra
Basic LAMP install
Any thoughts would be great.
Thanks
Ed
Edward J. Roche
Network Administrator
Solanco School District
717.786.2151 x2437
"At the End of the Day, Did You Play to Win or Not to Lose?"
_______________________________________________ Koha mailing list Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Ed, Try running in verbose mode (-v 2). Thanks, Savitra Sirohi Nucsoft OSS Labs www.osslabs.biz On Sat, Feb 28, 2009 at 3:07 AM, Roche III, Edward <edward_roche@solanco.k12.pa.us> wrote:
From the migration_tools directory I am running: perl bulkmarcimport.pl -file <file location> -n 1000 -commit 1000
And it keeps telling that it imported 0 marc records done.
Any ideas?
Thanks Ed
Edward J. Roche Network Administrator Solanco School District 717.786.2151 x2437
"At the End of the Day, Did You Play to Win or Not to Lose?"
-----Original Message----- From: savitra sirohi [mailto:savitra.sirohi@osslabs.biz] Sent: Friday, February 27, 2009 1:10 PM To: Roche III, Edward Cc: Doug Dearden; koha@lists.katipo.co.nz Subject: Re: [Koha] Staging of import stalls
no need to stage them.
Savitra Sirohi Nucsoft OSS Labs www.osslabs.biz
On Fri, Feb 27, 2009 at 11:14 PM, Roche III, Edward <edward_roche@solanco.k12.pa.us> wrote:
If I use the perl script does that mean I don't have to stage them?
Thanks Ed
Edward J. Roche Network Administrator Solanco School District 717.786.2151 x2437
"At the End of the Day, Did You Play to Win or Not to Lose?"
-----Original Message----- From: Doug Dearden [mailto:dearden@sarsf.org] Sent: Friday, February 27, 2009 11:41 AM To: Roche III, Edward Cc: koha@lists.katipo.co.nz Subject: Re: [Koha] Staging of import stalls
Hi Ed,
I had the same problem. Take a look at the last import (Home > Tools > Manage Staged MARC Records > Batch
Figure out the last record in the batch that went in, then edit the import file you are using and remove the record immediately after that one in the file. It has some kind of problem. Try again and see if you get further. It is either that record, or the last one that actually worked, I can't remember exactly which.
Also, there is a command line tool that you can use to import. You will find it at /usr/share/koha/bin/migration_tools/bulkmarcimport.pl
From the migration tools subdirectory enter: perl bulkmarcimport.pl and you will get the syntax and parameter info. It has a test mode you can run against the file.
Best,
Doug
"Roche III, Edward" <edward_roche@solanco.k12.pa.us> 2/27/2009 9:20 AM >>> Good Morning All
I am trying stage my MARC import data but it keeps stalling. I broke it down into 4 individual files of about 4000 records each. But it still stalls at about 15%. Has anyone had this issue? Can it be done from the terminal instead of through the browser? Every time I start the process it pins my cpu at 95 to 100% which is why it is probably stalling but not sure why.
My Config
----------------------------------
Ubuntu 8.1
1.5gb memory
Pentium 4 - 2.5ghz dual core
Koha 3.0
NoZebra
Basic LAMP install
Any thoughts would be great.
Thanks
Ed
Edward J. Roche
Network Administrator
Solanco School District
717.786.2151 x2437
"At the End of the Day, Did You Play to Win or Not to Lose?"
_______________________________________________ Koha mailing list Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
participants (2)
-
Roche III, Edward -
savitra sirohi