Import of .KOC file into Koha 17.11 hangs
Hello, Using a fresh install of Koha 17.11.00 (from Debian packages) I have successfully loaded our patron data, our catalog and our items. However when I try to import an offline circulation (.koc) file, nothing happens. The progress bar sits at 0% and nothing is imported. In the past I have successfully imported a .koc file with an identical format into Koha 17.05. Has the .koc file format changed for 17.11 perhaps? Is there some way to get a more detailed view of what is (or isn't) happening? In case it helps, here are the first few lines from the file: Version=1.0 2016-03-30 12:00:00 000 issue 000785874 1353 2017-07-19 12:00:00 000 issue 033089669 1498 2017-07-19 12:00:00 000 issue 033062620 3251 Thanks for any help you're able to give, Chris Brown
Excerpts from Chris Brown's message of 2017-12-27 17:03:17 +0000:
Using a fresh install of Koha 17.11.00 (from Debian packages) I have successfully loaded our patron data, our catalog and our items. However when I try to import an offline circulation (.koc) file, nothing happens. The progress bar sits at 0% and nothing is imported.
I just tried this with a six-entry .koc file on a test installation of 17.11.00 in a VM and it seemed to work. The progress bar did stay at 0% for a lengthy period, maybe 15 seconds, which was a little alarming. During that time, the VM seemed quite CPU-bound and I couldn't ssh into it; this might be due to the fact that the VM had only 1 GB of RAM. But eventually it did complete and reported that "your data was processed" along with a list of the processed items. Here's what my test file looked like, in case that might help. Note that there are tabs separating the fields, not spaces. Note also that this file was generated by a script I wrote to convert a Mandarin loan report to .koc, hence the funny looking timestamps. Version=1.0 Generator=pdf2koc.rb GeneratorVersion=0.1 2017-08-05 12:30:00 0 issue R7306 RPL24055 2015-07-09 12:30:00 1 issue R1786 RPL26855 2017-07-25 12:30:00 2 issue R1786 RPL22690 2017-08-01 12:30:00 3 issue R1786 RPL24021 2017-08-01 12:30:00 4 issue R1786 RPL23969 2017-08-01 12:30:00 5 issue R1786 RPL28030
Hi Mark, Thanks for your reply. After some random experimentation I finally got this to work. The problem seemed to be related to just one entry in the .koc file relating to a book that was issued way back on 2016-03-30. All the other books in the file were issued within the last few weeks. Without this entry the file imports OK, but a .koc file containing just this one line causes the import to hang, with CPU usage hovering around 80%. I suspect it might be the fines calculation that goes into a sulk somehow, though I have no real evidence to support that. Panic over. Our system goes live on Wednesday; fingers crossed ... Best Regards, Chris Brown On Thu, Dec 28, 2017 at 2:34 PM, Mark Alexander <marka@pobox.com> wrote:
Excerpts from Chris Brown's message of 2017-12-27 17:03:17 +0000:
Using a fresh install of Koha 17.11.00 (from Debian packages) I have successfully loaded our patron data, our catalog and our items. However when I try to import an offline circulation (.koc) file, nothing happens. The progress bar sits at 0% and nothing is imported.
I just tried this with a six-entry .koc file on a test installation of 17.11.00 in a VM and it seemed to work. The progress bar did stay at 0% for a lengthy period, maybe 15 seconds, which was a little alarming. During that time, the VM seemed quite CPU-bound and I couldn't ssh into it; this might be due to the fact that the VM had only 1 GB of RAM. But eventually it did complete and reported that "your data was processed" along with a list of the processed items.
Here's what my test file looked like, in case that might help. Note that there are tabs separating the fields, not spaces. Note also that this file was generated by a script I wrote to convert a Mandarin loan report to .koc, hence the funny looking timestamps.
Version=1.0 Generator=pdf2koc.rb GeneratorVersion=0.1 2017-08-05 12:30:00 0 issue R7306 RPL24055 2015-07-09 12:30:00 1 issue R1786 RPL26855 2017-07-25 12:30:00 2 issue R1786 RPL22690 2017-08-01 12:30:00 3 issue R1786 RPL24021 2017-08-01 12:30:00 4 issue R1786 RPL23969 2017-08-01 12:30:00 5 issue R1786 RPL28030 _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Good trouble-shooting, Chris. Please file this as a bug -- https://bugs.koha-community.org/bugzilla3/enter_bug.cgi?product=Koha The Component should be 'Circulation', Version: 17.11 Use a pithy descriptive summary field, then put in a description of how to re-create the problem into the description field. Thanks! --Barton On Thu, Dec 28, 2017 at 10:55 AM, Chris Brown <chris@stayawake.co.uk> wrote:
Hi Mark,
Thanks for your reply. After some random experimentation I finally got this to work. The problem seemed to be related to just one entry in the .koc file relating to a book that was issued way back on 2016-03-30. All the other books in the file were issued within the last few weeks. Without this entry the file imports OK, but a .koc file containing just this one line causes the import to hang, with CPU usage hovering around 80%. I suspect it might be the fines calculation that goes into a sulk somehow, though I have no real evidence to support that. Panic over. Our system goes live on Wednesday; fingers crossed ...
Best Regards,
Chris Brown
On Thu, Dec 28, 2017 at 2:34 PM, Mark Alexander <marka@pobox.com> wrote:
Excerpts from Chris Brown's message of 2017-12-27 17:03:17 +0000:
Using a fresh install of Koha 17.11.00 (from Debian packages) I have successfully loaded our patron data, our catalog and our items. However when I try to import an offline circulation (.koc) file, nothing happens. The progress bar sits at 0% and nothing is imported.
I just tried this with a six-entry .koc file on a test installation of 17.11.00 in a VM and it seemed to work. The progress bar did stay at 0% for a lengthy period, maybe 15 seconds, which was a little alarming. During that time, the VM seemed quite CPU-bound and I couldn't ssh into it; this might be due to the fact that the VM had only 1 GB of RAM. But eventually it did complete and reported that "your data was processed" along with a list of the processed items.
Here's what my test file looked like, in case that might help. Note that there are tabs separating the fields, not spaces. Note also that this file was generated by a script I wrote to convert a Mandarin loan report to .koc, hence the funny looking timestamps.
Version=1.0 Generator=pdf2koc.rb GeneratorVersion=0.1 2017-08-05 12:30:00 0 issue R7306 RPL24055 2015-07-09 12:30:00 1 issue R1786 RPL26855 2017-07-25 12:30:00 2 issue R1786 RPL22690 2017-08-01 12:30:00 3 issue R1786 RPL24021 2017-08-01 12:30:00 4 issue R1786 RPL23969 2017-08-01 12:30:00 5 issue R1786 RPL28030 _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
participants (3)
-
Barton Chittenden -
Chris Brown -
Mark Alexander