[Koha] Error when staging MARC records for import

[Pedro Amorim]

Hey,

I finally solved it, turns out my mappings were incorrect. I only now
started working with MARC and library software/terms. The error log
messages didn't help me at all, quite the opposite, ended up actually
misleading me in solving this issue. Also the fact that it shows the
message "no records have errors" and/or the loading bar not progressing is
quite confusing.

TL;DR:
- Errors logged have nothing to do with the problem, they still log despite
the fact the import is successfull;

Thanks,

Pedro

2015-11-01 17:28 GMT-01:00 Pedro Amorim <pjamorim91 at gmail.com>:

> Hello,
>
> Update:
> I came across a sample .mrc online with 1 record and imported it into my
> installation, went fine with no errors logged.
>
> After that I compared the mime type of that file and the one I have for
> import. I noticed the one that I imported successfully is application/marc
> whereas my original .mrc file is application/octet-stream.
>
> Can this be the cause?
>
> If so, how can I solve it? The .mrc file I'm using was generated by
> MARCEdit.
>
> Thanks,
>
> Pedro
>
>
> 2015-11-01 15:42 GMT-01:00 Pedro Amorim <pjamorim91 at gmail.com>:
>
>> Hello Katrin,
>>
>> Thank you for your reply!
>>
>> The errors logged happen at the exact time I click "Stage for import"
>> that's why I think they are relevant.
>>
>> The marcflavour of my installation is unimarc. Installed using
>> --marcflavour unimarc and picking unimarc in the installation steps. I know
>> for a fact this is correct and working because indexing of new catalogued
>> items works fine.
>>
>> I'm using version 3.20, the file i'm trying to import has around 14k
>> records and all of them have citation set to "null", and the batch import
>> doesn't go further than 0%.
>> NOTE: Trying to import the exact same .mrc file in the online demo it
>> get's stuck at 32%.
>>
>> Here's an example of a record from the .mrk file before compiling it into
>> MARC (.mrc) using MARCEdit:
>>
>> =LDR  003070000000001690004500
>> =967  11246
>> =968  21
>> =200  <Um> caprico da natureza
>> =700  Gordimer, Nadine
>> =225  Ficção Universal
>> =103  am
>> =675  821.111
>> =101  por
>> =966  821.111(68)-31 GOR.
>> =965  BPAAH
>> =995    $6$bBMPenela$f$k$r
>> =990    $c
>>
>> Thanks,
>>
>> Pedro
>>
>> 2015-11-01 9:39 GMT-01:00 Katrin Fischer <Katrin.Fischer.83 at web.de>:
>>
>>> Hi Pedro,
>>>
>>> I am not sure the warnings in the logs are related to the problems you
>>> describe.
>>>
>>> The citation column would normally be filled from 245 (MARC21) or 200
>>> (UNIMARC) from your imported records. Have you checked that your records
>>> are valid and match the MARC flavor of your installation?
>>>
>>> I think there is an existing bug about the status bar display. Which
>>> version are you using?
>>>
>>> Can you share a record that has not imported correctly?
>>>
>>> Hope this helps,
>>>
>>> Katrin
>>>
>>> Am 31.10.2015 um 14:21 schrieb Pedro Amorim:
>>> > Hello,
>>> >
>>> > I have been banging my head with this problem for the past couple of
>>> days
>>> > now and I have no idea what might be causing it.
>>> >
>>> > When I upload the .mrc file with the records to import all goes fine
>>> but
>>> > when I press "Stage for import" it stays at 0% for a while, then fills
>>> the
>>> > logs with errors (see below) and after that it goes to "manage staged
>>> > records" as if everything went fine. It lists how many records were
>>> staged
>>> > and 0 errors found.
>>> >
>>> > However, my imported records don't seem right:
>>> > - The "citation" column is null for every record;
>>> > - Some MARC fields don't seem to have been imported;
>>> >
>>> > I'm not sure if the problem is with the .mrc file or my Koha
>>> installation,
>>> > or both.
>>> >
>>> > I've been focusing on the "binmode() on closed filehandle STDOUT"
>>> message,
>>> > changing permissions in files, changing owners, changing the file
>>> > permission before uploading it, but nothing.
>>> >
>>> > Error stack:
>>> > [Sat Oct 31 13:06:24 2015] [error] [client 10.11.5.52] [Sat Oct 31
>>> 13:06:24
>>> > 2015] stage-marc-import.pl: binmode() on closed filehandle STDOUT at
>>> > /usr/share/koha/lib/C4/Templates.pm line 122., referer:
>>> > http://10.13.54.70:8086/cgi-bin/koha/tools/stage-marc-import.pl
>>> > [Sat Oct 31 13:06:24 2015] [error] [client 10.11.5.52] [Sat Oct 31
>>> 13:06:24
>>> > 2015] stage-marc-import.pl: Filehandle STDOUT reopened as FH only for
>>> input
>>> > at /usr/lib/perl5/Template/Provider.pm line 965., referer:
>>> > http://10.13.54.70:8086/cgi-bin/koha/tools/stage-marc-import.pl
>>> >
>>> > Thanks,
>>> >
>>> > Pedro Amorim
>>> > _______________________________________________
>>> > Koha mailing list  http://koha-community.org
>>> > Koha at lists.katipo.co.nz
>>> > https://lists.katipo.co.nz/mailman/listinfo/koha
>>> >
>>>
>>> _______________________________________________
>>> Koha mailing list  http://koha-community.org
>>> Koha at lists.katipo.co.nz
>>> https://lists.katipo.co.nz/mailman/listinfo/koha
>>>
>>
>>
>