Springer E-Books Marc File and MarcEditor and MRC formatting issues
Dear All, Springer has provided me with a .bin file. This file has marc21 data in it and when I stage it into Koha it works fine. However I have to modify this marc file and add fields or edit fields using the [MarcEditor] tool. Now the problem is, in order to read it correctly INSIDE the MARCEDITOR, i change the extension from .BIN to .MRC This is ok up to the loading of the data into the MARC Editor. Now, I added some new fields as well as I have edited some fields. Now the issue is here. ------------ After adding/editing fields in this file, I SAVE as MRC. When I try to load this NEW marc file into KOHA using Staging, it does not go through and it says NaN error. I am not sure what to do now. I am using Koha 3.0. Best Regards, On Wed, Apr 21, 2010 at 8:37 AM, Susan Mustafa <susan.mustafa@gmail.com>wrote:
Dear Stacy,
At the moment, I did an import of the 14,000 records MARC file into Koha-Test.
I did a rebuild_zeba -r -a -b <-- I believe this clears all of the previous indexes and does indexing from 0.
Now, I know that there is a record called [Extreme Sports]. This record is from Springer, and it is shown under biblios table in MySQL Db after I finished importing the Marc file into Koha. However once rebuilding zebra, searching for this record returns 0.
Some springer records are searchable, but others Koha can't find. Does this mean that Zebra didn't index them [I see no errors when I do rebuild] OR does this mean that something else is wrong?
I did random checking of some records, obviously there is no way for me to check and see that all 14,000 RECORDs were indexed and Searchable? OR is there? You know this better than me.
Kindly bear with me on this. I might need your help since you did the Springer Import before.
Best Regards,
Now once I go into the MySQL DB, I see that the record for example [Extreme Sports] exists
On Tue, Mar 9, 2010 at 12:35 AM, Stacy Pober <stacy.pober@manhattan.edu>wrote:
I loaded about 17,000 Springer ebooks into our catalog. I did not directly upload them into Koha, though. First, I edited them in the free MarcEdit program to add some fields.
We use EZproxy to allow our users to access IP-restricted resources from off-campus. If you use something similar, you would use the Edit Subfield Data function to alter the 856$u data. You would replace "http: with something like "http:ezproxy.yourlibrary.edu:2048/login?url=http:"
Additionally, the Springer ebook MARC records do not come with any custom link text. We added custom link text by adding an 856$y field. with the text "Available for our library via Springer eBooks. Click here for access". The custom link text is often provided in an 856$w field rather than the $y field, and the $w and $y but they seem to display exactly the same in our catalog, so if you get other vendor-supplied records with 845$w fields, you don't need to change them unless you want to customize the link text.
We also add a 952 field to specify the branchcode, ITYPE, shelving location and CCODE: \\$aMAN$bMAN$cEBOOKS$oELECTRONIC BOOKS$yEBOOKS$8EBOOKS
The branch code needed to be added because without it, each ebook appeared in Koha with messages about availability that we did not want to see. Adding the ITYPE allowed us to add a "View this eBook" link to each summary record which is a nice convenience for end-users.
We also add a 500$a field which lists the ebook service name (Springer eBooks) because that's the standard way we've been listing all other ebook packages (not all of the vendors have the package name anywhere in the record) and a 099$a field for Local Call Number of ELECTRONIC BOOKS because that's the way our other ebooks have always been listed.
You may not need or want this level of customization, but it's nice to know it's available.
When I first tried to upload the Springer records, I could not upload them in one step. Our catalog is hosted by LibLime and at the time I processed these records (a couple of months ago), the server response time was very slow and it would time out for large uploads. This was the only batch of MARC records I had that was quite so large, and I had to split the 17,000 records into batches of about 1500 records. I don't know if there is any effective limit on file size for uploads in the official version of Koha.
The processing of the initial file of the large Springer ebook record set was tedious but routine. However, Springer issues updated record sets for books they add to your subscription each month, and I am currently trying to work through some problems in the December update file. The monthly updates come in separate files for each publication year. We get five years of books, and rather than having to process them separately, I used MarcJoin in MarcEdit to concatenate them into one large file. This did not work, because it turned out there were some invalid characters in two of the records that caused errors in the joined file. I'm still working through that. The individual files validate correctly using the validator in MarcEdit, so I need to find a 'pickier' MARC validator to find the invalid characters.
One more thing about ebook MARC records generally: I find that the quality of publisher-supplied MARC records is very variable. One problem we ran into with the MARC record sets for netLibrary and a couple of other vendors is that some of the records included multiple $856$u fields with URL's leading to other subscription-based online services to which we have no access. I had to find those bad URLs and strip them out of our records, and that was a little tedious. -- Stacy Pober Information Alchemist Riverdale, NY 10471 stacy.pober@manhattan.edu
I forgot to add an example of the first-file data[the .bin] file from Springer and the data after I convert using MarcEditor and Koha can't read it. ========BEGINNING ====Works======= 02417cam 2200577Ia 4500001001300000003000600013005001700019006001900036007000700055008004100062040003600103020001800139020001500157029002200172029001800194029002200212035002100234037006100255050002500316060001500341060002400356072001300380082001800393049000900411100004800420245020700468260003400675300007400709533024300783504005101026650002501077650002801102650002101130650003001151650002801181650003901209650001901248650004001267650002401307650002401331650002801355650001701383655002901400700002201429776007601451710003401527856014301561856008101704938004001785994001401825 ocn184903927 OCoLC 20100416100144.0 m d cr cn| 071219s2007 nyuacf sb 001 0 eng d aGW5XE cGW5XE dGW5XE dYDXCP dTEX a9780387465265 a038746526X 1 aAU@ b000042133518 1 aNZ1 b11675905 1 aAU@b000043253015 a(OCoLC)184903927 a978-0-387-28223-7 bSpringer nhttp:// www.springerlink.com 14 aQP368.7 b.K37 2007eb 14 a2006 N-753 14 aWL 102.8 bK18e 2007 7 aQP 2lcco 04 a612.8/042 222 aMSDA 1 aKarczmar, A. G. q(Alexander George), d1918- 10 aExploring the vertebrate central cholinergic nervous system h[electronic resource] / cAlexander G. Karczmar ; with contributions by Neelima Chauhan ... [et al.] ; with a foreword ..............................................etc etc etc [Read by *NOTEPAD *] =========END AFTER SAVE AS .mrc =============Koha can't load it=====Nan error========= =LDR 02417cam 2200577Ia 4500 =001 ocn184903927 =003 OCoLC =005 20100416100144.0 =006 m\\\\\\\\d\\\\\\\\ =007 cr\cn| =008 071219s2007\\\\nyuacf\\sb\\\\001\0\eng\d =040 \\$aGW5XE$cGW5XE$dGW5XE$dYDXCP$dTEX =020 \\$a9780387465265 =020 \\$a038746526X =029 1\$aAU@$b000042133518 =029 1\$aNZ1$b11675905 =029 1\$aAU@$b000043253015 =035 \\$a(OCoLC)184903927 =037 \\$a978-0-387-28223-7$bSpringer$nhttp://www.springerlink.com =050 14$aQP368.7$b.K37 2007eb =060 14$a2006 N-753 =060 14$aWL 102.8$bK18e 2007 =072 \7$aQP$2lcco =082 04$a612.8/042$222 etc etc etc Please help, I am stuck at the moment.... On Thu, Apr 22, 2010 at 9:28 AM, Susan Mustafa <susan.mustafa@gmail.com>wrote:
Dear All,
Springer has provided me with a .bin file. This file has marc21 data in it and when I stage it into Koha it works fine.
However I have to modify this marc file and add fields or edit fields using the [MarcEditor] tool.
Now the problem is, in order to read it correctly INSIDE the MARCEDITOR, i change the extension from .BIN to .MRC
This is ok up to the loading of the data into the MARC Editor.
Now, I added some new fields as well as I have edited some fields. Now the issue is here.
------------ After adding/editing fields in this file, I SAVE as MRC.
When I try to load this NEW marc file into KOHA using Staging, it does not go through and it says NaN error.
I am not sure what to do now.
I am using Koha 3.0.
Best Regards,
On Wed, Apr 21, 2010 at 8:37 AM, Susan Mustafa <susan.mustafa@gmail.com>wrote:
Dear Stacy,
At the moment, I did an import of the 14,000 records MARC file into Koha-Test.
I did a rebuild_zeba -r -a -b <-- I believe this clears all of the previous indexes and does indexing from 0.
Now, I know that there is a record called [Extreme Sports]. This record is from Springer, and it is shown under biblios table in MySQL Db after I finished importing the Marc file into Koha. However once rebuilding zebra, searching for this record returns 0.
Some springer records are searchable, but others Koha can't find. Does this mean that Zebra didn't index them [I see no errors when I do rebuild] OR does this mean that something else is wrong?
I did random checking of some records, obviously there is no way for me to check and see that all 14,000 RECORDs were indexed and Searchable? OR is there? You know this better than me.
Kindly bear with me on this. I might need your help since you did the Springer Import before.
Best Regards,
Now once I go into the MySQL DB, I see that the record for example [Extreme Sports] exists
On Tue, Mar 9, 2010 at 12:35 AM, Stacy Pober <stacy.pober@manhattan.edu>wrote:
I loaded about 17,000 Springer ebooks into our catalog. I did not directly upload them into Koha, though. First, I edited them in the free MarcEdit program to add some fields.
We use EZproxy to allow our users to access IP-restricted resources from off-campus. If you use something similar, you would use the Edit Subfield Data function to alter the 856$u data. You would replace "http: with something like "http:ezproxy.yourlibrary.edu:2048/login?url=http:"
Additionally, the Springer ebook MARC records do not come with any custom link text. We added custom link text by adding an 856$y field. with the text "Available for our library via Springer eBooks. Click here for access". The custom link text is often provided in an 856$w field rather than the $y field, and the $w and $y but they seem to display exactly the same in our catalog, so if you get other vendor-supplied records with 845$w fields, you don't need to change them unless you want to customize the link text.
We also add a 952 field to specify the branchcode, ITYPE, shelving location and CCODE: \\$aMAN$bMAN$cEBOOKS$oELECTRONIC BOOKS$yEBOOKS$8EBOOKS
The branch code needed to be added because without it, each ebook appeared in Koha with messages about availability that we did not want to see. Adding the ITYPE allowed us to add a "View this eBook" link to each summary record which is a nice convenience for end-users.
We also add a 500$a field which lists the ebook service name (Springer eBooks) because that's the standard way we've been listing all other ebook packages (not all of the vendors have the package name anywhere in the record) and a 099$a field for Local Call Number of ELECTRONIC BOOKS because that's the way our other ebooks have always been listed.
You may not need or want this level of customization, but it's nice to know it's available.
When I first tried to upload the Springer records, I could not upload them in one step. Our catalog is hosted by LibLime and at the time I processed these records (a couple of months ago), the server response time was very slow and it would time out for large uploads. This was the only batch of MARC records I had that was quite so large, and I had to split the 17,000 records into batches of about 1500 records. I don't know if there is any effective limit on file size for uploads in the official version of Koha.
The processing of the initial file of the large Springer ebook record set was tedious but routine. However, Springer issues updated record sets for books they add to your subscription each month, and I am currently trying to work through some problems in the December update file. The monthly updates come in separate files for each publication year. We get five years of books, and rather than having to process them separately, I used MarcJoin in MarcEdit to concatenate them into one large file. This did not work, because it turned out there were some invalid characters in two of the records that caused errors in the joined file. I'm still working through that. The individual files validate correctly using the validator in MarcEdit, so I need to find a 'pickier' MARC validator to find the invalid characters.
One more thing about ebook MARC records generally: I find that the quality of publisher-supplied MARC records is very variable. One problem we ran into with the MARC record sets for netLibrary and a couple of other vendors is that some of the records included multiple $856$u fields with URL's leading to other subscription-based online services to which we have no access. I had to find those bad URLs and strip them out of our records, and that was a little tedious. -- Stacy Pober Information Alchemist Riverdale, NY 10471 stacy.pober@manhattan.edu
Dear All, Springer has provided me with a .bin file. This file has marc21 data in it and when I stage it into Koha it works fine. However I have to modify this marc file and add fields or edit fields using the [MarcEditor] tool. Now the problem is, in order to read it correctly INSIDE the MARCEDITOR, i change the extension from .BIN to .MRC This is ok up to the loading of the data into the MARC Editor. Now, I added some new fields as well as I have edited some fields. Now the issue is here. ------------ After adding/editing fields in this file, I SAVE as MRC. When I try to load this NEW marc file into KOHA using Staging, it does not go through and it says NaN error. I am not sure what to do now. I am using Koha 3.0. I forgot to add an example of the first-file data[the .bin] file from Springer and the data after I convert using MarcEditor and Koha can't read it. ========BEGINNING ====Works======= 02417cam 2200577Ia 4500001001300000003000600013005001700019006001900036007000700055008004100062040003600103020001800139020001500157029002200172029001800194029002200212035002100234037006100255050002500316060001500341060002400356072001300380082001800393049000900411100004800420245020700468260003400675300007400709533024300783504005101026650002501077650002801102650002101130650003001151650002801181650003901209650001901248650004001267650002401307650002401331650002801355650001701383655002901400700002201429776007601451710003401527856014301561856008101704938004001785994001401825 ocn184903927 OCoLC 20100416100144.0 m d cr cn| 071219s2007 nyuacf sb 001 0 eng d aGW5XE cGW5XE dGW5XE dYDXCP dTEX a9780387465265 a038746526X 1 aAU@ b000042133518 1 aNZ1 b11675905 1 aAU@b000043253015 a(OCoLC)184903927 a978-0-387-28223-7 bSpringer nhttp:// www.springerlink.com 14 aQP368.7 b.K37 2007eb 14 a2006 N-753 14 aWL 102.8 bK18e 2007 7 aQP 2lcco 04 a612.8/042 222 aMSDA 1 aKarczmar, A. G. q(Alexander George), d1918- 10 aExploring the vertebrate central cholinergic nervous system h[electronic resource] / cAlexander G. Karczmar ; with contributions by Neelima Chauhan ... [et al.] ; with a foreword ..............................................etc etc etc [Read by *NOTEPAD *] =========END AFTER SAVE AS .mrc =============Koha can't load it=====Nan error========= =LDR 02417cam 2200577Ia 4500 =001 ocn184903927 =003 OCoLC =005 20100416100144.0 =006 m\\\\\\\\d\\\\\\\\ =007 cr\cn| =008 071219s2007\\\\nyuacf\\sb\\\\001\0\eng\d =040 \\$aGW5XE$cGW5XE$dGW5XE$dYDXCP$dTEX =020 \\$a9780387465265 =020 \\$a038746526X =029 1\$aAU@$b000042133518 =029 1\$aNZ1$b11675905 =029 1\$aAU@$b000043253015 =035 \\$a(OCoLC)184903927 =037 \\$a978-0-387-28223-7$bSpringer$nhttp://www.springerlink.com =050 14$aQP368.7$b.K37 2007eb =060 14$a2006 N-753 =060 14$aWL 102.8$bK18e 2007 =072 \7$aQP$2lcco =082 04$a612.8/042$222 etc etc etc Please help, I am stuck at the moment....
participants (1)
-
Susan Mustafa