hello, I am working on setting up 2.0.0pre1. It installs fine and I am using the bulkmarcimport.pl script to import ~8,000 biblios in USMARC format from our old Winnebago system. So far so good. They seem to import fine. I can query the database and see the data. Now I seem to have 8,000 biblios, but no items. It seems that a biblio is a description of a possible book, but I actually need some items in my catalog to be able to check them in and out. Is this correct. Can someone give a brief explanation of the difference between a biblio, biblioitem, and item in the database and give me an idea of how I can actually convert those 8,000 biblios to books? Sorry, I'm a computer guy, not a library scientist.... but I'm learning ;-) Thanks in advance, Derek -- Derek Dresser http://network.gouldacademy.org/ Gould Academy Bethel, ME 04217 (207)824-7700 "Nothing endures but change" --Heraclitus ------------------------------------------------- This mail sent through IMP: http://horde.org/imp/
On Tue, Jul 08, 2003 at 03:37:51PM -0400, Derek Dresser said:
hello,
Hi Derek
I am working on setting up 2.0.0pre1. It installs fine and I am using the bulkmarcimport.pl script to import ~8,000 biblios in USMARC format from our old Winnebago system. So far so good. They seem to import fine. I can query the database and see the data.
Excellent sounds good so far :)
Now I seem to have 8,000 biblios, but no items. It seems that a biblio is a description of a possible book, but I actually need some items in my catalog to be able to check them in and out. Is this correct. Can someone give a brief explanation of the difference between a biblio, biblioitem, and item in the database and give me an idea of how I can actually convert those 8,000 biblios to books?
OK, here goes :) The way the koha orignal database was built was to separate data about say a book (or a video, or a serial etc) into 3 parts. To demonstrate, ill use The Return of the King (cos the premiere for the movie of this will be in wellington where i live :-)) 1/ biblio = which contains information such as title, subtitle, author, copyrightdate, abstract. And links to the bibliosubject and additionalauthors tables to hold subject information. You can see that information here http://hlt.katipo.co.nz/cgi-bin/koha/detail.pl?type=intra&bib=12180 Login:hdl pass:testing In the biblio box on the left. 2/ biblioitems, this is the next level down, and biblio can 'own' one or many biblioitems. Biblioitems hold information such as itemtype, dewey classification, publication date. We can see this more easily here http://hlt.katipo.co.nz/cgi-bin/koha/moredetail.pl?type=&item=&bib=12180&bi=13371 (where the group is what we call the biblioitem) or here http://hlt.katipo.co.nz/cgi-bin/koha/moredetail.pl?type=&item=&bib=12180&bi=28772 So in this example, we have one biblio, which has 2 biblioitems. now onto part 3 3/ Items Items hold item specific information, like which branch the item is at, how many times its been issued, replacement cost etc. http://hlt.katipo.co.nz/cgi-bin/koha/moredetail.pl?type=&item=&bib=12180&bi=28772 the thee boxes headed barcode are the items. So we have 1 biblio, with 2 biblioitems, 1 of which has 1 item, and one of which has 3 items.
Sorry, I'm a computer guy, not a library scientist.... but I'm learning ;-)
Me too :) Thats probably why it was done this way. It didnt make sense to us, to replicate information. IE we didnt want to have 2 biblios for the return of the king in this case, with the same author the same title, but the itemtype, and number of pages and classification being different. Or to have 4 items 3 of which contained a lot of the same stuff (all information about the F free fiction biblioitem) and one which contained the information about the talking book item. So this intermediate level, biblioitem was introduced. I hope this helps explain things a bit, if not, let me know and ill try and explain it better Chris -- Chris Cormack Programmer 027 4500 789 Katipo Communications Ltd chris@katipo.co.nz www.katipo.co.nz
Quoting Chris Cormack <chris@katipo.co.nz>:
On Tue, Jul 08, 2003 at 03:37:51PM -0400, Derek Dresser said:
hello,
Hi Derek
I am working on setting up 2.0.0pre1. It installs fine and I am using the
bulkmarcimport.pl script to import ~8,000 biblios in USMARC format from our
old Winnebago system. So far so good. They seem to import fine. I can query the database and see the data.
Excellent sounds good so far :)
Now I seem to have 8,000 biblios, but no items. It seems that a biblio is
a
description of a possible book, but I actually need some items in my catalog to be able to check them in and out. Is this correct. Can someone give a
brief explanation of the difference between a biblio, biblioitem, and item
in the database and give me an idea of how I can actually convert those 8,000 biblios to books?
OK, here goes :)
The way the koha orignal database was built was to separate data about say a book (or a video, or a serial etc) into 3 parts.
To demonstrate, ill use The Return of the King (cos the premiere for the movie of this will be in wellington where i live :-))
1/ biblio = which contains information such as title, subtitle, author, copyrightdate, abstract. And links to the bibliosubject and additionalauthors tables to hold subject information.
You can see that information here http://hlt.katipo.co.nz/cgi-bin/koha/detail.pl?type=intra&bib=12180 Login:hdl pass:testing
In the biblio box on the left.
2/ biblioitems, this is the next level down, and biblio can 'own' one or many biblioitems. Biblioitems hold information such as itemtype, dewey classification, publication date.
We can see this more easily here http://hlt.katipo.co.nz/cgi-bin/koha/moredetail.pl?type=&item=&bib=12180&bi=13371 (where the group is what we call the biblioitem) or here http://hlt.katipo.co.nz/cgi-bin/koha/moredetail.pl?type=&item=&bib=12180&bi=28772
So in this example, we have one biblio, which has 2 biblioitems.
now onto part 3
3/ Items Items hold item specific information, like which branch the item is at, how many times its been issued, replacement cost etc.
http://hlt.katipo.co.nz/cgi-bin/koha/moredetail.pl?type=&item=&bib=12180&bi=28772 the thee boxes headed barcode are the items.
So we have 1 biblio, with 2 biblioitems, 1 of which has 1 item, and one of which has 3 items.
Sorry, I'm a computer guy, not a library scientist.... but I'm learning ;-)
Me too :) Thats probably why it was done this way. It didnt make sense to us, to replicate information. IE we didnt want to have 2 biblios for the return of the king in this case, with the same author the same title, but the itemtype, and number of pages and classification being different. Or to have 4 items 3 of which contained a lot of the same stuff (all information about the F free fiction biblioitem) and one which contained the information about the talking book item.
So this intermediate level, biblioitem was introduced.
I hope this helps explain things a bit, if not, let me know and ill try and explain it better
Chris, This helps a lot. Let me just make sure I have it. A biblio is the general information about a publication, a biblioitem is a type of incarnation of a publication (book on tape, paperback, hardcover, first edition, etc.) and an item is an actual thing that can be checked out that fits one of those types. So you can obviously have multiple types, and then one or more instances of each type. That makes sense. Thanks. Now, during the import process of a bunch of USMARC records using bulkmarcimport.pl, should I expect my database to be populated with any items? After doing it, it seems that I get biblios and biblioitems, but no actual items. Just for fun I created a test "item" that matched one of my biblios and biblioitems, and then searched for it. It worked great an I got all the relevant info (bar code, etc). However, it is the only item in my whole database. ;-( I guess the real question is, "Is there enough information in a USMARC record to generate the item as well as the biblio and biblioitems, and should I expect bulkmarcimport.pl to do that?" I'd like to extract as much information as possible out of the Winnebago data. Basically, as far as I know, each USMARC record in the file represents an actual item in our library. Here is a small piece of the data file (about 4 or 5 records) if that helps clarify anything. Thanks again to everyone for your help and great work. FYI, We are hosting a 3 day Linux/Open Source seminar here at the school at the end of July and I'm giving one session on installing and configuring Koha. It is aimed at schools and libraries here in Maine. Should be fun. There's a little more info here if you're interested http://network.gouldacademy.org/ Thanks again. -Derek 00623pam 2200181 a 450000100130000000800410001302000150005405000210006908200140009010000350010424500860013926000660022530000260029150400650031765000300038285\ 2002300412961000600435^^ 85023778 ^^851129s1986 nyu b 00010 eng ^^ ^_a0025003402^^0 ^_aAZ221^_b.A35 1986^^0 ^_a001.2^_219^^10^_aAdler, Mortimer\ Jerome,^_d1902-^^12^_aA guidebook to learning :^_bfor a lifelong pursuit of wisdom /^_cMortimer J. Adler.^^0 ^_aNew York :^_bMacmillan ;^_aLondon :^_bCollier\ Macmillan,^_cc1986.^^ ^_axii, 163 p. ;^_c22 cm.^^ ^_a"Some books that may be helpful to autodidacts": p. 161-163.^^ 0^_aLearning and scholarship.^^1 ^_h001\ .2 Ad59g^_p10001^^WL^_t6^^^]00600pam 2200205 a 45000010013000000080041000130200022000540200022000760500024000980820017001221000020001392450064001592500012002\ 23260003800235300003500273504003900308650001600347852002500363961000600388^^ 84028794 ^^841231s1985 nyua b 00110 eng ^^ ^_a0716717174 (pbk.)^^ \ ^_a071671695X (hard)^^0 ^_aQA276.12^_b.M66 1985^^0 ^_a001.4/22^_219^^10^_aMoore, David S.^^10^_aStatistics :^_bconcepts and controversies /^_cDavid S. Moore.^\ ^ ^_a2nd ed.^^0 ^_aNew York :^_bW.H. Freeman,^_cc1985.^^ ^_axvii, 350 p. :^_bill. ;^_c24 cm.^^ ^_aIncludes bibliographies and index.^^ 0^_aStatistics.^^1 ^\ _h001.422 M782s^_p10002^^WL^_t6^^^]00737pam 2200217 i 4500001001300000008004100013020003000054020001300084050001400097082001200111100002300123245010400146260\ 005600250300002100306504005100327650003300378650002900411700004000440852003300480961000600513^^ 79065767 ^^790831s1980 cau b 00110 eng ^^ ^_a05\ 20040678 : ^_z0520039890^^ ^_a^_c$12.50^^0 ^_aH62^_b.G46^^ ^_a001.4/3^^10^_aGeorges, Robert A.^^10^_aPeople studying people :^_bthe human element in fieldwo\ rk /^_cRobert A. Georges and Michael O. Jones.^^0 ^_aBerkeley :^_bUniversity of California Press,^_cc1980.^^ ^_a178 p. ;^_c22 cm.^^ ^_aIncludes bibliographi\ cal references and index.^^ 0^_aSocial sciences^_xField work.^^ 0^_aInterpersonal relations.^^10^_aJones, Michael Owen,^_ejoint author.^^1 ^_9p12.50 ^_h001.43\ G295p^_p10003^^WL^_t6^^^]00986pam 2200265 a 4500001001600000008004100016020001500057050002100072082001800093100002100111245006500132260004500197300003400242\ 440002900276500002700305504003000332500002000362520017800382650004900560650002800609650002600637700002500663852002600688961000600714^^ 86008815 /AC^^860326s\ 1986 nyua j b 00110 eng ^^ ^_a0816014434^^0 ^_aP91.2^_b.F73 1986^^0 ^_a001.51/09^_219^^10^_aFranck, Irene M.^^10^_aCommunicators /^_cby Irene M. Fra\ nck and David M. Brownstone.^^0 ^_aNew York, N.Y. :^_bFacts on File,^_cc1986.^^ ^_axii, 228 p. :^_bill. ;^_c25 cm.^^ 0^_aWork throughout history.^^ ^_a"A Hu\ dson Group book."^^ ^_aBibliography: p. 217-220.^^ ^_aIncludes index.^^ ^_aExamines the role in history of the occupations involved with communication incl\ uding authors, scribes, clerks, editors, messengers, printers, journalists, and broadcasters.^^ 0^_aCommunication^_xHistory^_xJuvenile literature.^^ 1^_aCommu\ nication^_xHistory.^^ 1^_aOccupations^_xHistory.^^10^_aBrownstone, David M.^^1 ^_h001.5109 F847c^_p10004^^WL^_t6^^^]00795pam 2200253 a 4500001001300000008004\ 10001302000260005405000200008008200170010010000350011724500970015226000370024930000370028650400300032350000200035365000290037365000150040265000250041765000210\ 0442650002200463650001600485852003400501961000600535^^ 83046095 ^^850108s1985 nyua b 00110 eng ^^ ^_a0465045405 : ^_c$24.95^^0 ^_aQ335^_b.H63 19\ 85^^0 ^_a001.53/5^_219^^10^_aHofstadter, Douglas R.,^_d1945-^^10^_aMetamagical themas :^_bquesting for the essence of mind and pattern /^_cDouglas R. Hofstadt\ er.^^0 ^_aNew York :^_bBasic Books,^_cc1985.^^ ^_axxviii, 852 p. :^_bill. ;^_c24 cm.^^ ^_aBibliography: p. 802-819.^^ ^_aIncludes index.^^ 0^_aArtificial i\ ntelligence.^^ 0^_aIntellect.^^ 0^_aScience^_xPhilosophy.^^ 0^_aMetamathematics.^^ 0^_aSelf (Philosophy)^^ 0^_aAmusements.^^1 ^_9p24.95 ^_h001.535 H677m^_p100\ 05^^WL^_t6^^^]00672pam 2200217 a 4500001001300000008004100013020002600054050002000080082001700100100003600117245009200153250001200245260003700257300002700294\ 504003000321500002000351650002900371650001500400852003300415961000600448^^ 83022194 ^^831012s1984 mau b 00110 eng ^^ ^_a0316747300 : ^_c$14.95^\ ^0 ^_aQ335^_b.R58 1984^^0 ^_a001.53/5^_219^^10^_aRitchie, David,^_d1952 Sept. 18-^^14^_aThe binary brain :^_bartificial intelligence in the age of electronics\ /^_cDavid Ritchie.^^ ^_a1st ed.^^0 ^_aBoston :^_bLittle, Brown,^_cc1984.^^ ^_aviii, 212 p. ;^_c22 cm.^^ ^_aBibliography: p. 199-205.^^ ^_aIncludes index.\ ^^ 0^_aArtificial intelligence.^^ 0^_aComputers.^^1 ^_9p14.95 ^_h001.535 R51b^_p10006^^WL^_t6^^^]
Chris -- Chris Cormack Programmer 027 4500 789 Katipo Communications Ltd chris@katipo.co.nz www.katipo.co.nz
-- Derek Dresser http://network.gouldacademy.org/ Gould Academy Bethel, ME 04217 (207)824-7700 "Nothing endures but change" --Heraclitus ------------------------------------------------- This mail sent through IMP: http://horde.org/imp/
On Tue, Jul 08, 2003 at 11:40:14PM -0400, Derek Dresser said:
Chris,
This helps a lot. Let me just make sure I have it. A biblio is the general information about a publication, a biblioitem is a type of incarnation of a publication (book on tape, paperback, hardcover, first edition, etc.) and an item is an actual thing that can be checked out that fits one of those types. So you can obviously have multiple types, and then one or more instances of each type. That makes sense. Thanks.
Yep thats it :)
Now, during the import process of a bunch of USMARC records using bulkmarcimport.pl, should I expect my database to be populated with any items? After doing it, it seems that I get biblios and biblioitems, but no actual items. Just for fun I created a test "item" that matched one of my biblios and biblioitems, and then searched for it. It worked great an I got all the relevant info (bar code, etc). However, it is the only item in my whole database. ;-(
Hmm, ill have to defer to the more MARC savvy people on the list. But yes id expect you to get at least as many items as you got biblioitems on the import. Paul ... any ideas? [snip]
FYI, We are hosting a 3 day Linux/Open Source seminar here at the school at the end of July and I'm giving one session on installing and configuring Koha. It is aimed at schools and libraries here in Maine. Should be fun. There's a little more info here if you're interested http://network.gouldacademy.org/
Excellent that sounds great. Im sure we can figure out whats up with the import script before then. So you can do a succesful import. Chris -- Chris Cormack Programmer 027 4500 789 Katipo Communications Ltd chris@katipo.co.nz www.katipo.co.nz
On Wed, 9 Jul 2003, Chris Cormack wrote:
On Tue, Jul 08, 2003 at 11:40:14PM -0400, Derek Dresser said:
Now, during the import process of a bunch of USMARC records using bulkmarcimport.pl, should I expect my database to be populated with any items? After doing it, it seems that I get biblios and biblioitems, but no actual items. Just for fun I created a test "item" that matched one of my biblios and biblioitems, and then searched for it. It worked great an I got all the relevant info (bar code, etc). However, it is the only item in my whole database. ;-(
Hmm, ill have to defer to the more MARC savvy people on the list. But yes id expect you to get at least as many items as you got biblioitems on the import.
Paul ... any ideas?
Actually, this sounds like it's starting to bear on one of the conversations we're going to be covering tomorrow during the irc meeting. You're more than welcome to join in (and maybe you'll be able to help us hammer our the solution to a problem that's affecting a bunch of folks). If you're interested, we'll be meeting at 3PM EDT in the #koha channel of irc.koha.co.nz thanks, -pate
Chris Cormack wrote:
On Tue, Jul 08, 2003 at 11:40:14PM -0400, Derek Dresser said:
Chris,
This helps a lot. Let me just make sure I have it. A biblio is the general information about a publication, a biblioitem is a type of incarnation of a publication (book on tape, paperback, hardcover, first edition, etc.) and an item is an actual thing that can be checked out that fits one of those types. So you can obviously have multiple types, and then one or more instances of each type. That makes sense. Thanks.
Yep thats it :)
Now, during the import process of a bunch of USMARC records using bulkmarcimport.pl, should I expect my database to be populated with any items? After doing it, it seems that I get biblios and biblioitems, but no actual items. Just for fun I created a test "item" that matched one of my biblios and biblioitems, and then searched for it. It worked great an I got all the relevant info (bar code, etc). However, it is the only item in my whole database. ;-(
Hmm, ill have to defer to the more MARC savvy people on the list. But yes id expect you to get at least as many items as you got biblioitems on the import.
Paul ... any ideas?
Of course yes :-) If you want import to put items into items table, you have to tell Koha where are hidden your items in your MARC datas... Let me explain : Koha supports any MARC flavour. And each MARC flavour hides items in a different place (for example in UNIMARC, it's 995. For NPL, that uses MARC21, it's 952) * Go to parameter section of Koha, MARC parameters tables. * Search for the field where items are hidden (for example 947) * Open subfields of field 947. * "map" each 947 subfield to a items.something field. * Put each subfield you've mapped to tab "items". * go back to main parameter page * run "checkmarc". If it reports no errors, you've win. * import again, using delete flag to empty your database during the process. Hope This Helps Note : the main constraint is that all MARC subfields mapped to item field MUST be in the same field (you can't have a part of an item into 947 & 2nd part in 935). If you have, then the only solution is to "rewritte" your MARC data before importing. We have a problem with itemtypes, that is not in items in Koha but seems to have it's place in there, that's what we will speak during today IRC meeting. -- Paul POULAIN Consultant indépendant en logiciels libres responsable francophone de koha (SIGB libre http://www.koha-fr.org)
Chris Cormack wrote:
On Tue, Jul 08, 2003 at 11:40:14PM -0400, Derek Dresser said:
Chris,
This helps a lot. Let me just make sure I have it. A biblio is the general information about a publication, a biblioitem is a type of incarnation of a publication (book on tape, paperback, hardcover, first edition, etc.) and an item is an actual thing that can be checked out that fits one of those types. So you can obviously have multiple types, and then one or more instances of each type. That makes sense. Thanks.
Yep thats it :)
Now, during the import process of a bunch of USMARC records using bulkmarcimport.pl, should I expect my database to be populated with any items? After doing it, it seems that I get biblios and biblioitems, but no actual items. Just for fun I created a test "item" that matched one of my biblios and biblioitems, and then searched for it. It worked great an I got all the relevant info (bar code, etc). However, it is the only item in my whole database. ;-(
Hmm, ill have to defer to the more MARC savvy people on the list. But yes id expect you to get at least as many items as you got biblioitems on the import.
Paul ... any ideas?
Of course yes :-) If you want import to put items into items table, you have to tell Koha where are hidden your items in your MARC datas... Let me explain : Koha supports any MARC flavour. And each MARC flavour hides items in a different place (for example in UNIMARC, it's 995. For NPL, that uses MARC21, it's 952) * Go to parameter section of Koha, MARC parameters tables. * Search for the field where items are hidden (for example 947) * Open subfields of field 947. * "map" each 947 subfield to a items.something field. * Put each subfield you've mapped to tab "items". * go back to main parameter page * run "checkmarc". If it reports no errors, you've win. * import again, using delete flag to empty your database during the
Quoting paul POULAIN <paul.poulain@free.fr>: process.
Hope This Helps
Thanks, This helps a lot. I'm going to try and listen in on the IRC conversation this afternoon if I can make it. -Derek
Note : the main constraint is that all MARC subfields mapped to item field MUST be in the same field (you can't have a part of an item into 947 & 2nd part in 935). If you have, then the only solution is to "rewritte" your MARC data before importing. We have a problem with itemtypes, that is not in items in Koha but seems to have it's place in there, that's what we will speak during today IRC meeting.
-- Paul POULAIN Consultant indépendant en logiciels libres responsable francophone de koha (SIGB libre http://www.koha-fr.org)
-- Derek Dresser http://network.gouldacademy.org/ Gould Academy Bethel, ME 04217 (207)824-7700 "Nothing endures but change" --Heraclitus ------------------------------------------------- This mail sent through IMP: http://horde.org/imp/
participants (4)
-
Chris Cormack -
Derek Dresser -
Pat Eyler -
paul POULAIN