Hi, Just to add a little detail: The header row I used does not have any quotes (single or double) and ends like this: ,altcontactphone,smsalertnumber,patron_attributes In the actual borrower rows apart from the patron_attributes the only fields I enclosed in quotes were those that had a comma or an apostrophe. The rest have no quotes. The quotes I used were double quotes. Some examples snipped that do not invade privacy: ...,"O'Connor",Anna,,,,,,... ...,Cosham,Portsmouth,"Hants, PO6 2PZ",,... ...,Sevenoaks,TN14 7AG,... ...,EXP,23/11/1999,,,,0,,,,,NOTE: LEFT 2000,,,... ...,,"SID:O'S98001234","DEPARTMENT:C&F","COURSE:M80" So the patron_attributes appear as separate "fields" on the end and are not grouped in quotes as a single item. I hope that helps... Ian On 08/11/2010 14:52, Ian Bays wrote:
Hi Linda, On recent borrower import using the staff-client interface I found that the following formatting worked for patron-attributes:
,,,"SID:EVE99001234","COURSE:M7","DEPARTMENT:LIBRARY"
Although the staff interface loader usually gives good diagnostics I found there were some problems with data that failed silently (wish I could remember which) so I now often prepare borrower data as sql for loading mimicking the format of data from mysqldump.
Ian
On 08/11/2010 14:28, Linda Culberson wrote:
Sorry, I just *thought* it was solved. The patrons loaded but the patron attributes did not. So there is still a problem.
On 11/5/2010 11:25 AM, Linda Culberson wrote:
I think I've got it now. It seems that it didn't like the single quotes in the header nor the double quotes in the patron-attributes field
On 1:59 PM, Linda Culberson wrote:
I'm having trouble bulk loading patrons files into Koha 3.2. I used the same file I used in 3.1 with no success, so I did one manually, and then set everything to match that. I got the same errors in 3.2. both times: In the staff client, I get that the record was " not imported because they are not in the expected format" and then Critical field "surname" missing (borrowernumber: UNDEF; surname: UNDEF). I have headerrow copied from the "Import Patrons" page: 'surname', 'firstname', 'title', 'othernames', 'initials', 'streetnumber', 'streettype', 'address', 'address2', 'city', 'zipcode', 'country', 'email', 'phone', 'mobile', 'fax', 'emailpro', 'phonepro', 'B_streetnumber', 'B_streettype', 'B_address', 'B_address2', 'B_city', 'B_zipcode', 'B_country', 'B_email', 'B_phone', 'dateofbirth', 'branchcode', 'categorycode', 'dateenrolled', 'dateexpiry', 'gonenoaddress', 'lost', 'debarred', 'contactname', 'contactfirstname', 'contacttitle', 'guarantorid', 'borrowernotes', 'relationship', 'ethnicity', 'ethnotes', 'sex', 'password', 'flags', 'userid', 'opacnote', 'contactnote', 'sort1', 'sort2', 'altcontactfirstname', 'altcontactsurname', 'altcontactaddress1', 'altcontactaddress2', 'altcontactaddress3', 'altcontactzipcode', 'altcontactcountry', 'altcontactphone', 'smsalertnumber', 'privacy', 'patron_attributes' My record is: 'Crawford', 'Taz', '', 'Tazmo', '', '', '', '150 Our Street', '', 'Yazoo City, MS', '39194', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', 'DAH', '01', '11/05/2010', '11/05/2011', '', '', '', '', '', '', '', '', '', '', '', '', 'Tazmo', '', '11111', '', '', '', '', '', '', '', '', '', '', '', '', '', '1', 'CountyCode:yz,PhotoID:Tx VetId 0042201,StateCode:01'
In the /var/log/koha/koha-error_log [Fri Nov 05 09:56:43 2010] [error] [client 10.8.5.33] [Fri Nov 5 09:56:43 2010] import_borrowers.pl: Use of uninitialized value $keycol in substitution (s///) at /usr/share/koha/intranet/cgi-bin/tools/import_borrowers.pl line 124, <fh00001mytest.csv> line 1., referer: http://koha.mdah.state.ms.us:8080/cgi-bin/koha/tools/import_borrowers.pl [Fri Nov 05 09:56:43 2010] [error] [client 10.8.5.33] [Fri Nov 5 09:56:43 2010] import_borrowers.pl: Use of uninitialized value $keycol in hash element at /usr/share/koha/intranet/cgi-bin/tools/import_borrowers.pl line 125, <fh00001mytest.csv> line 1., referer: http://koha.mdah.state.ms.us:8080/cgi-bin/koha/tools/import_borrowers.pl [Fri Nov 05 09:56:43 2010] [error] [client 10.8.5.33] [Fri Nov 5 09:56:43 2010] import_borrowers.pl: Use of uninitialized value $csvcolumns[0] in join or string at /usr/share/koha/intranet/cgi-bin/tools/import_borrowers.pl line 133, <fh00001mytest.csv> line 1., referer: http://koha.mdah.state.ms.us:8080/cgi-bin/koha/tools/import_borrowers.pl
So I looked at import_borrowers.pl and those lines are 122 foreach my $keycol (@csvcolumns) { 123 # columnkeys don't contain whitespace, but some stupid tools add it 124 $keycol =~ s/ +//g; 125 $csvkeycol{$keycol} = $col++; 126 } 127 #warn($borrowerline); 128 my $ext_preserve = $input->param('ext_preserve') || 0; 129 if ($extended) { 130 $matchpoint_attr_type = C4::Members::AttributeTypes->fetch($matchpoint); 131 } 132 133 push @feedback, {feedback=>1, name=>'headerrow', value=>join(', ', @csvcolumns)};
Any help would be appreciated.
-- Ian Bays Director of Projects PTFS Europe.com mobile: +44 (0) 7774995297 phone: +44 (0) 800 756 6803 skype: ian.bays email: ian.bays@ptfs-europe.com