Records missing from data export
I'm preparing to help a library switch to Koha over the next few months. In testing the "Export data" tool today, I discovered that 2 of the 4 bibliographic entries are missing from the export. (The entries are only samples used to test the import and linking of records.) The XML export file and the MARCXML files saved from the individual records are attached to this message, assuming they passed through any list filters. Can someone help me understand what causes the omission of these two records? Thank you! ------------------------------ *David Liddle* *IT Support Specialist* Wycliffe Global Alliance - Europe Area Siegenweg 30, 57299 Burbach, Germany *Direct:* david_liddle@wycliffe.net *Support:* sos_europe@wycliffe.net *Bomgar:* https://sos.wycliffe.net <https://sos.wycliffe.net/download_customer_connector.ns?id=65&name=David+Liddle> *Office:* +49 2736 298 302, Ext. 107 *Mobile:* +49 176 421 473 69 *Skype:* dfliddle
Hi David, the attachments got filtered. You can use http://paste.koha-community.org/ and send a link with your data to the list. -- Mirko -- Mirko Tietgen mirko@abunchofthings.net http://koha.abunchofthings.net http://meinkoha.de Am 23.10.2015 um 16:57 schrieb David Liddle:
I'm preparing to help a library switch to Koha over the next few months. In testing the "Export data" tool today, I discovered that 2 of the 4 bibliographic entries are missing from the export. (The entries are only samples used to test the import and linking of records.) The XML export file and the MARCXML files saved from the individual records are attached to this message, assuming they passed through any list filters. Can someone help me understand what causes the omission of these two records?
Thank you!
------------------------------
*David Liddle*
*IT Support Specialist* Wycliffe Global Alliance - Europe Area Siegenweg 30, 57299 Burbach, Germany
*Direct:* david_liddle@wycliffe.net *Support:* sos_europe@wycliffe.net *Bomgar:* https://sos.wycliffe.net <https://sos.wycliffe.net/download_customer_connector.ns?id=65&name=David+Liddle>
*Office:* +49 2736 298 302, Ext. 107 *Mobile:* +49 176 421 473 69 *Skype:* dfliddle _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Hmm. Did they go missing at the import step or are they missing at the export stage? I ask because I had weird things happen when I was first building my Koha database up that item-level data would affect the import and some would not import. Certain records would get read as duplicates because of holdings mistakes (field 952) and then they would not import. Do you have 952 data in your test records? Anyway, this comes from my relatively newbie experience... Thank you, Jesse On Fri, Oct 23, 2015 at 10:57 AM, David Liddle <david_liddle@wycliffe.net> wrote:
I'm preparing to help a library switch to Koha over the next few months. In testing the "Export data" tool today, I discovered that 2 of the 4 bibliographic entries are missing from the export. (The entries are only samples used to test the import and linking of records.) The XML export file and the MARCXML files saved from the individual records are attached to this message, assuming they passed through any list filters. Can someone help me understand what causes the omission of these two records?
Thank you!
------------------------------
*David Liddle*
*IT Support Specialist* Wycliffe Global Alliance - Europe Area Siegenweg 30, 57299 Burbach, Germany
*Direct:* david_liddle@wycliffe.net *Support:* sos_europe@wycliffe.net *Bomgar:* https://sos.wycliffe.net < https://sos.wycliffe.net/download_customer_connector.ns?id=65&name=David+Liddle
*Office:* +49 2736 298 302, Ext. 107 *Mobile:* +49 176 421 473 69 *Skype:* dfliddle _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
-- Jesse A Lambertson Librarian Sultan Qaboos Cultural Center <http://www.sqcc.org/> Ph: (202)-677-3967 Ext. 104 jlambertson@sqcc.org
The records are only missing at the export stage. These particular records do not contain item information, as they are "Book Articles" contained by one of the two records that are successfully exported. Neither of the missing records, to the best of my recollection, contained 952 information at the time of import. Oh, and now I come to review the imported records, I see that many, many more are missing from the export. All of them, I believe, are similar in that they are articles contained within entries imported earlier. One mistake I made with the bulk of the missing records is that I DID include 952y information, which causes anomalies in search results—but that's an issue separate from the export problem. ------------------------------ *David Liddle* *Direct:* david_liddle@wycliffe.net On Fri, Oct 23, 2015 at 5:13 PM, Jesse Lambertson <jlambertson@sqcc.org> wrote:
Hmm. Did they go missing at the import step or are they missing at the export stage?
I ask because I had weird things happen when I was first building my Koha database up that item-level data would affect the import and some would not import.
Certain records would get read as duplicates because of holdings mistakes (field 952) and then they would not import.
Do you have 952 data in your test records?
Anyway, this comes from my relatively newbie experience... Thank you,
Jesse
On Fri, Oct 23, 2015 at 10:57 AM, David Liddle <david_liddle@wycliffe.net> wrote:
I'm preparing to help a library switch to Koha over the next few months. In testing the "Export data" tool today, I discovered that 2 of the 4 bibliographic entries are missing from the export. (The entries are only samples used to test the import and linking of records.) The XML export file and the MARCXML files saved from the individual records are attached to this message, assuming they passed through any list filters. Can someone help me understand what causes the omission of these two records?
Thank you!
------------------------------
*David Liddle*
*IT Support Specialist* Wycliffe Global Alliance - Europe Area Siegenweg 30, 57299 Burbach, Germany
*Direct:* david_liddle@wycliffe.net *Support:* sos_europe@wycliffe.net *Bomgar:* https://sos.wycliffe.net < https://sos.wycliffe.net/download_customer_connector.ns?id=65&name=David+Liddle
*Office:* +49 2736 298 302, Ext. 107 *Mobile:* +49 176 421 473 69 *Skype:* dfliddle _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
-- Jesse A Lambertson Librarian Sultan Qaboos Cultural Center <http://www.sqcc.org/>
Ph: (202)-677-3967 Ext. 104 jlambertson@sqcc.org
Here are the XML and MARCXML files I referred to: Exported Data: https://drive.google.com/open?id=0Bw7g2X4-U5rLU05oWElkeGFULWs Biblio 1 (included): https://drive.google.com/open?id=0Bw7g2X4-U5rLWmt3ODF6WGFxeE0 Biblio 2 (omitted): https://drive.google.com/open?id=0Bw7g2X4-U5rLMjlYbFdfLUZHaUk Biblio 3 (omitted): https://drive.google.com/open?id=0Bw7g2X4-U5rLVFV3Y1hiejRwRXc Biblio 65 (included): https://drive.google.com/open?id=0Bw7g2X4-U5rLOHh6QWpjYnhkREk On Fri, Oct 23, 2015 at 5:38 PM, David Liddle <david_liddle@wycliffe.net> wrote:
The records are only missing at the export stage. These particular records do not contain item information, as they are "Book Articles" contained by one of the two records that are successfully exported. Neither of the missing records, to the best of my recollection, contained 952 information at the time of import.
Oh, and now I come to review the imported records, I see that many, many more are missing from the export. All of them, I believe, are similar in that they are articles contained within entries imported earlier. One mistake I made with the bulk of the missing records is that I DID include 952y information, which causes anomalies in search results—but that's an issue separate from the export problem.
------------------------------
*David Liddle*
*Direct:* david_liddle@wycliffe.net
On Fri, Oct 23, 2015 at 5:13 PM, Jesse Lambertson <jlambertson@sqcc.org> wrote:
Hmm. Did they go missing at the import step or are they missing at the export stage?
I ask because I had weird things happen when I was first building my Koha database up that item-level data would affect the import and some would not import.
Certain records would get read as duplicates because of holdings mistakes (field 952) and then they would not import.
Do you have 952 data in your test records?
Anyway, this comes from my relatively newbie experience... Thank you,
Jesse
On Fri, Oct 23, 2015 at 10:57 AM, David Liddle <david_liddle@wycliffe.net
wrote:
I'm preparing to help a library switch to Koha over the next few months. In testing the "Export data" tool today, I discovered that 2 of the 4 bibliographic entries are missing from the export. (The entries are only samples used to test the import and linking of records.) The XML export file and the MARCXML files saved from the individual records are attached to this message, assuming they passed through any list filters. Can someone help me understand what causes the omission of these two records?
Thank you!
------------------------------
*David Liddle*
*IT Support Specialist* Wycliffe Global Alliance - Europe Area Siegenweg 30, 57299 Burbach, Germany
*Direct:* david_liddle@wycliffe.net *Support:* sos_europe@wycliffe.net *Bomgar:* https://sos.wycliffe.net < https://sos.wycliffe.net/download_customer_connector.ns?id=65&name=David+Liddle
*Office:* +49 2736 298 302, Ext. 107 *Mobile:* +49 176 421 473 69 *Skype:* dfliddle _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
-- Jesse A Lambertson Librarian Sultan Qaboos Cultural Center <http://www.sqcc.org/>
Ph: (202)-677-3967 Ext. 104 jlambertson@sqcc.org
My further investigation into the matter seems to indicate that it is my analytic records that are not being exported. These were created using the Analytics Enhanced Workflow method described in the manual. Does anyone have an explanation for the situation? The pre-production server that I am working with is running Koha 3.20.04 on Ubuntu 14.04.3 LTS.
Hi David, it sounds to me like the records without items (952) are the ones missing. I think the reason could be in the criteria you chose when exporting, like limiting on something that is only present in the item record - did you use the Accession date limit by chance? Could you share the options you selected in the export form? I just did a quick test with limiting on a biblionumber range and my record without an item was exported correctly. Hope this helps, Katrin Am 27.10.2015 um 13:17 schrieb David Liddle:
My further investigation into the matter seems to indicate that it is my analytic records that are not being exported. These were created using the Analytics Enhanced Workflow method described in the manual. Does anyone have an explanation for the situation?
The pre-production server that I am working with is running Koha 3.20.04 on Ubuntu 14.04.3 LTS. _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Thank you for the reply, Katrin. Even if I specify biblio numbers that I know include these item-less child records, and make no other changes to the export options, the result is a blank file. What I have to concede is that the configuration that I am working with is not one that has gone through the suggested implementation checklist; my efforts here were chiefly to ensure that the information in the existing software (PS-Biblio) could be transferred through the import process (after some data transformations). The export tests are largely an academic exercise, but I'm concerned that they may be demonstrating that something important is missing from the records. If it's not really a fair test without going through a proper configuration, then just let me know, and I will look into the matter again after the production system is created, configured, and populated. Gratefully, David Liddle Date: Sun, 1 Nov 2015 11:53:50 +0100
From: Katrin Fischer <Katrin.Fischer.83@web.de> To: koha@lists.katipo.co.nz Subject: Re: [Koha] Records missing from data export Message-ID: <5635EF3E.4040906@web.de> Content-Type: text/plain; charset=utf-8
Hi David,
it sounds to me like the records without items (952) are the ones missing.
I think the reason could be in the criteria you chose when exporting, like limiting on something that is only present in the item record - did you use the Accession date limit by chance? Could you share the options you selected in the export form?
I just did a quick test with limiting on a biblionumber range and my record without an item was exported correctly.
Hope this helps,
Katrin
On Tue, Oct 27, 2015 at 1:17 PM, David Liddle <david_liddle@wycliffe.net> wrote:
My further investigation into the matter seems to indicate that it is my analytic records that are not being exported. These were created using the Analytics Enhanced Workflow method described in the manual. Does anyone have an explanation for the situation?
The pre-production server that I am working with is running Koha 3.20.04 on Ubuntu 14.04.3 LTS.
participants (4)
-
David Liddle -
Jesse Lambertson -
Katrin Fischer -
Mirko Tietgen