[Koha] Introduction and incredibly slow searches
IBS Computer Support
ibssupport at Colorado.EDU
Fri Oct 28 05:44:16 NZDT 2011
Uname:
Linux ibs-koha 2.6.32-5-686 #1 SMP Mon Oct 3 04:15:24 UTC 2011 i686 GNU/Linux
Top:
After reboot and server settle:
top - 10:27:01 up 8 min, 1 user, load average: 0.00, 0.33, 0.32
During launch of 21 tabs searching links in single book listing:
top - 10:30:30 up 12 min, 1 user, load average: 2.93, 1.37, 0.70
Tasks: 131 total, 7 running, 124 sleeping, 0 stopped, 0 zombie
Cpu0 : 71.8%us, 27.5%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.7%si, 0.0%st
Cpu1 : 85.5%us, 13.5%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 1.0%si, 0.0%st
Cpu2 : 78.9%us, 20.1%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 1.0%si, 0.0%st
Cpu3 : 73.2%us, 25.8%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 1.0%si, 0.0%st
Mem: 1034236k total, 217968k used, 816268k free, 6396k buffers
Swap: 495608k total, 0k used, 495608k free, 75232k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ P COMMAND
1922 XXXXX 20 0 21316 15m 2988 R 83 1.5 0:03.14 1 opac-search.pl
1917 XXXXX 20 0 26316 20m 3092 R 66 2.0 0:03.98 2 opac-search.pl
1923 XXXXX 20 0 14120 8524 2644 R 52 0.8 0:01.83 0 opac-search.pl
1921 XXXXX 20 0 16492 10m 2692 R 51 1.1 0:02.13 0 opac-search.pl
1915 XXXXX 20 0 38832 31m 4652 R 40 3.1 0:07.00 1 opac-search.pl
1925 XXXXX 20 0 10580 5336 2316 R 25 0.5 0:00.79 3 opac-search.pl
1322 mysql 20 0 136m 28m 6044 S 10 2.8 0:17.13 3 mysqld
1924 XXXXX 20 0 28736 3516 1356 S 5 0.3 0:00.15 1 zebrasrv
1907 XXXXX 20 0 35460 5052 1180 S 3 0.5 0:00.37 3 apache2
1072 XXXXX 20 0 28232 4628 2764 S 1 0.4 0:00.88 2 zebrasrv
The opac-search eventually start dropping off to be replaced with opac-detail:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ P COMMAND
2013 XXXXX 20 0 37256 29m 4268 R 75 2.9 0:05.29 3 opac-search.pl
1995 XXXXX 20 0 38580 30m 4652 R 53 3.0 0:06.26 3 opac-search.pl
2011 XXXXX 20 0 32048 24m 3392 R 51 2.4 0:04.14 1 rebuild_zebra.p
2012 XXXXX 20 0 24552 18m 3056 R 50 1.8 0:03.35 0 opac-search.pl
1993 XXXXX 20 0 38460 30m 4652 R 48 3.0 0:06.80 1 opac-search.pl
1997 XXXXX 20 0 30872 24m 3420 R 48 2.4 0:04.67 2 opac-search.pl
1994 XXXXX 20 0 38900 30m 4368 R 47 3.0 0:07.14 2 opac-detail.pl
1322 mysql 20 0 136m 28m 6044 S 25 2.8 0:24.95 0 mysqld
2014 XXXXX 20 0 28732 3508 1356 S 4 0.3 0:00.11 1 zebrasrv
2015 XXXXX 20 0 28736 3512 1356 S 2 0.3 0:00.05 3 zebrasrv
Jeremy
From: Randall Rowe [mailto:r.rowe at lincolnlibraries.org]
Sent: Thursday, October 27, 2011 10:08 AM
To: ibs computer support; koha at lists.katipo.co.nz
Subject: Re: [Koha] Introduction and incredibly slow searches
Is top showing that you really are using the 4 CPUs available?
Pressing the numeral 1 will toggle multiple CPU lines in top.
To display the CPU a program is running on first press 'f' then 'J' to add the CPU in use column (P) to top's display.
What is your load average?
Does 'uname -a' show that you're running the SMP version of Debian?
Randy Rowe
Lincoln City Libraries I.T.
-----Original Message-----
From: "IBS Computer Support" <ibssupport at Colorado.EDU<mailto:ibssupport at Colorado.EDU>>
Sent 10/27/2011 10:35:36 AM
To: "Randall Rowe" <r.rowe at lincolnlibraries.org<mailto:r.rowe at lincolnlibraries.org>>, "ibs computer support" <ibssupport at colorado.edu<mailto:ibssupport at colorado.edu>>, "koha at lists.katipo.co.nz<mailto:koha at lists.katipo.co.nz>" <koha at lists.katipo.co.nz<mailto:koha at lists.katipo.co.nz>>, "Chris Cormack" <chris at bigballofwax.co.nz<mailto:chris at bigballofwax.co.nz>>
Subject: RE: [Koha] Introduction and incredibly slow searches
To answer the questions from Randy and Chris and add more detail.
Koha was installed following these directions:
http://wiki.koha-community.org/wiki/Koha_3.2_on_Debian_Squeeze
and the install notes towards the bottom of this page starting at “Step: Install Koha”
http://wiki.koha-community.org/wiki/Setting_Up_Koha_in_Virtual_Environment_%2B_Using_That_as_a_Development_Environment
The server is a virtual machine on ESXi v4.1.
It is the only virtual machine on the host ESXi server.
It has 4 CPUs dedicated to it, as well as 1GB RAM
Watching “top” it doesn’t use enough RAM to get to need to swap
Top shows:
opac-search.pl for however many tabs I open from the initial search screen
followed up with
opac-detail.pl
ping requests are <1ms
Machines are on the same physical network, just different subnets.
Thanks,
Jeremy
From: Randall Rowe [mailto:r.rowe at lincolnlibraries.org]<mailto:[mailto:r.rowe at lincolnlibraries.org]>
Sent: Thursday, October 27, 2011 5:47 AM
To: ibs computer support; koha at lists.katipo.co.nz<mailto:koha at lists.katipo.co.nz>
Subject: Re: [Koha] Introduction and incredibly slow searches
What version of koha are you running? Where did you download it?
I noticed that you went "through the examples on liblime.com".
If that is where you downloaded koha then you are not running the community version of koha.
Regardless of what koha you are running, check the output of the command "top".
That should give you an idea of what is taking up time in the process.
Are all these machines on a local network? Is ping response between the machines reasonable?
Randy Rowe
Lincoln City Libraries I.T.
-----Original Message-----
From: "IBS Computer Support" <ibssupport at Colorado.EDU<mailto:ibssupport at Colorado.EDU>>
Sent 10/26/2011 3:47:54 PM
To: "koha at lists.katipo.co.nz<mailto:koha at lists.katipo.co.nz>" <koha at lists.katipo.co.nz<mailto:koha at lists.katipo.co.nz>>
Subject: [Koha] Introduction and incredibly slow searches
Hello Everyone,
New to the list, new to Koha, increasingly frustrated :}
I’ve built a koha server for our in-house library which seems to have gone over fine but I’m having issues with incredibly slow search response.
I’m running the latest stable koha-common 3.6 (updated a few minutes ago) on Debian 6.0.3.
I have successfully entered in a record for one book. When I search from the initial koha page it takes ~4 seconds to find this item. Then once the item has loaded if I click one of the links for a searchable item (author, details, etc.) it takes ~4-5 seconds for it to load. When I open all of these options at the same time in new tabs it takes forever. It seems to be an almost linear increase in the time it takes for the searches to complete. Also, each new tab running a different search will continue to run until one has finished, then once one has finished another will go. This process is ~4 seconds for each search. Seems like all searches are in a very slow queue.
So for this example book I have in the system there are 7 items that are searchable. If I go through and open each in a separate tab the total process for all of this is 30+seconds.
I tried running a webserver load test with just 10 users clicking on a different link each time the new page loaded and it failed horribly with an average page load wait of 50 seconds
I really don’t know where to go to look for what’s causing this.
When I use the “browse by author or subject search”, the authority search results page comes back in less than 2 seconds. Though it does show 0 biblios records (no clue what that is)
I’ve gone through many example sites found here:
http://www.liblime.com/demos
And they don’t seem to have this same issue.
Any help. Thought, direction would be greatly appreciated!
Thanks,
Jeremy
_______________________________________________
Koha mailing list http://koha-community.org
Koha at lists.katipo.co.nz<mailto:Koha at lists.katipo.co.nz>
http://lists.katipo.co.nz/mailman/listinfo/koha
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.katipo.co.nz/pipermail/koha/attachments/20111027/7d896680/attachment-0001.html>
More information about the Koha
mailing list