[Koha] Introduction and incredibly slow searches

Sat Oct 29 07:47:59 NZDT 2011

Update and hopefully some new insight from you fine folks.

I got a little overzealous today and tried launching ~100 searches of the single book item. The server became basically nonfunctional. I DOS attacked myself…

The server load jumped into the high 40s.

I noticed that the rebuild_zebra.pl kept popping up in the top output. Should this be running actively during searches? I thought it was just supposed to be run through cron jobs. The default cron jobs were setup by the installation and I verified they do exist.

The opac-search.pl is just killing the server, any ideas of what to look for would be greatly appreciated.

Anyone else out there running on esxi, if so any issues?

Thanks,
Jeremy

From: IBS Computer Support
Sent: Thursday, October 27, 2011 10:44 AM
To: 'Randall Rowe'; koha at lists.katipo.co.nz<mailto:koha at lists.katipo.co.nz>
Subject: RE: [Koha] Introduction and incredibly slow searches

Uname:
Linux ibs-koha 2.6.32-5-686 #1 SMP Mon Oct 3 04:15:24 UTC 2011 i686 GNU/Linux

Top:
After reboot and server settle:
top - 10:27:01 up 8 min,  1 user,  load average: 0.00, 0.33, 0.32

During launch of 21 tabs searching links in single book listing:

top - 10:30:30 up 12 min,  1 user,  load average: 2.93, 1.37, 0.70
Tasks: 131 total,   7 running, 124 sleeping,   0 stopped,   0 zombie
Cpu0  : 71.8%us, 27.5%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  0.7%si,  0.0%st
Cpu1  : 85.5%us, 13.5%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  1.0%si,  0.0%st
Cpu2  : 78.9%us, 20.1%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  1.0%si,  0.0%st
Cpu3  : 73.2%us, 25.8%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  1.0%si,  0.0%st
Mem:   1034236k total,   217968k used,   816268k free,     6396k buffers
Swap:   495608k total,        0k used,   495608k free,    75232k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  P COMMAND
 1922 XXXXX  20   0 21316  15m 2988 R   83  1.5   0:03.14 1 opac-search.pl
 1917 XXXXX  20   0 26316  20m 3092 R   66  2.0   0:03.98 2 opac-search.pl
 1923 XXXXX  20   0 14120 8524 2644 R   52  0.8   0:01.83 0 opac-search.pl
 1921 XXXXX  20   0 16492  10m 2692 R   51  1.1   0:02.13 0 opac-search.pl
 1915 XXXXX  20   0 38832  31m 4652 R   40  3.1   0:07.00 1 opac-search.pl
 1925 XXXXX  20   0 10580 5336 2316 R   25  0.5   0:00.79 3 opac-search.pl
 1322 mysql     20   0  136m  28m 6044 S   10  2.8   0:17.13 3 mysqld
 1924 XXXXX  20   0 28736 3516 1356 S    5  0.3   0:00.15 1 zebrasrv
 1907 XXXXX  20   0 35460 5052 1180 S    3  0.5   0:00.37 3 apache2
 1072 XXXXX  20   0 28232 4628 2764 S    1  0.4   0:00.88 2 zebrasrv

The opac-search eventually start dropping off to be replaced with opac-detail:

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  P COMMAND
 2013 XXXXX  20   0 37256  29m 4268 R   75  2.9   0:05.29 3 opac-search.pl
 1995 XXXXX  20   0 38580  30m 4652 R   53  3.0   0:06.26 3 opac-search.pl
 2011 XXXXX  20   0 32048  24m 3392 R   51  2.4   0:04.14 1 rebuild_zebra.p
 2012 XXXXX  20   0 24552  18m 3056 R   50  1.8   0:03.35 0 opac-search.pl
 1993 XXXXX  20   0 38460  30m 4652 R   48  3.0   0:06.80 1 opac-search.pl
 1997 XXXXX  20   0 30872  24m 3420 R   48  2.4   0:04.67 2 opac-search.pl
 1994 XXXXX  20   0 38900  30m 4368 R   47  3.0   0:07.14 2 opac-detail.pl
 1322 mysql     20   0  136m  28m 6044 S   25  2.8   0:24.95 0 mysqld
 2014 XXXXX  20   0 28732 3508 1356 S    4  0.3   0:00.11 1 zebrasrv
2015 XXXXX  20   0 28736 3512 1356 S    2  0.3   0:00.05 3 zebrasrv

Jeremy

From: Randall Rowe [mailto:r.rowe at lincolnlibraries.org]<mailto:[mailto:r.rowe at lincolnlibraries.org]>
Sent: Thursday, October 27, 2011 10:08 AM
To: ibs computer support; koha at lists.katipo.co.nz<mailto:koha at lists.katipo.co.nz>
Subject: Re: [Koha] Introduction and incredibly slow searches

Is top showing that you really are using the 4 CPUs available?
Pressing the numeral 1 will toggle multiple CPU lines in top.
To display the CPU a program is running on first press 'f' then 'J' to add the CPU in use column (P) to top's display.
What is your load average?

Does 'uname -a' show that you're running the SMP version of Debian?

Randy Rowe
Lincoln City Libraries I.T.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.katipo.co.nz/pipermail/koha/attachments/20111028/a3f4fa8f/attachment-0001.html>