Koha slowness and server hardware
Hello everyone, I'm looking for some thoughts/opinions. I have a working 3.14.04 "package install" environment running on a 4-core 3.6GHz system with 8GB RAM. The OS is Debian 32-bit running as a VM on top of VMware ESXi. This single VM is allocated pretty much all of the physical hardware resources in the system...just wanted the flexibility of adding a "test" VM environment later perhaps. We are noticing that most functions are quite slow, including check-ins, check-outs, and patron lookups. I've monitored the system for a bit and am seeing that mysqld is consuming 100% of all 4 CPUs consistently during the slowness. What I'm wondering is: - Does this seem normal to folks? Should a relatively small environment (less than 2000 patrons and just over 11,000 items) be consuming that much CPU? - Could it be VMware? - Could it be the 32-bit OS? The version of VMware I installed wouldn't allow me to create a 64-bit Debian VM. - Are there any MySQL tuning parameters I should consider? - Any other thoughts/ideas on what I should look at? Thanks all! Steve
That number does seem usual. We've got a Koha instance that's larger in terms of items (small in terms of patrons) which gets a much lower usage. It's possible that a lot of searches or use could drive it up but that tends to be spikes rather than a long flat usage. VMware is a possible cause. The first thing I'd do is check your ESXi settings to see how much RAM and CPU you've allotted to your virtual machine. If your allotment for the VM is unusually low your virtual machine might be starved for resources. Also if you've assigned over 4 GB of RAM to this VM you're wasting it since a 32 bit OS will be capped at 4 GB of usable RAM. If you're still seeing high usage, inside MySQL try running a SHOW PROCESSLIST; to see what's going on when you see that 100% CPU use. There could be a background job that is stalling for some reason when other activity happens. Daniel Sanford On Wed, Jul 16, 2014 at 1:32 PM, Steven Nickerson <snicker1@maine.rr.com> wrote:
Hello everyone,
I'm looking for some thoughts/opinions. I have a working 3.14.04 "package install" environment running on a 4-core 3.6GHz system with 8GB RAM. The OS is Debian 32-bit running as a VM on top of VMware ESXi. This single VM is allocated pretty much all of the physical hardware resources in the system...just wanted the flexibility of adding a "test" VM environment later perhaps. We are noticing that most functions are quite slow, including check-ins, check-outs, and patron lookups. I've monitored the system for a bit and am seeing that mysqld is consuming 100% of all 4 CPUs consistently during the slowness. What I'm wondering is:
- Does this seem normal to folks? Should a relatively small environment (less than 2000 patrons and just over 11,000 items) be consuming that much CPU?
- Could it be VMware?
- Could it be the 32-bit OS? The version of VMware I installed wouldn't allow me to create a 64-bit Debian VM.
- Are there any MySQL tuning parameters I should consider?
- Any other thoughts/ideas on what I should look at?
Thanks all!
Steve
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
We're seeing a similar problem with our Koha install; we're blaming the 32-bit OS. I'd recommend upgrading VMWare and (re)installing Deb 64bit on your system, and also possibly moving up to Koha 3.16, if you have to option to do those things. Would the vSphere Hypervisor work for you? We've been playing with it here, and will probably use it for our next virtual machine server. http://www.vmware.com/products/vsphere-hypervisor/ Greg -- Greg Lawson Network Administrator Rolling Hills Consolidated Library 1912 N. Belt Highway St. Joseph, MO 64506 ------------------------------------ On 07/16/2014 12:32 PM, Steven Nickerson wrote:
Hello everyone,
I'm looking for some thoughts/opinions. I have a working 3.14.04 "package install" environment running on a 4-core 3.6GHz system with 8GB RAM. The OS is Debian 32-bit running as a VM on top of VMware ESXi. This single VM is allocated pretty much all of the physical hardware resources in the system...just wanted the flexibility of adding a "test" VM environment later perhaps. We are noticing that most functions are quite slow, including check-ins, check-outs, and patron lookups. I've monitored the system for a bit and am seeing that mysqld is consuming 100% of all 4 CPUs consistently during the slowness. What I'm wondering is:
- Does this seem normal to folks? Should a relatively small environment (less than 2000 patrons and just over 11,000 items) be consuming that much CPU?
- Could it be VMware?
- Could it be the 32-bit OS? The version of VMware I installed wouldn't allow me to create a 64-bit Debian VM.
- Are there any MySQL tuning parameters I should consider?
- Any other thoughts/ideas on what I should look at?
Thanks all!
Steve
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Steven Nickerson schreef op wo 16-07-2014 om 13:32 [-0400]:
- Could it be the 32-bit OS? The version of VMware I installed wouldn't allow me to create a 64-bit Debian VM.
It could be, but it's probably not with that number of items. 64-bit is recommended however, and can be done with other virtualisation systems, for example KVM or Xen.
- Are there any MySQL tuning parameters I should consider?
Yes. There's too much to get into via email, but make sure that mysql has enough memory to cache the entire database into RAM, that your query cache is large enough, and so on. There are plenty of articles and helper scripts around for this.
- Any other thoughts/ideas on what I should look at?
Turn on the MySQL slow query log: that'll tell you what _actually_ is taking the time. It might be that for some reason one of your tables doesn't have an index that it should, and so queries are slower than they should be. Also, disk IO can sometimes be a bit weird under virtualisation, make sure that your disk access is at an appropriate speed, although caching the whole thing in MySQL should make that less important. -- Robin Sheat Catalyst IT Ltd. ✆ +64 4 803 2204 GPG: 5FA7 4B49 1E4D CAA4 4C38 8505 77F5 B724 F871 3BDF
Hie, We know the disk IO performance can be very bad on VMware. It will set MySQL slower. Consider using sysbench to mesure the performance : https://packages.debian.org/wheezy/sysbench For MySQL : you will be given advices by http://mysqltuner.com/. Personnaly, we use LXC as virtualizer, its awsome. Best regards, Le 16/07/2014 19:32, Steven Nickerson a écrit :
Hello everyone,
I'm looking for some thoughts/opinions. I have a working 3.14.04 "package install" environment running on a 4-core 3.6GHz system with 8GB RAM. The OS is Debian 32-bit running as a VM on top of VMware ESXi. This single VM is allocated pretty much all of the physical hardware resources in the system...just wanted the flexibility of adding a "test" VM environment later perhaps. We are noticing that most functions are quite slow, including check-ins, check-outs, and patron lookups. I've monitored the system for a bit and am seeing that mysqld is consuming 100% of all 4 CPUs consistently during the slowness. What I'm wondering is:
- Does this seem normal to folks? Should a relatively small environment (less than 2000 patrons and just over 11,000 items) be consuming that much CPU?
- Could it be VMware?
- Could it be the 32-bit OS? The version of VMware I installed wouldn't allow me to create a 64-bit Debian VM.
- Are there any MySQL tuning parameters I should consider?
- Any other thoughts/ideas on what I should look at?
Thanks all!
Steve
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
-- Fridolin SOMERS Biblibre - Pôles support et système fridolin.somers@biblibre.com
participants (5)
-
Daniel Sanford -
Fridolin SOMERS -
glaws -
Robin Sheat -
Steven Nickerson