Good Morning, In the version of Koha 20.05.02 with Ubuntu 20.04. I was seeing a slow process. I verified with the TOP command an excess of CPU usage that was causing Koha to slow down. I carried out the following instruction and the slowness was resolved. cd /usr/share/koha/opac/htdocs sudo nano robots.txt Crawl-delay: 60 User-agent: * Disallow: / User-agent: Googlebot Disallow: /cgi-bin/koha/opac-search.pl Disallow: /cgi-bin/koha/opac-showmarc.pl Disallow: /cgi-bin/koha/opac-detailprint.pl Disallow: /cgi-bin/koha/opac-ISBDdetail.pl Disallow: /cgi-bin/koha/opac-MARCdetail.pl Disallow: /cgi-bin/koha/opac-reserve.pl Disallow: /cgi-bin/koha/opac-export.pl Disallow: /cgi-bin/koha/opac-detail.pl Disallow: /cgi-bin/koha/opac-authoritiesdetail.pl The question is, does this instruction completely limit the indexing of the google robot or partially limit it? Thank you, Victor
I recommend you also set the sitemap. El jue., 13 ago. 2020 a las 9:11, Victor Barroso Oliveira (< vbovictor@gmail.com>) escribió:
Good Morning, In the version of Koha 20.05.02 with Ubuntu 20.04. I was seeing a slow process. I verified with the TOP command an excess of CPU usage that was causing Koha to slow down. I carried out the following instruction and the slowness was resolved.
cd /usr/share/koha/opac/htdocs sudo nano robots.txt
Crawl-delay: 60
User-agent: * Disallow: /
User-agent: Googlebot Disallow: /cgi-bin/koha/opac-search.pl Disallow: /cgi-bin/koha/opac-showmarc.pl Disallow: /cgi-bin/koha/opac-detailprint.pl Disallow: /cgi-bin/koha/opac-ISBDdetail.pl Disallow: /cgi-bin/koha/opac-MARCdetail.pl Disallow: /cgi-bin/koha/opac-reserve.pl Disallow: /cgi-bin/koha/opac-export.pl Disallow: /cgi-bin/koha/opac-detail.pl Disallow: /cgi-bin/koha/opac-authoritiesdetail.pl
The question is, does this instruction completely limit the indexing of the google robot or partially limit it?
Thank you, Victor _______________________________________________
Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha
-- Tomás Cohen Arazi Theke Solutions (http://theke.io) ✆ +54 9351 3513384 GPG: B2F3C15F
On Thu, 13 Aug 2020 09:10:56 -0300 Victor Barroso Oliveira <vbovictor@gmail.com> wrote:
The question is, does this instruction completely limit the indexing of the google robot or partially limit it?
If it obeys the instructions, it looks to me like it should completely prevent indexing. Can you check your access logs to see if it has? Is that what you intended to do? I think we find that our libraries are more troubled by robots other than Google which don't respect any robots.txt or sitemap. Regards, -- MJR http://mjr.towers.org.uk/ Member of http://www.software.coop/ (but this email is my personal view only)
participants (3)
-
MJ Ray -
Tomas Cohen Arazi -
Victor Barroso Oliveira