17 Aug
2020
17 Aug
'20
3:57 p.m.
On Thu, 13 Aug 2020 09:10:56 -0300 Victor Barroso Oliveira <vbovictor@gmail.com> wrote:
The question is, does this instruction completely limit the indexing of the google robot or partially limit it?
If it obeys the instructions, it looks to me like it should completely prevent indexing. Can you check your access logs to see if it has? Is that what you intended to do? I think we find that our libraries are more troubled by robots other than Google which don't respect any robots.txt or sitemap. Regards, -- MJR http://mjr.towers.org.uk/ Member of http://www.software.coop/ (but this email is my personal view only)