Disallow robots from indexing /interact/ (#10666)
This does not provide any new information and may just triple the number of crawled pages
This commit is contained in:
parent
0db269f3dc
commit
c4f2433300
@ -2,3 +2,4 @@
|
||||
|
||||
User-agent: *
|
||||
Disallow: /media_proxy/
|
||||
Disallow: /interact/
|
||||
|
Loading…
Reference in New Issue
Block a user