doc.silverstripe.org/robots.txt

5 lines
99 B
Plaintext

User-agent: *
Disallow: /admin
Disallow: /assets/src
Disallow: /assets/.lucene-index
Crawl-Delay: 4