silverstripe-webpack/public/robots.txt
2018-05-27 18:50:22 +07:00

7 lines
150 B
Plaintext
Executable File

User-agent: *
Allow: /
Crawl-delay: 10
Disallow: /admin
Disallow: /Security
Sitemap: https://www.bla-bla.org/sitemap.xml
Host: https://www.bla-bla.org