tonyair/doc.silverstripe.org
1
0
Fork 0
mirror of https://github.com/silverstripe/doc.silverstripe.org synced 2024-10-22 17:05:50 +02:00
Code Issues Projects Releases Wiki Activity
2c8cba75be
doc.silverstripe.org/robots.txt

5 lines
99 B
Plaintext
Raw Normal View History

Added robots.txt to avoid indexing while in beta
2014-11-24 20:40:13 +01:00
User-agent: *
Changes to make environment work on platform
2016-02-03 05:08:04 +01:00
Disallow: /admin
Disallow: /assets/src
added crontask and updatetask buildtask as per userhelp, repositories yml, updated robots file, removed update shell script
2016-02-09 05:57:27 +01:00
Disallow: /assets/.lucene-index
Changes to make environment work on platform
2016-02-03 05:08:04 +01:00
Crawl-Delay: 4
Reference in New Issue Copy Permalink