GitHub/gf-core
1
0
Fork 1
mirror of https://github.com/GrammaticalFramework/gf-core.git synced 2026-08-08 13:35:13 -06:00
Code Issues Packages Projects Releases Wiki Activity
Files
11c5687e982718f8bef73c60f0a04d335644cf34
gf-core/src/www/robots.txt
T
hallgren 5f9e6b1220 src/www/robots.txt: robot exclusion file for the GF cloud service. 
To reduce potential server load caused by search bots.
2014-08-22 12:13:04 +00:00

5 lines
69 B
Plaintext
Raw Blame History

User-agent: *
Disallow: /grammars
Disallow: /robust
Disallow: /*.pgf
Reference in New Issue View Git Blame Copy Permalink