src/www/robots.txt: robot exclusion file for the GF cloud service.

To reduce potential server load caused by search bots.
2026-07-02 03:48:33 -06:00 · 2014-08-22 12:13:04 +00:00
parent 11105f81cd
commit 5f9e6b1220
1 changed files with 4 additions and 0 deletions
@@ -0,0 +1,4 @@
+User-agent: *
+Disallow: /grammars
+Disallow: /robust
+Disallow: /*.pgf