[geany/www.geany.org] b14990: Add robots.txt

Enrico Tröger git-noreply at xxxxx
Sun Jun 9 14:40:57 UTC 2019


Branch:      refs/heads/master
Author:      Enrico Tröger <enrico.troeger at uvena.de>
Committer:   Enrico Tröger <enrico.troeger at uvena.de>
Date:        Sun, 09 Jun 2019 14:40:57 UTC
Commit:      b1499015a11e0bab8a3513adb4230a75ed6859f6
             https://github.com/geany/www.geany.org/commit/b1499015a11e0bab8a3513adb4230a75ed6859f6

Log Message:
-----------
Add robots.txt

The different filename is to not conflict with Mezzanine's default
robots.txt. Our geany_robots.txt is delivered as /robots.txt via
webserver configuration directive.


Modified Paths:
--------------
    geany/static/geany_robots.txt

Modified: geany/static/geany_robots.txt
7 lines changed, 7 insertions(+), 0 deletions(-)
===================================================================
@@ -0,0 +1,7 @@
+# robots.txt for https://www.geany.org/
+
+User-agent: *
+Crawl-delay: 20
+Allow: /
+
+Sitemap: https://www.geany.org/sitemap.xml



--------------
This E-Mail was brought to you by github_commit_mail.py (Source: https://github.com/geany/infrastructure).


More information about the Commits mailing list