[geany/www.geany.org] b14990: Add robots.txt
Enrico Tröger
git-noreply at xxxxx
Sun Jun 9 14:40:57 UTC 2019
Branch: refs/heads/master
Author: Enrico Tröger <enrico.troeger at uvena.de>
Committer: Enrico Tröger <enrico.troeger at uvena.de>
Date: Sun, 09 Jun 2019 14:40:57 UTC
Commit: b1499015a11e0bab8a3513adb4230a75ed6859f6
https://github.com/geany/www.geany.org/commit/b1499015a11e0bab8a3513adb4230a75ed6859f6
Log Message:
-----------
Add robots.txt
The different filename is to not conflict with Mezzanine's default
robots.txt. Our geany_robots.txt is delivered as /robots.txt via
webserver configuration directive.
Modified Paths:
--------------
geany/static/geany_robots.txt
Modified: geany/static/geany_robots.txt
7 lines changed, 7 insertions(+), 0 deletions(-)
===================================================================
@@ -0,0 +1,7 @@
+# robots.txt for https://www.geany.org/
+
+User-agent: *
+Crawl-delay: 20
+Allow: /
+
+Sitemap: https://www.geany.org/sitemap.xml
--------------
This E-Mail was brought to you by github_commit_mail.py (Source: https://github.com/geany/infrastructure).
More information about the Commits
mailing list