diff options
| author | XhmikosR <xhmikosr@users.sourceforge.net> | 2014-02-23 15:33:33 +0400 |
|---|---|---|
| committer | XhmikosR <xhmikosr@users.sourceforge.net> | 2014-02-27 19:05:52 +0400 |
| commit | 17722e5ef23f58bf661c00c7bb8fea306318bcf2 (patch) | |
| tree | 4c7ca8363004fd90253f760f6ba3095f4e9fa06c /docs/robots.txt | |
| parent | 4d527f925109a75ab88ff8ec811b781190372506 (diff) | |
Add sitemap.xml and robots.txt files.
Diffstat (limited to 'docs/robots.txt')
| -rw-r--r-- | docs/robots.txt | 10 |
1 files changed, 10 insertions, 0 deletions
diff --git a/docs/robots.txt b/docs/robots.txt new file mode 100644 index 0000000000..3f86d8a9dd --- /dev/null +++ b/docs/robots.txt @@ -0,0 +1,10 @@ +--- +layout: nil +--- + +# www.robotstxt.org/ + +# Allow crawling of all content +User-agent: * +Disallow: +Sitemap: {{ site.url }}/sitemap.xml |