diff options
| author | Marcia Ramos <virtua.creative@gmail.com> | 2018-04-19 23:51:36 +0300 |
|---|---|---|
| committer | Marcia Ramos <virtua.creative@gmail.com> | 2018-04-19 23:51:36 +0300 |
| commit | 2cf6054559bd5af8b0666be4216ef66de6394686 (patch) | |
| tree | 9b65edec1c4d9fe0d36b64391c3c203ff93498f3 /content | |
| parent | b7bc30b6da8ac1686ceff92a6c8f08537db7d9c4 (diff) | |
| parent | f3d4f10675fa4c079c259a4c40371f39fcca8ecb (diff) | |
Merge branch 'fix-robots' into 'master'
Fix robots.txt
See merge request gitlab-com/gitlab-docs!257
Diffstat (limited to 'content')
| -rw-r--r-- | content/robots.txt.erb | 8 |
1 files changed, 5 insertions, 3 deletions
diff --git a/content/robots.txt.erb b/content/robots.txt.erb index b4a4b64f..e228e9f8 100644 --- a/content/robots.txt.erb +++ b/content/robots.txt.erb @@ -3,9 +3,11 @@ is_hidden: true --- <% if ENV['CI_COMMIT_REF_NAME'] == 'master' %> -Sitemap: <%= @items['/sitemap.*'].path %> +sitemap: https://docs.gitlab.com/sitemap.xml +user-agent: * +disallow: /ce/ <% else %> # Ban all spiders from the entire site when not on master branch -User-Agent: * -Disallow: / +user-agent: * +disallow: / <% end %> |