diff options
| author | Achilleas Pipinellis <axil@gitlab.com> | 2018-06-29 09:42:19 +0300 |
|---|---|---|
| committer | Achilleas Pipinellis <axil@gitlab.com> | 2018-06-29 09:53:19 +0300 |
| commit | ae8a0fcc6c59f67c84f5ccb3de6bc725561bf32e (patch) | |
| tree | 29da904988c478607a593470c48a49ec6e9e6105 /content/robots.txt.erb | |
| parent | aa98bb823e3a41b510e8fd757cc0e7fb93841657 (diff) | |
Use _data/versions.yml to loop through disallow pages
Diffstat (limited to 'content/robots.txt.erb')
| -rw-r--r-- | content/robots.txt.erb | 16 |
1 files changed, 9 insertions, 7 deletions
diff --git a/content/robots.txt.erb b/content/robots.txt.erb index cb837894..afeacaad 100644 --- a/content/robots.txt.erb +++ b/content/robots.txt.erb @@ -6,13 +6,15 @@ is_hidden: true sitemap: https://docs.gitlab.com/sitemap.xml user-agent: * disallow: /ce/ -disallow: /11.0/ -disallow: /10.8/ -disallow: /10.7/ -disallow: /10.6/ -disallow: /10.5/ -disallow: /10.4/ -disallow: /10.3/ +<% @items['/_data/versions.yaml'][:current].each do |version| %> +disallow: /<%= version %>/ +<% end %> +<% @items['/_data/versions.yaml'][:previous].each do |version| %> +disallow: /<%= version %>/ +<% end %> +<% @items['/_data/versions.yaml'][:offline].each do |version| %> +disallow: /<%= version %>/ +<% end %> <% else %> # Ban all spiders from the entire site when not on master branch user-agent: * |