robots.txt.erb « content - gitlab.com/gitlab-org/gitlab-docs.git - Unnamed repository; edit this file 'description' to name the repository.

Welcome to mirror list, hosted at ThFree Co, Russian Federation.

robots.txt.erb « content - gitlab.com/gitlab-org/gitlab-docs.git - Unnamed repository; edit this file 'description' to name the repository.

index : gitlab.com/gitlab-org/gitlab-docs.git

Unnamed repository; edit this file 'description' to name the repository.

root

summary refs log tree commit diff

path: root/content/robots.txt.erb

blob: b4a4b64f4e7247a3351706669ba6675da17b1a99 (plain)

---
is_hidden: true
---

<% if ENV['CI_COMMIT_REF_NAME'] == 'master' %>
Sitemap: <%= @items['/sitemap.*'].path %>
<% else %>
# Ban all spiders from the entire site when not on master branch
User-Agent: *
Disallow: /
<% end %>