robots.txt.erb « content - gitlab.com/gitlab-org/gitlab-docs.git - Unnamed repository; edit this file 'description' to name the repository.

Welcome to mirror list, hosted at ThFree Co, Russian Federation.

robots.txt.erb « content - gitlab.com/gitlab-org/gitlab-docs.git - Unnamed repository; edit this file 'description' to name the repository.

index : gitlab.com/gitlab-org/gitlab-docs.git

Unnamed repository; edit this file 'description' to name the repository.

root

summary refs log tree commit diff

path: root/content/robots.txt.erb

blob: e228e9f8013025500389c06fae64e9a2251b19e2 (plain)

---
is_hidden: true
---

<% if ENV['CI_COMMIT_REF_NAME'] == 'master' %>
sitemap: https://docs.gitlab.com/sitemap.xml
user-agent: *
disallow: /ce/
<% else %>
# Ban all spiders from the entire site when not on master branch
user-agent: *
disallow: /
<% end %>