robots.txt « site - github.com/twbs/bootstrap.git - Unnamed repository; edit this file 'description' to name the repository.

Welcome to mirror list, hosted at ThFree Co, Russian Federation.

robots.txt « site - github.com/twbs/bootstrap.git - Unnamed repository; edit this file 'description' to name the repository.

index : github.com/twbs/bootstrap.git

Unnamed repository; edit this file 'description' to name the repository.

www-data

summary refs log tree commit diff

path: root/site/robots.txt

blob: 9097d50dad7ae57bff8398ac2478955e73525cb4 (plain)

---
---

# www.robotstxt.org/

{% if jekyll.environment != "netlify" -%}
# Allow crawling of all content
{%- endif %}
User-agent: *
Disallow:{% if jekyll.environment == "netlify" %} /{% endif %}
Sitemap: {{ site.url }}/sitemap.xml