robots.txt « layouts - github.com/it-gro/hugo-theme-w3css-basic.git - Unnamed repository; edit this file 'description' to name the repository.

Welcome to mirror list, hosted at ThFree Co, Russian Federation.

robots.txt « layouts - github.com/it-gro/hugo-theme-w3css-basic.git - Unnamed repository; edit this file 'description' to name the repository.

summary refs log tree commit diff

path: root/layouts/robots.txt

blob: 2d9ce24cc795064cc3a5577e92f8aec97a6299f8 (plain)

# www.robotstxt.org/
# http://code.google.com/web/controlcrawlindex/

User-agent: *
Disallow: {{ if (findRE `\b(gitlab.io|github.io)\b` $.Site.BaseURL) }}/{{ end }}