diff options
| author | Matthieu Aubry <mattab@users.noreply.github.com> | 2020-11-30 05:33:20 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2020-11-30 05:33:20 +0300 |
| commit | 23739ca598715496e29323f44d1d800a22e3db07 (patch) | |
| tree | 330f611f41019e384486d9b93dfd8e3d15305990 /robots.txt | |
| parent | bbf8888ce8517e2e6296d5f31881a07a940de359 (diff) | |
Create robots.txt to prevent bots from indexing Matomo app (#16795)
Diffstat (limited to 'robots.txt')
| -rw-r--r-- | robots.txt | 32 |
1 files changed, 32 insertions, 0 deletions
diff --git a/robots.txt b/robots.txt new file mode 100644 index 0000000000..47ec9a18ff --- /dev/null +++ b/robots.txt @@ -0,0 +1,32 @@ +User-agent: Googlebot +User-agent: AdsBot-Google +User-agent: AdsBot-Google-Mobile +User-agent: AdsBot-Google-Mobile-Apps +User-agent: Google Favicon +User-agent: Googlebot-News +User-agent: Googlebot-Image +User-agent: Googlebot-Video +User-agent: Mediapartners-Google +User-agent: APIs-Google +User-agent: DuplexWeb-Google +User-agent: Bingbot +User-agent: Slurp +User-agent: DuckDuckBot +User-agent: Baiduspider +User-agent: AhrefsBot +User-agent: rogerbot +User-agent: YandexBot +User-agent: DotBot +User-agent: Twitterbot +User-agent: BingPreview +User-agent: LinkedInBot +User-agent: Yandexbot +User-agent: facebot +User-agent: facebookexternalhit +User-agent: MSNBot +User-agent: MSNBot-Media +Disallow: / + +User-agent: * +Disallow: /matomo.php +Disallow: /piwik.php |