diff options
| author | Yury Melnichek <melnichek@gmail.com> | 2012-05-29 10:10:12 +0400 |
|---|---|---|
| committer | Alex Zolotarev <alex@maps.me> | 2015-09-23 01:40:15 +0300 |
| commit | 3f35ce220c8ea553d621a9046e3682b216699ce1 (patch) | |
| tree | 3de53e925662b05a27dbbe452e3bed30c63b5db5 /crawler | |
| parent | 26c2224b9d89722c1502f41fa6b1846500aa9382 (diff) | |
[guide] Download images with wget.
Diffstat (limited to 'crawler')
| -rwxr-xr-x | crawler/wikitravel-crawler.sh | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/crawler/wikitravel-crawler.sh b/crawler/wikitravel-crawler.sh index 7f3eb802fe..58fd1a2f3f 100755 --- a/crawler/wikitravel-crawler.sh +++ b/crawler/wikitravel-crawler.sh @@ -28,4 +28,6 @@ cat wikitravel-pages.json | python $MY_PATH/wikitravel-optimize-articles.py $MY_PATH/extract-image-urls.sh wikitravel-images.urls +wget --wait=1 --no-clobber -i wikitravel-images.urls + # TODO: Run publisher. |