项目作者: zuoez02

项目描述 :
Konachan.com scrapy
高级语言: Python
项目地址: git://github.com/zuoez02/konachan-scrapy.git
创建时间: 2019-03-03T10:24:39Z
项目社区:https://github.com/zuoez02/konachan-scrapy

开源协议:MIT License

下载


Konachan scrapy

Konachan.com is a wallpaper image websit. To scrap pictures, I write this spider.

Install

You should install python3, pip, scrapy.

Usage

Run scrapy crawl post -a tag="TAGS", where TAGS are tag you want to search like it is in website.

Arguments

  1. scrapy crawl post
  2. -a clear=true # clear current search cache
  3. -a stop=false # not stop download when match cache
  4. -a tag='TAGS' # search tags

Configuration

To config where the pictures are downloaded, edit the config in konachan/settings.py FILES_STORE

License

MIT