PLC/vPLC>> sof-crawler>> 返回
项目作者： ozcanyarimdunya

项目描述 ：
A crawler for stackoverflow.com's latest 5000 questions by tag
高级语言： Python
项目地址: git://github.com/ozcanyarimdunya/sof-crawler.git
创建时间： 2019-01-18T21:59:35Z
项目社区：https://github.com/ozcanyarimdunya/sof-crawler
开源协议：
下载


Sof crawler

A Crawler for stackoverflow.com’s latest 5000 questions by tag

Run locally

  1. Clone the repository

  2. Install the requirements

    pip install -r requirements.txt

  3. Run the crawler

    scrapy crawl sof

Run with docker

  1. Clone the repository

  2. Run docker-compose

    docker-compose up -d --build

After this processes latest 5000 questions will be inserted to sof.db database file.