项目作者: kevinbennet

项目描述 :
Artnet.com scraper built in Python – exporting artist data (country of origin and active years) from artnet as csv and pickle files.
高级语言: Python
项目地址: git://github.com/kevinbennet/artnet-artist-scraper.git
创建时间: 2021-05-11T23:18:31Z
项目社区:https://github.com/kevinbennet/artnet-artist-scraper

开源协议:MIT License

下载


Artnet Artist Scraper

This is a scraper built in Python. The script creates a list of all artists (including design/furniture companies) that have had works offered for sale (mainly auctions/galleries), as recorded by artnet. It creates a DataFrame for all artists recorded on artnet (approximately 400k), further splitting data into the artist’s country of origin and active years.

Set Up

  1. Clone the project using:
  1. git clone https://github.com/kevinbennet/artnet-artist-scraper.git
  1. Set up a virtual environment (Optional):
  1. python -m venv venv
  1. Activate the virtual environment (Optional):
  • Windows: venv\Scripts\activate
  • Linux/Mac: source venv/bin/activate
  1. Install required packages:
  1. cd artnet-artist-scraper
  2. pip install -r requirements.txt

Usage

To run scrape:

  1. python artnet_scraper.py

This will create both a csv and pickle file in the fork directory.

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.