项目作者: Harwood

项目描述 :
Airbnb listing scraper
高级语言: Python
项目地址: git://github.com/Harwood/PropertyScraper.git
创建时间: 2017-08-04T05:10:57Z
项目社区:https://github.com/Harwood/PropertyScraper

开源协议:MIT License

下载


PropertyScraper

asciicast

Description

Displays rental information for a given Airbnb listing url.

For usage run:

  1. ./property_scraper.py --help

Findings are stored in an SQLite database table listings with the following columns.

  • url
  • name
  • market,
  • score),
  • review_count
  • type
  • bed
  • bath
  • guest
  • price
  • photo_url
  • description
  • amenities (CSV)

NOTE: It appears Airbnb will throttle results. If this occurs a warning will be printed to stderr and the scraper will quit.

Usage

Requires Python 3

  1. ./property_scraper.py "https://www.airbnb.co.uk/rooms/14531512"
  2. ./property_scraper.py urls.txt
  3. echo "https://www.airbnb.co.uk/rooms/14531512" | ./property_scraper.py -

Future Improvements

  • CLI flags
  • Database storage
  • Handle mutiple urls
  • Add requirements.txt
  • Proper testing
  • Implement with different libraries and languages to explore performance variations
  • Create Slack bot