A crawler in Python to crawl Reddit. Planning to crawl other sites, too.
A crawler in Python to crawl Reddit.
Specifically, it will crawl the subreddit /r/dailyprogrammer, find all the challenges, sort them according to the difficulty level, and display the challenge in a table. The table has three columns: ‘Easy’, ‘Intermediate’, ‘Hard’ for the types of the challenges.
The challenge is https://www.reddit.com/r/dailyprogrammer/comments/41hp6u/20160118_challenge_250_easy_scraping/
reddit_crawler.py contains the code without using the API.
reddit_crawler_with_api.py contains the code made using API.
The output is in the file output.md
python reddit_crawler_api.py
show_challenges()
function