Quickstart

pip install poetry
poetry install
poetry shell
scrapy crawl playdede -O data.json

NOTE: This project was only tested on Python 3.8, but should work with any version of Python 3.

IDE

For Python there are several good IDEs, but my recommendation is PyCharm: https://www.jetbrains.com/pycharm/

Scrapy's Documentation

We use Scrapy to crawl and scrape playdede, you can find here the official documentation (it's pretty good) I recommend reading the official documentation, but before that you could check out this YouTube video, which offers a nice introduction to Scrapy.

Other

This web is good to practice scraping, if you need to.