https://github.com/rennerocha/europython-2023-gathering-data-tutorial

EuroPython 2023 - Tutorial - Gathering data from the web using Python
https://github.com/rennerocha/europython-2023-gathering-data-tutorial

Last synced: 23 days ago
JSON representation

EuroPython 2023 - Tutorial - Gathering data from the web using Python

• Host: GitHub
• URL: https://github.com/rennerocha/europython-2023-gathering-data-tutorial
• Owner: rennerocha
• License: gpl-3.0
• Created: 2023-06-21T00:58:53.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-07-17T21:48:31.000Z (over 1 year ago)
• Last Synced: 2024-11-10T16:53:16.311Z (3 months ago)
• Language: HTML
• Size: 9.79 MB
• Stars: 5
• Watchers: 2
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Gathering data from the web using Python

## EuroPython 2023 - 18 / 07 / 2023

## About the tutorial

Information is abundant and readily available on the internet. However, the sheer amount of data can be overwhelming and time-consuming to navigate through. That's where web scraping comes in - a powerful tool used to extract data from websites and turn it into a usable format.

In this tutorial, we will explore the basics of web scraping and how to implement it using Scrapy (a Python framework). Whether you are a data analyst, programmer, or researcher, this tutorial will equip you with the fundamental skills needed to create your own web scraper and extract valuable information from websites.

## Before the tutorial

Clone this repository so you will get access to the presentation and also for the code solution of the suggested exercises:

https://github.com/rennerocha/europython-2023-gathering-data-tutorial

During the tutorial it is expected that you try to solve some small exercises using [Scrapy](https://scrapy.org), a web scraping framework. It will be the only required library to be installed (any other dependencies should be installed together with it).

Follow the [Scrapy installation guide](https://docs.scrapy.org/en/latest/intro/install.html) according your platform and ensure that you are able to run the `scrapy version` in your terminal and see `Scrapy 2.9.0` as result (with no errors).

In Linux platform I suggest the use of a virtual environment. If everything is right, it should be a few commands to have everything up and running:

```

$ git clone [email protected]:rennerocha/europython-2023-gathering-data-tutorial.git ep2023-tutorial

$ cd ep2023-tutorial

$ python3 -m venv .venv

$ source .venv/bin/activate

$ cd code

$ pip install -r requirements

```