https://github.com/vgvr0/supermarket-mercadona-scraper

Supermarket-Mercadona-Scraper is an efficient and user-friendly tool that automatically scrapes and organizes product data from the Mercadona website, enabling you to analyze and compare product prices and features in real-time.
https://github.com/vgvr0/supermarket-mercadona-scraper

beautifulsoup chromedriver mercadona mercadona-scraper mercadona-scraping python-scraping selenium

Last synced: 26 days ago
JSON representation

Supermarket-Mercadona-Scraper is an efficient and user-friendly tool that automatically scrapes and organizes product data from the Mercadona website, enabling you to analyze and compare product prices and features in real-time.

• Host: GitHub
• URL: https://github.com/vgvr0/supermarket-mercadona-scraper
• Owner: vgvr0
• Created: 2024-05-04T16:26:23.000Z (8 months ago)
• Default Branch: main
• Last Pushed: 2024-10-21T08:36:35.000Z (2 months ago)
• Last Synced: 2024-10-21T11:55:03.596Z (2 months ago)
• Topics: beautifulsoup, chromedriver, mercadona, mercadona-scraper, mercadona-scraping, python-scraping, selenium
• Language: Jupyter Notebook
• Homepage:
• Size: 42 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Supermarket-Mercadona-Scraper

![Mercadona Cover](LogoMercadona.png)

Supermarket-Mercadona-Scraper is a Python-based web scraper designed to extract and organize product data from the Mercadona supermarket website.

![OS](https://img.shields.io/badge/os-linux%20%7C%20macOS%20%7C%20windows-blue&logoColor=white)

![Regex](https://img.shields.io/badge/regex-007ACC?style=for-the-badge&logo=regex&logoColor=white)

![CSV](https://img.shields.io/badge/CSV-FFB13B?style=for-the-badge&logo=csv&logoColor=white)

![Time](https://img.shields.io/badge/Time-007ACC?style=for-the-badge&logo=clock&logoColor=white)

![Random](https://img.shields.io/badge/Random-007ACC?style=for-the-badge&logo=dice&logoColor=white)

![SQLite](https://img.shields.io/badge/sqlite-%2307405e.svg?style=for-the-badge&logo=sqlite&logoColor=white)

![Keyboard](https://img.shields.io/badge/Keyboard-007ACC?style=for-the-badge&logo=keyboard&logoColor=white)

![Funciones Aux](https://img.shields.io/badge/Funciones%20Aux-007ACC?style=for-the-badge&logo=code&logoColor=white)

![Datetime](https://img.shields.io/badge/Datetime-007ACC?style=for-the-badge&logo=calendar&logoColor=white)

![BeautifulSoup](https://img.shields.io/badge/BeautifulSoup-4B8BBE?style=for-the-badge&logo=beautifulsoup&logoColor=white)

![SeleniumBase](https://img.shields.io/badge/SeleniumBase-43B02A?style=for-the-badge&logo=selenium&logoColor=white)

![Selenium](https://img.shields.io/badge/Selenium-43B02A?style=for-the-badge&logo=selenium&logoColor=white)

## Features

- Automated browsing through product categories and subcategories.

- Extraction of product details including name, image, and price.

- Utilizes Selenium WebDriver for dynamic page interaction.

## Usage

The main script is contained in the file `scraper.py`. Here's a basic usage example:

```python

from scraper import Driver

from datetime import datetime

import time

import random

from bs4 import BeautifulSoup

# Initialize the driver

driver = Driver(

    browser="chrome",

    uc=True,

    headless2=False,

    incognito=False,

    agent='Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36',

    do_not_track=True,

    undetectable=True

)

```