https://github.com/sahashraee/webscraper-to-sqlite

A Simple Python project to scrape book data and store it in an SQLite database for easy access and analysis.
https://github.com/sahashraee/webscraper-to-sqlite

beautifulsoup4 python sqlite3

Last synced: about 1 year ago
JSON representation

A Simple Python project to scrape book data and store it in an SQLite database for easy access and analysis.

• Host: GitHub
• URL: https://github.com/sahashraee/webscraper-to-sqlite
• Owner: SahashRaee
• License: mit
• Created: 2024-12-04T15:21:42.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-12-08T20:39:16.000Z (over 1 year ago)
• Last Synced: 2025-02-18T04:56:22.577Z (over 1 year ago)
• Topics: beautifulsoup4, python, sqlite3
• Language: Python
• Homepage:
• Size: 484 KB
• Stars: 3
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
![WebScrapping_Image](https://github.com/Sahash-Rai/Webscraper-To-Sqlite/blob/main/Asset/webscrapping_image.png)

# 📚 Book Scraping and Database Storage

Welcome to the **Book Scraping and Database Storage** project! This project scrapes book data from [Books to Scrape](https://books.toscrape.com/), stores the information in a **SQLite** database. This project is a great starting point for learning web scraping with Python, and I have completed it as a beginner.

---

## 🚀 Project Overview

This project scrapes details such as the title, price, and URL of books from the **Books to Scrape** website and stores them in an **SQLite** database. 

### Key Features:

- **Web Scraping**: Scrape top books with basic details like title, price, and URL.

- **SQLite Database**: Store and manage scraped data in a local SQLite database.

---

## 🛠️ Technologies Used

- **Python 3.x** – Programming language

- **BeautifulSoup** – For parsing HTML and scraping data

- **Requests** – For making HTTP requests

- **SQLite** – A lightweight database for storing scraped data

---

## 💡 Installation and Setup

### 1. Clone the repository:

git clone https://github.com/Sahash-Rai/Webscraper-To-Sqlite.git

### 2. Set up a virtual environment:

For macOS:

python3 -m venv myenv

source myenv/bin/activate

For Windows:

python -m venv myenv

.\myvenv\Scripts\activate

### 3. Install the required dependencies:

pip install -r requirements.txt

🏃‍♂️ Running the Project

To start the web scraping process, simply run the main script.