Projects in Awesome Lists tagged with scrapy-framework

https://github.com/dojutsu-user/imdb-scraper

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

imdb-webscrapping movie-dataset python3 scrapy scrapy-crawler scrapy-framework web-scraping

Last synced: 22 Mar 2025

https://github.com/yashpatel7025/pricetracker

Amazon Price tracker using Python, Django, Celery Task Queue and Scrapy Frameworks. Front end is developed using HTML, CSS and Bootstrap

amazon amazon-price-tracker celery django django-background-tasks django-framework price-tracker price-tracking-system pricetrack python python3 scrapy scrapy-framework tracker

Last synced: 23 Aug 2025

https://github.com/varunnayal15112/E-Commercial-Sites-Scrappers

Developed various python scripts using Scrapy Framework for scraping various E-Commerce Sites like AliExpress, Flipkart, Amazon and Ebay along with the DataBase Connectivity [MYSQLWorkbench].

aliexpress amazon database-connection ebay ecommercial-sites-scrappers flipkart mysql-workbench python-script scrapy-framework

Last synced: 04 Apr 2025

https://github.com/mahmudahsan/webscraping

Lets learn web scraping and apply them in real application.

beautiful-soup beautifulsoup beautifulsoup4 python python3 scrapy scrapy-crawler scrapy-demo scrapy-framework scrapy-spider scrapy-tutorial webscraping

Last synced: 25 Apr 2025

https://github.com/nikamrohan/news-aggregator

News Aggregator Using Python,Django ,Scrapy Frameworks.

django django-framework economic-times economy entertainment hindustantimes indian-express lifestyle news news-aggregator python scrapy scrapy-framework sports techcrunch technews the variety verge

Last synced: 26 Oct 2025

https://github.com/nikamrohan/price-tracker

A Price Tracker to track the prices of your willing to buy products at E-Commerce websites once they fall below your mentioned Desired price.

django django-framework flipkart-scraper-python price-tracker python3 scrapy scrapy-framework

Last synced: 08 Jul 2025

https://github.com/rafaelhenrique/curse_spider

Curse client for Mac/Linux/Wherever

curse-client python3 scrapy-framework world-of-warcraft

Last synced: 29 Mar 2025

https://github.com/santhoshse7en/imdb-scrapy

A fun projects made using Scrapy. The Spiders included in this are able to extract Movie, TV-Series, TV-Movies based on year and title type. A lot more to come ahead

beautifulsoup4 imdb imdb-dataset imdb-scraper scrapy scrapy-crawler scrapy-framework scrapy-spider

Last synced: 13 Aug 2025

https://github.com/anthonybloomer/nrscrapy

Monitor Scrapy using the New Relic Python Agent API

newrelic newrelic-insights scrapy scrapy-framework scrapy-tutorial

Last synced: 26 Oct 2025

https://github.com/adamfisher/scrapyrt.client

A C# client to make calls to a scrapyrt (Scrapy real-time) HTTP endpoint.

crawler scraper scrapy scrapy-crawler scrapy-framework scrapy-spider

Last synced: 21 Mar 2025

https://github.com/aathifzahir/py-scrap

This project demonstrates how to build a web scraper using Scrapy, a powerful Python framework for web scraping, and store the extracted data in MongoDB, a flexible NoSQL database.

mongodb python python3 scrapy scrapy-framework webscraping