Projects in Awesome Lists tagged with data-scraper

https://github.com/egbertbouman/youtube-comment-downloader

Simple script for downloading Youtube comments without using the Youtube API

data-science data-scraper python youtube youtube-comments

Last synced: 15 May 2025

https://github.com/je-suis-tm/web-scraping

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

bloomberg data-scraper data-scraping financial-data financial-times futures futures-historical-data news-scraper news-websites newsletter options-data python-web-scraper reuters scrapper sraping wall-street-journal wallstreetbets web-scraper web-scrapers web-scraping

Last synced: 04 Apr 2025

https://github.com/kaymen99/ai-web-scraper

AI web scraper built with Crawl4AI for extracting structured leads data from websites.

ai-agents ai-scraping crawl4ai data-scraper lead-generation llms scraper web-scraper web-scraping

Last synced: 28 Apr 2026

https://github.com/farukalamai/yelp-scraper-scrapy-python

Yelp Restaurant data scraping using python, scrapy spider

ai-bot data-extraction data-mining data-scraper data-scraping python python-scraper scrapy scrapy-crawler scrapy-spider web-scraper web-scraping web-scraping-python web-scraping-software yelp yelp-api yelp-restaurants yelp-resturant-data-scraping yelp-scraper

Last synced: 01 Sep 2025

https://github.com/ortanav2/data-scraper

A data-scraper that makes it possible to filter out the most important information from huge amounts of text based data.

data data-scraper file file-scraper scraper search searching

Last synced: 23 Mar 2025

https://github.com/bitartisan1/netdigger

A .NET 8.0 C# WPF desktop application for web scraping data into structured databases with a modern UI, comprehensive logging and optimized high performance.

csharp data data-scraper data-scraping database desktop dotnet internet logging scraper ui url web-scraper web-scrapers web-scraping web-scrapping

Last synced: 13 Apr 2025

https://github.com/iamdulanga/iqair-data-scraper

Air quality data scraping tool for get real-time data from https://www.iqair.com/ in Sri Lanka by FECTSL

air-quality air-quality-data data-scraper iqair purple-air

Last synced: 26 Jan 2026

https://github.com/sabujxi/python-scraper-and-data-analysts-admin-panel-in-django

A data scraper from texas govt site and a helping web app for managing, reviewing and editing the data

analyst data data-analysis data-entry data-scraper django django-application python python-scraper real-estate regex scraper texas

Last synced: 30 Apr 2026

https://github.com/shahrozatiq/hevy-exercises-data-scraper

This bot automates the process of logging into the Hevy website using your email and password, navigating to the exercises section, and extracting detailed data for each exercise. The extracted attributes include: Name Equipment Primary Muscle Secondary Muscle Source Source Type Thumbnail The data is systematically stored in a CSV file

data-scraper data-scraping dataset exercises exercises-dataset hevy-scraper python selenium selenium-webdriver workout-exercises