Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with scraping-python

A curated list of projects in awesome lists tagged with scraping-python .

https://github.com/vishal815/python-based-flight-data-scraping-automating-data-collection-for-analysis

This project is a Python-based web scraping script designed to extract flight details from the Yatra travel website. The extracted data includes flight pricing, origin, destination, departure and arrival times, and duration. The data is then saved into a CSV file for further analysis.

beautifulsoup flight-data-analysis flight-data-visualization numpy pandas pyhton pyplot scraping scraping-python seaborn selenium vishal-lazrus vishallazrus webscraping webscraping-projects

Last synced: 18 Apr 2026

https://github.com/dnlzrgz/lorekeepers-ledger

A web scraper project that exemplifies the use of Scrapy in a single file.

scraper scraping scraping-python scrapy

Last synced: 09 Apr 2025

https://github.com/eddie2111/movie_and_chill

This python project suggests random movies from IMDB hit list. If you want to work on source then "test1.01.py" is there for you to test. Made with /Python/

html python3 scraping-python tex tkinter

Last synced: 21 Sep 2025

https://github.com/liebki/minecraftserverforkdownloads

Easy access to (almost) all minecraft server types/loaders with direct links.

craftbukkit fabricmc forge github-actions minecraft-server neoforge papermc quiltmc scraping-python spigotmc sponge

Last synced: 11 Apr 2026

https://github.com/dms-codes/scrape_dosen_fh_ui

Python Web Scraping for Law Faculty Staff Information This Python script is designed to scrape information about staff members from the Law Faculty of the University of Indonesia's website. It collects data such as names, titles, fields of study, biographies, education, courses taught, books

python scraper scraping scraping-python scraping-websites

Last synced: 14 Jul 2025

https://github.com/akanshdivker/gitscrape

Flexible and efficient Python program to query for GitHub repositories, scrape relevant data, and then clone them for later use.

collector github github-api python python3 research-tool scrape scraper scraping scraping-python scraping-websites tool

Last synced: 28 Apr 2026

https://github.com/streanger/sigma-to-elastic-rules

wrapper for uncoder.io for sigma rules convertion

scraping scraping-python

Last synced: 04 Apr 2025

https://github.com/hasdata/playwright-scraping

This repository demonstrates web scraping and browser automation using Playwright in both Python and Node.js. It includes scripts for common tasks such as scraping data, interacting with web elements, handling authentication, and managing errors.

javascript playwright python scraping scraping-node scraping-python

Last synced: 08 May 2026

https://github.com/abhinavmir/rateyourchances

Get profiles of students admitted or interested in a certain college, visualize their GPAs, GRE, TOEFL/IELTS and Work Ex and use ML to predict your chances.

data-science machine-learning scraping-python

Last synced: 09 Oct 2025

https://github.com/Dalia-Mahmoud-ElSayes/Gp-2022-ma3aref-Arabic-QA

Our Graduation project: "Ma'aref" an Arabic Question Answering on Quran and Fatwa.

arabic arabic-nlp fatwa islamic knowledge-base nlp question-answering quran rule-based scraping-python

Last synced: 10 Mar 2026

https://github.com/senapedev/unirideatm

Bot Telegram per ottenere rapidamente le informazioni sui bus dell'ATM.

python scraping-python telegram-bot

Last synced: 08 Jul 2025

https://github.com/mostafahima/price-tracker-bot

A price tracking tool that scrapes product prices using BeautifulSoup and sends email alerts when prices drop below a target.

beautifulsoup scraping-python

Last synced: 08 Jul 2026

https://github.com/girorme/multisearcher

Open source scan which uses some engines to find web sites with the use of keywords and phrases.

bing python3 scanner scraping scraping-python webcrawler

Last synced: 26 Feb 2026

https://github.com/lehuuan1006/fitness_app

Chatbot that helps users maintain physical activity and adopt healthy habits by utilizing PDF scraping techniques

application chatbot fitness-app python scraping-python streamlit

Last synced: 15 Apr 2026

https://github.com/sxryxnshs5/python-playwright-stockscraper-api

A Flask-based API that scrapes stock data using Playwright and BeautifulSoup, returning the results as downloadable CSV files. Note: The API is hosted on Render.com's free tier, which may lead to a loading time of 3-4 minutes.

nifty playwright python scraping scraping-api scraping-python stock-data

Last synced: 17 Apr 2026

https://github.com/oanderoficial/scraping

Web Scraping - Utilizando a biblioteca beautifulsoup4

python scraping scraping-python scraping-websites web webscraping

Last synced: 26 Mar 2025

https://github.com/wsijp/scrapepath

Web scraping syntax

easy python scraping-python syntax templates

Last synced: 04 Apr 2026

https://github.com/redlinefb/webscraping-precios

Web Scraping de precios en un sitio web.

python3 scraping-python scraping-websites

Last synced: 06 Jun 2026

https://github.com/datacollectionspecialist/how-to-use-selenium-with-powershell

Learn how to use Selenium with PowerShell to automate web tasks efficiently. This guide covers setup, scripting, and practical examples to boost productivity!

g2 powershell powershell-module powershell-script scrape scraping scraping-python scraping-websites selenium selenium-grid selenium-java selenium-python selenium4

Last synced: 13 May 2026

https://github.com/sharph/phl-party

An interface to Philly City Council that is as bad as legistar, but with more hyperlinks

beautifulsoup4 django philadelphia scraping scraping-python

Last synced: 20 Apr 2026

https://github.com/rajputpriyankaa/playwright

Web scraping for sites with dynamic content and infinite scroll pagination.

playwright playwright-python scraping-python scraping-websites webscraping

Last synced: 08 Apr 2025

https://github.com/streanger/pastebin

pastebin scraper for educational purposes

scraping scraping-python

Last synced: 04 Apr 2025

https://github.com/benmar2406/weather-data_api-and-scraping

Different approaches (sraping and via API) to pull weather data into a programm and make it useful for the user. One option is including a daily send out via mail

python requests-library-python scraping scraping-python selenium

Last synced: 06 Apr 2025

https://github.com/giuseppeboezio/autoscout_scraping

Scrape offers from Autoscout to speed up the process of finding a new car

cars scraping-python

Last synced: 16 Jul 2025

https://github.com/elon-fask/data_scrapingnum1

script to download videos from streaming sites to dropbox

data-mining python scraping-python

Last synced: 08 Nov 2025

https://github.com/m-taghizadeh/persian_question_answering_voice2voice_ai

This repository hosts BonyadAI, a Persian question answering AI Model. We developed an initial web crawler and scraper to gather the dataset. The second phase involved building a machine learning model based on word embeddings and NLP techniques. This AI model operates end-to-end, receiving user voice input and providing responses in Persian voice.

artificial-intelligence corpus-linguistics crawler deep-learning farsi farsi-datasets large-language-models machine-learning natural-language-processing persian python question-answering scraping-python speech-to-text text-to-speech transformer-architecture word2vec

Last synced: 04 May 2026

https://github.com/braiso-22/scraping-politicos-gallegos

scraping de datos de la página de transparencia de la xunta de galicia

chromedriver galicia python scraping scraping-python scraping-websites selenium selenium-python xunta

Last synced: 21 May 2026

https://github.com/paudelgaurav/content_aggregator

It scraps TheKtmPost, Annapurna and Rising nepal for subscribed topics

django python scraping-python

Last synced: 18 May 2026

https://github.com/vishal815/flight_details_scraper_and_visualization

This project focuses on scraping flight details from Google Flights, processing the data, and performing cleaning and visualization for future use in analytics or predictive modeling.

beautifulsoup end-to-end-project flight-data flight-data-analysis google-flights google-flights-scraper pandas pyhon scraping-project scraping-python selenium vishal-lazrus vishallazrus visualization webscraping webscraping-data

Last synced: 13 Apr 2026

https://github.com/notthestallion/eve-online_deals_finder-web-scraping-

This repository will have different deal finders for EVE Online, offering players ways to discover in-game opportunities like finding rare items, resources and trade routes. With multiple options available, players can optimize their gameplay and achieve their goals.

game game-development games scrape scraper scraper-api scrapers scraping scraping-api scraping-python scraping-web scraping-websites scrapy

Last synced: 05 Jun 2026

https://github.com/rhiteshks/blackcoffer-blogs-text-analysis

Web Scraping, Sentimental Analysis and Exploratory Text Analysis on the blogs of Blackcoffer website

nltk-python pandas scraping-python

Last synced: 17 May 2026

https://github.com/orestesgaolin/rns-statystyki

Statystyki odtworzeń Radia Nowy Świat

scraping scraping-python statistics

Last synced: 20 May 2026