Projects in Awesome Lists tagged with webscrape

https://github.com/libraryofcelsus/Aetherius_AI_Assistant

A completely private, locally-operated Ai Assistant/Chatbot/Sub-Agent Framework with realistic Long Term Memory and thought formation using Open Source LLMs. Qdrant is used for the Vector DB.

agent ai assistant autonomous chatbot companion customizable discord gpt gpt-4 gpt-vision long-term-memory multi-agent oobabooga qdrant research research-tool voice-assistant webscrape

Last synced: 24 Mar 2025

https://github.com/bosniankicks/greenlight

A Golang based Undetected Web Automation Framework

akamai anti antibot bot browser go golang kasada kasada-solver nike playwright scraping security selenium web webautomation webscrape webscraping

Last synced: 01 Mar 2025

https://github.com/fahimfba/web-scraper

Extract data from websites using the web-scrapper. Made with nodejs, ExpressJS, axios & cheerio.

axios cheerio cheeriojs javascript js npm npm-package webscrape webscraping webscraping-data webscraping-search webscrapper

Last synced: 14 Apr 2025

https://github.com/aditeyabaral/newsnow

Automated document merging and extractive summarization of news articles

news nlp python-3 python-3-6 python3 python36 sklearn sklearn-vectorizer text-processing webscrape webscraper webscraping

Last synced: 09 Apr 2025

https://github.com/fahimfba/simple-web-scrapper

Extract data from websites using the web-scrapper. Made with nodejs, ExpressJS, axios & cheerio.

axios cheerio cheeriojs javascript js npm npm-package webscrape webscraping webscraping-data webscraping-search webscrapper

Last synced: 10 Oct 2025

https://github.com/disane87/scrape-dojo

🥷 Master the art of web scraping with JSON-powered workflows Define scrapes declaratively · Template everything · Run and monitor in style

angular astro automation browser-automation docker dojo json modular nestjs puppeteer scrape scraping self-hosted typescript web-scraping webscrape

Last synced: 11 Mar 2026

https://github.com/matt-dray/og-emoji-svg

:poop::thumbsup: Recreate the first-ever emoji set (SoftBank, 1997) as SVGs using R

emoji rstats svg webscrape

Last synced: 02 Apr 2025

https://github.com/ng10op/tradesphere

TradeSphere is a web-based application designed for stock analysis, utilizing web scraping to collect, analyze, and visualize stock market data.

chromedriver express javascript jwt mongodb nodejs react selenium selenium-webdriver stock stock-analysis stocks tailwindcss webscrape webscraping webscraping-data yahoo-finance

Last synced: 08 Apr 2026

https://github.com/evanlei-git/youtube-uploader-for-reddit-compilations-poc

This Project is a POC to prove one way of how Automated Compilation Channels work on Youtube.

automation python3 reddit webscrape youtube

Last synced: 14 Sep 2025

https://github.com/sh13y/adalk-news-scraper

🚀 This repo auto-scrapes Ada.lk 📰 for the latest news, updates the README, and stores logs in a JSON file. Your 24/7 digital news butler - no coffee needed! ☕✨

adalk lk newsscraper python sinhala-news sri-lanka webscrape

Last synced: 30 Jun 2025

https://github.com/furqanhun/mal_animanga_dsa

This repo contains code files that we created to scrap My Anime List and use the database to train multiple machine learning and deep learning models for our Data Structure and Algorithms university project

data-structures-and-algorithms dsa dsa-practice mal myanimelist webscrape webscraping

Last synced: 26 Feb 2025

https://github.com/revmax-creator/web-scrapper

A powerful and flexible Python-based web scraper designed to extract data from websites efficiently. This repository is ideal for developers, data analysts, and enthusiasts who need a robust solution for web scraping tasks, ranging from basic static pages to complex, JavaScript-rendered content.

webscrape webscraper webscraping webscraping-beautifulsoup webscraping-data webscrapper webscrapping webscrapping-python

Last synced: 30 Mar 2025

https://github.com/dms-codes/scrape-stei-itb-ac-id

Web Scraping with Python This Python script performs web scraping on a website to extract links, emails, and WhatsApp links from the specified domain (stei.itb.ac.id). It uses the requests library to fetch web pages and BeautifulSoup for parsing HTML content.

itb python stei webscrape webscraper

Last synced: 27 May 2026