Projects in Awesome Lists tagged with scraping-framework
A curated list of projects in awesome lists tagged with scraping-framework .
https://github.com/omkarcloud/botasaurus
The All in One Framework to Build Undefeatable Scrapers
anti-bot anti-detect anti-detect-browser anti-detection antidetect-browser bot-detection bypass-cloudflare cloudflare-bypass cloudflare-scrape python-scraper python-web-scraper python-web-scraping scraping-framework scraping-python scraping-tool undetectable undetected undetected-chromedriver web-crawling web-scraping-python
Last synced: 13 May 2025
https://github.com/zhuyingda/webster
a reliable high-level web crawling & scraping framework for Node.js.
automation-test automation-ui chromium crawler crawling headless-chrome javascript javascript-framework nodejs nodejs-framework puppeteer scraping-framework spider
Last synced: 15 May 2025
https://github.com/alephdata/memorious
Lightweight web scraping toolkit for documents and structured data.
crawling scraping scraping-framework
Last synced: 12 Apr 2025
https://github.com/kennethreitz/requests-html
Pythonic HTML Parsing for Humans™
html requests scraping scraping-framework scraping-websites
Last synced: 15 May 2025
https://github.com/flulemon/sneakpeek
Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis
crawler crawler-python crawlers crawling crawling-engine crawling-framework python python3 scraper scraper-api scraper-engine scrapers scraping scraping-framework vue website-crawler
Last synced: 14 Jan 2026
https://github.com/omkarcloud/botasaurus-starter
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
beautifulsoup crawler crawling crawling-framework crawling-python crawling-tool headless node-crawler python-crawler scraper scraping scraping-framework scraping-python scraping-tool selenium web-crawler web-crawling web-scraper web-scraping webscraping
Last synced: 23 Apr 2025
https://github.com/pim97/scrappey-wrapper-python
An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)
akamai anti-bot-api captcha captcha-solver cloudflare-anti-bot cloudflare-bypass data-extraction datadome incapsula perimetex queue-it scraping-framework scraping-library scraping-service scraping-tool shape web-data-extration web-scraping web-scraping-solution
Last synced: 12 Jan 2026
https://github.com/omkarcloud/omkar-temp-mail
🚀 OMKAR TEMP MAIL HELPS YOU USE TEMPORARY EMAILS. 🤖
10minute 10minutemail beautifulsoup crawling disposable-email disposable-email-addresses free-mail mail-api scraper scraping scraping-framework selenium temp-mail tempmail temporary-email web-crawler web-crawling web-scraper web-scraping webscraping
Last synced: 18 Mar 2025
https://github.com/omkarcloud/web-scraping-template
🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖
beautifulsoup crawler crawling crawling-framework crawling-python crawling-tool headless node-crawler python-crawler scraper scraping scraping-framework scraping-python scraping-tool selenium web-crawler web-crawling web-scraper web-scraping webscraping
Last synced: 24 Oct 2025
https://github.com/umihico/minigun-requests
Web scraping API to outsource tons of GET & xpath to cloud computing
crawler crawling scraping scraping-api scraping-framework scraping-python web-scraping
Last synced: 13 Apr 2025
https://github.com/omkarcloud/selenium-2captcha-recaptcha-solver-demo
🚀 FINAL CODE FOR TUTORIAL ON HOW TO SOLVE CAPTCHA IN SELENIUM USING 2CAPTCHA 🤖
2captcha captcha captcha-break captcha-breaker captcha-breaking captcha-bypass captcha-generator captcha-image captcha-library captcha-solver captcha-solving crack-captcha scraping scraping-framework selenium web-crawler web-crawling web-scraper web-scraping webscraping
Last synced: 07 Sep 2025
https://github.com/jimmylaurent/node-crawling-framework
✨ NodeJs crawling & scraping framework heavily inspired by Scrapy
crawler crawling crawling-framework elasticsearch headless-chrome middleware mongodb nodejs-framework scraper scraping scraping-framework scrapy spider
Last synced: 15 Mar 2025
https://github.com/omkarcloud/dentalkart-scraper
🚀 SCRAPE 1000'S OF PRODUCTS FROM DENTALKART 🤖
beautifulsoup crawler crawling crawling-framework crawling-python dentalkart dentalkart-product-scraper dentalkart-scraper dentalkart-scraping node-crawler scraper scraping scraping-framework scraping-python selenium web-crawler web-crawling web-scraper web-scraping webscraping
Last synced: 07 Sep 2025
https://github.com/codestorm-official/selenium-fastapi
A lightweight template for running Selenium-based web scraping with FastAPI on Railway. It includes headless Chromium, an optimized ChromeDriver setup, and a ready-to-use scraping endpoint, making it ideal for efficient browser automation and dependable data extraction.
scraping scraping-framework scraping-web scraping-websites selenium selenium-python
Last synced: 23 Jun 2026
https://github.com/mr-mudgal/amazon-scrapper
This Python-based Amazon Scraper is designed to efficiently extract detailed product data from Amazon's product pages. The tool leverages powerful libraries like BeautifulSoup4 and csv, along with the Scrapingant API to simulate browser behavior and bypass Amazon’s anti-scraping algorithms.
amazon csv csv-export python3 scraper scraping scraping-framework scraping-websites web-scraper web-scraping web-scraping-python web-scraping-software web-scrapping
Last synced: 26 Mar 2025
