Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with scraping-api

A curated list of projects in awesome lists tagged with scraping-api .

https://github.com/alex-on-ai/WebReaper

AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

ai-agents-automation claude-code crawler dotnet firecrawl-alternative llm markdown mcp parser parsing scraper scraping scraping-api scraping-web scraping-websites webcrawler webscraping

Last synced: 14 Jun 2026

https://github.com/pavlovtech/WebReaper

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

crawler datamining parser parsing scraper scraping scraping-api scraping-data scraping-tool scraping-web scraping-websites webcrawler webscraping

Last synced: 08 Apr 2025

https://github.com/us/crw

Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/v1/scrape, /v1/crawl, /v1/search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

ai ai-agents crawler data-extraction docker firecrawl firecrawl-alternative html-to-markdown llm markdown mcp mcp-server rust scraping-api self-hosted tavily-alternative web-crawler web-scraper web-scraping web-search-api

Last synced: 09 May 2026

https://github.com/orsifrancesco/instagram-without-api-node

A simple Node.js code to get unlimited instagram public pictures by every user without api, without credentials.

instagram instagram-api instagram-scraper node node-js nodejs scraper scraping scraping-api without-api

Last synced: 19 Jul 2025

https://github.com/oxylabs/how-to-scrape-google-trends

Learn step-by-step how to scrape Google Trends data and make a result comparison using Python and Oxylabs SERP API. Extract keywords, their popularity, breakdown by region, related queries, and more.

google google-trend google-trend-api google-trend-strategy google-trends google-trends-api google-trends-crawler google-trends-scraper python scraper scraper-api scraping scraping-api web-scraping

Last synced: 14 Apr 2025

https://github.com/Matthew17-21/Captcha-Tools

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!

2captcha 2captcha-api anticaptcha anticaptcha-client capsolver capsolvercom captcha hcaptcha recaptcha scraper scraping scraping-api sneakerbot sneakerbots sneakers

Last synced: 08 Apr 2025

https://github.com/oxylabs/scrape-google-python

In this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.

google python python-scraping python-web-scraper scrape scrape-google scraper-api scraping scraping-api web-scraping

Last synced: 21 Sep 2025

https://github.com/scrapfly/python-scrapfly

Scrapfly Python SDK for headless browsers and proxy rotation

crawler headless-browser python scraper scraping scraping-api sdk web-scraper web-scraping

Last synced: 14 Apr 2025

https://github.com/addy999/onequery

AI web agent to find answers to any question

ai llm rag scraping-api selenium web webdev

Last synced: 12 May 2025

https://github.com/chrismichaelps/ryuanime

A free anime streaming , using the jkanime content by scraping the jkanime website.

anime desktop-application electron-app exprees jkanime nodejs scraping-api scraping-websites streaming-video typescript videos vuejs

Last synced: 28 Aug 2025

https://github.com/juftin/yellowstone-camping

Campsite Reservation Cancellation Finder (Yellowstone National Park)

camping docker national-parks push-notifications pushover python scraping scraping-api

Last synced: 15 Jul 2025

https://github.com/umihico/minigun-requests

Web scraping API to outsource tons of GET & xpath to cloud computing

crawler crawling scraping scraping-api scraping-framework scraping-python web-scraping

Last synced: 13 Apr 2025

https://github.com/scrape-badger/scrapebadger-node

Official Node.js SDK for ScrapeBadger - Async web scraping APIs for Twitter and more

scrapebadger-sdk scraping scraping-api sdk twitter twitter-api twitter-scraper x

Last synced: 31 May 2026

https://github.com/jonesrussell/page-prowler

Experimental mashup of golang commands to scrape the web

scraping-api scraping-websites

Last synced: 25 Jan 2026

https://github.com/scrapeless-ai/scrapeless-sdk-python

SDK to access Scrapeless API directly from Python. We handle Proxies, Scraping Browser, Scraping API, Web Unlocker and Captcha Solver for you.

captcha-solver proxies python scrapeless scraping-api scraping-browser sdk sdk-packages webunlocker

Last synced: 06 Mar 2025

https://github.com/sxryxnshs5/python-playwright-stockscraper-api

A Flask-based API that scrapes stock data using Playwright and BeautifulSoup, returning the results as downloadable CSV files. Note: The API is hosted on Render.com's free tier, which may lead to a loading time of 3-4 minutes.

nifty playwright python scraping scraping-api scraping-python stock-data

Last synced: 17 Apr 2026

https://github.com/scrapeless-ai/scrapeless-sdk-go

SDK to access Scrapeless API directly from Golang. We handle Proxies, Scraping Browser, Scraping API, Web Unlocker and Captcha Solver for you.

captcha-solver go proxies scrapeless scraper scraper-go scraping-api scraping-browser sdk sdk-go webunlocker

Last synced: 06 Jun 2026

https://github.com/scrapeless-ai/webunlocker-skill

OpenClaw skill of Scrapeless Web Unlocker for Web Scraping, reCAPTCHA & Cloudflare Solving, and AI Data Collection.

ai-agent ai-agents ai-search chatgpt-scraper cloudflare-solver llm-scraping openclaw openclaw-skills perplexity scraping-api web-scraping web-unblocker

Last synced: 14 Apr 2026

https://github.com/notthestallion/eve-online_deals_finder-web-scraping-

This repository will have different deal finders for EVE Online, offering players ways to discover in-game opportunities like finding rare items, resources and trade routes. With multiple options available, players can optimize their gameplay and achieve their goals.

game game-development games scrape scraper scraper-api scrapers scraping scraping-api scraping-python scraping-web scraping-websites scrapy

Last synced: 05 Jun 2026