Projects in Awesome Lists tagged with scraper
A curated list of projects in awesome lists tagged with scraper .
https://github.com/firecrawl/firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
ai ai-agents ai-crawler ai-scraping ai-search crawler data-extraction html-to-markdown llm markdown scraper scraping web-crawler web-data web-data-extraction web-scraper web-scraping web-search webscraping
Last synced: 09 Nov 2026
https://github.com/unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
ai ai-agents crawler data-extraction llm markdown mcp open-source playwright python rag scraper web-crawler web-crawling web-scraping
Last synced: 09 Nov 2026
https://github.com/huginn/huginn
Create agents that monitor and act on your behalf. Your agents are standing by!
agent automation feed feedgenerator huginn monitoring notifications rss scraper webscraping
Last synced: 09 Nov 2026
https://github.com/naibowang/easyspider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
batch-processing batch-script code-free crawler data-collection frontend gui html input-parameters layman parameters robotics rpa scraper spider visual visualization visualprogramming web www
Last synced: 18 Oct 2026
https://github.com/mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
ai ai-scraping crawler data html-to-markdown llm markdown rag scraper scraping web-crawler webscraping
Last synced: 12 May 2025
https://github.com/NaiboWang/EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
batch-processing batch-script code-free crawler data-collection frontend gui html input-parameters layman parameters robotics rpa scraper spider visual visualization visualprogramming web www
Last synced: 20 Mar 2025
https://github.com/cheeriojs/cheerio
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
cheerio dom hacktoberfest html htmlparser htmlparser2 jquery parser scraper selector
Last synced: 18 Oct 2026
https://github.com/feder-cr/Jobs_Applier_AI_Agent_AIHawk
AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.
agent application-resume artificial-intelligence automate automation bot chatgpt chrome gpt human-resources job jobs jobsearch jobseeker opeai python resume scraper scraping selenium
Last synced: 09 Oct 2025
https://github.com/feder-cr/jobs_applier_ai_agent_aihawk
AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.
agent application-resume artificial-intelligence automate automation bot chatgpt chrome gpt human-resources job jobs jobsearch jobseeker opeai python resume scraper scraping selenium
Last synced: 13 May 2025
https://github.com/apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
apify automation crawler crawling headless headless-chrome javascript nodejs npm playwright puppeteer scraper scraping typescript web-crawler web-crawling web-scraping
Last synced: 09 Nov 2026
https://github.com/evil0ctal/douyin_tiktok_download_api
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
bilibili crawler data-collection douyin douyin-api downloader fastapi mcp-server model-context-protocol openapi rest-api scraper social-media speech-to-text tiktok tiktok-api tiktok-downloader tiktok-scraper video-downloader web-scraping
Last synced: 09 Nov 2026
https://github.com/apifytech/apify-js
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
apify automation crawler crawling headless headless-chrome javascript nodejs npm playwright puppeteer scraper scraping typescript web-crawler web-crawling web-scraping
Last synced: 06 Jul 2025
https://github.com/getmaxun/maxun
Turn any website into a structured API. Extract, automate, search and monitor the web.
agents api automation browser-automation crawler crawling data-extraction no-code nocode playwright robotic-process-automation rpa scraper self-hosted web-scraper web-scraping web-search webscraping
Last synced: 18 Oct 2026
https://github.com/Evil0ctal/Douyin_TikTok_Download_API
🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音、快手、TikTok、Bilibili数据爬取工具，支持API调用，在线批量解析及下载。
api async crawler douyin douyin-api douyin-scraper douyin-tiktok-api douyin-tiktok-download fastapi no-watermark online-parsing python pywebio scraper spider tiktok tiktok-api tiktok-scraper tiktok-signature web-scraping
Last synced: 26 Mar 2025
https://github.com/pwxcoo/chinese-xinhua
:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。
chinese chinese-characters chinese-language chinese-nlp chinese-simplified chinese-traditional data json json-data json-dataset python3 scraper
Last synced: 18 Oct 2026
https://github.com/nopechallc/nopecha-extension
Automated CAPTCHA solver for your browser. Works with Selenium, Puppeteer, Playwright, and more.
ai-agents anti-captcha arkose aws-waf browser-automation captcha-solver-for-bots cloudflare-turnstile nopecha perimeterx perimeterx-solver recaptcha-bypass-scraping scraper turnstile turnstile-solver web-scraping
Last synced: 09 Nov 2026
https://github.com/guyueyingmu/avbook
AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
adult adult-video avmoo crawler database guzzlehttp javbus javlibrary laravel magnet magnet-link scraper spider
Last synced: 18 Oct 2026
https://github.com/apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
apify automation beautifulsoup crawler crawling headless headless-chrome parsel pip playwright python scraper scraping selenium web-crawler web-crawling web-scraping
Last synced: 09 Nov 2026
https://github.com/alirezamika/autoscraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
ai artificial-intelligence automation crawler machine-learning python scrape scraper scraping web-scraping webautomation webscraping
Last synced: 09 Nov 2026
https://github.com/teamwiseflow/wiseflow
Use LLMs to dig out what you care about from massive amounts of information and a variety of sources daily.
crawler focus-stacking information-gathering llm scraper
Last synced: 27 Apr 2026
https://github.com/go-rod/rod
A Chrome DevTools Protocol driver for web automation and scraping.
automation cdp chrome-devtools chrome-devtools-protocol chrome-headless crawling devtools devtools-protocol go golang gorod headless rod scraper testing web web-scraping
Last synced: 18 Oct 2026
https://github.com/TeamWiseFlow/wiseflow
Use LLMs to dig out what you care about from massive amounts of information and a variety of sources daily.
crawler focus-stacking information-gathering llm scraper
Last synced: 24 Mar 2025
https://github.com/mishushakov/llm-scraper
Turn any webpage into structured data using LLMs
ai artificial-intelligence browser browser-automation gpt gpt-4 langchain llama llm openai playwright puppeteer scraper
Last synced: 09 Nov 2026
https://github.com/MontFerret/ferret
Declarative web scraping
cdp chrome cli crawler crawling data-mining dsl go golang hacktoberfest library query-language scraper scraping scraping-websites tool
Last synced: 13 Mar 2025
https://github.com/ahmadibrahiim/website-downloader
💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
assets downloader offline-web-pages scraper
Last synced: 18 Oct 2026
https://github.com/justanotherarchivist/snscrape
A social networking service scraper in Python
python scraper social-media social-network
Last synced: 18 Oct 2026
https://github.com/bjesus/pipet
Swiss-army tool for scraping and extracting data from online assets, made for hackers
css curl gjson json playwright scraper scraping
Last synced: 19 Oct 2026
https://github.com/d60/twikit
Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot
bot client python python-web-scraper python3 scrape scraper scraping search tweepy twitter twitter-api twitter-bot twitter-client twitter-internal-api twitter-scraper wrapper x x-api
Last synced: 10 Nov 2026
https://github.com/fent/node-ytdl-core
YouTube video downloader in javascript.
node scraper video-downloader youtube youtube-downloader
Last synced: 19 Oct 2026
https://github.com/joeyism/linkedin_scraper
A library that scrapes Linkedin for user data
chrome company driver firefox linkedin linkedin-profile linkedin-scraper linkedin-url profile scraper scrapes-linkedin users
Last synced: 19 Oct 2026
https://github.com/JustAnotherArchivist/snscrape
A social networking service scraper in Python
python scraper social-media social-network
Last synced: 27 Mar 2025
https://github.com/madawei2699/myGPTReader
A community-driven way to read and chat with AI bots - powered by chatGPT.
ai chatgpt crawler daily-news embedding gpt-35-turbo hot-news openai prompt reader scraper slack-bot
Last synced: 16 Apr 2025
https://github.com/myreader-io/myGPTReader
A community-driven way to read and chat with AI bots - powered by chatGPT.
ai chatgpt crawler daily-news embedding gpt-35-turbo hot-news openai prompt reader scraper slack-bot
Last synced: 10 Apr 2025
https://github.com/myreader-io/mygptreader
A community-driven way to read and chat with AI bots - powered by chatGPT.
ai chatgpt crawler daily-news embedding gpt-35-turbo hot-news openai prompt reader scraper slack-bot
Last synced: 19 Oct 2026
https://github.com/ultimahoarder/ultimascraper
Scrape all the media from an OnlyFans account - Updated regularly
archive datascraping onlyfans scraper
Last synced: 19 Oct 2026
https://github.com/ionicabizau/scrape-it
🔮 A Node.js scraper for humans.
node-scraper scraper web-scraping
Last synced: 19 Oct 2026
https://github.com/IonicaBizau/scrape-it
🔮 A Node.js scraper for humans.
hacktoberfest node-scraper scraper
Last synced: 15 Mar 2025
https://github.com/UltimaHoarder/UltimaScraper
Scrape all the media from an OnlyFans account - Updated regularly
archive datascraping onlyfans scraper
Last synced: 26 Mar 2025
https://github.com/anakin-inc/anakin
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
ai anti-detect golang markdown open-source playwright scraper self-hosted web-crawler web-scraping
Last synced: 09 Nov 2026
https://github.com/javscraper/emby.plugins.javscraper
Emby/Jellyfin 的一个日本电影刮削器插件，可以从某些网站抓取影片信息。
adult emby fanart-poster fc2 japanese jav jav-scraper javbus jellyfin jsproxy metadata plugin scraper synology
Last synced: 18 Oct 2026
https://github.com/edoardottt/cariddi
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
bugbounty crawler crawling endpoint-discovery endpoints go golang hacktoberfest infosec osint penetration-testing pentesting recon reconnaissance redteam scraper secret-keys secrets-detection security security-tools
Last synced: 18 Oct 2026
https://github.com/sqzw-x/mdcx
Movie metadata scraper
crawler emby jav-scraper jellyfin metadata movie-crawler movie-metadata movie-scrapper movies python scraper
Last synced: 18 Oct 2026
https://github.com/meetdeveloper/freedictionaryapi
There was no free Dictionary API on the web when I wanted one for my friend, so I created one.
api dictionary-api dictonary free-api google google-dictionary scraper
Last synced: 19 Oct 2026
https://github.com/JavScraper/Emby.Plugins.JavScraper
Emby/Jellyfin 的一个日本电影刮削器插件，可以从某些网站抓取影片信息。
adult emby fanart-poster fc2 japanese jav jav-scraper javbus jellyfin jsproxy metadata plugin scraper synology
Last synced: 27 Mar 2025
https://github.com/itsowen/cyberscraper-2077
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
ai-scraping gemini-api llm llm-scraper openai scraper web-scraper webscraping
Last synced: 09 Nov 2026
https://github.com/aapatre/automatic-udemy-course-enroller-get-paid-udemy-courses-for-free
Do you want to LEARN NEW STUFF for FREE? Don't worry, with the power of web-scraping and automation, this script will find the necessary Udemy coupons & enroll you for PAID UDEMY COURSES, ABSOLUTELY FREE!
python python3 scraper scraping selenium
Last synced: 19 Oct 2026
https://github.com/aapatre/Automatic-Udemy-Course-Enroller-GET-PAID-UDEMY-COURSES-for-FREE
Do you want to LEARN NEW STUFF for FREE? Don't worry, with the power of web-scraping and automation, this script will find the necessary Udemy coupons & enroll you for PAID UDEMY COURSES, ABSOLUTELY FREE!
python python3 scraper scraping selenium
Last synced: 03 Apr 2025
https://github.com/facundoolano/google-play-scraper
Node.js scraper to get data from Google Play
api crawler google-play nodejs scraper
Last synced: 19 Oct 2026
https://github.com/vladkens/twscrape
Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.
data-collection data-mining scraper scraping social-media-automation social-network-analysis tweets twitter twitter-api twitter-automation twitter-bot twitter-client twitter-crawler twitter-data twitter-scraper twitter-scraping web-scraping x-api x-scraper x-twitter
Last synced: 10 Nov 2026
https://github.com/oxylabs/how-to-scrape-google-trends
Learn step-by-step how to scrape Google Trends data and make a result comparison using Python and Oxylabs SERP API. Extract keywords, their popularity, breakdown by region, related queries, and more.
google google-trend google-trend-api google-trend-strategy google-trends google-trends-api google-trends-crawler google-trends-scraper python scraper scraper-api scraping scraping-api web-scraping
Last synced: 19 Oct 2026
https://github.com/microlinkhq/metascraper
Scrape metadata from any URL using Open Graph, JSON-LD, HTML meta tags, and smart fallbacks.
article cheerio extract html json-ld metadata metascraper og open-graph preview scraper unfurl
Last synced: 19 Oct 2026
https://github.com/jae-jae/querylist
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
crawler querylist scraper spider
Last synced: 19 Oct 2026
https://github.com/jae-jae/QueryList
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
crawler querylist scraper spider
Last synced: 14 Mar 2025
https://github.com/serene-arc/bulk-downloader-for-reddit
Downloads and archives content from reddit
archive downloader gfycat imgur python reddit scraper
Last synced: 19 Oct 2026
https://github.com/Serene-Arc/bulk-downloader-for-reddit
Downloads and archives content from reddit
archive downloader gfycat imgur python reddit scraper
Last synced: 12 Mar 2025
https://github.com/meetDeveloper/freeDictionaryAPI
There was no free Dictionary API on the web when I wanted one for my friend, so I created one.
api dictionary-api dictonary free-api google google-dictionary scraper
Last synced: 28 Mar 2025
https://github.com/finic-ai/psychic
Stealth browsers as a service. Connect your scraper or automation to a fleet of cloud-hosted browsers configured for reliability and stealth.
automation generative-ai integrations rpa scraper
Last synced: 11 Aug 2025
https://github.com/finic-ai/finic
Stealth browsers as a service. Connect your scraper or automation to a fleet of cloud-hosted browsers configured for reliability and stealth.
automation generative-ai integrations rpa scraper
Last synced: 10 Apr 2025
https://github.com/zerodytrash/tiktok-live-connector
TikTok LIVE API for Node.js: An unofficial library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.
api api-wrapper bot broadcast chat chat-reader connector hacktoberfest live livestream nodejs package scraper stream tiktok tiktok-api tiktok-live tiktok-live-api webcast websocket
Last synced: 10 Nov 2026
https://github.com/paulmcinnis/jobfunnel
Scrape job websites into a single spreadsheet with no duplicates.
automated beautiful-soup csv glassdoor indeed international job job-search jobs linkedin python scraper search tfidf waterloo yaml
Last synced: 19 Oct 2026
https://github.com/cyberagiinc/devdocs
Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App
cline crawl4ai cursor documentation llm playwright python3 scraper security typescript windsurf
Last synced: 19 Oct 2026
https://github.com/teamnewpipe/newpipeextractor
NewPipe's core library for extracting data from streaming sites
bandcamp crawler extractor mediaccc newpipe peertube scraper soundcloud youtube
Last synced: 19 Oct 2026
https://github.com/PaulMcInnis/JobFunnel
Scrape job websites into a single spreadsheet with no duplicates.
automated beautifulsoup beautifulsoup4 csv glassdoor indeed international job jobs monster python scraper search tfidf waterloo yaml
Last synced: 17 Mar 2025
https://github.com/watercrawl/watercrawl
Transform Web Content into LLM-Ready Data
aicrawler crawl4ai crawler crawling-python html2markdown llm-crawler llm-scraper scraper
Last synced: 19 Oct 2026
https://github.com/oxylabs/how-to-scrape-google-jobs
Learn how to build your own Google Jobs scraper that simultaneously scrapes Google Jobs for multiple search queries and geo-locations with Python and Oxylabs’ Google Jobs Scraper API. https://oxylabs.io/blog/how-to-scrape-google-jobs
google-scraping google-search-api google-search-scraper python scraper scraper-api scraper-python serp-scraper-api serp-scraping web-scraping
Last synced: 19 Oct 2026
https://github.com/website-scraper/node-website-scraper
Download website to local directory (including all css, images, js, etc.)
hacktoberfest javascript nodejs scraper website-scraper
Last synced: 19 Oct 2026
https://github.com/oxylabs/google-play-scraper
Google Play Scraper for collecting public details about applications, games, movies & TV shows, books, and more.
google google-play google-play-api google-play-scraper google-play-scraper-api google-play-store google-search-scraper movies-api play-scraper scraper
Last synced: 19 Oct 2026
https://github.com/metafates/mangal
📖 The most advanced (yet simple) cli manga downloader in the entire universe! Lua scrapers, export formats, anilist integration, fancy TUI and more!
anilist anime cli comic-downloader command-line go golang linux lua macos manga manga-downloader manga-reader mangadex mangal pdf scraper terminal tui windows
Last synced: 19 Oct 2026
https://github.com/rushter/selectolax
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
crawler css html html5 parser python scraper web-scraping
Last synced: 19 Oct 2026
https://github.com/paulpierre/informer
A Telegram Mass Surveillance Bot in Python
bot cryptocurrency listen listener monitor python scraper spy surveillance telegram telegram-api telegram-bot telegram-bot-api telegrambot telethon telethon-userbot
Last synced: 19 Oct 2026
https://github.com/AhmadIbrahiim/Website-downloader
💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
assets downloader offline-web-pages scraper
Last synced: 04 Apr 2025
https://github.com/gramaddict/bot
Completely free and open-source human-like Instagram bot. Powered by UIAutomator2 and compatible with basically any Android device 5.0+ that can run Instagram - real or emulated.
adb android automatic automation automator bot emulator follow followers gramaddict instagram instagram-bot interaction like python scraper script telegram-reports uia2
Last synced: 19 Oct 2026
https://github.com/altimis/scweet
Scrape tweets, profiles, followers and following from Twitter/X, no API key needed. Python library with smart multi-account pooling, proxy support and async.
apify data-collection graphql proxy python python-library scrape-tweets scraper social-media tweet-scraper tweets twitter twitter-data twitter-followers twitter-following twitter-scraper twitter-search twitter-x web-scraping x
Last synced: 19 Oct 2026
https://github.com/katrielmoses/mailaccess
Free email OSINT tool, 5000+ platforms, identity clustering, breach detection. No API keys required. pip install mailaccess
cybersecurity email email-automation email-marketing email-osint email-scraper email-verification infosec open-source osint osint-tool penetration-testing privacy python reconnaissance scraper security-tools threat-analysis threat-intelligence
Last synced: 19 Oct 2026
https://github.com/eatmoreduck/boss-zhipin-scraper
Boss直聘爬虫 / BOSS直聘职位数据抓取工具，基于 Chrome CDP 协议复用真实登录态，绕过字体反爬，输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.
agent-skills ai-agents boss-zhipin boss-zhipin-scraper boss-zhipin-spider bosszp chrome-cdp claude-skills crawler job-scraper python scraper spider zhipin
Last synced: 19 Oct 2026
https://github.com/Altimis/Scweet
Scrape tweets, profiles, followers and following from Twitter/X, no API key needed. Python library with smart multi-account pooling, proxy support and async.
apify data-collection graphql proxy python python-library scrape-tweets scraper social-media tweet-scraper tweets twitter twitter-data twitter-followers twitter-following twitter-scraper twitter-search twitter-x web-scraping x
Last synced: 14 Aug 2026
https://github.com/th3unkn0n/osi.ig
Information Gathering Instagram.
information-gathering information-retrieval instagram instagram-scraper linux osint python python3 scraper termux termux-tool
Last synced: 19 Oct 2026
https://github.com/justfoolingaround/animdl
A highly efficient, fast, powerful and light-weight anime downloader and streamer for your favorite anime.
Last synced: 19 Oct 2026
https://github.com/zerodytrash/TikTok-Live-Connector
Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.
api api-wrapper bot broadcast chat chat-reader connector hacktoberfest javascript live livestream nodejs package scraper stream tiktok tiktok-api tiktok-live webcast websocket
Last synced: 13 Apr 2025
https://github.com/0x676e67/wreq-python
An ergonomic, privacy-aware Python HTTP Client
akamai akamai-fingerprint censorship-resistant crawler fingerprint http http-client http2 https ja3 ja4 python rust scraper tls tls-client tls-fingerprint web-scraping websocket websocket-client
Last synced: 19 Oct 2026
https://github.com/isaackogan/TikTokLive
The definitive Python library to receive livestream events (comments, gifts, etc.) in realtime from TikTok LIVE.
api chat-reader connector printer python scraper stream tiktok tiktok-api tiktok-live tiktok-printer tiktok-scraper
Last synced: 11 Jul 2026
https://github.com/mahanaicoach/google-maps-scraper-kit
Free Google Maps scraper for lead generation. Exports phones, emails, websites and socials to CSV. Runs locally in Docker, no API keys. Claude Code skill included.
agent-skills b2b-leads claude-code claude-skills codex-skills cold-outreach docker email-extractor email-scraper google-maps google-maps-scraper google-places lead-generation lead-scraper local-business playwright python sales-prospecting scraper web-scraping
Last synced: 19 Oct 2026
https://github.com/yjl9903/animegarden
動漫花園 镜像站 | 动画 BT 资源聚合站 | 动画 BT 资源开放接口
agent animation anime anime-tracker animegarden animelist animespace anitomy bangumi claude-code codex dmhy dsh-plugin openapi scraper skills torrent
Last synced: 09 Nov 2026
https://github.com/TeamNewPipe/NewPipeExtractor
NewPipe's core library for extracting data from streaming sites
bandcamp crawler extractor mediaccc newpipe peertube scraper soundcloud youtube
Last synced: 19 Jul 2025
https://github.com/lorey/mlscraper
🤖 Scrape data from HTML websites automatically by just providing examples
crawler crawler-python crawling extraction-engine html machine-learning scraper scraping
Last synced: 19 Oct 2026
https://github.com/felipecsl/wombat
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Last synced: 19 Oct 2026
https://github.com/huaying/instagram-crawler
Get Instagram posts/profile/hashtag data without using Instagram API
auto autoliker instagram instagram-bot instagram-crawler instagram-liker instagram-scraper likers python scraper webdriver
Last synced: 19 Oct 2026
https://github.com/avnsx/fansly-downloader
Easy to use fansly.com content downloading tool. Written in python, but ships as a standalone Executable App for Windows too. Enjoy your Fansly content offline anytime, anywhere in the highest possible content resolution! Fully customizable to download in bulk or single: photos, videos & audio from timeline, messages, collection & specific posts 👍
cross-platform database datascraping downloader fansly fansly-download fansly-downloader fansly-scraper gui image-download linux macos open-source portable python reddit scraper video video-download windows
Last synced: 19 Oct 2026
https://github.com/mariostoev/finviz
Unofficial API for finviz.com
analysis api chart csv database finviz finviz-api finviz-csv finviz-scraper pypi scraper screener sql
Last synced: 19 Oct 2026
https://github.com/consumet/api.consumet.org
A Modern Search Engine API for Anime, Movies/TVShows, Books, Light Novels, Manga, etc.
anilist anime anime-api api books books-api comics comics-api light-novels lightnovel-api manga manga-api movies movies-api rest-api scraper search-engine streaming streaming-api typescript
Last synced: 28 Mar 2025
https://github.com/cinemagoer/cinemagoer
Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb (to which we are not affiliated in any way) movie database about movies, people and characters
actors cast character cinema cinemagoer company database db imdb internet-movie-database movie movie-database movies parser python scraper sql
Last synced: 19 Oct 2026
https://github.com/nriver/episode-rename
电视剧/番剧自动化重命名工具, 一键批量改名. 可配合QBittorrent下载后自动重命名, 方便Emby自动刮削. 支持Windows, Linux, MacOS, Docker 和 群晖套件环境运行
automation command-line command-line-tool docker linux macos python python3 qbittorrent rename rename-script scraper synology windows
Last synced: 19 Oct 2026
https://github.com/adyzng/jd-autobuy
Python爬虫，京东自动登录，在线抢购商品
crawler jingdong python scraper
Last synced: 19 Oct 2026
https://github.com/Adyzng/jd-autobuy
Python爬虫，京东自动登录，在线抢购商品
crawler jingdong python scraper
Last synced: 15 May 2025
https://github.com/Nriver/Episode-ReName
电视剧/番剧自动化重命名工具, 一键批量改名. 可配合QBittorrent下载后自动重命名, 方便Emby自动刮削. 支持Windows, Linux, MacOS, Docker 和 群晖套件环境运行
automation command-line command-line-tool docker linux macos python python3 qbittorrent rename rename-script scraper synology windows
Last synced: 29 Apr 2025