Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with headless-browser

A curated list of projects in awesome lists tagged with headless-browser .

https://github.com/ariya/phantomjs

Scriptable Headless Browser

automation headless headless-browser phantomjs

Last synced: 22 Oct 2025

https://github.com/archivebox/archivebox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

archivebox backups bookmark-archiver browser-bookmarks chromium digipres firefox headless-browser internet-archiving pinboard pocket python rss self-hosted singlefile warc wayback-machine web-archiving wget youtube-dl

Last synced: 09 Sep 2025

https://github.com/pirate/ArchiveBox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

archivebox backups bookmark-archiver browser-bookmarks chromium digipres firefox headless-browser internet-archiving pinboard pocket python rss self-hosted singlefile warc wayback-machine web-archiving wget youtube-dl

Last synced: 01 Apr 2025

https://github.com/ArchiveBox/ArchiveBox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

archivebox backups bookmark-archiver browser-bookmarks chromium digipres firefox headless-browser internet-archiving pinboard pocket python rss self-hosted singlefile warc wayback-machine web-archiving wget youtube-dl

Last synced: 13 Mar 2025

https://github.com/jo-inc/camofox-browser

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

ai-agent anti-bot antidetect-browser automation bot-detection browser-automation cloudflare-bypass headless-browser javascript nodejs playwright puppeteer scraping stealth-browser web-scraping

Last synced: 24 May 2026

https://github.com/figranium/figranium

Figranium is a self-hosted, free browser automation and scraping platform built on Playwright, designed to handle everything from simple scraping to complex, human-like browser interactions. It provides a visual task editor, a structured JSON task format, and advanced execution modes that go far beyond traditional scrapers.

agentic-tasks api automation browser-automation headless headless-browser playwright web-scraping

Last synced: 12 Apr 2026

https://github.com/vgalin/html2image

A package acting as a wrapper around the headless mode of existing web browsers to generate images from URLs and from HTML+CSS strings or files.

chrome chromium chromium-browser css headless-browser html html2image python python3

Last synced: 28 Mar 2025

https://github.com/mnemosynestack/doppelganger

Doppelganger is a self-hosted, free browser automation and scraping platform built on Playwright, designed to handle everything from simple scraping to complex, human-like browser interactions. It provides a visual task editor, a structured JSON task format, and advanced execution modes that go far beyond traditional scrapers.

agentic-tasks api automation browser-automation headless headless-browser playwright web-scraping

Last synced: 27 Feb 2026

https://github.com/watzon/marionette

Selenium alternative for Crystal. Browser manipulation without the Java overhead.

api browser crystal crystal-lang devtools firefox headless headless-browser marionette puppeteer selenium selenium-webdriver shards testing webdriver

Last synced: 26 Aug 2025

https://github.com/mnemosyne-artificial-intelligence/doppelganger

Doppelganger is a self-hosted, free browser automation and scraping platform built on Playwright, designed to handle everything from simple scraping to complex, human-like browser interactions. It provides a visual task editor, a structured JSON task format, and advanced execution modes that go far beyond traditional scrapers.

agentic-tasks api automation browser-automation headless headless-browser playwright web-scraping

Last synced: 03 Feb 2026

https://github.com/scrapfly/python-scrapfly

Scrapfly Python SDK for headless browsers and proxy rotation

crawler headless-browser python scraper scraping scraping-api sdk web-scraper web-scraping

Last synced: 14 Apr 2025

https://github.com/coderluii/holycode

AI coding workstation: OpenCode + Claude subscription support + 30+ tools + headless browser + multi-agent orchestration

ai ai-coding anthropic coding-agent container developer-tools devtools docker docker-compose gemini headless-browser openai opencode playwright self-hosted

Last synced: 27 May 2026

https://github.com/TarekJor/bookmark-archiver

🗄 Save an archived copy of websites from Pocket/Pinboard/Bookmarks/RSS. Outputs HTML, PDFs, and more...

archive backup bookmarks browser chromium firefox google-chrome headless-browser headless-chrome html-export pinboard pocket preservation python rss safari web-archive web-archiving web-browser wget

Last synced: 27 Mar 2025

https://github.com/tarekjor/bookmark-archiver

🗄 Save an archived copy of websites from Pocket/Pinboard/Bookmarks/RSS. Outputs HTML, PDFs, and more...

archive backup bookmarks browser chromium firefox google-chrome headless-browser headless-chrome html-export pinboard pocket preservation python rss safari web-archive web-archiving web-browser wget

Last synced: 05 Oct 2025

https://github.com/archivebox/digestbox

DigestBox takes any webpage URL (news article, video link, comment thread, etc.) and gives you just the raw content. It's powered by ArchiveBox.io under the hood.

archivebox backups digipres headless-browser internet-archiving warc web-archiving

Last synced: 01 Feb 2026

https://github.com/ancs21/playpanda

Fetch any URL to clean, LLM-ready markdown. 3-tier engine: HTTP → Lightpanda → CloakBrowser.

ai cli cloakbrowser headless-browser lightpanda llm markdown scraper web-scraping zig

Last synced: 24 May 2026

https://github.com/psyb0t/phantomime

An embeddable headless browser package for Python that provides a simplified interface for interacting with web pages using Selenium and Selenium Hub.

automation browser embeddable headless-browser selenium selenium-webdriver webdriver

Last synced: 10 Mar 2026

https://github.com/thesethrose/fetch-browser

A powerful headless browser MCP server that enables AI agents to fetch web content and perform Google searches without requiring any API keys.

automation headless-browser mcp mcp-server

Last synced: 29 Apr 2026

https://github.com/archivebox/abx-plugins

🧩 Plugins and extractors that ArchiveBox + abx-dl use: chrome, ytdlp, wget, singlefile, readability, forum-dl, gallery-dl, papers-dl, and more...

abx archivebox archivebox-plugins chromium forum-dl gallery-dl headless-browser internet-archiving papers-dl puppeteer readability scraping singlefile web-scraping wget yt-dlp

Last synced: 31 May 2026

https://github.com/ExceptionRegret/Kryfto

The open-source web-browsing backend for AI agents & workflow engines. Ships a 42-tool MCP server for Claude Code/Cursor/Codex, a full REST API for n8n/Zapier/Make, federated multi-engine search, anti-bot stealth, and enterprise infrastructure (Postgres, Redis, BullMQ, MinIO). Self-host for $5/mo flat

ai-agents anti-detection claude-code codex cursor data-extraction developer-tools fastapi headless-browser mcp mcp-server n8n open-source playwright redis search-engine self-hosted stealth web-scraping workflow-automation

Last synced: 03 Apr 2026

https://github.com/plasmate-labs/plasmate

The browser engine for agents. HTML in, Semantic Object Model out. 10x token compression, V8 JS rendering, CDP compatible. Apache-2.0.

agent-web-protocol ai-agents browser-engine cdp headless-browser llm mcp puppeteer rust semantic-web som token-compression web-automation web-scraping

Last synced: 04 Apr 2026

https://github.com/alexmarqs/alm-invoices-cli

🧾 My personal CLI app to manage my invoices via Web Scraping.

automation chalk cli executable headless-browser inquirerjs meow nodejs pkg puppeteer typescript webscraping

Last synced: 06 May 2026

https://github.com/hi-tech-ai/scraping-headless_mode

Simple web scraping from public website using headless mode.

headless headless-browser python selenium selenium-webdriver web-scraping

Last synced: 28 Apr 2025

https://github.com/greysquirr3l/stygian

High-performance graph-based web scraping engine + anti-detection browser automation for Rust

anti-bot async-rust browser-automation chrome-devtools-protocol dag headless-browser llm rust tokio web-scraping

Last synced: 27 Apr 2026

https://github.com/georgemandis/tezcatl

curl for rendered DOMs on macOS. Headless web rendering CLI powered by native macOS WebKit. Render JS-heavy pages, extract DOM, evaluate JavaScript, all from the command line.

cli command-line-tool headless-browser macos web-scraping webkit zig

Last synced: 28 Jun 2026

https://github.com/oxylabs/puppeteer-tutorial

Use this tutorial and learn how to perform web scraping using a headless browser.

headless-browser puppeteer web-scraping

Last synced: 22 Jun 2025

https://github.com/karlicoss/bt-wifi-reconnect

Make BT Wifi great again

automation headless-browser

Last synced: 07 Apr 2025

https://github.com/klarlabs-studio/scout

Browser automation, one binary. The simpler alternative to Playwright — no Node, no Python, no runtime. Library, CLI, MCP server, and chat UI for any AI agent.

ai-agent ai-browser browser-automation cdp chrome claude-mcp cursor-mcp devtools-protocol golang headless-browser llm mcp mcp-server middleware playwright-alternative screencast single-binary video-recording web-scraping

Last synced: 09 Jun 2026

https://github.com/avindra/casd-json-schema

Schema discovery tool for the CA technologies (now Broadcom) ServiceDesk / ServiceCatalog web services

broadcom ca-technologies data-engineering doselect headless-browser javascript json parsing scraper service-management servicedesk

Last synced: 16 Apr 2026

https://github.com/sofiane-abou-abderrahim/javascript-introduction-to-testing-synchronous-code

In this little JavaScript demo, I used the 3 main core types of testing: Unit Test, Integration Test and End-to-End Test (or User Interface Test). I tested my application with relatively simple synchronous code.

assertion-library end-to-end-test headless-browser intergration-test javascript jest nodejs test-runner unit-test webpack

Last synced: 11 Apr 2026

https://github.com/zmwangx/docker-selenium-python

Python 3, selenium, Chromium/chromedriver or Firefox/geckodriver.

docker dockerfile headless-browser python selenium

Last synced: 20 Apr 2026

https://github.com/codeterrayt/dare2024.com-solver

Dare2024.com Solver is a Python automation script for seamlessly solving Dare2024.com quizzes. Impress your friends with correct answers effortlessly. Compatible with all dare2024.com versions and future updates.

automation-script automation-scripts dare2024 headless-browser headless-browsers opensource python python3 quiz-solver selenium selenium-python selenium-webdriver web-automation web-automation-with-selenium web-scraping web-scraping-project web-scraping-python web-scraping-software webdriver-manager

Last synced: 07 May 2026

https://github.com/kihdev/playwright-stealth-4j

Playwright-Stealth for JVM – A Kotlin-based library to enhance Playwright's stealth capabilities for Java, Kotlin, and Groovy.

headless-browser java jvm kotlin playwright stealth

Last synced: 13 Apr 2026

https://github.com/reasonkit/reasonkit-web

High-performance MCP server for browser automation, web capture, and content extraction. Rust-powered CDP client for AI agents.

agent-tools ai-agent async automation browser-automation cdp chrome-devtools-protocol chromium developer-tools headless-browser html-extraction llm-tools mcp model-context-protocol pdf rust screenshot tokio web-automation web-scraping

Last synced: 08 Jan 2026

https://github.com/pinkpixel-dev/prysm

Prysm is a blazing-smart Puppeteer-based web scraper that doesn't just extract - it understands structure. Capable of scraping virtually any website with intelligent content detection and 14 specialized scroll strategies that adapt to different page layouts, Prysm excels at extracting content that other scrapers miss.

api cloudflare-bypass content-extraction data-extraction headless-browser headless-browsers javascript nodejs pagination puppeteer web-automation web-scraper web-scraping

Last synced: 19 Apr 2026

https://github.com/bhattjayd/passbreachfinder

A Python script that checks whether a password has been compromised using the Have I Been Pwned service. The script automates the process of querying the website and retrieving the results for the given password, leveraging Selenium and a headless Firefox browser. It’s a simple tool for testing password security and checking for data breaches.

automation command-line-tool cybersecurity data-breach data-breach-checker geckodriver haveibeenpwned headless-browser password-leak password-security python security-tool selenium web-scraping web-scraping-python

Last synced: 02 May 2026

https://github.com/just-rich/x-dm-followers

Python script that sends a DM to all the users that follow the account. With headless browser option and detailed debugging logs.

direct-message direct-messaging dm headless headless-browser messager messaging python selenium selenium-webdriver twitter twitter-dm twitter-dm-tool twitter-dmer twitter-dmer-tool x x-dm x-dm-tool x-dmer x-dmer-tool

Last synced: 10 Oct 2025

https://github.com/yfedoseev/browser_oxide

Stealth headless browser engine in Rust — native BoringSSL TLS/JA4 fingerprint, real JS via deno_core, no Chromium, no CDP. Python + MCP bindings. A camoufox alternative.

ai-agents anti-bot anti-detect-browser boringssl browser-fingerprint camoufox-alternative headless-browser ja4 mcp puppeteer-alternative rust stealth-browser tls-fingerprint undetected-browser web-scraping

Last synced: 28 Jun 2026

https://github.com/jpoindexter/browser-session

Reuse your real logged-in browser session from Node — read+decrypt Brave/Chrome/Edge cookies (zero deps) and open any login-walled page in a headless browser with that session.

brave browser-cookies chrome-cookies cli cookies cookies-from-browser headless-browser macos nodejs playwright session typescript web-scraping zero-dependency

Last synced: 04 Jul 2026

https://github.com/oaklight/veilrender

Headless browser rendering API — self-hostable on HF Spaces, Docker, or bare metal

api browser-rendering docker headless-browser html markdown playwright readability screenshot web-scraping

Last synced: 04 Jul 2026

https://github.com/johnnylearnscs/nekofetch

NekoFetch – A smart, cat-powered CLI scraper for downloading videos, files, and subtitles with optional headless browser support.

automation cli ffmpeg file-downloader headless-browser media-scraper nekofetch playwright python scraper subtitles terminal-app video-downloader

Last synced: 20 Jul 2025

https://github.com/epicsagas/obscura-plugin

MCP server for Obscura headless browser — CLI wrapper for AI agent integration with web scraping, JavaScript rendering, and browser automation

ai-agent browser-automation cli headless-browser mcp mcp-server rust web-scraping

Last synced: 03 Jul 2026

https://github.com/toolstackhq/cdpwright

Lightweight Chromium-only browser automation library built on CDP. Playwright-style API — no test runner, no framework baggage.

automation browser-automation cdp chromium devtools-protocol e2e-testing headless-browser nodejs playwright test-automation typescript web-testing

Last synced: 18 Apr 2026

https://github.com/scrapfly/scrapfly-cli

Agentic CLI for the Scrapfly platform: scrape, extract, crawl, and drive a cloud browser over CDP. Built-in LLM agent with Anthropic, OpenAI, Gemini, and Ollama. JSON-first, pipe-friendly, one static binary.

agentic ai-agent anthropic anti-bot anti-detect antidetect-browser bot-detection browser-automation cdp cli data-extraction golang headless-browser llm-agent openai scrapfly screenshot stealth-browser web-crawler web-scraping

Last synced: 20 Apr 2026

https://github.com/jcloh98/rental-property-finder

A web scraper that helps users find rental properties by automatically gathering and organizing listings from various websites to discover available homes and apartments.

data headless-browser node scraper scraping web

Last synced: 17 May 2026

https://github.com/matteuzzz/correos-cl-postal-code-scraper

Python-based scraper that automates the postal code lookup on the official Correos de Chile website. It simulates the public form with autocomplete validation and returns clean JSON responses. Fully API-ready for integration with Django or Flask backends.

api-ready chile codigo-postal correos-de-chile form-autocomplete headless-browser json-output playwright postal-code python web-scraping

Last synced: 29 Apr 2026

https://github.com/gideon-k-addai/x-dm-followers

Python script that sends a DM to all the users that follow your X (formerly Twitter) account. With headless browser option and detailed debugging logs.

direct-message dm dm-tool headless headless-browser messager messaging selenium twitter twitter-dm twitter-dm-tool twitter-dmer twitter-dmer-tool x

Last synced: 30 Apr 2026

https://github.com/tamdilip/localstorage-grabber

A minimal web app to grab localStorage of a web page with headless browser using puppeteer on server side.

headless headless-browser headless-chrome javascript localstorage nodejs puppeteer rest-api

Last synced: 01 May 2026

https://github.com/daidai118/pi-obscura-skill

Lightweight, low-memory browser automation for Pi using Obscura, with a built-in compatibility self-check for deciding when to stay on Obscura.

automation browser cdp headless-browser obscura pi pi-coding-agent pi-package skills

Last synced: 03 May 2026

https://github.com/ali-jaan-butt/job-posting-scraping

Job posting data scraped from Indeed.com. This data is used in django web for testing purpose.

headless-browser job job-posting job-postings jobs python scraping scraping-websites selenium selenium-python selenium-webdriver

Last synced: 05 May 2026

https://github.com/heyhaiden/mcp-ag-grid

Headless AG Grid server for advanced data visualization, manipulation, and export, seamlessly integrated with Claude Desktop.

ag-grid claude-desktop data-grid data-visualization headless-browser mcp open-source puppeteer

Last synced: 06 May 2026

https://github.com/inqwise/inqwise-mcp-site2ts

Convert existing websites into TypeScript Next.js apps via an MCP server (Rust) with a Node/Playwright helper. ARM-first, Tailwind-first, sandboxed under `.site2ts/`

arm64 headless-browser mcp nextjs playwright rust tailwindcss typescript web-crawler

Last synced: 11 Apr 2026

https://github.com/luminati-io/manage-failed-python-requests

Handle failed HTTP requests in Python using retry strategies with HTTPAdapter, Tenacity, and custom logic to improve web scraping reliability.

headless-browser http python requests scraping-browser status-codes tenacity web-scraping web-unblocker

Last synced: 28 Oct 2025

https://github.com/smouj/agent-browser

Give any AI agent a real browser. REST API + Web Dashboard + Vision AI. Control browsers via Playwright from OpenClaw, Hermes, or any LLM. Built with Next.js and TypeScript.

accessibility-tree agent-framework ai-agent browser-automation computer-vision headless-browser hermes llm mcp nextjs open-source openclaw playwright rest-api screenshot typescript vision-ai web-automation web-scraping

Last synced: 12 Jun 2026

https://github.com/poran-dip/frenderer

Execute client-side JavaScript and extract fully rendered HTML or text — without a browser.

crawler headless-browser prerender rendering seo spa ssr

Last synced: 25 Jun 2026

https://github.com/valpere/datascrapexter

Universal web scraper built with Go featuring advanced anti-detection, ethical compliance, and configuration-driven operation for any website.

anti-detection captcha-solver chromedp cobra-cli colly configuration-driven data-extraction data-scraping ethical-scraping go golang goquery headless-browser high-performance legal-compliance proxy-rotation viper web-crawling web-scraping

Last synced: 11 Jul 2025

https://github.com/chandankhamitkar/billbot

This is a BillBot 🤖 which acts a simplistic invoice generator, just by taking input from user and converting into a Invoice and sending invoice image to user. CURRENT STAGE: Enhancing 🚀

bot chromium-browser express gemini-ai headless-browser nextjs postgresql prisma puppeteer redis server telegram-bot-api typescript webhook

Last synced: 12 Apr 2026

https://github.com/macrat/ayd-web-scenario-scheme

A headless browser controller for Ayd status monitoring tool.

alerting ayd headless-browser monitoring

Last synced: 15 Dec 2025

https://github.com/instill-network/serp

Google SERP via Playwright — minimal scraper and benchmarking CLI. CLI & Docker; headless/headful (VNC); focuses on organic results.

benchmarking cli docker google-search headless-browser nodejs playwright proxies residential-proxies serp typescript vnc web-scraping

Last synced: 10 Apr 2026

https://github.com/ria-19/semantic_router

A QLoRA fine-tuned Llama-3.1-8B-Instruct AI agent for structured outputs, secure Python sandbox execution, hybrid code search, web scraping, and safe human-in-the-loop automation. Perfect for developers, researchers, and AI-assisted coding.

ai-agents fine-tuning headless-browser hybrid-rag llm lora qlora sandbox semantic-search unsloth

Last synced: 30 May 2026

https://github.com/patrick204nqh/browserctl

Persistent browser automation daemon and CLI for AI agents and developer workflows. Named sessions, Ruby DSL, and a token-efficient snapshot format.

ai-agents browser-automation chrome-devtools-protocol cli developer-tools dsl ferrum headless-browser ruby smoke-testing unix-socket workflow-automation

Last synced: 01 May 2026

https://github.com/luminati-io/scraping-browser

Scraping Browser is an automated headless browser for effortless web scraping with Puppeteer, Selenium, and Playwright.

captcha-solving headless-browser headless-browsers javascript nodejs playwright proxy-server puppeteer python scraping-browser selenium web-scraping

Last synced: 12 Apr 2026

https://github.com/sultannaufal/puppeteer-mcp-server

Self-hosted Puppeteer MCP server with remote SSE access, API key authentication, and Docker deployment. Complete tool suite for browser automation via Model Context Protocol.

api authentication browser-automation docker headless-browser mcp model-context-protocol nodejs puppeteer remote-access server-sent-events sse typescript web-scraping

Last synced: 10 Apr 2026