Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/apify/crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

apify automation crawler crawling headless headless-chrome javascript nodejs npm playwright puppeteer scraper scraping typescript web-crawler web-crawling web-scraping

Last synced: 18 Nov 2024

https://github.com/checkly/headless-recorder

Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script.

chrome chrome-extension playwright puppeteer vue

Last synced: 29 Sep 2024

https://github.com/browserless/browserless

Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.

browserless chrome docker firefox nodejs playwright puppeteer typescript webkit websocket

Last synced: 18 Nov 2024

https://github.com/gotenberg/gotenberg

A developer-friendly API for converting numerous document formats into PDF files, and more!

api chrome chromium convert-to-pdf docker docx-to-pdf excel exiftool html-to-pdf libreoffice openoffice pdf pdf-converter pdftk puppeteer qpdf screenshots unoconv wkhtmltopdf word

Last synced: 18 Nov 2024

https://github.com/alvarcarto/url-to-pdf-api

Web page PDF/PNG rendering done right. Self-hosted service for rendering receipts, invoices, or any content.

chrome headless headless-chrome heroku heroku-button html invoice pdf puppeteer receipt

Last synced: 10 Oct 2024

https://github.com/orkestral/venom

Venom is a high-performance system developed with JavaScript to create a bot for WhatsApp, support for creating any interaction, such as customer service, media sending, sentence recognition based on artificial intelligence and all types of design architecture for WhatsApp.

ai ai-bot bot bot-javascript bot-typescript chat chatbot framework message puppeteer sulla venom whatsapp whatsapp-api whatsapp-bot zap-api zap-bot

Last synced: 18 Nov 2024

https://github.com/FlareSolverr/FlareSolverr

Proxy server to bypass Cloudflare protection

api chrome chromium cloudflare docker hacktoberfest proxy puppeteer rest server

Last synced: 26 Oct 2024

https://github.com/flaresolverr/flaresolverr

Proxy server to bypass Cloudflare protection

api chrome chromium cloudflare docker hacktoberfest proxy puppeteer rest server

Last synced: 18 Nov 2024

https://github.com/danburzo/percollate

A command-line tool to turn web pages into readable PDF, EPUB, HTML, or Markdown docs.

cli epub html markdown pdf puppeteer readability

Last synced: 29 Oct 2024

https://github.com/harlan-zw/unlighthouse

Scan your entire site with Google Lighthouse in 2 minutes (on average). Open source, fully configurable with minimal setup.

google-lighthouse puppeteer site-audit

Last synced: 18 Nov 2024

https://github.com/niespodd/browser-fingerprinting

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

automation bot bot-detection browser-fingerprinting chromedriver chromium chromium-browser crawler detection fingerprinting puppeteer recaptcha scraper spider stealth web webscraping

Last synced: 10 Oct 2024

https://github.com/palxiao/poster-design

一款漂亮且功能强大的在线海报设计器,图片编辑器,仿稿定设计,适用于多种场景:海报生成、电商产品图、文章长图、视频/公众号封面等。A beautiful online image designer, suitable for various scenarios like generate posters, making design easier!

canvas design image moveable nodejs poster puppeteer vue3

Last synced: 10 Oct 2024

https://github.com/miyakogi/pyppeteer

Headless chrome/chromium automation library (unofficial port of puppeteer)

browser-automation headless-chrome puppeteer

Last synced: 27 Sep 2024

https://github.com/argos-ci/jest-puppeteer

Run tests using Jest & Puppeteer 🎪✨

chrome chromeless integration-testing jest jest-environment puppeteer

Last synced: 18 Nov 2024

https://github.com/pyppeteer/pyppeteer

Headless chrome/chromium automation library (unofficial port of puppeteer)

automation chromium puppeteer

Last synced: 18 Nov 2024

https://github.com/thomasdondorf/puppeteer-cluster

Puppeteer Pool, run a cluster of instances in parallel

cluster headless-chrome node pool pooling puppeteer

Last synced: 28 Oct 2024

https://github.com/alixaxel/chrome-aws-lambda

Chromium Binary for AWS Lambda and Google Cloud Functions

ansible aws aws-lambda chromium puppeteer serverless

Last synced: 18 Nov 2024

https://github.com/checkly/puppeteer-examples

Puppeteer example scripts for running Headless Chrome from Node.

developer-tools headless-chrome jest monitoring node nodejs puppeteer testing

Last synced: 27 Sep 2024

https://github.com/ElemeFE/page-skeleton-webpack-plugin

Webpack plugin to generate the skeleton page automatically

page-skeleton puppeteer webpack-plugin

Last synced: 30 Oct 2024

https://github.com/elemefe/page-skeleton-webpack-plugin

Webpack plugin to generate the skeleton page automatically

page-skeleton puppeteer webpack-plugin

Last synced: 10 Oct 2024

https://github.com/elegantapp/pwa-asset-generator

Automates PWA asset generation and image declaration. Automatically generates icon and splash screen images, favicons and mstile images. Updates manifest.json and index.html files with the generated images according to Web App Manifest specs and Apple Human Interface guidelines.

android favicon favicon-generator html-tags icon icon-sizes image-generation ios launch-image manifest manifest-specs mstile progressive-web-app progressive-web-apps puppeteer pwa pwa-assets splash-screen splash-screens

Last synced: 18 Nov 2024

https://github.com/pocketjoso/penthouse

Generate critical css for your web pages

css nodejs performance puppeteer web

Last synced: 10 Oct 2024

https://github.com/vogler/free-games-claimer

Automatically claims free games on the Epic Games Store, Amazon Prime Gaming and GOG.

amazon-games automation claimer docker epic-games epic-games-store free-games freebies gog playwright prime-gaming puppeteer

Last synced: 10 Oct 2024

https://github.com/emadehsan/thal

Getting started with Puppeteer and Chrome Headless for Web Scraping

chrome-headless mongodb mongoose nodejs puppeteer scraping

Last synced: 10 Oct 2024

https://github.com/puppeteer/examples

Use case-driven examples for using Puppeteer and headless chrome

automation browser-testing browser-tools demos puppeteer

Last synced: 07 Oct 2024

https://github.com/macbre/phantomas

Headless Chromium-based web performance metrics collector and monitoring tool

automation chromium css developer-tools dom domquery headless-chrome http2 http3 javascript jquery metrics phantomas puppeteer webperf webperformance

Last synced: 18 Nov 2024

https://github.com/rendora/rendora

dynamic server-side rendering using headless Chrome to effortlessly solve the SEO problem for modern javascript websites

angular chrome-devtools chrome-headless crawler dynamic-rendering go golang javascript puppeteer react reactjs seo seo-optimization server-side-rendering spa ssr vue vuejs

Last synced: 10 Oct 2024

https://github.com/gildas-lormeau/singlefilez

Web Extension to save a faithful copy of an entire web page in a self-extracting ZIP file

archive cli docker firefox html maff nodejs puppeteer save selenium self-extracting singlefile web-extensions webpage zip

Last synced: 10 Oct 2024

https://github.com/gildas-lormeau/SingleFileZ

Web Extension to save a faithful copy of an entire web page in a self-extracting ZIP file

archive cli docker firefox html maff nodejs puppeteer save selenium self-extracting singlefile web-extensions webpage zip

Last synced: 28 Oct 2024

https://github.com/addyosmani/puppeteer-webperf

Automating Web Performance testing with Puppeteer 🎪

chrome chrome-devtools devtools lighthouse puppeteer puppeteer-demo web-performance

Last synced: 18 Oct 2024

https://github.com/vladocar/screenshoteer

Make website screenshots and mobile emulations from the command line.

emulates mobile mobile-emulations nodejs npm-scripts pdf-generation puppeteer puppeteer-screenshot screenshots

Last synced: 10 Oct 2024

https://github.com/NoriSte/ui-testing-best-practices

The largest UI testing best practices list (last update: March 2023)

best-practices cypress e2e-testing puppeteer ui-testing

Last synced: 29 Oct 2024

https://github.com/noriste/ui-testing-best-practices

The largest UI testing best practices list (last update: March 2023)

best-practices cypress e2e-testing puppeteer ui-testing

Last synced: 10 Oct 2024

https://github.com/wppconnect-team/wppconnect

WPPConnect is an open source project developed by the JavaScript community with the aim of exporting functions from WhatsApp Web to the node, which can be used to support the creation of any interaction, such as customer service, media sending, intelligence recognition based on phrases artificial and many other things, use your imagination

ai api automate bot chat chatbot framework message nodejs open-source puppeteer sulla typescript wa whatsapp whatsapp-api whatsapp-bot wpp wppconnect zap-api

Last synced: 10 Oct 2024

https://github.com/microlinkhq/browserless

The headless Chrome/Chromium driver on top of Puppeteer.

headless-chrome headless-chromium puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/Kikobeats/browserless

browserless is an efficient way to interact with a headless browser built on top of puppeteer.

headless-chrome headless-chromium puppeteer puppeteer-core

Last synced: 05 Aug 2024

https://github.com/rialto-php/puphpeteer

A Puppeteer bridge for PHP, supporting the entire API.

automation developer-tools headless-chrome php puppeteer testing web

Last synced: 27 Sep 2024

https://github.com/nesk/puphpeteer

A Puppeteer bridge for PHP, supporting the entire API.

automation developer-tools headless-chrome php puppeteer testing web

Last synced: 04 Aug 2024

https://github.com/open-source-labs/spearmint

Testing, simplified. || An inclusive, accessibility-first GUI for generating clean, semantic Javascript tests in only a few clicks of a button.

accessibility axe-core darkmode electron endpoint-testing enzyme hooks jest open-source puppeteer react security test-driven-development testing testing-tools vue web-accessibility

Last synced: 10 Oct 2024

https://github.com/open-source-labs/Spearmint

Testing, simplified. || An inclusive, accessibility-first GUI for generating clean, semantic Javascript tests in only a few clicks of a button.

accessibility axe-core darkmode electron endpoint-testing enzyme hooks jest open-source puppeteer react security test-driven-development testing testing-tools vue web-accessibility

Last synced: 23 Oct 2024

https://github.com/zhentaoo/puppeteer-deep

Puppeteer, Headless Chrome;爬取《es6标准入门》、自动推文到掘金、站点性能分析;高级爬虫、自动化UI测试、性能分析;

chrome headless-chrome javascript node puppeteer

Last synced: 10 Oct 2024

https://github.com/simonhaenisch/md-to-pdf

Hackable CLI tool for converting Markdown files to PDF using Node.js and headless Chrome.

assignments cli documentation headless-chrome homework markdown markdown-to-pdf md pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/kkoooqq/fakebrowser

🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person.

anti-bot-detection anti-fingerprinting automation bot browser-fingerprint cheat crawler fake headless puppeteer puppeteer-extra puppeteer-extra-plugin scrapy spoof stealth

Last synced: 10 Oct 2024

https://github.com/browserbase/stagehand

An AI web browsing framework focused on simplicity and extensibility.

agents ai llms playwright puppeteer selenium

Last synced: 14 Nov 2024

https://github.com/fingerprintjs/botd

Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MIT license, no usage restrictions.

automation bot-detection bots headless-chrome playwright puppeteer selenium

Last synced: 10 Oct 2024

https://github.com/vasani-arpit/WBOT

A simple Web based BOT for WhatsApp™ in NodeJS 😜. Working as of 📅 Feb 4th, 2024

bot cli command-line-tool hacktoberfest hacktoberfest-accepted linux macos nodejs puppeteer wbot whatsapp whatsapp-bot whatsapp-web windows

Last synced: 25 Oct 2024

https://github.com/vasani-arpit/wbot

A simple Web based BOT for WhatsApp™ in NodeJS 😜. Working as of 📅 Feb 4th, 2024

bot cli command-line-tool hacktoberfest hacktoberfest-accepted linux macos nodejs puppeteer wbot whatsapp whatsapp-bot whatsapp-web windows

Last synced: 10 Oct 2024

https://github.com/puppeteer/replay

Library that provides an API to replay and stringify recordings created using Chrome DevTools Recorder

automation devtools javascript puppeteer

Last synced: 07 Oct 2024

https://github.com/fingerprintjs/BotD

Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MIT license, no usage restrictions.

automation bot-detection bots headless-chrome playwright puppeteer selenium

Last synced: 09 Aug 2024

https://github.com/famanoder/dps

:tangerine: a way to make skeleton screen, 一种自动生成网页骨架屏的方式

dps puppeteer skeleton-screen

Last synced: 10 Oct 2024

https://github.com/jxnblk/repng

React component to PNG converter

component image png png-converter puppeteer react

Last synced: 27 Sep 2024

https://github.com/coder-hxl/x-crawl

x-crawl is a flexible Node.js AI-assisted crawler library. Making crawler work more efficient, intelligent and convenient. ------ x-crawl 是一个灵活的 Node.js AI 辅助爬虫库。使爬虫工作变得更加高效、智能和便捷。(v10 版本已发布)

ai ai-crawl chromium crawl crawler fingerprint flexible javascript multifunction nodejs promise puppeteer spider typescript web

Last synced: 10 Oct 2024

https://github.com/buildkite/docker-puppeteer

A minimal Docker image for Puppeteer

docker headless-chrome puppeteer

Last synced: 27 Sep 2024

https://github.com/zhaoqize/puppeteer-api-zh_cn

📖 Puppeteer中文文档(官方指定的中文文档)

automation chrome developer-tools headless node puppeteer testing web

Last synced: 10 Oct 2024

https://github.com/deepsweet/foxr

🦊 Node.js API to control Firefox

firefox headless marionette puppeteer remote selenium

Last synced: 27 Sep 2024

https://github.com/samc621/SneakerBot

All-in-one bot, with auto captcha-solving and proxy management, using Node.js and Puppeteer.

2captcha bot docker docker-compose nodejs puppeteer sneakerbot vnc vncviewer x11vnc xvfb

Last synced: 05 Nov 2024

https://github.com/samc621/sneakerbot

All-in-one bot, with auto captcha-solving and proxy management, using Node.js and Puppeteer.

2captcha bot docker docker-compose nodejs puppeteer sneakerbot vnc vncviewer x11vnc xvfb

Last synced: 10 Oct 2024

https://github.com/zfc-digital/puppeteer-real-browser

This package is designed to bypass puppeteer's bot-detecting captchas such as Cloudflare. It acts like a real browser and can be managed with puppeteer.

cloudflare-bypass puppeteer puppeteer-cloudflare-captcha puppeteer-extra-plugin puppeteer-fingerprint puppeteer-real-browser puppeteer-undetected-browser undetected undetected-browser undetected-puppeteer

Last synced: 17 Nov 2024

https://github.com/carcabot/tiktok-signature

Generate tiktok signature token using node

node playwright puppeteer tiktok tiktok-signature

Last synced: 10 Oct 2024

https://github.com/ebidel/try-puppeteer

Run Puppeteer code in the cloud

appengine docker headless-chrome node puppeteer

Last synced: 10 Oct 2024

https://github.com/ghostery/adblocker

Efficient embeddable adblocker library

adblock adblocker content-blocking easylist javascript privacy puppeteer

Last synced: 10 Oct 2024

https://github.com/cliqz-oss/adblocker

Efficient embeddable adblocker library

adblock adblocker content-blocking easylist javascript privacy puppeteer

Last synced: 05 Aug 2024

https://github.com/reg-viz/storycap

A Storybook Addon, Save the screenshot image of your stories :camera: via puppeteer.

addon puppeteer screenshot screenshot-image storybook visual-testing

Last synced: 10 Oct 2024

https://github.com/apify/fingerprint-suite

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

fingerprinting playwright puppeteer scraping typescript

Last synced: 10 Oct 2024

https://github.com/fanyong920/jvppeteer

Headless Chrome For Java (Java 爬虫)

chrome chrome-headless crawler java jvppeteer puppeteer scraper

Last synced: 10 Oct 2024

https://github.com/ulixee/secret-agent

The web scraper that's nearly impossible to block - now called @ulixee/hero

automated browser chromium devtools mitm mitmproxy playwright proxy puppeteer scraping secretagent stealth

Last synced: 10 Oct 2024

https://github.com/csbun/thal

译文:Puppeteer 与 Chrome Headless —— 从入门到爬虫

headless-chrome puppeteer scraping-websites

Last synced: 27 Sep 2024

https://github.com/NimaSoroush/differencify

Differencify is a library for visual regression testing

headless-chrome jest nodejs puppeteer visual-regression-testing visual-testing

Last synced: 25 Oct 2024

https://github.com/nimasoroush/differencify

Differencify is a library for visual regression testing

headless-chrome jest nodejs puppeteer visual-regression-testing visual-testing

Last synced: 10 Oct 2024

https://github.com/zfcsoftware/puppeteer-real-browser

This package is designed to bypass puppeteer's bot-detecting captchas such as Cloudflare. It acts like a real browser and can be managed with puppeteer.

cloudflare-bypass puppeteer puppeteer-cloudflare-captcha puppeteer-extra-plugin puppeteer-fingerprint puppeteer-real-browser puppeteer-undetected-browser undetected undetected-browser undetected-puppeteer

Last synced: 10 Oct 2024

https://github.com/tungs/timecut

Node.js program to record smooth movies of web pages with JavaScript animations

nodejs puppeteer video

Last synced: 10 Oct 2024

https://github.com/prescience-data/dark-knowledge

😈📚 A curated library of research papers and presentations for counter-detection and web privacy enthusiasts.

anti-detect counter-detection fingerprinting hacktoberfest papers puppeteer puppeteer-extra research scraping

Last synced: 12 Oct 2024

https://github.com/linvo-io/linvo-scraper

Linkedin Automation Bot with every possible scraping! Valid for 2022 used by Linvo.io

automation hacktoberfest hactoberfest-accepted linkedin puppeteer scraper

Last synced: 10 Oct 2024

https://github.com/sambaiz/puppeteer-lambda-starter-kit

Starter Kit for running Headless-Chrome by Puppeteer on AWS Lambda.

aws-lambda chrome headless-chrome lambda nodejs puppeteer serverless serverless-framework

Last synced: 10 Oct 2024

https://github.com/cheeaun/puppetron

Puppeteer (Headless Chrome Node API)-based rendering solution.

chrome chromium headless pdf prerender puppeteer screenshot

Last synced: 12 Nov 2024

https://github.com/luisfarzati/chromda

λ 🖼️ Chromda is an AWS Lambda function for capturing screenshots of websites.

aws aws-lambda chrome-headless puppeteer screenshot serverless

Last synced: 10 Oct 2024

https://github.com/felippechemello/podcast-maker

Fully automated video maker using motion graphics and text-to-speech synthesis to turn newsletters into daily YouTube videos.

nodejs podcast podcast-maker puppeteer react remotion text-to-speech video-maker youtube

Last synced: 10 Oct 2024

https://github.com/FelippeChemello/podcast-maker

Fully automated video maker using motion graphics and text-to-speech synthesis to turn newsletters into daily YouTube videos.

nodejs podcast podcast-maker puppeteer react remotion text-to-speech video-maker youtube

Last synced: 29 Oct 2024

https://github.com/axetroy/sms-boom

利用chrome的headless模式,模拟用户注册进行短信轰炸机

boom chrome chrome-headless headless puppeteer sms

Last synced: 12 Nov 2024

https://github.com/alekzonder/docker-puppeteer

docker image with Google Puppeteer installed

docker docker-image google-puppeteer puppeteer screenshot

Last synced: 10 Oct 2024