Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/llorenspujol/linkedin-jobs-scraper

LinkedIn Jobs Scraper running in Node.js that uses Puppeteer and RxJS to scrape job offers from LinkedIn.

nodejs puppeteer rxjs

Last synced: 10 Dec 2024

https://github.com/sorok-dva/freenom-auto-renew-domains

A scraper built with puppeteer that auto renew free domains on Freenom and send discord message using bot

automation autorenewal bot discord discord-bot discord-js discordx domains freenom nodejs puppeteer scraper scraping typescript

Last synced: 25 Dec 2024

https://github.com/prescience-data/foundation

🧱 A uniform template to use as a foundation for Puppeteer bot construction.

bot botting framework playwright puppeteer puppeteer-extra scraper scraping

Last synced: 28 Oct 2024

https://github.com/claabs/puppeteer-extra-plugin-portal

A puppeteer-extra plugin to remotely view and interact with puppeteer sessions. Essentially opening a "portal" to the page.

puppeteer puppeteer-extra puppeteer-extra-plugin

Last synced: 14 Oct 2024

https://github.com/Tabueeee/puppeteer-request-spy

Watch, fake or block requests from puppeteer matching patterns

puppeteer puppeteer-request-spy request-interceptors

Last synced: 05 Nov 2024

https://github.com/forsti0506/a11y-sitechecker

Automatic accessibility checker with website crawling + screenshots for easy use

accessibility accessibility-criteria accessibility-testing axe crawler hacktoberfest open-source puppeteer typescript typescript-library

Last synced: 22 Nov 2024

https://github.com/percy/percy-puppeteer

Visual testing with Puppeteer and Percy

percy percy-sdk puppeteer visual-testing visual-tests

Last synced: 20 Dec 2024

https://github.com/mbalabash/puppeteer-autoscroll-down

Handle infinite scroll on websites by puppeteer

headless-chrome parsing puppeteer

Last synced: 18 Nov 2024

https://github.com/ReedD/crawler

Chromium / Puppeteer site crawler

bot chromium crawler puppeteer redis scraper

Last synced: 25 Oct 2024

https://github.com/dosyago/puppetromium

:tophat: A single tab web browser built with puppeteer. Also, no client-side JS. Viewport is streamed with MJPEG. For realz.

devtools mjpeg no-js nodejs puppeteer pupppetromium web-browser

Last synced: 16 Nov 2024

https://github.com/shenfe/puppeteer-service

🎠 Run headless Chrome (aka Puppeteer) as a service.

headless-chrome puppeteer puppeteer-service web-crawler

Last synced: 12 Oct 2024

https://github.com/simonw/puppeteer-screenshot

Vercel app for taking screenshots of web pages using Puppeteer

puppeteer screenshots vercel

Last synced: 18 Oct 2024

https://github.com/s4l1h/bet365-live-soccer-scraper

Bet365 Live Soccer Score Scraper

bet365 express express-js puppeteer

Last synced: 12 Nov 2024

https://github.com/dmoosocool/puppeteer-autotest

puppeteer autotest, 用puppeteer做页面自动化测试和restful接口测试.

autotest puppeteer

Last synced: 19 Dec 2024

https://github.com/joseconstela/webparsy

Node.JS library and cli for scraping websites using Puppeteer (or not) and YAML definitions

browser chrome headless nodejs puppeteer yaml

Last synced: 27 Oct 2024

https://github.com/uyamazak/hc-pdf-server

Convert HTML to PDF Server by headless chrome with TypeScript. The new version of hcep-pdf-server.

docker fastify headless-chrome puppeteer typescript

Last synced: 16 Dec 2024

https://github.com/draym/discord-puppet

Discord client for server side applications, includes Midjourney AI client.

discord midjourney puppet puppeteer

Last synced: 14 Oct 2024

https://github.com/ruochuan12/learn-nodejs

learn-nodejs 前端使用 puppeteer 爬虫生成《React.js 小书》PDF并合并 链接是掘金，阅读体验效果可能更佳

koa2 nodejs puppeteer

Last synced: 28 Oct 2024

https://github.com/macacajs/macaca-puppeteer

Macaca puppeteer driver

headless macaca puppeteer

Last synced: 16 Nov 2024

https://github.com/azerpas/detect-headless

A web page that compiles methods used by Akamai, Datadome, and other bot detection solutions and WAF (Web Application Firewall) to identify headless bots like Selenium, Puppeteer, Phantom...

akamai datadome phantom puppeteer selenium waf

Last synced: 06 Nov 2024

https://github.com/NielsSteensma/Dhalang

Generate PDFs and make screenshots of HTML using Puppeteer in Ruby

pdf pdf-generation puppeteer screenshot

Last synced: 24 Nov 2024

https://github.com/mrxujiang/crawel

基于Apify+node+react搭建的有点意思的爬虫平台

apify crawler node puppeteer react react-hooks umi umi3

Last synced: 07 Nov 2024

https://github.com/VAllens/CrawlerSamples

This is a Puppeteer+AngleSharp crawler console app samples, used C# 7.1 coding and dotnet core build.

anglesharp chsarp crawler dotnetcore headless headless-browsers headless-chrome headless-chromium puppeteer

Last synced: 13 Nov 2024

https://github.com/c0mm4nd/mibuy

小米商城抢购

mi puppeteer xiaomi

Last synced: 04 Dec 2024

https://github.com/kiwi0fruit/pyppdf

Pyppeteer PDF. Print html sites and files to pdf via pyppeteer (uses patched pyppeteer that by default downloads updated Chromium revision via https with certifi).

html-to-pdf html2pdf pdf puppeteer pyppeteer python

Last synced: 12 Oct 2024

https://github.com/spirosikmd/cucumber-puppeteer-example

Example project on how to use cucumber with puppeteer for UI testing

cucumber-js gherkin puppeteer ui-testing

Last synced: 13 Nov 2024

https://github.com/archivebox/abx-dl

⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless Chrome to get HTML, JS, CSS, images/video/audio/subtitles, PDFs, screenshots, article text, git repos, and more...

ai-scraping archivebox chrome cli cli-tool crawling curl downloader gallery-dl headless http-client internet-archiving playwright puppeteer scraping wget youtube-dl yt-dlp

Last synced: 10 Dec 2024

https://github.com/diokuz/teremock

Easy to use test request mocker for puppeteer / mocha / karma

mock-files mocker playwright puppeteer

Last synced: 11 Oct 2024

https://github.com/JackZhang1988/Puppetry

基于Puppeteer的页面E2E测试GUI工具

puppeteer

Last synced: 22 Nov 2024

https://github.com/webrecorder/browsertrix-behaviors

Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.

automation browsertrix-behaviors puppeteer

Last synced: 19 Dec 2024

https://github.com/dedinc/emunium

A Python module for automating interactions to mimic human behavior in standalone apps or browsers when using Selenium, Pyppeteer, or Playwright. Provides utilities to programmatically move the mouse cursor, click on page elements, type text, and scroll as if performed by a human user.

automation bypass-antibots bypass-bot-detection-systems captcha-bypass human-interactions playwright puppeteer pyppeteer selenium-automation selenium-test simulation standalone-automation web-testing

Last synced: 13 Dec 2024

https://github.com/prescience-data/harden-puppeteer

🛡🎭 A conceptual patch which modifies some vanilla puppeteer files to decrease detection rates.

harden-puppeteer isolated-worlds puppeteer puppeteer-extra puppeteer-patch

Last synced: 28 Oct 2024

https://github.com/justinribeiro/lighthouse-jest-example

Sample using lighthouse and puppeteer with jest to run tests on your project/site.

jest lighthouse puppeteer webpagetest

Last synced: 16 Oct 2024

https://github.com/guocaoyi/meituan-spider

美团™爬虫练习项目（Region、POI、店铺、商品）

china-city data learning meituan meituan-pois poi puppeteer reptile reptile-nodejs

Last synced: 27 Oct 2024

https://github.com/noriste/redux-saga-login-react-example

The redux-saga login example with a super-essential UI

generators javascript jest-puppeteer puppeteer react redux-saga

Last synced: 27 Oct 2024

https://github.com/jsmonday/Cezanne

🎣 Serverless Image Generation Function

google-cloud lambda-functions nodejs puppeteer serverless

Last synced: 06 Dec 2024

https://github.com/selfrefactor/services

Holder of multiple npm packages

angular commit-message lint puppeteer vscode

Last synced: 25 Dec 2024

https://github.com/humanmade/trafficator

Traffic generator for local analytics testing

puppeteer testing-tools traffic traffic-generator traffic-simulation

Last synced: 06 Nov 2024

https://github.com/EasyWebApp/puppeteer-browser

Multiple Web browser controller based on Puppeteer API

automation browser puppeteer testing web

Last synced: 28 Oct 2024

https://github.com/shimohq/finch

🤖 Puppeteer as a Service

e2e-testing paas puppeteer screenshot web-automation

Last synced: 05 Nov 2024

https://github.com/saasify-sh/puppeteer-serverless

Puppeteer for both serverless functions and development.

chrome lambda puppeteer serverless

Last synced: 11 Oct 2024

https://github.com/jeroentvb/wind-scrape

Node package for scraping wind forecast from a few websites

forecast nodejs package puppeteer scraper typescript wind windfinder windguru windy

Last synced: 16 Nov 2024

https://github.com/redbadger/puppeteer-lighthouse-jest

A starter suite of tests utilising Puppeteer to drive non-functional tests through a Lighthouse audit

accessibility lighthouse performance-testing puppeteer seo

Last synced: 08 Nov 2024

https://github.com/its404/php-puppeteer

PHP Wrapper of Google Chrome Puppeteer for PDF Generation

pdf php5 puppeteer

Last synced: 12 Oct 2024

https://github.com/creativecommons/og-image-generator

An open graph image generator for Creative Commons projects.

hacktoberfest hacktoberfest2020 lambda-functions puppeteer serverless typescript

Last synced: 07 Nov 2024

https://github.com/urigo/leumi-leumicard-bank-data-scraper

Open bank data for Leumi bank and Leumi card credit card

api banking leumi open-api puppeteer scraper

Last synced: 07 Nov 2024

https://github.com/shaunbharat/googlemeetapi

A Javascript package for interacting with a Google Meet, using Puppeteer.

api bot google google-meet google-meet-api google-meet-bot meet meetings puppeteer

Last synced: 02 Nov 2024

https://github.com/theolampert/naos

📉 Uptime and error monitoring CLI

monitoring node puppeteer scraping typescript

Last synced: 07 Nov 2024

https://github.com/chromium-for-lambda/chromium-binaries

Pre-built Chromium binaries for AWS Lambda, compatible with Playwright and Puppeteer.

aws-cdk chrome chromium lambda playwright puppeteer

Last synced: 10 Oct 2024

https://github.com/radiolondra/Server-side-FabricJs-using-Puppeteer

Using not-node-module FabricJs server side with Puppeteer

fabricjs nginx node-canvas nodejs puppeteer

Last synced: 05 Nov 2024

https://github.com/evenchange4/micro-website-api

An API microservice that crawls dynamic website powered by puppeteer.

puppeteer

Last synced: 27 Oct 2024

https://github.com/nezhar/chrome-shots

A docker compose configuration that uses headless chrome with puppeteer to generate full page screenshots for a given set of urls and devices.

hacktoberfest puppeteer screenshots

Last synced: 19 Oct 2024

https://github.com/rjdestigter/xstate-marionettist

Model based testing with Jest, XState and Puppeteer or Playwright made easy

hacktoberfest jest model-based-testing playwright puppeteer xstate

Last synced: 19 Oct 2024

https://github.com/TheJoin95/skyscanner-flights-scraping

A scraping tool (for personal use, not commercial) to get some information about flights

docker express javascript nodejs puppeteer scraping skyscanner

Last synced: 28 Oct 2024

https://github.com/kimmobrunfeldt/squint

Makes visual reviews of web app releases easy.

crawl diff node puppeteer screenshot testing visual visual-diff

Last synced: 27 Oct 2024

https://github.com/invertase/puppeteer-pool

Flexible Puppeteer Browser instance resource pooling.

nodejs pooling puppeteer

Last synced: 08 Nov 2024

https://github.com/andersonba/puppeteer-assets

Measuring and monitor assets metrics using Puppeteer and Prometheus

assets grafana metrics monitoring prometheus puppeteer

Last synced: 12 Oct 2024

https://github.com/maximiliana-dev/lucientes

Lucientes is a simple web service for converting HTML files into high-quality images

api chromium docker html-to-image puppeteer screenshots webservice

Last synced: 10 Oct 2024

https://github.com/dgtlmoon/sockpuppetbrowser

A scalable server for providing Chrome interfaces where needed

chrome chrome-cdp nodejs puppeteer python3

Last synced: 27 Oct 2024

https://github.com/thejoin95/skyscanner-flights-scraping

A scraping tool (for personal use, not commercial) to get some information about flights

docker express javascript nodejs puppeteer scraping skyscanner

Last synced: 06 Nov 2024

https://github.com/funbox/phantom-lord

Handy API for Headless Chromium

casperjs e2e-tests headless-chrome phantomjs puppeteer

Last synced: 21 Nov 2024

https://github.com/ocavue/jest-puppeteer-istanbul

Collect code coverage information from end-to-end jest puppeteer tests

chrome coverage e2e integration-testing istanbul jest jest-puppeteer puppeteer

Last synced: 27 Oct 2024

https://github.com/raharrison/puppeteer-perf

Website performance testing with Headless Chrome & Puppeteer

headless-chrome nodejs performance puppeteer

Last synced: 28 Oct 2024

https://github.com/cawfree/sameorigin

🤖 🧪 Masquerade as if you were their own frontend.

axios blur bypass cloudflare cors exploit marketplace nft opensea puppeteer

Last synced: 12 Oct 2024

https://github.com/dtinth/timelapse

Capture a timelapse screenshot of my projects using GitHub Actions.

automated github-actions nodejs puppeteer

Last synced: 23 Nov 2024

https://github.com/entrptaher/playground-react-puppeteer

Example of using react and puppeteer with http-proxy and more.

hacktoberfest puppeteer react

Last synced: 19 Nov 2024

https://github.com/nusr/ComicHub

📚Comic Downloader (漫画下载器)

antd cartoons comics downloader dvajs koa mysql puppeteer react spider typescript umijs

Last synced: 25 Nov 2024

https://github.com/prohetamine/webcam-bots

💁‍♀️ Cheating viewers on the webcam broadcast for chaturbate

bongacams bot bots cb cbhours chaturbate promotion puppeteer stripchat webcam webcam-for

Last synced: 19 Nov 2024

https://github.com/nusr/comichub

📚Comic Downloader (漫画下载器)

antd cartoons comics downloader dvajs koa mysql puppeteer react spider typescript umijs

Last synced: 23 Nov 2024

https://github.com/vasani-arpit/youtube-remove-copyright

A puppeteer script to trim copyrighted part from Youtube videos

nodejs puppeteer web-automation youtube

Last synced: 27 Oct 2024

https://github.com/pitops/reddit-bot-scraper

Scrape subreddits based on search criteria or get the X latest from 'hot' or 'new' categories

puppeteer reddit-bot

Last synced: 01 Dec 2024

https://github.com/dtinth/personal-puppeteer

A personal web page screenshotting service. Basically, it exposes an API that I can use to generate screenshot of any URL.

jwt puppeteer typescript vercel

Last synced: 23 Nov 2024

https://github.com/dcdunkan/syntax-highlighter-bot

A customizable syntax highlighter bot for Telegram.

bot deno deta grammyjs highlightjs puppeteer syntax-highlighting telegram-bot

Last synced: 22 Oct 2024

https://github.com/xcoo/pdfshot

PDF screenshot generator for web pages

clojure clojurescript docker puppeteer

Last synced: 15 Nov 2024

https://github.com/saasify-sh/puppet-master

Puppeteer as a service hosted on Saasify.

crawling headless-chrome pdf puppeteer saas screenshot

Last synced: 13 Nov 2024

https://github.com/seznam/qape

Independent tester for any website

e2e-testing puppeteer qa qatools robot test-automation testing-framework

Last synced: 10 Nov 2024

https://github.com/sabber-slt/netextract

NetExtract: Efficiently extract core content from any webpage and convert it to clean, LLM-optimized Markdown with a simple API.

api crawling gemma2 llm markdown puppeteer

Last synced: 10 Oct 2024

https://github.com/samhuk/stealthy-scraper

Extra stealthy web scraper in Typescript

puppeteer scraper stealth typescript

Last synced: 15 Nov 2024

https://github.com/HuddleEng/puppeteer-extensions

Convenience functions for the Puppeteer

puppeteer testing ui utilities

Last synced: 28 Oct 2024

https://github.com/agenty/browser-automation-api

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.

api browser-automation extraction nodejs pdf playwright puppeteer scraping screenshot webscraping

Last synced: 25 Nov 2024

https://github.com/yusu-f/nftuploader

Opensea NFT uploader

nft nodejs opensea puppeteer

Last synced: 20 Dec 2024

https://github.com/force-adverse/puppeteer-humanize

🕺 Humanizer functions for Puppeteer

antidetect bots humanize puppeteer puppeteer-extra scraping

Last synced: 11 Oct 2024

https://github.com/cmfcmf/magicmouse

A webbrowser for Squeak using Chrome/Chromium. Not to be confused with a highly innovative pointing device.

chrome puppeteer smalltalk squeak webbrowser

Last synced: 22 Oct 2024

https://github.com/o8e/soccer-scrape

:page_with_curl: Scrape football data from Bet365

bet365 betting crawler es6 football javascript puppeteer scraper soccer

Last synced: 13 Nov 2024

https://github.com/funliday/pppr

pppr is a prerender service

expressjs funliday prerender puppeteer

Last synced: 19 Dec 2024

https://github.com/unadlib/tees

Universal test framework for front-end with WebDriver, Puppeteer and Enzyme

enzyme puppeteer selenium-webdriver tees webdriver

Last synced: 11 Oct 2024

https://github.com/websemantics/codepen-puppeteer

Use Puppeteer to download pens from Codepen.io as single html pages

codepen headless-chrome puppeteer web-scraping

Last synced: 06 Nov 2024

https://github.com/trentmwillis/devtools-protocol-demos

Demos of the Chrome DevTools Protocol for various testing/automation techniques

demos devtools-protocol node puppeteer

Last synced: 08 Nov 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 80 博文 78 Packages 29 Utils 23 Integrations 16 包 14 Testing 13 Services 12 Rendering and web scraping 11 渲染和网页抓取 11 Reporters 10 Official 9 Examples 9 Showcases 9 Language Support 9 官方 9 测试 9 例子 7 License 6 Guides 5