Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/balaji-atoa/puppe-pdf

an npm package to convert HTML or any website to pdf flawlessly in seconds using puppeteer/chromium!

htmlpdf htmltopdf node pdf pdf-generation puppeteer

Last synced: 17 Nov 2024

https://github.com/oxylabs/puppeteer-tutorial

Use this tutorial and learn how to perform web scraping using a headless browser.

headless-browser puppeteer web-scraping

Last synced: 17 Jan 2025

https://github.com/pdehaan/playwright-test

Testing playwright -- a Node library to automate the Chromium, WebKit and Firefox browsers.

chromium firefox playwright puppeteer webkit

Last synced: 19 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Expect.

commonjs e2e-test e2e-testing e2e-tests end-to-end-test-automation jest puppeteer

Last synced: 11 Jan 2025

https://github.com/emmanuel-rods/snapbot

SnapBot is an automation tool designed to help maintain Snap Streaks effortlessly. It logs into Snapchat, captures snaps with custom captions, and sends them to your best friends or groups, all through an easy-to-use script.

automation bot puppeteer snapchat streaks

Last synced: 23 Jan 2025

https://github.com/lencx/learn-puppeteer

puppeteer 学习笔记

demo puppeteer puppeteer-demo

Last synced: 08 Dec 2024

https://github.com/mrseanryan/style-scraper

Scrape styles from a website using reliable computed styling via a headless browser [fonts, colors, border styles ...]

puppeteer scraping scraping-styling scraping-websites styling-css

Last synced: 28 Dec 2024

https://github.com/tokuda109/techbookfest07-puppeteer-samples

技術書典7に出典した「実践マニアックテスト 〜Android・iOS・Web編〜」の「Puppeteerを使ったE2Eテストの始め方」のサンプルコード集

e2e javascript nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/sokraglav13/end-to-end-testing-with-puppeteer

This project contains all the required components for an automation testing framework like Logger, Reporter, Video Recording, Test Data, Static Code Analysis, CI Integration, POM.

allure-report automated-testing end-to-end-testing mocha-chai nodejs puppeteer static-analysis testing ui-testing video-recording winston-logger

Last synced: 07 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-expect

Puppeteer end-to-end test automation boilerplate project. Using commonjs, mocha and chai.

chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/rayc2045/ghibli-crawler

Automatically download 1,178 studio Ghibli's work photos

axios crawler ghibli node node-js nodejs puppeteer rest-api restful restful-api

Last synced: 27 Nov 2024

https://github.com/joeylemon/scraper

a scraper for checking item availability at websites such as online retailers

nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/rn0x/htmlsnapshot

A lightweight API for generating images from HTML templates using Puppeteer and Node.js.

api ar arabic generating generating-images html-template htmltoimage htmltopdf nodejs puppeteer templates

Last synced: 27 Nov 2024

https://github.com/adamtylerlynch/puppeteer-multiarch

Creating Multi-Arch docker images for ARM64/x86 (amd64) using CodeBuild from Jenkins. Headless browsing with Chromium and Puppeteer.

aarch64-linux arm arm64 chromium codebuild docker docker-image multi-arch-images multiarch puppeteer

Last synced: 14 Dec 2024

https://github.com/xtruder/browserboi

Headless browser automation service for things that we can't do with official APIs

api automation browser puppeteer youtube

Last synced: 04 Jan 2025

https://github.com/cage1016/screenshot-as-a-service-demo

GCPUG Taiwan Meetup #29: screenshot as a service demo code

chromeless phantomjs puppeteer screenshot

Last synced: 25 Nov 2024

https://github.com/hiagoisoppo/trybe-futebol-club

Aplicação web full stack, desenvolvida em monorepo com o objetivo de registrar e organizar a pontuação em um campeonato de futebol fictício.

axios bcrypt chai docker expressjs jest joi jsonwebtoken mocha mysql nodejs nodemon puppeteer reactjs router-dom sequelize sinon testing-library tsnode typescript

Last synced: 22 Jan 2025

https://github.com/euberdeveloper/bbb-video-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served by BBB

npm puppeteer scraper typescript video-scraper

Last synced: 09 Dec 2024

https://github.com/jglchen/web-scrape

This is a next.js framework site to demonstrate web scraping cases and my expertise in web scraping.

cheerio docker nextjs nodejs puppeteer reactjs

Last synced: 20 Jan 2025

https://github.com/dfa1234/iux-node

node api for sending email with a pdf attached, corresponding to the given webpage url

nodejs puppeteer

Last synced: 21 Dec 2024

https://github.com/codingchili/tls-privacy

ML with sklearn/pandas in Python to identify page loads for specific websites when TLS is used. Uses NodeJS/Puppeteer for traffic generation.

machine-learning nodejs pandas puppeteer python scapy security security-testing

Last synced: 19 Dec 2024

https://github.com/hdorgeval/puppeteer-core-starter

starter project for e2e tests with jest and puppeteer-core-controller

e2e jest puppeteer puppeteer-core

Last synced: 20 Dec 2024

https://github.com/danielesteban/autocalamari

Automated Calamari Clock-In/Out

automation nodejs puppeteer

Last synced: 21 Dec 2024

https://github.com/jonaylor89/beeline-bot

Bot to automate the browser to do my timesheet

automation docker nodejs puppeteer

Last synced: 11 Jan 2025

https://github.com/cclient/weizhishu-puppeteer

puppeteer抓取微博指数

chrome clawler puppeteer spider

Last synced: 16 Jan 2025

https://github.com/guilhermebkel/semantic-search-llm-ai

🤖 That's a simple LLM semantic search that implements RAG concepts with help of LangChain and OpenAI API.

ai embeddings langchain openai-api puppeteer rag redis redis-vector-store retrieval-augmented-generation semantic-search-ai typescript

Last synced: 05 Nov 2024

https://github.com/rahulnisanth/trackitnow

The e-commerce price tracker and analyzer for best deals

bright-data cheerio-js cron-jobs nextjs14 puppeteer web-scraping-software

Last synced: 05 Nov 2024

https://github.com/ttsukagoshi/axe-test

テキストファイルで指定する複数のウェブページに対して、Deque社提供のaxe-coreを使ったウェブアクセシビリティ検査を一括実行する、Node.js上のスクリプト

a11y axe-core puppeteer web-accessibility

Last synced: 23 Oct 2024

https://github.com/shinchven/iris

Internet scraper

chrome cli instagram puppeteer scrapers

Last synced: 23 Jan 2025

https://github.com/zahradnik-ondrej/puppethelper

A Puppeteer utility package for web automation.

automation browser puppeteer qa web

Last synced: 10 Oct 2024

https://github.com/kayoshi-dev/salitag

Once a day, a new Tagalog word 🇵🇭 Might contains errors, always verify the definition online :)

dictionary javascript opengraph oss philippines puppeteer ssr svelte sveltekit tagalog typescript

Last synced: 28 Nov 2024

https://github.com/foysalbn/dte-electron

A tool to Automate DTE Stipend repeating task

dte dte-stipend electron puppeteer

Last synced: 10 Oct 2024

https://github.com/cocohfl/twitchremotecontrol

Remotely control Twitch streams running on your PC from any device.

nodejs puppeteer remote-control twitch

Last synced: 12 Jan 2025

https://github.com/t2bamboo/t2-puppeteer-plugin-random-ua

Helping to improve web scraping and automation by evading detection.

puppeteer puppeteer-plugin puppeteer-random-ua random-user-agent user-agent

Last synced: 21 Jan 2025

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Jan 2025

https://github.com/ervin-sungkono/mlbb-wiki-scraper

Scraping tool to extract data from MLBB Wiki and output as JSON file

fs javascript json nodejs p-limit puppeteer

Last synced: 16 Dec 2024

https://github.com/marcel-msc/puppeteer-correios

Simple way of using Puppeteer to get valid address of a giving CEP on Correios website.

correios correios-cep headless-chrome puppeteer

Last synced: 06 Dec 2024

https://github.com/leandro-bertoluzzi/scrap-to-api

API to get the content of web pages via scraping

docker docker-compose nodejs puppeteer scraper

Last synced: 07 Jan 2025

https://github.com/sthotakura/remove-linkedin-connections

puppeteer script to remove linkedin connections

linkedin puppeteer

Last synced: 02 Jan 2025

https://github.com/mariusconjeaud/angular-with-api-calls

Angular with API calls template. Full Azure Pipeline with unit testing, e2e testing, code coverage and linting included.

angular azure-app-service azure-devops cobertura expressjs junit karma protractor puppeteer typescript

Last synced: 14 Dec 2024

https://github.com/mgoyal98/pdf-pipeline

PDF Pipeline is a Node.js app that reads messages from SQS, generates PDFs using Puppeteer and Mustache, uploads them to S3, and updates status via SQS or webhooks

docker docker-pdf document-generator microservice mustache node-pdf nodejs pdf-generation pdf-generator pdf-microservice puppeteer sqs webhook

Last synced: 21 Dec 2024

https://github.com/shiv-source/slice-chrome-extension-automation

This project automates the viewing of advertisements through the Slice Chrome Extension. It is designed to view ads on your behalf, and credits for viewing these ads will be automatically added to your Slice account. You can monitor these credits through the Slice extension app.

automation puppeteer slice slice-extension

Last synced: 07 Jan 2025

https://github.com/sidvishnoi/subresources

List all subresources/assets (CSS/JS files, images, fonts, audio/video etc.) used in a document.

hacktoberfest http-dependencies puppeteer subresources

Last synced: 29 Oct 2024

https://github.com/arthurweinmann/puppeteer-server

Run Puppeteer (browser automation) as a HTTP API

api puppeteer rpc

Last synced: 07 Jan 2025

https://github.com/christianrich/generate-pdf-puppeteer

Generate a PDF with Puppeteer, Handlebars and Express

docker docker-compose express handlebars node-js pdf-generation puppeteer

Last synced: 29 Dec 2024

https://github.com/ilhamlamp/menu-scrapper

learn scrapping with nest and puppeteer

nestjs puppeteer typescript

Last synced: 06 Dec 2024

https://github.com/apexcaptain/allergy-alert

오늘 날짜를 기준으로 모 대학의 학교 홈페이지에서 제공하는 식당 정보를 Crawling하여 회관별/메뉴 분류 별로 메뉴들과 메뉴 별 알러지 유발 식품에 대한 정보를 알려줍니다.

crawler docker expressjs puppeteer reactjs sqlite typescript

Last synced: 01 Dec 2024

https://github.com/softonic/docker-puppeteer

Puppeteer docker image

docker-image puppeteer

Last synced: 21 Dec 2024

https://github.com/iomerkoyuncu/website-to-file

Node.js library to capture image/pdf from url.

puppeteer url-to-image url-to-pdf

Last synced: 30 Oct 2024

https://github.com/j-m/anvomywz1k

A community-based game review website

coursework game jest koa puppeteer review website

Last synced: 30 Dec 2024

https://github.com/canardconfit/puppeteer-docker

A simple docker image to run Puppeteer under arm64 architecture.

arm64 docker docker-image puppeteer

Last synced: 06 Dec 2024

https://github.com/bhagyamudgal/custom-puppeteer-server

A custom express server to use puppeteer for generating screenshots, pdfs, etc.

expressjs nodejs puppeteer typescript

Last synced: 24 Jan 2025

https://github.com/jonathanlinat/simple-nodejs-amazon-web-scraper

A very simple and automated tool to scrape Amazon.com results

amazon cheerio nodejs puppeteer web-scraper

Last synced: 14 Jan 2025

https://github.com/pro-oc/pro-oc-dzs-proxy

REST API CORS Proxy server pro DZS registr.

cors-proxy-server dzs proxy-server puppeteer rest-api

Last synced: 14 Jan 2025

https://github.com/crusaderincode/article-saver-bot

This bot listens to incoming messages for valid URLs. When a URL is provided, the bot fetches the website content and returns it as a PDF file.

bot html-pdf-converter html-pdf-service nodejs open-source pdf-generation puppeteer telegraf telegram telegram-bot webscraping

Last synced: 21 Jan 2025

https://github.com/radzionc/medium-updater

Programatically Update Medium Stories CTAs

medium nodejs puppeteer

Last synced: 24 Dec 2024

https://github.com/radzionc/apartments-watcher

Opens new apartments for sale in Chrome

nodejs puppeteer

Last synced: 24 Dec 2024

https://github.com/brightspace/d2l-beaker

A driver for Google Puppeteer to collect client-side performance metrics.

automation performance puppeteer

Last synced: 07 Jan 2025

https://github.com/yarosj/crossdomain-selector

Retrieves a selector from another site by a screenshot

crossdomain puppeteer screenshot selector

Last synced: 30 Nov 2024

https://github.com/mdato/dolar2030

puppeteer + heroku + express

express heroku puppeteer

Last synced: 07 Jan 2025

https://github.com/achanta3215/covid19indiascraper

To scrape covid 19 data from sources available

contributions-welcome covid-19 india node open-source puppeteer typescript

Last synced: 28 Dec 2024

https://github.com/tuurdutoit/puppeteer-utils

A library of utility functions for Puppeteer

library puppeteer utility

Last synced: 14 Jan 2025

https://github.com/tuurdutoit/puppeteer-find

Find elements with Puppeteer based on their content

dom find puppeteer query search utility

Last synced: 14 Jan 2025

https://github.com/f00b4r/2021-03-vercel-puppeteer-social-networks

🎁 How to use Puppeteer to generate images for social networks deployed to Vercel

f00b4r lambda network plugin puppeteer screenshot social vercel widget

Last synced: 13 Jan 2025

https://github.com/cboulanger/qx-puppeteer

UI testing of a qooxdoo application with puppeteer

puppeteer qooxdoo testing

Last synced: 06 Jan 2025

https://github.com/portrunban/node-vk-puppeteer-user

This app removes inactive users from the group Vkontakte. base on puppeteer

puppeteer vk vkontakte

Last synced: 02 Jan 2025

https://github.com/prixladi/site-capture-puppet

Worker service capturing sites using puppeteer. Part of Site Capture project - https://github.com/prixladi/site-capture

docker mongodb nodejs puppeteer redis

Last synced: 16 Jan 2025

https://github.com/pdehaan/firefox-monitor-puppeteer-scan

Scan for breached emails using Puppeteer. Because why not.

firefoxmonitor hibp puppeteer

Last synced: 29 Dec 2024

https://github.com/vaenow/crawler-chromeless

A chromeless crawler for coursera

chromeless coursera crawler puppeteer

Last synced: 13 Dec 2024

https://github.com/yuiseki/ppptr

Simple CLI tool and npm package just take screenshot of Web page with puppeteer in minutes

nodejs npm npm-package puppeteer screenshot typescript

Last synced: 21 Dec 2024

https://github.com/korigamik/vuemastery-downloader

Download every vuemastery course locally.

puppeteer typescript vuejs

Last synced: 14 Dec 2024

https://github.com/dmehra2102/advance-node

This is the advance node project where I'm using redis for caching and Jest for writing test for my project.

javascript jest nodejs passport puppeteer redis

Last synced: 06 Dec 2024

https://github.com/zachltech/duckduckgoscraper-firebase

Fork of a previous project of mine with Firebase Cloud Functions/Firestore integration.

firebase firebase-database firebase-functions javascript puppeteer

Last synced: 30 Dec 2024

https://github.com/yashkathe/download-wallpapers-cli

Search wallpapers from terminal directly and the script will download all the high resolution wallapers from the website

expressjs nodejs puppeteer script wallpaper web-scraping

Last synced: 25 Dec 2024

https://github.com/sj22032003/scrapper-basic-flipkart

Minor web scrapper using puppeteer to scrap data from Flipkart listing

bun puppeteer typescript

Last synced: 06 Jan 2025

https://github.com/argshook/sitemap-to-html

CLI tool to generate HTML files for each link defined in sitemap.xml

crawlers html-snapshot puppeteer sitemap

Last synced: 14 Jan 2025

https://github.com/sarukuku/dependency-checker

A command line tool that checks your web page's dependencies, what percentage of them are cross-origin or cross-domain and who's in control of them.

dependencies nodejs puppeteer whois

Last synced: 10 Dec 2024

https://github.com/afeiship/pptr-html

Get html by puppeteer.

crawl html pptr puppeteer spider

Last synced: 14 Dec 2024

https://github.com/micalevisk/ecampus-ufam-crawler

🚧 Command Line Interface (CLI) tool that automates common tasks for https://ecampus.ufam.edu.br users.

nodejs-cli puppeteer ufam ufam-cli

Last synced: 28 Oct 2024

https://github.com/reshnivisionx/web_scrapping_react

I developed a web application that scrapes website content into PDFs, HTML snapshots, and screenshots using Puppeteer for automation. The data, along with scrape timestamps, is stored in MongoDB for retrieval and download. The frontend interface allows users to input URLs and select desired formats with ease.

axios expressjs mongodb nodejs puppeteer reactjs

Last synced: 30 Dec 2024

https://github.com/jprando/lotofacil

Buscar informacoes do ultimo sorteio da lotofacil

javascript lotofacil puppeteer

Last synced: 29 Nov 2024

https://github.com/janumedia/puppeteer-ssr

Puppeteer SSR example

chromium node puppeteer ssr

Last synced: 29 Dec 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 84 博文 83 Packages 30 Utils 23 Integrations 17 包 14 Testing 13 Rendering and web scraping 12 Services 12 渲染和网页抓取 11 Examples 10 Reporters 10 Language Support 9 Showcases 9 Official 9 官方 9 测试 9 例子 8 License 6 Related 6