Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/joswinemmanuel/info-collector

Info Collector gathers information from multiple search engines ( Google, Bing, Yahoo ), performs searches with a specified term, retrieves results, and saves them to separate files.

javascript nodemon puppeteer

Last synced: 31 Jan 2025

https://github.com/vermajay/internshala-automation

Automatically apply to internships on Internshala using Google's Puppeteer high level API for chrome

api automation chrome google internships puppeteer

Last synced: 13 Oct 2024

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 07 Jan 2025

https://github.com/brianpunzalan/nextjs-advanced-starter

Next.js Advanced Starter with Typescript, MaterialUI, Storybook, Jest, Puppeteer, Redux, ESLint, Prettier and more.

eslint jest material-ui nextjs prettier puppeteer redux storybook typescript

Last synced: 23 Dec 2024

https://github.com/athrvk/calibre-puppeteer-base

This repository contains a Dockerfile for creating a base image with Calibre and Puppeteer pre-installed. This image is built on top of Ubuntu 22.04 and includes all necessary dependencies for running Calibre and Puppeteer.

browserless calibre docker docker-image ebook-converter puppeteer

Last synced: 03 Feb 2025

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Jan 2025

https://github.com/umuthopeyildirim/puppateer-screenshot

The Google Cloud function that can take screenshots of websites.

google-cloud-functions google-cloud-storage javascript puppeteer

Last synced: 11 Jan 2025

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 04 Jan 2025

https://github.com/samthor/headless-test

Run Mocha tests in a headless browser

http mocha puppeteer test

Last synced: 18 Jan 2025

https://github.com/shuuji3/pukiwiki-bot

🥝 Bot to publish articles to Pukiwiki site

pukiwiki puppeteer

Last synced: 27 Jan 2025

https://github.com/rayc2045/ghibli-crawler

Automatically download 1,178 studio Ghibli's work photos

axios crawler ghibli node node-js nodejs puppeteer rest-api restful restful-api

Last synced: 26 Jan 2025

https://github.com/andriilive/stav-rizeni-mvcr-oamp-pupppetter

Browser automation to check the application status at Department for Asylum and Migration Policy, Czech Republic

czech czech-republic nodejs oamp puppeteer

Last synced: 17 Jan 2025

https://github.com/dkgee/tk_spa

nodejs案例 puppeteer

centos7 nodejs puppeteer windows-7

Last synced: 22 Dec 2024

https://github.com/zbo14/robit

Easily configure and run browser automation jobs!

browser-automation puppeteer web-scraping

Last synced: 31 Jan 2025

https://github.com/vasani-arpit/puppeteer-extension-automation-example

Tutorial on how to add and use an extension programmatically in puppeteer

automation extensions node nodejs puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/yandeu/jenkins-puppeteer-docker

Use Puppeteer on Jenkins on Docker with Node.js and Jest.

docker jenkins jest nodejs puppeteer

Last synced: 05 Feb 2025

https://github.com/optimics/docker-puppeteer

Docker image that includes everything needed to run Puppeteer.js on Bitbucket Pipelines

bitbucket-pipelines docker nodejs puppeteer

Last synced: 06 Jan 2025

https://github.com/kayyz1/llmscraper

LLM AI web scraper tool

openai puppeteer react remix typescript

Last synced: 10 Dec 2024

https://github.com/anonymous961/scrapebooks

Just a repo to check puppeteer

neondb prisma puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/bettercallsundim/crote

aesthetic & colorful class routine generator

expressjs mongodb mongoose nextjs puppeteer shadcn-ui

Last synced: 06 Feb 2025

https://github.com/yanivefraim/react-node-tdd-workshop-example

A demo for my React/Node TDD workshop, using Puppeteer & Mocha :sunglasses:

javascript mocha nodejs puppeteer react tdd

Last synced: 26 Jan 2025

https://github.com/onfranciis/sustainobles-backend

Add donations and retrieve list as pdf using NodeJS, MongoDB and Puppeteer

expressjs jest mongodb nodejs puppeteer typescript

Last synced: 09 Feb 2025

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/kimromi/kshot

📷 Tools to take screenshots.

javascript koajs puppeteer

Last synced: 17 Jan 2025

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 23 Dec 2024

https://github.com/megave/puppeteer-scripts

A few browser scripts made using puppeteer library in NodeJS

browser-automation nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/kimkykie/blog-pdf-converter

Convert messy web articles into clean PDFs. Perfect for reading, archiving, sharing, and content analysis. Strips the noise, keeps what matters.

nodejs pdf-generation pdfkit puppeteer

Last synced: 09 Feb 2025

https://github.com/runnin-n-gunnin/puppeteerpanellib

PuppeteerPanel is a User Control that embeds puppeteer's chromium window in a Windows Forms application. POC.

chromium crawling puppeteer puppeteer-sharp scraping winforms

Last synced: 09 Jan 2025

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/tomashubelbauer/playwright-pdf

Using Playwright Firefox to scrape PDFs

firefox pdf playwright puppeteer scraping

Last synced: 31 Dec 2024

https://github.com/devstar2004/sotodata

You can find any firm lawyers over the world.

css html linkedin nodejs php puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/damianravindupeiris/jobber-cli

A simple AI based Node-JS script to automate the job applying process.

ai nodejs open-ai puppeteer typescript web-scraping

Last synced: 05 Jan 2025

https://github.com/hutsoninc/stihl-scraper

Used to scrape data on Stihl products.

puppeteer stihl

Last synced: 27 Dec 2024

https://github.com/tomashubelbauer/playwright-github-actions

Demonstrates using Playwright to control Firefox to take a screenshot of Hacker News in GitHub Actions

github-actions playwright puppeteer

Last synced: 31 Dec 2024

https://github.com/michalsn/sls-chrome-puppeteer

Run puppeteer with Serverless on AWS Lambda.

aws-lambda puppeteer serverless

Last synced: 26 Jan 2025

https://github.com/tomashubelbauer/shoot

A Node tool for capturing web page screenshots using Puppeteer

node npm npx puppeteer screenshot

Last synced: 31 Dec 2024

https://github.com/dm94/another-autologin

Daily auto login to get things done

autologin nodejs puppeteer

Last synced: 06 Jan 2025

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Jan 2025

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Jan 2025

https://github.com/tomashubelbauer/puppeteer-deterministic-screenshot

Pondering about whether Puppeteer screenshots are deterministic

deterministic jpg png puppeteer reproducible-builds screenshot

Last synced: 31 Dec 2024

https://github.com/tomashubelbauer/puppeteer-deterministic-pdf

Making PDFs generated using Puppeteer deterministic by zeroing their date and time stamps

pdf puppeteer

Last synced: 31 Dec 2024

https://github.com/sojebsikder/extra-power

This is a simple project that helps other developer to achieve something different

express nodejs puppeteer typescript

Last synced: 09 Jan 2025

https://github.com/tomashubelbauer/cra-test-puppeteer

Testing CRA (Create React App) with Puppeteer

cra create-react-app puppeteer

Last synced: 31 Dec 2024

https://github.com/anujdhillxn/igbot

Automated bot for instagram using puppeteer and expressjs for posting, scraping and gathering followers

expressjs mongodb puppeteer typescript webscraping

Last synced: 31 Dec 2024

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 08 Jan 2025

https://github.com/softplus/detweet

Remove Tweets via Puppeteer

nodejs puppeteer twitter twitter-api

Last synced: 23 Dec 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 23 Dec 2024

https://github.com/uday160386/test-automation-poc-demos

The consolidation of proofs of concept (POCs) using various open source tools is a strategic approach that can streamline development processes and enhance productivity

playwright-javascript puppeteer robotframework selenium

Last synced: 23 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using ES Modules, esm, Mocha, Chai and Assert.

assert chai end-to-end-test-automation esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/mersocarlin/puppeteer

Run headless Chrome Node.js tests in a Docker container

automated-testing docker docker-image dockerfile puppeteer

Last synced: 23 Dec 2024

https://github.com/konojunya/puppeteer-react

[CODE SANDBOX] puppeteer e2e testing with React

e2e-tests puppeteer react

Last synced: 23 Dec 2024

https://github.com/pdehaan/firefox-monitor-puppeteer-scan

Scan for breached emails using Puppeteer. Because why not.

firefoxmonitor hibp puppeteer

Last synced: 29 Dec 2024

https://github.com/kayantchian/fooddatascraper

FoodDataScraper is a browser extension that performs web scraping on predefined restaurant menu websites. It collects data from these menus and generates automated spreadsheets, optimizing the internal menu registration process for businesses.

csv data-science javascript papaparse puppeteer webscrapy

Last synced: 25 Jan 2025

https://github.com/demapy/flow

Flow - is an automatization builder tool that helps you automate repetitive tasks.

automation crypto javascript puppeteer react reactflow typescript zod

Last synced: 27 Jan 2025

https://github.com/kirk-en/nes-video-fetch

A web scraping tool designed to fetch download links for NES (Nintendo Entertainment System) long play videos based on game title. This tool currently supports pulling long plays and wiki info for 443 licensed NES titles.

puppeteer retrogaming scraping video-downloader video-processing

Last synced: 25 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Expect.

commonjs cucumber end-to-end-test-automation expect puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Assert.

assert commonjs end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jasmine-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jasmine and Expect.

commonjs end-to-end-test-automation jasmine puppeteer puppeteer-commonjs-jasmine

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-babel-jest-expect

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, BabelJS, Jest and Expect.

babel end-to-end-test-automation es6 puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Assert.

assert chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/bhagyamudgal/time-fun-scraper

Node.js script to scrape time.fun and create a txt report

nodejs puppeteer typescript

Last synced: 17 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber, Chai and Expect.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/idan-sh/puppeteer-automation

a JavaScript web-form test automation using the Puppeteer library.

automation-testing javascript puppeteer

Last synced: 17 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-assert

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, ESM, Mocha and Assert.

assert e2e-test e2e-testing e2e-tests es6 esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Cucumber, Chai and Should.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/tuurdutoit/puppeteer-extensible

Exports all Puppeteer's classes, so they can be extended

puppeteer utility

Last synced: 07 Jan 2025

https://github.com/gonzalofh/travel-ban-updates

This script acts a web scraper for the Covid-19 travel restrictions page on the US Gov Travel website. It returns the last date that guidelines were updated.

covid covid-19 covid19 js nodejs puppeteer travel-ban travelban

Last synced: 20 Jan 2025

https://github.com/jp7io/puppy

Simple website screenshot using AWS Lambda, Chromium, and Puppeteer.

chromium lambda puppeteer screenshot

Last synced: 20 Jan 2025

https://github.com/sidvishnoi/all-requests

Find all local and remote sub-resources and HTTP requests in a HTML document.

http-dependencies http-requests puppeteer scraper sub-resource subresource

Last synced: 09 Feb 2025

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 11 Jan 2025

https://github.com/mahmutmft/finki-scraper-app

A web scraping tool for FINKI's course directory, designed to automatically collect and display course information from the Faculty of Computer Science. Built with modern web technologies, it provides dynamic, responsive, and secure data presentation.

automation javascript nodejs puppeteer web-scraping

Last synced: 04 Feb 2025

https://github.com/bllsglm/scrape-with-puppeteer

Scrape with Puppeteer

node-js puppeteer scraper

Last synced: 20 Jan 2025

https://github.com/whosydd/cookie-format

format cookie for lib

cookie format puppeteer

Last synced: 20 Jan 2025

https://github.com/derrmru/scrape-the-news

Proof of concept - Scrape News Outlets with Express JS

expressjs javascript nlp puppeteer

Last synced: 23 Dec 2024

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 08 Jan 2025

https://github.com/eric-philippe/crilstats-webscrapping

Web scraping for statistics and analytics.

api puppeteer resacril rest webscraping

Last synced: 06 Feb 2025

https://github.com/riskers/sideex2puppeteer

sideex command to puppeteer command

puppeteer sideex

Last synced: 07 Jan 2025

https://github.com/arnavk-09/clone-html-site

⛓️ Script to clone website elements...

browserless html-css-javascript html5 node pptr puppeteer

Last synced: 06 Feb 2025

https://github.com/evanhalley/hatjitbot

A simple Slackbot for requesting a Hatjitsu room for Agile/Scrum style story sizing.

hatjitsu javascript nodejs puppeteer slack slackbot

Last synced: 30 Dec 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 72 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 87 博文 86 Packages 30 Utils 23 Integrations 17 包 14 Testing 13 Rendering and web scraping 12 Services 12 渲染和网页抓取 11 Reporters 10 Examples 10 Language Support 9 Showcases 9 Official 9 官方 9 测试 9 例子 9 Guides 6 Related 6