Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/zahradnik-ondrej/jobscz-scraper

A simple data scraper of Jobs.cz written in multiple JS/TS libraries.

javascript jobs playwright puppeteer selenium typescript web-scraping

Last synced: 07 Jan 2025

https://github.com/athrvk/calibre-puppeteer-base

This repository contains a Dockerfile for creating a base image with Calibre and Puppeteer pre-installed. This image is built on top of Ubuntu 22.04 and includes all necessary dependencies for running Calibre and Puppeteer.

browserless calibre docker docker-image ebook-converter puppeteer

Last synced: 09 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Expect.

commonjs cucumber end-to-end-test-automation expect puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Assert.

assert commonjs end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/umuthopeyildirim/puppateer-screenshot

The Google Cloud function that can take screenshots of websites.

google-cloud-functions google-cloud-storage javascript puppeteer

Last synced: 11 Jan 2025

https://github.com/younusaliakash/web-automation-deep-link

Easily collect HackerNews links with hn.algolia.com. Swiftly process comments using BullMQ. Understand sentiments (positive, negative, neutral) effortlessly. Store data in Redis for quick access. Simplify your analysis, make informed decisions effortlessly.

deep-link puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/pro-oc/pro-oc-dzs-proxy

REST API CORS Proxy server pro DZS registr.

cors-proxy-server dzs proxy-server puppeteer rest-api

Last synced: 14 Jan 2025

https://github.com/tomaszrewak/react-app-puppeteer-component-testing

Guide on how to to configure puppeteer with a default (non-ejected) react app in order to test individual react components.

puppeteer react regression-testing visual-testing

Last synced: 05 Jan 2025

https://github.com/c0de-l00p/whatsapp-bot

Simple whatsapp bot made with node js and puppeteer

node puppeteer qrcode whatsapp

Last synced: 03 Jan 2025

https://github.com/rchrdlss3/spotify-scraper

Obtain data from Spotify regarding your favorite artist or album. Utilizes Puppeteer.

artists music npm npm-package puppeteer scrape spotify web

Last synced: 05 Jan 2025

https://github.com/encoreshao/node-practices

Node.js Practices

javascript nodejs puppeteer

Last synced: 12 Jan 2025

https://github.com/zbo14/hype-radio

CLI radio that plays the newest songs on Hype Machine.

audio browser-automation internet-radio javascript music nodejs puppeteer radio streaming

Last synced: 04 Dec 2024

https://github.com/zbo14/robit

Easily configure and run browser automation jobs!

browser-automation puppeteer web-scraping

Last synced: 04 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-jasmine-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jasmine and Expect.

commonjs end-to-end-test-automation jasmine puppeteer puppeteer-commonjs-jasmine

Last synced: 11 Jan 2025

https://github.com/younusaliakash/web-automation-cookie-consent

Capture screenshots of a webpage with cookie consents, ads, and offers. Take one after removing the popup and another after accepting it. Ensure clarity and accuracy in your screenshots.

cookie-consent puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/b4dnewz/webpage-capture-cli

Capture the web in many ways from the command line

cli-tool cli-utility puppeteer puppeteer-screenshot screenshot webpage webshot website

Last synced: 12 Jan 2025

https://github.com/vasani-arpit/puppeteer-extension-automation-example

Tutorial on how to add and use an extension programmatically in puppeteer

automation extensions node nodejs puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/ekamid/goodreads-book-scrapper

Scrap Goodreads Book information using Puppeteer

javascript puppeteer scrapper scrapping typescript

Last synced: 08 Jan 2025

https://github.com/heronlabs/node-alpine-puppeteer

Image for Node Alpine with Puppeteer

docker docker-hub docker-image node nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/anibalalpizar/puppeteer-overview

Control your browser using Javascript code, together with the Puppeteer library and Nodejs

nodejs puppeteer webscraping

Last synced: 08 Jan 2025

https://github.com/entrptaher/playground-puppeteer-examples

Various example problem solved using puppeteer

headless-chrome puppeteer

Last synced: 19 Nov 2024

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 04 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Assert.

assert commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 09 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-should

Puppeteer end-to-end test automation boilerplate, Using ES Modules, esm, Mocha, Chai and Should.

chai end-to-end-test-automation esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/onfranciis/sustainobles-backend

Add donations and retrieve list as pdf using NodeJS and MongoDB

expressjs jest mongodb nodejs puppeteer typescript

Last synced: 16 Dec 2024

https://github.com/yuriyvyatkin/ahj-hw-4-testing

ДЗ к лекции «Организация тестирования (Unit, E2E)» курса «Продвинутый JavaScript в браузере» Нетологии

card-validator jest js jsdom puppeteer

Last synced: 04 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jasmine-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jasmine and Assert.

assert commonjs end-to-end-test-automation jasmine puppeteer

Last synced: 11 Jan 2025

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 23 Dec 2024

https://github.com/mstephen19/kuhlosul-app

Full-Stack artist portfolio for Kuhlosul utilizing a custom SoundCloud-scraper library written in Node.js, Express, GraphQL, and React.

apollo-cache apollo-client cheerio context-api express graphql jwt jwt-authentication mongodb mongoose nodejs nodemailer puppeteer react react-router rebass sessionstorage

Last synced: 10 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Cucumber, Chai and Assert.

assert chai commonjs cucumber puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-assert

Puppeteer end-to-end test automation boilerplate project. Using commonjs, mocha and assert.

assert commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/runnin-n-gunnin/puppeteerpanellib

PuppeteerPanel is a User Control that embeds puppeteer's chromium window in a Windows Forms application. POC.

chromium crawling puppeteer puppeteer-sharp scraping winforms

Last synced: 09 Jan 2025

https://github.com/lightbeem3296/stealth-chrome-automation

Completely undetectable chrome browser automation script. Even better than all the automation libraries including Selenium, Puppeteer, Playwright and so on.

automation bypass playwright puppeteer scraper selenium stealth-bot undetectable-browser

Last synced: 05 Jan 2025

https://github.com/tomashubelbauer/playwright-pdf

Using Playwright Firefox to scrape PDFs

firefox pdf playwright puppeteer scraping

Last synced: 31 Dec 2024

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 07 Jan 2025

https://github.com/francescocoding/harvest-time

🌽 Harvest Time is a Node-based web scraper that utilizes Puppeteer to get past the login page directly from the Node environment (programmatically).

nodejs puppeteer scraper scraping

Last synced: 15 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-expect

Puppeteer end-to-end test automation boilerplate project. Using ES6 modules, ESM, mocha and chai.

chai es6 esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Jan 2025

https://github.com/tomashubelbauer/playwright-github-actions

Demonstrates using Playwright to control Firefox to take a screenshot of Hacker News in GitHub Actions

github-actions playwright puppeteer

Last synced: 31 Dec 2024

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 04 Jan 2025

https://github.com/tomashubelbauer/shoot

A Node tool for capturing web page screenshots using Puppeteer

node npm npx puppeteer screenshot

Last synced: 31 Dec 2024

https://github.com/guiselair/atena-project-pupperteer

Repositório destinado ao aprendizado e testes da biblioteca Pupperteer

puppeteer web-scrapping

Last synced: 26 Oct 2024

https://github.com/e2e-boilerplate/puppeteer-typescript-ts-jest-jest-assert

Puppeteer end-to-end test automation boilerplate, Using TypeScript, ts-jest, Jest and Assert.

assert end-to-end-test-automation jest puppeteer puppeteer-typescript ts-jest typescript

Last synced: 11 Jan 2025

https://github.com/tomashubelbauer/puppeteer-deterministic-screenshot

Pondering about whether Puppeteer screenshots are deterministic

deterministic jpg png puppeteer reproducible-builds screenshot

Last synced: 31 Dec 2024

https://github.com/tomashubelbauer/puppeteer-deterministic-pdf

Making PDFs generated using Puppeteer deterministic by zeroing their date and time stamps

pdf puppeteer

Last synced: 31 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-typescript-ts-node-jasmine-assert

Puppeteer end-to-end test automation boilerplate, Using TypeScript, ts-node, Jasmine and Assert.

assert end-to-end-test-automation jasmine puppeteer typescript

Last synced: 11 Jan 2025

https://github.com/oxylabs/bypass-captcha-puppeteer

A comprehensive tutorial with real code samples to learn how to bypass CAPTCHA with Puppeteer.

captcha puppeteer web-scraping

Last synced: 10 Dec 2024

https://github.com/sojebsikder/extra-power

This is a simple project that helps other developer to achieve something different

express nodejs puppeteer typescript

Last synced: 09 Jan 2025

https://github.com/jp7io/puppy

Simple website screenshot using AWS Lambda, Chromium, and Puppeteer.

chromium lambda puppeteer screenshot

Last synced: 19 Nov 2024

https://github.com/tomashubelbauer/cra-test-puppeteer

Testing CRA (Create React App) with Puppeteer

cra create-react-app puppeteer

Last synced: 31 Dec 2024

https://github.com/softonic/docker-puppeteer

Puppeteer docker image

docker-image puppeteer

Last synced: 21 Dec 2024

https://github.com/lukmanrambe/sekawan-restaurant

Restaurant Catalogue Website. Submission for "Menjadi Front-End Web Developer Expert" (https://www.dicoding.com/academies/219) Dicoding Class

accessibility codeceptjs css html jasmine javascript karma karma-jasmine progressive-web-app puppeteer pwa semantic-html webpack workbox

Last synced: 18 Dec 2024

https://github.com/anujdhillxn/igbot

Automated bot for instagram using puppeteer and expressjs for posting, scraping and gathering followers

expressjs mongodb puppeteer typescript webscraping

Last synced: 31 Dec 2024

https://github.com/ghdwlsgur/node-crawling

# puppeteer 라이브러리를 사용하여 웹크롤링하기

crawling node puppeteer

Last synced: 27 Dec 2024

https://github.com/softplus/detweet

Remove Tweets via Puppeteer

nodejs puppeteer twitter twitter-api

Last synced: 23 Dec 2024

https://github.com/jonathanprojetos/open_food

Esta API fornece uma maneira simples de obter dados do site OpenFood usando Puppeteer. O website OpenFoodFacts é um website abrangente de produtos alimentícios, fornecendo informações detalhadas sobre ingredientes, valores nutricionais e muito mais.

nestjs nodejs puppeteer swagger

Last synced: 11 Dec 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 23 Dec 2024

https://github.com/uday160386/test-automation-poc-demos

The consolidation of proofs of concept (POCs) using various open source tools is a strategic approach that can streamline development processes and enhance productivity

playwright-javascript puppeteer robotframework selenium

Last synced: 23 Dec 2024

https://github.com/yandeu/mocha-chai-nyc-puppeteer-example

Client/Server testing and code-coverage with Mocha, Chai, NYC (Istanbul) and Puppeteer

chai istanbul mocha nyc puppeteer

Last synced: 11 Dec 2024

https://github.com/masreplay/html-to-image

Get s3 url from html file using node express

express html js nodejs puppeteer s3

Last synced: 11 Dec 2024

https://github.com/j-m/anvomywz1k

A community-based game review website

coursework game jest koa puppeteer review website

Last synced: 30 Dec 2024

https://github.com/mersocarlin/puppeteer

Run headless Chrome Node.js tests in a Docker container

automated-testing docker docker-image dockerfile puppeteer

Last synced: 23 Dec 2024

https://github.com/konojunya/puppeteer-react

[CODE SANDBOX] puppeteer e2e testing with React

e2e-tests puppeteer react

Last synced: 23 Dec 2024

https://github.com/yr72dpi/mysql_error_google_scrapper

¤ This nodeJs script scrappes mysql errors found on google using puppeteer.

google mysql nodejs osint puppeteer scrapper scrapper-script

Last synced: 11 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-es-modules-babel-jest-expect

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, BabelJS, Jest and Expect.

babel end-to-end-test-automation es6 puppeteer

Last synced: 11 Jan 2025

https://github.com/erenkucuker/amazon-asin-scraper

Webscraper api that allows get product data by asin from amazon

amazon asin express javascript puppeteer webscraping

Last synced: 11 Dec 2024

https://gitlab.com/hajnyon-projects/slichta/slichta-scraper

Scrapes various websites for daily meal menus. https://slichta.vercel.app/

apify menus puppeteer restaurants scraper

Last synced: 23 Oct 2024

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 12 Dec 2024

https://github.com/code-yeongyu/puppeteer-practice-melon-top100-crawler

My first puppeteer project using typescript. It prints melon top 100 chart with rank and song info!

melon puppeteer typescript

Last synced: 04 Jan 2025

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 12 Dec 2024

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 12 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Should.

chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/dkgee/tk_spa

nodejs案例 puppeteer

centos7 nodejs puppeteer windows-7

Last synced: 22 Dec 2024

https://github.com/baxsm/scrapway

Scrapway allows users to create powerful data scraping workflows and execute them either manually or via cron jobs. With an intuitive UI and support for various tasks such as user interactions, data extraction, storage, and result delivery – you can easily automate scraping operations with minimal effort.

cheerio nextjs openai puppeteer scraping shadcn-ui stripe tailwindcss

Last synced: 06 Dec 2024

https://github.com/hideack/node_shutter

puppeteerによるスクリーンショット取得するシンプルなAPIを提供

puppeteer

Last synced: 12 Dec 2024

https://github.com/kimkykie/blog-pdf-converter

Convert messy web articles into clean PDFs. Perfect for reading, archiving, sharing, and content analysis. Strips the noise, keeps what matters.

nodejs pdf-generation pdfkit puppeteer

Last synced: 17 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Assert.

assert chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/kayyz1/llmscraper

LLM AI web scraper tool

openai puppeteer react remix typescript

Last synced: 10 Dec 2024

https://github.com/sidvishnoi/all-requests

Find all local and remote sub-resources and HTTP requests in a HTML document.

http-dependencies http-requests puppeteer scraper sub-resource subresource

Last synced: 17 Dec 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 11 Jan 2025

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 83 博文 82 Packages 30 Utils 23 Integrations 17 包 14 Testing 13 Rendering and web scraping 12 Services 12 渲染和网页抓取 11 Examples 10 Reporters 10 Language Support 9 Showcases 9 Official 9 官方 9 测试 9 例子 8 License 6 Related 6