Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/ssv445/js-rendering-proxy-docker

JS Rendering Proxy API to Handle JS Website in Your Crawler.

crawler proxy puppeteer

Last synced: 18 Jan 2025

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 09 Dec 2024

https://github.com/onfranciis/sustainobles-backend

Add donations and retrieve list as pdf using NodeJS and MongoDB

expressjs jest mongodb nodejs puppeteer typescript

Last synced: 16 Dec 2024

https://github.com/dm94/another-autologin

Daily auto login to get things done

autologin nodejs puppeteer

Last synced: 06 Jan 2025

https://github.com/kimromi/kshot

📷 Tools to take screenshots.

javascript koajs puppeteer

Last synced: 17 Jan 2025

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 23 Dec 2024

https://github.com/mstephen19/kuhlosul-app

Full-Stack artist portfolio for Kuhlosul utilizing a custom SoundCloud-scraper library written in Node.js, Express, GraphQL, and React.

apollo-cache apollo-client cheerio context-api express graphql jwt jwt-authentication mongodb mongoose nodejs nodemailer puppeteer react react-router rebass sessionstorage

Last synced: 10 Dec 2024

https://github.com/shiv-source/slice-chrome-extension-automation

This project automates the viewing of advertisements through the Slice Chrome Extension. It is designed to view ads on your behalf, and credits for viewing these ads will be automatically added to your Slice account. You can monitor these credits through the Slice extension app.

automation puppeteer slice slice-extension

Last synced: 07 Jan 2025

https://github.com/runnin-n-gunnin/puppeteerpanellib

PuppeteerPanel is a User Control that embeds puppeteer's chromium window in a Windows Forms application. POC.

chromium crawling puppeteer puppeteer-sharp scraping winforms

Last synced: 09 Jan 2025

https://github.com/tomashubelbauer/playwright-pdf

Using Playwright Firefox to scrape PDFs

firefox pdf playwright puppeteer scraping

Last synced: 31 Dec 2024

https://github.com/mgoyal98/pdf-pipeline

PDF Pipeline is a Node.js app that reads messages from SQS, generates PDFs using Puppeteer and Mustache, uploads them to S3, and updates status via SQS or webhooks

docker docker-pdf document-generator microservice mustache node-pdf nodejs pdf-generation pdf-generator pdf-microservice puppeteer sqs webhook

Last synced: 21 Dec 2024

https://github.com/mariusconjeaud/angular-with-api-calls

Angular with API calls template. Full Azure Pipeline with unit testing, e2e testing, code coverage and linting included.

angular azure-app-service azure-devops cobertura expressjs junit karma protractor puppeteer typescript

Last synced: 14 Dec 2024

https://github.com/beckkramer/puppeteer-traverse

Puppeteer utility to easily run a function you define per route on a set of routes.

crawler crawling nodejs puppeteer

Last synced: 19 Jan 2025

https://github.com/lightbeem3296/stealth-chrome-automation

Completely undetectable chrome browser automation script. Even better than all the automation libraries including Selenium, Puppeteer, Playwright and so on.

automation bypass playwright puppeteer scraper selenium stealth-bot undetectable-browser

Last synced: 05 Jan 2025

https://github.com/tomashubelbauer/playwright-github-actions

Demonstrates using Playwright to control Firefox to take a screenshot of Hacker News in GitHub Actions

github-actions playwright puppeteer

Last synced: 31 Dec 2024

https://github.com/leandro-bertoluzzi/scrap-to-api

API to get the content of web pages via scraping

docker docker-compose nodejs puppeteer scraper

Last synced: 07 Jan 2025

https://github.com/tomashubelbauer/shoot

A Node tool for capturing web page screenshots using Puppeteer

node npm npx puppeteer screenshot

Last synced: 31 Dec 2024

https://github.com/ervin-sungkono/mlbb-wiki-scraper

Scraping tool to extract data from MLBB Wiki and output as JSON file

fs javascript json nodejs p-limit puppeteer

Last synced: 16 Dec 2024

https://github.com/heronlabs/node-alpine-puppeteer

Image for Node Alpine with Puppeteer

docker docker-hub docker-image node nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/tomashubelbauer/puppeteer-deterministic-screenshot

Pondering about whether Puppeteer screenshots are deterministic

deterministic jpg png puppeteer reproducible-builds screenshot

Last synced: 31 Dec 2024

https://github.com/tomashubelbauer/puppeteer-deterministic-pdf

Making PDFs generated using Puppeteer deterministic by zeroing their date and time stamps

pdf puppeteer

Last synced: 31 Dec 2024

https://github.com/nia3zzz/word-meaning---webscraping

A basic Nodejs environmental function that takes in a word to search in a word-meaning website and then prints it in the terminal through web-scraping.

javascript nodejs puppeteer webscraping wordmeaning

Last synced: 19 Jan 2025

https://github.com/oxylabs/bypass-captcha-puppeteer

A comprehensive tutorial with real code samples to learn how to bypass CAPTCHA with Puppeteer.

captcha puppeteer web-scraping

Last synced: 10 Dec 2024

https://github.com/sojebsikder/extra-power

This is a simple project that helps other developer to achieve something different

express nodejs puppeteer typescript

Last synced: 09 Jan 2025

https://github.com/kos/react-ssr-genie

A simple tool for simple server-side rendering needs

pdf puppeteer

Last synced: 24 Jan 2025

https://github.com/tomashubelbauer/cra-test-puppeteer

Testing CRA (Create React App) with Puppeteer

cra create-react-app puppeteer

Last synced: 31 Dec 2024

https://github.com/yusukeiwaki/capybara-puppeteer-driver

Headless Chrome driver for Capybara using puppeteer-ruby

capybara puppeteer

Last synced: 02 Feb 2025

https://github.com/anujdhillxn/igbot

Automated bot for instagram using puppeteer and expressjs for posting, scraping and gathering followers

expressjs mongodb puppeteer typescript webscraping

Last synced: 31 Dec 2024

https://github.com/kimkykie/blog-pdf-converter

Convert messy web articles into clean PDFs. Perfect for reading, archiving, sharing, and content analysis. Strips the noise, keeps what matters.

nodejs pdf-generation pdfkit puppeteer

Last synced: 17 Dec 2024

https://github.com/softplus/detweet

Remove Tweets via Puppeteer

nodejs puppeteer twitter twitter-api

Last synced: 23 Dec 2024

https://github.com/jonathanprojetos/open_food

Esta API fornece uma maneira simples de obter dados do site OpenFood usando Puppeteer. O website OpenFoodFacts é um website abrangente de produtos alimentícios, fornecendo informações detalhadas sobre ingredientes, valores nutricionais e muito mais.

nestjs nodejs puppeteer swagger

Last synced: 11 Dec 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 23 Dec 2024

https://github.com/uday160386/test-automation-poc-demos

The consolidation of proofs of concept (POCs) using various open source tools is a strategic approach that can streamline development processes and enhance productivity

playwright-javascript puppeteer robotframework selenium

Last synced: 23 Dec 2024

https://github.com/yandeu/mocha-chai-nyc-puppeteer-example

Client/Server testing and code-coverage with Mocha, Chai, NYC (Istanbul) and Puppeteer

chai istanbul mocha nyc puppeteer

Last synced: 11 Dec 2024

https://github.com/masreplay/html-to-image

Get s3 url from html file using node express

express html js nodejs puppeteer s3

Last synced: 11 Dec 2024

https://github.com/creativeprojects/gallerydownloader

Download images from a webpage using headless chrome

puppeteer

Last synced: 05 Jan 2025

https://github.com/mersocarlin/puppeteer

Run headless Chrome Node.js tests in a Docker container

automated-testing docker docker-image dockerfile puppeteer

Last synced: 23 Dec 2024

https://github.com/konojunya/puppeteer-react

[CODE SANDBOX] puppeteer e2e testing with React

e2e-tests puppeteer react

Last synced: 23 Dec 2024

https://github.com/yr72dpi/mysql_error_google_scrapper

¤ This nodeJs script scrappes mysql errors found on google using puppeteer.

google mysql nodejs osint puppeteer scrapper scrapper-script

Last synced: 11 Dec 2024

https://github.com/michalsn/sls-chrome-puppeteer

Run puppeteer with Serverless on AWS Lambda.

aws-lambda puppeteer serverless

Last synced: 26 Jan 2025

https://github.com/cityssm/node-faster-report-exporter

On demand exports of selected reports from the FASTER Web Fleet Management System.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 11 Nov 2024

https://github.com/yanivefraim/react-node-tdd-workshop-example

A demo for my React/Node TDD workshop, using Puppeteer & Mocha :sunglasses:

javascript mocha nodejs puppeteer react tdd

Last synced: 26 Jan 2025

https://github.com/erenkucuker/amazon-asin-scraper

Webscraper api that allows get product data by asin from amazon

amazon asin express javascript puppeteer webscraping

Last synced: 11 Dec 2024

https://github.com/suryaxanden/google-search-with-puppeteer

Node JS script to scrape entity name and entity description from Google search.

googlesearch nodejs puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/guiselair/atena-project-pupperteer

Repositório destinado ao aprendizado e testes da biblioteca Pupperteer

puppeteer web-scrapping

Last synced: 26 Oct 2024

https://github.com/silverbirder/silver-enigma

this repository is the tool to monitor the visual regression.

backstopjs circleci montoring puppeteer

Last synced: 21 Jan 2025

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 12 Dec 2024

https://github.com/jedrzejratajczak/scraper

Web Scraper with Discord Bot running as Windows process

cron discord-bot puppeteer sqlite web-scraping windows-process

Last synced: 28 Dec 2024

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 12 Dec 2024

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 12 Dec 2024

https://github.com/ilhamlamp/menu-scrapper

learn scrapping with nest and puppeteer

nestjs puppeteer typescript

Last synced: 01 Feb 2025

https://github.com/rajeshberwal/simple-node-web-scraper

Simple web scraper template that you can use to scrape data from a website.

javascript nodejs puppeteer scraper

Last synced: 04 Jan 2025

https://github.com/hideack/node_shutter

puppeteerによるスクリーンショット取得するシンプルなAPIを提供

puppeteer

Last synced: 12 Dec 2024

https://github.com/bhagyamudgal/time-fun-scraper

Node.js script to scrape time.fun and create a txt report

nodejs puppeteer typescript

Last synced: 17 Jan 2025

https://github.com/demapy/flow

Flow - is an automatization builder tool that helps you automate repetitive tasks.

automation crypto javascript puppeteer react reactflow typescript zod

Last synced: 27 Jan 2025

https://github.com/idan-sh/puppeteer-automation

a JavaScript web-form test automation using the Puppeteer library.

automation-testing javascript puppeteer

Last synced: 17 Jan 2025

https://github.com/t2bamboo/t2-puppeteer-plugin-random-ua

Helping to improve web scraping and automation by evading detection.

puppeteer puppeteer-plugin puppeteer-random-ua random-user-agent user-agent

Last synced: 21 Jan 2025

https://github.com/t2bamboo/t2-puppeteer-plugin-block-resources

Blocks unnecessary resources like images, fonts, and stylesheets to optimize performance and speed up page loads.

automation performance puppeteer puppeteer-extra resource-optimization web-scraping

Last synced: 21 Jan 2025

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Jan 2025

https://github.com/hamzahussyn/daraz-data-scrapper

Scrapes data from the site Daraz.pk and saves in a json file.

daraz darazpk data-science puppeteer scra scrapper

Last synced: 19 Jan 2025

https://github.com/sidvishnoi/all-requests

Find all local and remote sub-resources and HTTP requests in a HTML document.

http-dependencies http-requests puppeteer scraper sub-resource subresource

Last synced: 17 Dec 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 11 Jan 2025

https://github.com/volodymyr-kasap/puppeteer-div-screenshot

Example of how to take a screenshot of each HTML block using puppeteer and sharp

puppeteer screenshot sharp typescript

Last synced: 02 Feb 2025

https://github.com/antoniowd/nitto-tire-crawler

Web scraper del sitio nittotire para la obtención de las características de sus neumáticos y analizar que autos pueden usarlo

mongodb nodejs puppeteer webcrawler webscraping

Last synced: 12 Dec 2024

https://github.com/wlun001/html-image-headless

Example of convert HTML to image with Headless environment

docker headless-chrome nodejs puppeteer

Last synced: 17 Dec 2024

https://github.com/derrmru/scrape-the-news

Proof of concept - Scrape News Outlets with Express JS

expressjs javascript nlp puppeteer

Last synced: 23 Dec 2024

https://github.com/sthotakura/remove-linkedin-connections

puppeteer script to remove linkedin connections

linkedin puppeteer

Last synced: 02 Jan 2025

https://github.com/eric-philippe/crilstats-webscrapping

Web scraping for statistics and analytics.

api puppeteer resacril rest webscraping

Last synced: 12 Dec 2024

https://github.com/dzmitry-duboyski/automation-framework-using-jest-and-puppeteer

Part #5: Automation Framework using Jest and Puppeteer for course https://www.udemy.com/course/automated-headless-browser-testing-with-puppeteer/

jest puppeteer

Last synced: 12 Jan 2025

https://github.com/christianrich/generate-pdf-puppeteer

Generate a PDF with Puppeteer, Handlebars and Express

docker docker-compose express handlebars node-js pdf-generation puppeteer

Last synced: 29 Dec 2024

https://github.com/ashnel3/usherd

command-line puppeteer script manager

puppeteer web-scraping

Last synced: 20 Dec 2024

https://github.com/stopsopa/state-of-puppeteer

🎎Bunch of test of my own puppeteer extensions

extension extensions puppeteer

Last synced: 12 Dec 2024

https://github.com/stopsopa/docker-puppeteer-html-scraper

(Deprecated -> use better https://github.com/stopsopa/html-scraper-browserless) Microservice tool to scraping html from "any" page

docker html-scraper node nodejs puppeteer scraper

Last synced: 12 Dec 2024

https://github.com/kernix13/puppeteer-web-scraper

How to use Puppeteer for web scaping

puppeteer

Last synced: 05 Jan 2025

https://github.com/andrewjbateman/node-puppeteer-webscraper

:clipboard: Node.js with puppeteer to extract web content from Google Chrome

cheerio html5 javascript nodejs puppeteer webscrapping

Last synced: 27 Dec 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 86 博文 85 Packages 30 Utils 23 Integrations 17 包 14 Services 12 Rendering and web scraping 12 Testing 12 渲染和网页抓取 11 Examples 10 Reporters 10 Official 9 Showcases 9 Language Support 9 官方 9 测试 8 例子 8 Related 6 License 6