Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/vasani-arpit/puppeteer-extension-automation-example

Tutorial on how to add and use an extension programmatically in puppeteer

automation extensions node nodejs puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/leandro-bertoluzzi/scrap-to-api

API to get the content of web pages via scraping

docker docker-compose nodejs puppeteer scraper

Last synced: 07 Jan 2025

https://github.com/ervin-sungkono/mlbb-wiki-scraper

Scraping tool to extract data from MLBB Wiki and output as JSON file

fs javascript json nodejs p-limit puppeteer

Last synced: 16 Dec 2024

https://github.com/kimkykie/blog-pdf-converter

Convert messy web articles into clean PDFs. Perfect for reading, archiving, sharing, and content analysis. Strips the noise, keeps what matters.

nodejs pdf-generation pdfkit puppeteer

Last synced: 17 Dec 2024

https://github.com/guiselair/atena-project-pupperteer

Repositório destinado ao aprendizado e testes da biblioteca Pupperteer

puppeteer web-scrapping

Last synced: 26 Oct 2024

https://github.com/kos/react-ssr-genie

A simple tool for simple server-side rendering needs

pdf puppeteer

Last synced: 24 Jan 2025

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 09 Dec 2024

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Oct 2024

https://github.com/onfranciis/sustainobles-backend

Add donations and retrieve list as pdf using NodeJS and MongoDB

expressjs jest mongodb nodejs puppeteer typescript

Last synced: 16 Dec 2024

https://github.com/daviteixeira-dev/saucedemo-automation-with-puppeteer

Using the Puppeteer library to perform automated testing on Swag Labs' soucedemo.com website.

jest jest-puppeteer nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/silverbirder/silver-enigma

this repository is the tool to monitor the visual regression.

backstopjs circleci montoring puppeteer

Last synced: 21 Jan 2025

https://github.com/kimromi/kshot

📷 Tools to take screenshots.

javascript koajs puppeteer

Last synced: 17 Jan 2025

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 23 Dec 2024

https://github.com/mstephen19/kuhlosul-app

Full-Stack artist portfolio for Kuhlosul utilizing a custom SoundCloud-scraper library written in Node.js, Express, GraphQL, and React.

apollo-cache apollo-client cheerio context-api express graphql jwt jwt-authentication mongodb mongoose nodejs nodemailer puppeteer react react-router rebass sessionstorage

Last synced: 10 Dec 2024

https://github.com/demapy/flow

Flow - is an automatization builder tool that helps you automate repetitive tasks.

automation crypto javascript puppeteer react reactflow typescript zod

Last synced: 27 Jan 2025

https://github.com/younusaliakash/web-automation-invoice-printer

Automatic invoice generator with puppet.js and express.js that will convert an html invoice to pdf and download automatically

expressjs invoice-generator puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/runnin-n-gunnin/puppeteerpanellib

PuppeteerPanel is a User Control that embeds puppeteer's chromium window in a Windows Forms application. POC.

chromium crawling puppeteer puppeteer-sharp scraping winforms

Last synced: 09 Jan 2025

https://github.com/tomashubelbauer/playwright-pdf

Using Playwright Firefox to scrape PDFs

firefox pdf playwright puppeteer scraping

Last synced: 31 Dec 2024

https://github.com/t2bamboo/t2-puppeteer-plugin-random-ua

Helping to improve web scraping and automation by evading detection.

puppeteer puppeteer-plugin puppeteer-random-ua random-user-agent user-agent

Last synced: 21 Jan 2025

https://github.com/t2bamboo/t2-puppeteer-plugin-block-resources

Blocks unnecessary resources like images, fonts, and stylesheets to optimize performance and speed up page loads.

automation performance puppeteer puppeteer-extra resource-optimization web-scraping

Last synced: 21 Jan 2025

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automação que fornece informações dos elencos dos times da NBA. O sistema em questão é uma aplicação console que fornece opções de escolha, o usuário digita a opção que deseja e as informações são mostradas de acordo com essa opção.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Oct 2024

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Jan 2025

https://github.com/tomashubelbauer/playwright-github-actions

Demonstrates using Playwright to control Firefox to take a screenshot of Hacker News in GitHub Actions

github-actions playwright puppeteer

Last synced: 31 Dec 2024

https://github.com/marcel-msc/puppeteer-correios

Simple way of using Puppeteer to get valid address of a giving CEP on Correios website.

correios correios-cep headless-chrome puppeteer

Last synced: 06 Dec 2024

https://github.com/tomashubelbauer/shoot

A Node tool for capturing web page screenshots using Puppeteer

node npm npx puppeteer screenshot

Last synced: 31 Dec 2024

https://github.com/sthotakura/remove-linkedin-connections

puppeteer script to remove linkedin connections

linkedin puppeteer

Last synced: 02 Jan 2025

https://github.com/sidvishnoi/subresources

List all subresources/assets (CSS/JS files, images, fonts, audio/video etc.) used in a document.

hacktoberfest http-dependencies puppeteer subresources

Last synced: 29 Oct 2024

https://github.com/tomashubelbauer/puppeteer-deterministic-screenshot

Pondering about whether Puppeteer screenshots are deterministic

deterministic jpg png puppeteer reproducible-builds screenshot

Last synced: 31 Dec 2024

https://github.com/tomashubelbauer/puppeteer-deterministic-pdf

Making PDFs generated using Puppeteer deterministic by zeroing their date and time stamps

pdf puppeteer

Last synced: 31 Dec 2024

https://github.com/joaopaulopmedeiros/playing-with-pptr

Using puppeteer for going to urls, accessing dom elements and taking screenshots

js puppeteer

Last synced: 03 Dec 2024

https://github.com/oxylabs/bypass-captcha-puppeteer

A comprehensive tutorial with real code samples to learn how to bypass CAPTCHA with Puppeteer.

captcha puppeteer web-scraping

Last synced: 10 Dec 2024

https://github.com/sojebsikder/extra-power

This is a simple project that helps other developer to achieve something different

express nodejs puppeteer typescript

Last synced: 09 Jan 2025

https://github.com/suryaxanden/google-search-with-puppeteer

Node JS script to scrape entity name and entity description from Google search.

googlesearch nodejs puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/tomashubelbauer/cra-test-puppeteer

Testing CRA (Create React App) with Puppeteer

cra create-react-app puppeteer

Last synced: 31 Dec 2024

https://github.com/christianrich/generate-pdf-puppeteer

Generate a PDF with Puppeteer, Handlebars and Express

docker docker-compose express handlebars node-js pdf-generation puppeteer

Last synced: 29 Dec 2024

https://github.com/ilhamlamp/menu-scrapper

learn scrapping with nest and puppeteer

nestjs puppeteer typescript

Last synced: 06 Dec 2024

https://github.com/anujdhillxn/igbot

Automated bot for instagram using puppeteer and expressjs for posting, scraping and gathering followers

expressjs mongodb puppeteer typescript webscraping

Last synced: 31 Dec 2024

https://github.com/apexcaptain/allergy-alert

오늘 날짜를 기준으로 모 대학의 학교 홈페이지에서 제공하는 식당 정보를 Crawling하여 회관별/메뉴 분류 별로 메뉴들과 메뉴 별 알러지 유발 식품에 대한 정보를 알려줍니다.

crawler docker expressjs puppeteer reactjs sqlite typescript

Last synced: 01 Dec 2024

https://github.com/softplus/detweet

Remove Tweets via Puppeteer

nodejs puppeteer twitter twitter-api

Last synced: 23 Dec 2024

https://github.com/jonathanprojetos/open_food

Esta API fornece uma maneira simples de obter dados do site OpenFood usando Puppeteer. O website OpenFoodFacts é um website abrangente de produtos alimentícios, fornecendo informações detalhadas sobre ingredientes, valores nutricionais e muito mais.

nestjs nodejs puppeteer swagger

Last synced: 11 Dec 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 23 Dec 2024

https://github.com/uday160386/test-automation-poc-demos

The consolidation of proofs of concept (POCs) using various open source tools is a strategic approach that can streamline development processes and enhance productivity

playwright-javascript puppeteer robotframework selenium

Last synced: 23 Dec 2024

https://github.com/yandeu/mocha-chai-nyc-puppeteer-example

Client/Server testing and code-coverage with Mocha, Chai, NYC (Istanbul) and Puppeteer

chai istanbul mocha nyc puppeteer

Last synced: 11 Dec 2024

https://github.com/masreplay/html-to-image

Get s3 url from html file using node express

express html js nodejs puppeteer s3

Last synced: 11 Dec 2024

https://github.com/mersocarlin/puppeteer

Run headless Chrome Node.js tests in a Docker container

automated-testing docker docker-image dockerfile puppeteer

Last synced: 23 Dec 2024

https://github.com/konojunya/puppeteer-react

[CODE SANDBOX] puppeteer e2e testing with React

e2e-tests puppeteer react

Last synced: 23 Dec 2024

https://github.com/yr72dpi/mysql_error_google_scrapper

¤ This nodeJs script scrappes mysql errors found on google using puppeteer.

google mysql nodejs osint puppeteer scrapper scrapper-script

Last synced: 11 Dec 2024

https://github.com/younusaliakash/web-automation-deep-link

Easily collect HackerNews links with hn.algolia.com. Swiftly process comments using BullMQ. Understand sentiments (positive, negative, neutral) effortlessly. Store data in Redis for quick access. Simplify your analysis, make informed decisions effortlessly.

deep-link puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/erenkucuker/amazon-asin-scraper

Webscraper api that allows get product data by asin from amazon

amazon asin express javascript puppeteer webscraping

Last synced: 11 Dec 2024

https://github.com/canardconfit/puppeteer-docker

A simple docker image to run Puppeteer under arm64 architecture.

arm64 docker docker-image puppeteer

Last synced: 06 Dec 2024

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 12 Dec 2024

https://github.com/bubblxs/steam-avatar-showcase

simple application that collects profile pictures from public steam profiles and publishes them on my tumblr.

javascript puppeteer steam tumblr web-scraping

Last synced: 05 Dec 2024

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 12 Dec 2024

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 12 Dec 2024

https://github.com/hamzahussyn/daraz-data-scrapper

Scrapes data from the site Daraz.pk and saves in a json file.

daraz darazpk data-science puppeteer scra scrapper

Last synced: 19 Jan 2025

https://github.com/crusaderincode/article-saver-bot

This bot listens to incoming messages for valid URLs. When a URL is provided, the bot fetches the website content and returns it as a PDF file.

bot html-pdf-converter html-pdf-service nodejs open-source pdf-generation puppeteer telegraf telegram telegram-bot webscraping

Last synced: 21 Jan 2025

https://github.com/hideack/node_shutter

puppeteerによるスクリーンショット取得するシンプルなAPIを提供

puppeteer

Last synced: 12 Dec 2024

https://github.com/bhagyamudgal/time-fun-scraper

Node.js script to scrape time.fun and create a txt report

nodejs puppeteer typescript

Last synced: 17 Jan 2025

https://github.com/idan-sh/puppeteer-automation

a JavaScript web-form test automation using the Puppeteer library.

automation-testing javascript puppeteer

Last synced: 17 Jan 2025

https://github.com/f00b4r/2021-03-vercel-puppeteer-social-networks

🎁 How to use Puppeteer to generate images for social networks deployed to Vercel

f00b4r lambda network plugin puppeteer screenshot social vercel widget

Last synced: 13 Jan 2025

https://github.com/cboulanger/qx-puppeteer

UI testing of a qooxdoo application with puppeteer

puppeteer qooxdoo testing

Last synced: 06 Jan 2025

https://github.com/pdehaan/firefox-monitor-puppeteer-scan

Scan for breached emails using Puppeteer. Because why not.

firefoxmonitor hibp puppeteer

Last synced: 29 Dec 2024

https://github.com/vaenow/crawler-chromeless

A chromeless crawler for coursera

chromeless coursera crawler puppeteer

Last synced: 13 Dec 2024

https://github.com/younusaliakash/web-automation-cookie-consent

Capture screenshots of a webpage with cookie consents, ads, and offers. Take one after removing the popup and another after accepting it. Ensure clarity and accuracy in your screenshots.

cookie-consent puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/ghdwlsgur/node-crawling

# puppeteer 라이브러리를 사용하여 웹크롤링하기

crawling node puppeteer

Last synced: 27 Dec 2024

https://github.com/sidvishnoi/all-requests

Find all local and remote sub-resources and HTTP requests in a HTML document.

http-dependencies http-requests puppeteer scraper sub-resource subresource

Last synced: 17 Dec 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 11 Jan 2025

https://github.com/yuiseki/ppptr

Simple CLI tool and npm package just take screenshot of Web page with puppeteer in minutes

nodejs npm npm-package puppeteer screenshot typescript

Last synced: 21 Dec 2024

https://github.com/antoniowd/nitto-tire-crawler

Web scraper del sitio nittotire para la obtención de las características de sus neumáticos y analizar que autos pueden usarlo

mongodb nodejs puppeteer webcrawler webscraping

Last synced: 12 Dec 2024

https://github.com/korigamik/vuemastery-downloader

Download every vuemastery course locally.

puppeteer typescript vuejs

Last synced: 14 Dec 2024

https://github.com/wlun001/html-image-headless

Example of convert HTML to image with Headless environment

docker headless-chrome nodejs puppeteer

Last synced: 17 Dec 2024

https://github.com/derrmru/scrape-the-news

Proof of concept - Scrape News Outlets with Express JS

expressjs javascript nlp puppeteer

Last synced: 23 Dec 2024

https://github.com/dmehra2102/advance-node

This is the advance node project where I'm using redis for caching and Jest for writing test for my project.

javascript jest nodejs passport puppeteer redis

Last synced: 06 Dec 2024

https://github.com/sarukuku/dependency-checker

A command line tool that checks your web page's dependencies, what percentage of them are cross-origin or cross-domain and who's in control of them.

dependencies nodejs puppeteer whois

Last synced: 10 Dec 2024

https://github.com/eric-philippe/crilstats-webscrapping

Web scraping for statistics and analytics.

api puppeteer resacril rest webscraping

Last synced: 12 Dec 2024

https://github.com/afeiship/pptr-html

Get html by puppeteer.

crawl html pptr puppeteer spider

Last synced: 14 Dec 2024

https://github.com/andrewjbateman/node-puppeteer-webscraper

:clipboard: Node.js with puppeteer to extract web content from Google Chrome

cheerio html5 javascript nodejs puppeteer webscrapping

Last synced: 27 Dec 2024

https://github.com/micalevisk/ecampus-ufam-crawler

🚧 Command Line Interface (CLI) tool that automates common tasks for https://ecampus.ufam.edu.br users.

nodejs-cli puppeteer ufam ufam-cli

Last synced: 28 Oct 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 85 博文 84 Packages 30 Utils 23 Integrations 17 包 14 Testing 12 Rendering and web scraping 12 Services 12 渲染和网页抓取 11 Examples 10 Reporters 10 官方 9 Language Support 9 Showcases 9 Official 9 测试 8 例子 8 License 6 Related 6