Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/lencx/learn-puppeteer

puppeteer 学习笔记

demo puppeteer puppeteer-demo

Last synced: 19 Oct 2024

https://github.com/tokuda109/techbookfest07-puppeteer-samples

技術書典7に出典した「実践マニアックテスト 〜Android・iOS・Web編〜」の「Puppeteerを使ったE2Eテストの始め方」のサンプルコード集

e2e javascript nodejs puppeteer

Last synced: 14 Nov 2024

https://github.com/adamtylerlynch/puppeteer-multiarch

Creating Multi-Arch docker images for ARM64/x86 (amd64) using CodeBuild from Jenkins. Headless browsing with Chromium and Puppeteer.

aarch64-linux arm arm64 chromium codebuild docker docker-image multi-arch-images multiarch puppeteer

Last synced: 27 Oct 2024

https://github.com/encoreshao/puppeteer-typescript-starter

The most basic Puppeteer TypeScript starter

data-scraper json nodemon puppeteer structure typescript

Last synced: 21 Oct 2024

https://github.com/euberdeveloper/video-scraper-core

An npm package that provides an abstract class to scrape videos with Puppeteer

npm puppeteer scraper typescript video-scraper

Last synced: 21 Oct 2024

https://github.com/noriste/feti-workshop-e2e-testing-with-puppeteer

The reference repo of a workshop for FETI about browser automation (both for E2E testing and for web scraping) with Puppeteer. Workshop level: basic.

e2e-testing e2e-tests puppeteer scraping-websites testing-tools web

Last synced: 05 Nov 2024

https://github.com/nadavkli/react-to-pdf-ts

Transform React components into PDFs effortlessly! Leverage TypeScript and Puppeteer for high-quality, customizable PDFs with just a few lines of code.

nodejs pdf pdf-generation puppeteer react reactjs typescript

Last synced: 21 Oct 2024

https://github.com/kodie/stack-fanatic-cli

A CLI tool for checking the progress of the badge you are tracking on your Stack Overflow profile.

badge badges cli command-line command-line-tool google node node-js node-module nodejs puppeteer stack-overflow stackexchange stackoverflow

Last synced: 21 Oct 2024

https://github.com/pmmmwh/cimg-puppeteer

A Docker "Convenience Image" built to run Puppeteer-related tasks on CircleCI.

circleci circleci-cimg convenience-image docker puppeteer

Last synced: 13 Oct 2024

https://github.com/willemverbuyst/willemverbuyst

Scrape the topics of my repos, convert those into badges and present them in an overview (with a cron job)

githubactions javascript mustache puppeteer

Last synced: 02 Nov 2024

https://github.com/coderdotjs/html-to-pdf-node

This plugin will convert html page or public URL into PDF. This will work with Node.js

converter html-pdf nodejs npm npm-package pdf puppeteer serverside

Last synced: 12 Oct 2024

https://github.com/shellyln/mdne-electron

Markdown Neo Edit for Electron - A simple markdown and code editor powered by Markdown-it, Ace and Electron.

ace code-editor editor electron lisp liyad lsx markdown markdown-editor markdown-it markdown-to-html menneu pdf puppeteer pwa

Last synced: 14 Oct 2024

https://github.com/petehouston/node-proshot

Handy tool to capture website screenshots using Puppeteer.

capture capture-website-screenshots javascript node nodejs puppeteer screenshot screenshots

Last synced: 25 Oct 2024

https://github.com/petehouston/mshot-cli

CLI to take screenshots for multiple website at one using Puppeteer.

capture cli puppeteer puppeteer-screenshot screenshot screenshot-utility screenshots

Last synced: 25 Oct 2024

https://github.com/molvqingtai/testing-library-extra

Add bySelector and byAttribute to @testing-library/dom

happy-dom jest jsdom playwright puppeteer testing-library testing-library-dom vitest

Last synced: 27 Oct 2024

https://github.com/slickcharmer/screen-sharing-basic

Simple Screen Sharing Application using React and Node.js. You can use it on your project.

nodejs puppeteer react screen sharing

Last synced: 15 Nov 2024

https://github.com/ykon550/puppenomist

Puppenomist = Scraper for the Economist with Puppeteer

economist puppeteer puppeteer-demo webscraping

Last synced: 14 Oct 2024

https://github.com/raeesbhatti/vbully

Scrapes data off vBulletin websites

puppeteer scraper vbulletin

Last synced: 26 Oct 2024

https://github.com/tkdn/chroco

[experimental] Chroco operates `puppeteer` with commandable, pluggable settings.

chrome cli experimental headless puppeteer scenario

Last synced: 14 Oct 2024

https://github.com/wangshibiaoflytiger/spider_puppeteer

nodejs puppeteer爬虫开发脚手架

crawl nodejs puppeteer spider

Last synced: 10 Nov 2024

https://github.com/rebrowser/rebrowser-puppeteer-core

A drop-in replacement for puppeteer-core patched with rebrowser-patches. It allows to pass modern automation detection tests.

automation bot bot-detection captcha headless puppeteer rebrowser rebrowser-patches scraping web-scraping

Last synced: 12 Oct 2024

https://github.com/mobilerast/accessibility-checker

A tool for assessing website accessibility, leveraging Puppeteer and axe-core. It automates the process of detecting common accessibility issues, providing a quick and efficient means to ensure web content is accessible to all users, including those with disabilities.

accessibility accessibility-analysis accessibility-automation accessibility-testing accessible axe-core axe-puppeteer javascript nodejs puppeteer puppeteer-core puppeteer-demo validation violations

Last synced: 11 Nov 2024

https://github.com/bwally0/depop-scraper-api

Web Scraper API for https://www.depop.com/

api depop express-js node-js puppeteer web-scraping

Last synced: 27 Oct 2024

https://github.com/pudochu/stealthbot

🔬 Educational web automation tool showcasing advanced techniques. 🚫 Not for malicious use. 🎓 Learn responsibly!

automation-tool browser-automation javascript nodejs puppeteer user-simulation web-automation web-testing

Last synced: 05 Nov 2024

https://github.com/aexynn/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 14 Oct 2024

https://github.com/kiprasmel/snitch-latest-car

🔭 Snitch the latest car like it's nothin'

car executable javascript kiprasmel latest nexe puppeteer sarpik snitch

Last synced: 15 Nov 2024

https://github.com/samc621/business-insider

Takes the URL of a Business Insider article and PDF's it's raw content, bypassing the paywall.

axios jsdom nodejs puppeteer web-scraping

Last synced: 05 Nov 2024

https://github.com/stefanzweifel/sidecar-browsershot-layer

AWS Lambda Layer containing puppeteer-core. Used by sidecar-browsershot

aws-lambda aws-lambda-layer puppeteer puppeteer-core

Last synced: 24 Oct 2024

https://github.com/devrax/opencorpdrscrapper

Web scraper to extract company data from OpenCorporates

javascript nodejs puppeteer supabase

Last synced: 12 Nov 2024

https://github.com/shunyue1320/buy-xiaomi

抢小米手机脚本

buy k40 node phone puppeteer script xiaomi

Last synced: 15 Oct 2024

https://github.com/cenfun/page-save-as

Page save as JPG/PNG/PDF

jpg page pdf png puppeteer save

Last synced: 18 Oct 2024

https://github.com/scriptsmith/routerreboot

Reboot my cheap router

puppeteer typescript

Last synced: 05 Nov 2024

https://github.com/darkterminal/rest-screenshoot

REST Screenshoot is a free tool for capturing screenshots of webpages via a REST API. Free an always!

open-source puppeteer rest-api screenshoot

Last synced: 08 Nov 2024

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 10 Oct 2024

https://github.com/arthurweinmann/puppeteer-server

Run Puppeteer (browser automation) as a HTTP API

api puppeteer rpc

Last synced: 10 Nov 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Oct 2024

https://github.com/lameuler/astro-pdf

A simple Astro integration to generate PDFs from built pages.

astro astro-integration pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 09 Nov 2024

https://github.com/iadtya/web-summarizer

Web-summarizer scrapes the specific url to pipes that text data into gpt-3.5-turbo model to generate summary of the url and uses redis to cache the summary to save overhead price

expressjs nodejs openai-api puppeteer reactjs redis tailwindcss

Last synced: 09 Nov 2024

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 10 Nov 2024

https://github.com/andrei0x309/puppeteer-extra-plugin-browser-extension-interact

Puppeteer extra plugin to interact with browser extensions, highly experimental.

browser-extention-interaction puppeteer puppeteer-extra puppeteer-extra-plugin

Last synced: 09 Nov 2024

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 05 Nov 2024

https://github.com/spm999/invoice-generator

Invoice generator application built using Node.js, Express.js, Handlebars, and Puppeteer. It generates invoices in PDF format based on the provided data.

api-rest express hbs invoice-generator nodejs postman puppeteer template-engine templateengine

Last synced: 05 Nov 2024

https://github.com/c0de-l00p/whatsapp-bot

Simple whatsapp bot made with node js and puppeteer

node puppeteer qrcode whatsapp

Last synced: 09 Nov 2024

https://github.com/christiancesar/hunter

Scraping of the target web application, using puppeeter, node with typescript and best practices.

backend ddd factory-pattern fullstack-development mongodb-atlas nodejs observer-pattern poo puppeteer react tdd typescript

Last synced: 10 Oct 2024

https://github.com/copha-project/copha

Open-Source Software For Managing Tasks

crawler framework nodejs puppeteer selenium

Last synced: 15 Nov 2024

https://github.com/mushfiqurniazzz/word-meaning---webscraping

A basic Nodejs environmental function that takes in a word to search in a word-meaning website and then prints it in the terminal through web-scraping.

javascript nodejs puppeteer webscraping wordmeaning

Last synced: 05 Nov 2024

https://github.com/duranda/lambda-pdf-generator

Generate PDF from HTML remotely on AWS Lambda with the Chromium rendering engine

aws-lambda chromium pdf-generation puppeteer wkhtmltopdf

Last synced: 05 Nov 2024

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel 蓋棉被純聊天.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/code-yeongyu/puppeteer-practice-melon-top100-crawler

My first puppeteer project using typescript. It prints melon top 100 chart with rank and song info!

melon puppeteer typescript

Last synced: 09 Nov 2024

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 09 Nov 2024

https://github.com/avivharuzi/instagram-downloader

Download images and videos from Instagram using Node.js with Puppeteer

javascript nodejs puppeteer

Last synced: 15 Nov 2024

https://github.com/uday160386/test-automation-poc-demos

The consolidation of proofs of concept (POCs) using various open source tools is a strategic approach that can streamline development processes and enhance productivity

playwright-javascript puppeteer robotframework selenium

Last synced: 10 Oct 2024

https://github.com/tushcmd/olo-scraper

This is a full-stack web scraping application that simulates browser-like interactions using a headless browser. Users can input a URL, and the application scrapes data and performs specified actions.

cors express nodejs puppeteer react tailwindcss typescript winston

Last synced: 05 Nov 2024

https://github.com/mdato/dolar2030

puppeteer + heroku + express

express heroku puppeteer

Last synced: 10 Nov 2024

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 10 Nov 2024

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicação console que fornece informações dos elencos, próximas partidas e notícias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 10 Oct 2024

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 09 Nov 2024

https://github.com/brightspace/d2l-beaker

A driver for Google Puppeteer to collect client-side performance metrics.

automation performance puppeteer

Last synced: 10 Nov 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer

NodeJs version with all dependencies to run Puppeteer

docker nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/matthewjselby/json-resume

Generate a resume in both HTML and PDF from a JSON file.

gulp handlebars html javascript json puppeteer resume sass

Last synced: 14 Nov 2024

https://github.com/ellache/adjust_your_algo

Run puppeteer core in the background to modify your digital profile by navigating repeatedly to a specified set of webpages.

nodejs puppeteer puppeteer-core

Last synced: 09 Nov 2024

https://github.com/evgeniyarbatov/location-testing

E2E testing of pages with location

expressjs location mocha puppeteer

Last synced: 05 Nov 2024

https://github.com/rajeshberwal/simple-node-web-scraper

Simple web scraper template that you can use to scrape data from a website.

javascript nodejs puppeteer scraper

Last synced: 09 Nov 2024

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

https://github.com/zewa666/au-puppeteer-example

A sample showing how an Aurelia app can be tested with Puppeteer

aurelia e2e-tests jest puppeteer typescript

Last synced: 15 Nov 2024

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Oct 2024

https://github.com/tomaszrewak/react-app-puppeteer-component-testing

Guide on how to to configure puppeteer with a default (non-ejected) react app in order to test individual react components.

puppeteer react regression-testing visual-testing

Last synced: 09 Nov 2024

https://github.com/damianravindupeiris/jobber-cli

A simple AI based Node-JS script to automate the job applying process.

ai nodejs open-ai puppeteer typescript web-scraping

Last synced: 09 Nov 2024

https://github.com/eltonsantos/gerador-de-pdf

Projeto desenvolvido - Vídeo: Vamos gerar PDF com NodeJS, Puppeteer, EJS e TailwindCSS - Instrutor: Mayk Brito - Link: https://www.youtube.com/watch?v=AoU7aEdTldE

ejs express html-pdf nodejs pdf puppeteer tailwindcss

Last synced: 12 Nov 2024

https://github.com/eltonsantos/calcular-horas-video-youtube

Simple Youtube Video Hour Calculator. - Vídeo: O último Code/Drops! Script que calcula horas de vídeo | Code/Drops #68 - Instrutor: Diego Fernandes & Mayk Brito - Link: https://www.youtube.com/watch?v=faekjlZuTFA

nodejs puppeteer

Last synced: 12 Nov 2024

https://github.com/f00b4r/2021-03-vercel-puppeteer-social-networks

🎁 How to use Puppeteer to generate images for social networks deployed to Vercel

f00b4r lambda network plugin puppeteer screenshot social vercel widget

Last synced: 14 Nov 2024

https://github.com/stopsopa/docker-puppeteer-html-scraper

(Deprecated -> use better https://github.com/stopsopa/html-scraper-browserless) Microservice tool to scraping html from "any" page

docker html-scraper node nodejs puppeteer scraper

Last synced: 24 Oct 2024

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 10 Nov 2024

https://github.com/stopsopa/state-of-puppeteer

🎎Bunch of test of my own puppeteer extensions

extension extensions puppeteer

Last synced: 24 Oct 2024

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 11 Nov 2024

https://github.com/mobilerast/ssr-generator

SSR Generator is able to save your SPA as a rendered HTML. SSR For Angular, React.js, Vue.js.

angular-apps javascript nodejs puppeteer search-engines server-side-render server-side-rendering ssr ssr-generator

Last synced: 11 Nov 2024

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 24 Oct 2024

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 24 Oct 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 05 Nov 2024

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 21 Oct 2024

https://github.com/pionl/docker-node-puppeteer-ready

🐳 Docker image based on official node with with GoogleChrome/puppeteer support

chrome docker docker-image nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 24 Oct 2024

https://github.com/anibalalpizar/puppeteer-overview

Control your browser using Javascript code, together with the Puppeteer library and Nodejs

nodejs puppeteer webscraping

Last synced: 11 Nov 2024

https://github.com/lightbeem3296/stealth-chrome-automation

Completely undetectable chrome browser automation script. Even better than all the automation libraries including Selenium, Puppeteer, Playwright and so on.

automation bypass playwright puppeteer scraper selenium stealth-bot undetectable-browser

Last synced: 09 Nov 2024

https://github.com/flolu/bazel-node-puppeteer

Can't run Bazel nodejs_image with Puppeteer

bazel docker nodejs puppeteer rules-nodejs

Last synced: 11 Nov 2024

https://github.com/rafaellaurindo/mercadolivre-scraper

Scraper to Mercado Livre products written in Node.js using Puppeteer.

bot mercadolivre nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/pioug/cookbook

Recipes to start my umpteenth dev projects.

cloud-run frontend javascript puppeteer rollup vuejs

Last synced: 16 Nov 2024