Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/arthurweinmann/puppeteer-server

Run Puppeteer (browser automation) as a HTTP API

api puppeteer rpc

Last synced: 10 Nov 2024

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website 📷

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/sirok1/lolz-auto-contests

Lolzteam | zelenka.guru app for auto-participation in draws

discord-webhook nodejs puppeteer telegram-bot

Last synced: 16 Nov 2024

https://github.com/ashutoshsce/nys-liquor-authority

Directly scrape records from https://www.tran.sla.ny.gov/JSP/query/PublicQueryAdvanceSearchPage.jsp and present it in datatable format

datatable expressjs mongodb node nys-liquor-authority puppeteer vuejs website-scraper

Last synced: 28 Oct 2024

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automação que fornece informações dos elencos dos times da NBA. O sistema em questão é uma aplicação console que fornece opções de escolha, o usuário digita a opção que deseja e as informações são mostradas de acordo com essa opção.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Oct 2024

https://github.com/zaidkhalid44/irctc

Technologies used: JavaScript, Puppeteer, Tesseract.js, Jimp Description: Developed an automated system using Puppeteer and Tesseract.js to streamline IRCTC train ticket booking, handling login, captcha solving, and form filling. Automated login and form-filling tasks, reducing manual effort by approximately 90%.

jimp puppeteer tesseract

Last synced: 05 Nov 2024

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 09 Nov 2024

https://github.com/iadtya/web-summarizer

Web-summarizer scrapes the specific url to pipes that text data into gpt-3.5-turbo model to generate summary of the url and uses redis to cache the summary to save overhead price

expressjs nodejs openai-api puppeteer reactjs redis tailwindcss

Last synced: 09 Nov 2024

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 10 Nov 2024

https://github.com/miscos/discord-web-crawler

A puppeteer based webcrawler posting results to a discord webhook

discord puppeteer webcrawler

Last synced: 05 Nov 2024

https://github.com/andrei0x309/puppeteer-extra-plugin-browser-extension-interact

Puppeteer extra plugin to interact with browser extensions, highly experimental.

browser-extention-interaction puppeteer puppeteer-extra puppeteer-extra-plugin

Last synced: 09 Nov 2024

https://github.com/redaezziani/scrape-data-store-jolt

Product Scraper for Jolt Store is a robust tool designed to automate the collection of product data from e-commerce websites. This project leverages Puppeteer for web scraping and Prisma Client for seamless database management, ensuring efficient integration of external product data into the Jolt Store.

nodejs puppeteer webscraping

Last synced: 05 Nov 2024

https://github.com/omarkhairy21/nodens-assignment-

Simple Authentication MVC With Unit Testing and e2e testing

expressjs jest jwt jwt-authentication nodejs pugjs puppeteer semantic-ui

Last synced: 16 Nov 2024

https://github.com/derrmru/scrape-the-news

Proof of concept - Scrape News Outlets with Express JS

expressjs javascript nlp puppeteer

Last synced: 05 Nov 2024

https://github.com/michalsn/sls-chrome-puppeteer

Run puppeteer with Serverless on AWS Lambda.

aws-lambda puppeteer serverless

Last synced: 01 Oct 2024

https://github.com/radzionc/apartments-watcher

Opens new apartments for sale in Chrome

nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/c0de-l00p/whatsapp-bot

Simple whatsapp bot made with node js and puppeteer

node puppeteer qrcode whatsapp

Last synced: 09 Nov 2024

https://github.com/radzionc/linkedin-connector

Connect With Customers From Email List on LinkedIn With Automation

dynamodb nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/radzionc/medium-updater

Programatically Update Medium Stories CTAs

medium nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/radzionc/music-alarm

Alarm with Yandex-music

nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/radzionc/twitter-outreach-cli

Half-automatically Reach Followers of a specific Profile

nodejs puppeteer twitter-api

Last synced: 06 Nov 2024

https://github.com/stephlaf/puppeteer-airtable-tutorial

Tutorial to scrape the web using Puppeteer and store to Airtable

airtable-api javascript puppeteer scraping

Last synced: 20 Oct 2024

https://github.com/hideack/node_shutter

puppeteerによるスクリーンショット取得するシンプルなAPIを提供

puppeteer

Last synced: 24 Oct 2024

https://github.com/vedovati-matteo/gpu-price-tracker

A sophisticated web scraper for tracking GPU prices across e-commerce platforms, featuring proxy rotation, CAPTCHA handling, and data visualization.

captcha-handling docker fullstack gpu-prices javascript mongodb next-js node-js proxy-rotation puppeteer telegram-bot web-scraping

Last synced: 12 Oct 2024

https://github.com/akirak/docker-chromium

Docker image containing a Chromium executable for Puppeteer

chromium docker-image puppeteer

Last synced: 31 Oct 2024

https://github.com/code-yeongyu/puppeteer-practice-melon-top100-crawler

My first puppeteer project using typescript. It prints melon top 100 chart with rank and song info!

melon puppeteer typescript

Last synced: 09 Nov 2024

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 09 Nov 2024

https://github.com/rishi-raj-jain/grabscreen

GrabScreen - A Screenshot Generator

api chrome-aws-lambda nextjs puppeteer serverless

Last synced: 26 Oct 2024

https://github.com/rishi-raj-jain/html-og-image

A deployment of OG Image Generator to Layer0.

chrome-aws-lambda layer0 nextjs prettier puppeteer react react-dom

Last synced: 26 Oct 2024

https://github.com/thundermiracle/costco-monitor

Monitor product's price & stock status. Send email when price is down or stock status is changed.

costco puppeteer

Last synced: 20 Oct 2024

https://github.com/luifean/dicio-api

API desenvolvida para obter o significado de palavras através de mineração de dados

express javascript nodejs puppeteer

Last synced: 08 Nov 2024

https://github.com/mdato/dolar2030

puppeteer + heroku + express

express heroku puppeteer

Last synced: 10 Nov 2024

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 10 Nov 2024

https://github.com/iomerkoyuncu/website-to-file

Node.js library to capture image/pdf from url.

puppeteer url-to-image url-to-pdf

Last synced: 30 Oct 2024

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 09 Nov 2024

https://github.com/angrykoala/wendigo-plugin

Bootstraping of a wendigo plugin

automation browser chrome puppeteer template wendigo

Last synced: 30 Oct 2024

https://github.com/brightspace/d2l-beaker

A driver for Google Puppeteer to collect client-side performance metrics.

automation performance puppeteer

Last synced: 10 Nov 2024

https://github.com/luifean/randomflix-api

API desenvolvida a fim de prover informações de filmes da sua lista da Netflix. Faz uso do conceito de web scraping como data source.

cors express javascript nodejs puppeteer

Last synced: 08 Nov 2024

https://github.com/alxzu/imm-puppeteer

Search the IMM website for free places for the vehicle controller

nodejs puppeteer scraper

Last synced: 11 Nov 2024

https://github.com/zenika/google-puppet

Some headless Chrome scripts to manipulate G Suite

chrome-headless google puppeteer

Last synced: 16 Nov 2024

https://github.com/matthewjselby/json-resume

Generate a resume in both HTML and PDF from a JSON file.

gulp handlebars html javascript json puppeteer resume sass

Last synced: 14 Nov 2024

https://github.com/ellache/adjust_your_algo

Run puppeteer core in the background to modify your digital profile by navigating repeatedly to a specified set of webpages.

nodejs puppeteer puppeteer-core

Last synced: 09 Nov 2024

https://github.com/rajeshberwal/simple-node-web-scraper

Simple web scraper template that you can use to scrape data from a website.

javascript nodejs puppeteer scraper

Last synced: 09 Nov 2024

https://github.com/jhowbhz/scrap-consultaprocessos-rj

Esse é um caso de estudo sobre puppeteer

nodejs processos processos-rj puppeteer rj webscrap

Last synced: 13 Oct 2024

https://github.com/masreplay/html-to-image

Get s3 url from html file using node express

express html js nodejs puppeteer s3

Last synced: 23 Oct 2024

https://github.com/iamafnansk/personal-whatsapp-api

API to send message via Whatsapp Web

express nodejs puppeteer whatsapp-api

Last synced: 06 Nov 2024

https://github.com/tomaszrewak/react-app-puppeteer-component-testing

Guide on how to to configure puppeteer with a default (non-ejected) react app in order to test individual react components.

puppeteer react regression-testing visual-testing

Last synced: 09 Nov 2024

https://github.com/damianravindupeiris/jobber-cli

A simple AI based Node-JS script to automate the job applying process.

ai nodejs open-ai puppeteer typescript web-scraping

Last synced: 09 Nov 2024

https://github.com/oxylabs/puppeteer-tutorial

Use this tutorial and learn how to perform web scraping using a headless browser.

headless-browser puppeteer web-scraping

Last synced: 17 Nov 2024

https://github.com/yandeu/mocha-chai-nyc-puppeteer-example

Client/Server testing and code-coverage with Mocha, Chai, NYC (Istanbul) and Puppeteer

chai istanbul mocha nyc puppeteer

Last synced: 23 Oct 2024

https://github.com/optimics/docker-puppeteer

Docker image that includes everything needed to run Puppeteer.js on Bitbucket Pipelines

bitbucket-pipelines docker nodejs puppeteer

Last synced: 10 Nov 2024

https://github.com/eltonsantos/gerador-de-pdf

Projeto desenvolvido - Vídeo: Vamos gerar PDF com NodeJS, Puppeteer, EJS e TailwindCSS - Instrutor: Mayk Brito - Link: https://www.youtube.com/watch?v=AoU7aEdTldE

ejs express html-pdf nodejs pdf puppeteer tailwindcss

Last synced: 12 Nov 2024

https://github.com/eltonsantos/calcular-horas-video-youtube

Simple Youtube Video Hour Calculator. - Vídeo: O último Code/Drops! Script que calcula horas de vídeo | Code/Drops #68 - Instrutor: Diego Fernandes & Mayk Brito - Link: https://www.youtube.com/watch?v=faekjlZuTFA

nodejs puppeteer

Last synced: 12 Nov 2024

https://github.com/wlun001/html-image-headless

Example of convert HTML to image with Headless environment

docker headless-chrome nodejs puppeteer

Last synced: 29 Oct 2024

https://github.com/f00b4r/2021-03-vercel-puppeteer-social-networks

🎁 How to use Puppeteer to generate images for social networks deployed to Vercel

f00b4r lambda network plugin puppeteer screenshot social vercel widget

Last synced: 14 Nov 2024

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 10 Nov 2024

https://github.com/mariusconjeaud/angular-with-api-calls

Angular with API calls template. Full Azure Pipeline with unit testing, e2e testing, code coverage and linting included.

angular azure-app-service azure-devops cobertura expressjs junit karma protractor puppeteer typescript

Last synced: 27 Oct 2024

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 11 Nov 2024

https://github.com/mobilerast/ssr-generator

SSR Generator is able to save your SPA as a rendered HTML. SSR For Angular, React.js, Vue.js.

angular-apps javascript nodejs puppeteer search-engines server-side-render server-side-rendering ssr ssr-generator

Last synced: 11 Nov 2024

https://github.com/thomasjvu/entry-level-jobs-scraper

Job scraper for entry-level roles for the Ground Zero project

puppeteer supabase

Last synced: 12 Oct 2024

https://github.com/cboulanger/qx-puppeteer

UI testing of a qooxdoo application with puppeteer

puppeteer qooxdoo testing

Last synced: 27 Oct 2024

https://github.com/pdsuwwz/koa-playwright-server

🎭 Playwright 实现的 Node.js 中间件 API 服务, 替换 Puppeteer, 基于 ESM + Rollup + Koa + TypeScript + Nodemon + PM2 + ESLint (v9) 用于快速爬取并合并多网页到 PDF 文件、图片高保真快照, 支持热更新、Cookie 、水印、页眉页脚注入

es generator module pdf playwright puppeteer rollup typescript upgrade

Last synced: 27 Oct 2024

https://github.com/cityssm/node-faster-unofficial-api

An unofficial API for the FASTER Web fleet management system, relying on exported reports and complex parsers.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 23 Oct 2024

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 24 Oct 2024

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 21 Oct 2024

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 24 Oct 2024

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 24 Oct 2024

https://github.com/stopsopa/state-of-puppeteer

🎎Bunch of test of my own puppeteer extensions

extension extensions puppeteer

Last synced: 24 Oct 2024

https://github.com/ervin-sungkono/mlbb-wiki-scraper

Scraping tool to extract data from MLBB Wiki and output as JSON file

fs javascript json nodejs p-limit puppeteer

Last synced: 29 Oct 2024

https://github.com/hawtim/collection

Code collection about demos, snippets, documents, etc...

es6 expressjs nodejs puppeteer pwa typescript vue

Last synced: 13 Oct 2024

https://github.com/stopsopa/docker-puppeteer-html-scraper

(Deprecated -> use better https://github.com/stopsopa/html-scraper-browserless) Microservice tool to scraping html from "any" page

docker html-scraper node nodejs puppeteer scraper

Last synced: 24 Oct 2024

https://github.com/tazeg/screenshots

Web sites url screenshots

nodejs puppeteer screenshots

Last synced: 17 Nov 2024

https://github.com/vermajay/internshala-automation

Automatically apply to internships on Internshala using Google's Puppeteer high level API for chrome

api automation chrome google internships puppeteer

Last synced: 13 Oct 2024

https://github.com/anibalalpizar/puppeteer-overview

Control your browser using Javascript code, together with the Puppeteer library and Nodejs

nodejs puppeteer webscraping

Last synced: 11 Nov 2024

https://github.com/afeiship/pptr-html

Get html by puppeteer.

crawl html pptr puppeteer spider

Last synced: 27 Oct 2024

https://github.com/flolu/bazel-node-puppeteer

Can't run Bazel nodejs_image with Puppeteer

bazel docker nodejs puppeteer rules-nodejs

Last synced: 11 Nov 2024

https://github.com/noriste/stackoverflow-52383438-cypress-issue

The same test run on Cypress/TestCafe/Puppeteer to check the strange behaviour of the former

cypress e2e-testing puppeteer testcafe

Last synced: 27 Oct 2024

https://github.com/pionl/docker-node-puppeteer-ready

🐳 Docker image based on official node with with GoogleChrome/puppeteer support

chrome docker docker-image nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/rafaellaurindo/mercadolivre-scraper

Scraper to Mercado Livre products written in Node.js using Puppeteer.

bot mercadolivre nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/pioug/cookbook

Recipes to start my umpteenth dev projects.

cloud-run frontend javascript puppeteer rollup vuejs

Last synced: 16 Nov 2024

https://github.com/abduldevhub/react-mountain

A repository containing all of the React projects I made to test and learn new react concepts. Each project resides in its own dedicated folder.

css html javascript puppeteer react scss threejs typescript vite

Last synced: 12 Oct 2024

https://github.com/carelessinternet/schoolsoft-scraper

Unofficial SchoolSoft API made in Node.js

api node nodejs puppeteer puppeteer-core schoolsoft

Last synced: 29 Sep 2024

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Oct 2024

https://github.com/kimkykie/blog-pdf-converter

Convert messy web articles into clean PDFs. Perfect for reading, archiving, sharing, and content analysis. Strips the noise, keeps what matters.

nodejs pdf-generation pdfkit puppeteer

Last synced: 29 Oct 2024

https://github.com/amoutonbrady/jobs-scraper

Simple scraper to fetch and centralized jobs in one place

jobs puppeteer scraper

Last synced: 05 Nov 2024

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 74 博文 72 Packages 29 Utils 23 Integrations 17 包 14 Testing 13 Services 12 渲染和网页抓取 11 Rendering and web scraping 11 Reporters 10 Examples 10 Showcases 9 Language Support 9 测试 9 官方 9 Official 9 例子 8 License 6 Guides 6