Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/flolu/bazel-node-puppeteer

Can't run Bazel nodejs_image with Puppeteer

bazel docker nodejs puppeteer rules-nodejs

Last synced: 11 Nov 2024

https://github.com/kumarshivesh/aastey-newarrivals

Web Scraping data from E-Commerce Clothing Store Asstey

expressjs javascript nodejs puppeteer

Last synced: 17 Nov 2024

https://github.com/rafaellaurindo/mercadolivre-scraper

Scraper to Mercado Livre products written in Node.js using Puppeteer.

bot mercadolivre nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/pioug/cookbook

Recipes to start my umpteenth dev projects.

cloud-run frontend javascript puppeteer rollup vuejs

Last synced: 16 Nov 2024

https://github.com/arfazhxss/app-sys

Automation System contains a series of scripts mostly written in bash and python that helps automate generation of multiple PDF documents at ones from Learning In Motion.

bash latex puppeteer python3 shell typescript

Last synced: 12 Oct 2024

https://github.com/vedovati-matteo/gpu-price-tracker

A sophisticated web scraper for tracking GPU prices across e-commerce platforms, featuring proxy rotation, CAPTCHA handling, and data visualization.

captcha-handling docker fullstack gpu-prices javascript mongodb next-js node-js proxy-rotation puppeteer telegram-bot web-scraping

Last synced: 12 Oct 2024

https://github.com/thomasjvu/entry-level-jobs-scraper

Job scraper for entry-level roles for the Ground Zero project

puppeteer supabase

Last synced: 12 Oct 2024

https://github.com/luqueee/moodle-rest-scraper

Rest API express with puppeteer library for scraping information of a user

express moodle puppeteer

Last synced: 12 Oct 2024

https://github.com/jp7io/puppy

Simple website screenshot using AWS Lambda, Chromium, and Puppeteer.

chromium lambda puppeteer screenshot

Last synced: 12 Oct 2024

https://github.com/the-phinisher/auto-netaccess

Automatic renewal of authorization for IITM netaccess

iitm netacces nodejs puppeteer

Last synced: 12 Oct 2024

https://github.com/rushi0508/insta-reels-automation

Fetches the reels for different users including captions and stores it in AWS S3.

javascript nodejs puppeteer webscraping

Last synced: 12 Oct 2024

https://github.com/umuthopeyildirim/puppateer-screenshot

The Google Cloud function that can take screenshots of websites.

google-cloud-functions google-cloud-storage javascript puppeteer

Last synced: 12 Nov 2024

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Nov 2024

https://github.com/rn0x/puppeteerproxy

Puppeteer Proxy is a lightweight web proxy built with Node.js and Puppeteer and Express, designed to return HTML content from web pages using a headless Chrome browser.

express nodejs proxy proxy-puppeteer puppeteer

Last synced: 31 Oct 2024

https://github.com/luifean/dicio-api

API desenvolvida para obter o significado de palavras através de mineração de dados

express javascript nodejs puppeteer

Last synced: 08 Nov 2024

https://github.com/luifean/randomflix-api

API desenvolvida a fim de prover informações de filmes da sua lista da Netflix. Faz uso do conceito de web scraping como data source.

cors express javascript nodejs puppeteer

Last synced: 08 Nov 2024

https://github.com/robertoachar/screenshot-puppeteer

A playground for take a screenshot with Puppeteer.

playground puppeteer screenshot

Last synced: 06 Nov 2024

https://github.com/austenstone/puppeteer-github

Puppeteering GitHub

puppeteer

Last synced: 27 Oct 2024

https://github.com/zrna/cars-scraper

🚙 Scraping cars ads

javascript puppeteer scraper

Last synced: 11 Nov 2024

https://github.com/yordadev/yorviewer

Yorviewer is a simple view bot that utilizes proxies and incognito.

bot nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/runnin-n-gunnin/puppeteerpanellib

PuppeteerPanel is a User Control that embeds puppeteer's chromium window in a Windows Forms application. POC.

chromium crawling puppeteer puppeteer-sharp scraping winforms

Last synced: 11 Nov 2024

https://github.com/sojebsikder/extra-power

This is a simple project that helps other developer to achieve something different

express nodejs puppeteer typescript

Last synced: 11 Nov 2024

https://github.com/kayyz1/llmscraper

LLM AI web scraper tool

openai puppeteer react remix typescript

Last synced: 22 Oct 2024

https://github.com/amoutonbrady/jobs-scraper

Simple scraper to fetch and centralized jobs in one place

jobs puppeteer scraper

Last synced: 05 Nov 2024

https://github.com/oxylabs/puppeteer-tutorial

Use this tutorial and learn how to perform web scraping using a headless browser.

headless-browser puppeteer web-scraping

Last synced: 17 Nov 2024

https://github.com/nstseek/download-all-github-repos

Automated script that downloads every repo from a GitHub organization or user

automation download eslint github organization prettier puppeteer repositories repository scripting typescript user

Last synced: 15 Nov 2024

https://github.com/hawtim/collection

Code collection about demos, snippets, documents, etc...

es6 expressjs nodejs puppeteer pwa typescript vue

Last synced: 13 Oct 2024

https://github.com/optimics/docker-puppeteer

Docker image that includes everything needed to run Puppeteer.js on Bitbucket Pipelines

bitbucket-pipelines docker nodejs puppeteer

Last synced: 10 Nov 2024

https://github.com/sirok1/lolz-auto-contests

Lolzteam | zelenka.guru app for auto-participation in draws

discord-webhook nodejs puppeteer telegram-bot

Last synced: 16 Nov 2024

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website 📷

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/mhzmn/webscraper

A web scraper for drNutrition's products

nodejs puppeteer webscraper webscraping

Last synced: 17 Nov 2024

https://github.com/andriilive/stav-rizeni-mvcr-oamp-pupppetter

Browser automation to check the application status at Department for Asylum and Migration Policy, Czech Republic

czech czech-republic nodejs oamp puppeteer

Last synced: 16 Nov 2024

https://github.com/louiscklaw/page-change-detect-tryout

page-change-detect-tryout

javascript puppeteer

Last synced: 24 Oct 2024

https://github.com/jayvirrathi/nodejs-puppeteer

NodeJS Instagram Post Liker using Puppeteer

instagram nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 10 Oct 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Oct 2024

https://github.com/lameuler/astro-pdf

A simple Astro integration to generate PDFs from built pages.

astro astro-integration pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 05 Nov 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 05 Nov 2024

https://github.com/spm999/invoice-generator

Invoice generator application built using Node.js, Express.js, Handlebars, and Puppeteer. It generates invoices in PDF format based on the provided data.

api-rest express hbs invoice-generator nodejs postman puppeteer template-engine templateengine

Last synced: 05 Nov 2024

https://github.com/christiancesar/hunter

Scraping of the target web application, using puppeeter, node with typescript and best practices.

backend ddd factory-pattern fullstack-development mongodb-atlas nodejs observer-pattern poo puppeteer react tdd typescript

Last synced: 10 Oct 2024

https://github.com/mushfiqurniazzz/word-meaning---webscraping

A basic Nodejs environmental function that takes in a word to search in a word-meaning website and then prints it in the terminal through web-scraping.

javascript nodejs puppeteer webscraping wordmeaning

Last synced: 05 Nov 2024

https://github.com/duranda/lambda-pdf-generator

Generate PDF from HTML remotely on AWS Lambda with the Chromium rendering engine

aws-lambda chromium pdf-generation puppeteer wkhtmltopdf

Last synced: 05 Nov 2024

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel 蓋棉被純聊天.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/uday160386/test-automation-poc-demos

The consolidation of proofs of concept (POCs) using various open source tools is a strategic approach that can streamline development processes and enhance productivity

playwright-javascript puppeteer robotframework selenium

Last synced: 10 Oct 2024

https://github.com/kimromi/kshot

📷 Tools to take screenshots.

javascript koajs puppeteer

Last synced: 16 Nov 2024

https://github.com/tazeg/screenshots

Web sites url screenshots

nodejs puppeteer screenshots

Last synced: 17 Nov 2024

https://github.com/tushcmd/olo-scraper

This is a full-stack web scraping application that simulates browser-like interactions using a headless browser. Users can input a URL, and the application scrapes data and performs specified actions.

cors express nodejs puppeteer react tailwindcss typescript winston

Last synced: 05 Nov 2024

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicação console que fornece informações dos elencos, próximas partidas e notícias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 10 Oct 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer

NodeJs version with all dependencies to run Puppeteer

docker nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/se-madhusudan/puppeteer-demo

Screenshot and pdf generation with puppeteer, image-size, and pdfkit

image-size pdf pdfkit puppeteer screenshot

Last synced: 13 Nov 2024

https://github.com/evgeniyarbatov/location-testing

E2E testing of pages with location

expressjs location mocha puppeteer

Last synced: 05 Nov 2024

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Oct 2024

https://github.com/rushi0508/razorpay-attendance-automation

Will trigger github action as cron job and will mark my attendance in the razorpay application.

javascript puppeteer razorpay

Last synced: 13 Nov 2024

https://github.com/cocohfl/twitchremotecontrol

Remotely control Twitch streams running on your PC from any device.

nodejs puppeteer remote-control twitch

Last synced: 13 Nov 2024

https://github.com/devmunyi/puppeteer-web-automation

Using puppeteer to scrap and automate some repetitive web tasks

nodejs puppeteer typescript

Last synced: 14 Nov 2024

https://github.com/jonathanlinat/simple-nodejs-amazon-web-scraper

A very simple and automated tool to scrape Amazon.com results

amazon cheerio nodejs puppeteer web-scraper

Last synced: 14 Nov 2024

https://github.com/stopsopa/docker-puppeteer-html-scraper

(Deprecated -> use better https://github.com/stopsopa/html-scraper-browserless) Microservice tool to scraping html from "any" page

docker html-scraper node nodejs puppeteer scraper

Last synced: 24 Oct 2024

https://github.com/stopsopa/state-of-puppeteer

🎎Bunch of test of my own puppeteer extensions

extension extensions puppeteer

Last synced: 24 Oct 2024

https://github.com/pionl/docker-node-puppeteer-ready

🐳 Docker image based on official node with with GoogleChrome/puppeteer support

chrome docker docker-image nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/pro-oc/pro-oc-dzs-proxy

REST API CORS Proxy server pro DZS registr.

cors-proxy-server dzs proxy-server puppeteer rest-api

Last synced: 14 Nov 2024

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 24 Oct 2024

https://github.com/adrianhdezm/spa-boilerplate

A boilerplate for building Single-Page Applications with React and TypeScript

jest json-server puppeteer react typescript webpack

Last synced: 16 Nov 2024

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 24 Oct 2024

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 21 Oct 2024

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 24 Oct 2024

https://github.com/yandeu/mocha-chai-nyc-puppeteer-example

Client/Server testing and code-coverage with Mocha, Chai, NYC (Istanbul) and Puppeteer

chai istanbul mocha nyc puppeteer

Last synced: 23 Oct 2024

https://github.com/b4dnewz/webpage-capture-cli

Capture the web in many ways from the command line

cli-tool cli-utility puppeteer puppeteer-screenshot screenshot webpage webshot website

Last synced: 13 Nov 2024

https://github.com/thundermiracle/costco-monitor

Monitor product's price & stock status. Send email when price is down or stock status is changed.

costco puppeteer

Last synced: 20 Oct 2024

https://github.com/lightbeem3296/stealth-chrome-automation

Completely undetectable chrome browser automation script. Even better than all the automation libraries including Selenium, Puppeteer, Playwright and so on.

automation bypass playwright puppeteer scraper selenium stealth-bot undetectable-browser

Last synced: 09 Nov 2024

https://github.com/rishi-raj-jain/html-og-image

A deployment of OG Image Generator to Layer0.

chrome-aws-lambda layer0 nextjs prettier puppeteer react react-dom

Last synced: 26 Oct 2024

https://github.com/rishi-raj-jain/grabscreen

GrabScreen - A Screenshot Generator

api chrome-aws-lambda nextjs puppeteer serverless

Last synced: 26 Oct 2024

https://github.com/vasani-arpit/puppeteer-extension-automation-example

Tutorial on how to add and use an extension programmatically in puppeteer

automation extensions node nodejs puppeteer web-automation

Last synced: 05 Nov 2024

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 05 Nov 2024

https://github.com/cityssm/node-faster-report-exporter

On demand exports of selected reports from the FASTER Web Fleet Management System.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 11 Nov 2024

https://github.com/akirak/docker-chromium

Docker image containing a Chromium executable for Puppeteer

chromium docker-image puppeteer

Last synced: 31 Oct 2024

https://github.com/hideack/node_shutter

puppeteerによるスクリーンショット取得するシンプルなAPIを提供

puppeteer

Last synced: 24 Oct 2024

https://github.com/stephlaf/puppeteer-airtable-tutorial

Tutorial to scrape the web using Puppeteer and store to Airtable

airtable-api javascript puppeteer scraping

Last synced: 20 Oct 2024

https://github.com/francescocoding/harvest-time

🌽 Harvest Time is a Node-based web scraper that utilizes Puppeteer to get past the login page directly from the Node environment (programmatically).

nodejs puppeteer scraper scraping

Last synced: 28 Oct 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 74 博文 72 Packages 29 Utils 23 Integrations 17 包 14 Testing 13 Services 12 渲染和网页抓取 11 Rendering and web scraping 11 Reporters 10 Examples 10 Showcases 9 Language Support 9 测试 9 官方 9 Official 9 例子 8 License 6 Guides 6