Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/alxzu/imm-puppeteer

Search the IMM website for free places for the vehicle controller

nodejs puppeteer scraper

Last synced: 10 Jan 2025

https://github.com/capjavert/crawlathon

Winning solution for Crawlathon Hackathon by ReversingLabs

automation crawling hackathon hackathon-project puppeteer scraping

Last synced: 29 Jan 2025

https://github.com/prixladi/site-capture-puppet

Worker service capturing sites using puppeteer. Part of Site Capture project - https://github.com/prixladi/site-capture

docker mongodb nodejs puppeteer redis

Last synced: 16 Jan 2025

https://github.com/dhairyash-1/url-content-summarizer

This project is a Web URL Summarizer, utilizing Puppeteer for web scraping and the ChatGPT API to deliver concise summaries of extracted content. Built with React, TypeScript, and ExpressJS.

browserless chatgpt-api epxressjs puppeteer reactjs typescript

Last synced: 04 Jan 2025

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 05 Feb 2025

https://github.com/eltonsantos/gerador-de-pdf

Projeto desenvolvido - Vídeo: Vamos gerar PDF com NodeJS, Puppeteer, EJS e TailwindCSS - Instrutor: Mayk Brito - Link: https://www.youtube.com/watch?v=AoU7aEdTldE

ejs express html-pdf nodejs pdf puppeteer tailwindcss

Last synced: 11 Jan 2025

https://github.com/prashantbtkl/scoopify

scrape domains of all shopify stores

puppeteer scraping shopify

Last synced: 01 Feb 2025

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 05 Feb 2025

https://github.com/zhaoyiming0803/demo-puppeteer

puppeteer 应用伪代码

nodejs puppeteer

Last synced: 26 Jan 2025

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Jan 2025

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Jan 2025

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 05 Feb 2025

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 04 Feb 2025

https://github.com/anonymous961/scrapebooks

Just a repo to check puppeteer

neondb prisma puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/leandro-bertoluzzi/scrap-to-api

API to get the content of web pages via scraping

docker docker-compose nodejs puppeteer scraper

Last synced: 07 Jan 2025

https://github.com/manjillama/node-redis-ci

Simple React/Node application using MongoDB and Redis (database caching). Jest and puppeteer for automated browser testing and Travis for CI

google-oauth2 jest mongodb mongoose node puppeteer react redis travis-ci

Last synced: 22 Jan 2025

https://github.com/nuzulul/hookrender

hookrender adalah bot instagram menggunkan puppeteer di render

bot instagram javascript node-js nodejs puppeteer render

Last synced: 11 Jan 2025

https://github.com/ilhamlamp/menu-scrapper

learn scrapping with nest and puppeteer

nestjs puppeteer typescript

Last synced: 01 Feb 2025

https://github.com/hideack/node_shutter

puppeteerによるスクリーンショット取得するシンプルなAPIを提供

puppeteer

Last synced: 05 Feb 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Assert.

assert chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/akihokurino/goerli-charger

goerli faucet auto charge

lambda nodejs puppeteer

Last synced: 01 Feb 2025

https://github.com/khalyomede/hypercharged

Generates a static, prerendered site from your original website.

html javascript node nodejs npm prerender prerendering puppeteer renderer rendering single-page-applications

Last synced: 22 Jan 2025

https://github.com/lucassimao/coinmarketcap-crawler

Crypto currencies market data from http://coinmarketcap.com/ crawled using puppteer + expressjs backend + Elasticsearch + React frontend

elasticsearch express nodejs puppeteer react

Last synced: 23 Jan 2025

https://github.com/dzmitry-duboyski/automation-framework-using-jest-and-puppeteer

Part #5: Automation Framework using Jest and Puppeteer for course https://www.udemy.com/course/automated-headless-browser-testing-with-puppeteer/

jest puppeteer

Last synced: 12 Jan 2025

https://github.com/the-phinisher/auto-netaccess

Automatic renewal of authorization for IITM netaccess

iitm netacces nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/reshnivisionx/web_scrapping_react

I developed a web application that scrapes website content into PDFs, HTML snapshots, and screenshots using Puppeteer for automation. The data, along with scrape timestamps, is stored in MongoDB for retrieval and download. The frontend interface allows users to input URLs and select desired formats with ease.

axios expressjs mongodb nodejs puppeteer reactjs

Last synced: 30 Dec 2024

https://github.com/portrunban/node-vk-puppeteer-user

This app removes inactive users from the group Vkontakte. base on puppeteer

puppeteer vk vkontakte

Last synced: 02 Jan 2025

https://github.com/gabrielczar/tests-for-api-interest-points

BDD tests for API Interest Points

bdd chai cucumber-js puppeteer tests

Last synced: 19 Jan 2025

https://github.com/showlotus/lansite

Forwarding pages between machines in a LAN

lan nuxt puppeteer

Last synced: 15 Dec 2024

https://github.com/mariusconjeaud/angular-with-api-calls

Angular with API calls template. Full Azure Pipeline with unit testing, e2e testing, code coverage and linting included.

angular azure-app-service azure-devops cobertura expressjs junit karma protractor puppeteer typescript

Last synced: 14 Dec 2024

https://github.com/whosydd/cookie-format

format cookie for lib

cookie format puppeteer

Last synced: 20 Jan 2025

https://github.com/mgoyal98/pdf-pipeline

PDF Pipeline is a Node.js app that reads messages from SQS, generates PDFs using Puppeteer and Mustache, uploads them to S3, and updates status via SQS or webhooks

docker docker-pdf document-generator microservice mustache node-pdf nodejs pdf-generation pdf-generator pdf-microservice puppeteer sqs webhook

Last synced: 21 Dec 2024

https://github.com/teitei-tk/example-puppeteer-google-functions

example Puppeteer on Google Cloud functions

cloud-functions puppeteer

Last synced: 03 Feb 2025

https://github.com/t2leaf/t2-puppeteer-plugin-block-resources

Blocks unnecessary resources like images, fonts, and stylesheets to optimize performance and speed up page loads.

automation performance puppeteer puppeteer-extra resource-optimization web-scraping

Last synced: 11 Jan 2025

https://github.com/bllsglm/scrape-with-puppeteer

Scrape with Puppeteer

node-js puppeteer scraper

Last synced: 20 Jan 2025

https://github.com/gonzalofh/travel-ban-updates

This script acts a web scraper for the Covid-19 travel restrictions page on the US Gov Travel website. It returns the last date that guidelines were updated.

covid covid-19 covid19 js nodejs puppeteer travel-ban travelban

Last synced: 20 Jan 2025

https://github.com/zrna/cars-scraper

🚙 Scraping cars ads

javascript puppeteer scraper

Last synced: 09 Jan 2025

https://github.com/t2leaf/t2-puppeteer-plugin-random-ua

Helping to improve web scraping and automation by evading detection.

puppeteer puppeteer-plugin puppeteer-random-ua random-user-agent user-agent

Last synced: 11 Jan 2025

https://github.com/makelove/chromedp_examples

chromedp官方代码,中文注释

chromedp puppeteer

Last synced: 20 Jan 2025

https://github.com/marcinrek/seed

Cutup boilerplate with support of: react, hyperapp and more ...

boilerplate-template boilerplates hyperapp mocha puppeteer react scaffold webpack

Last synced: 28 Jan 2025

https://github.com/rynthebest/walletscrapper

A Puppeteer scraper that collects top trader data from gmgn.ai, processes coin rankings, filters duplicates, and extracts trader details like address and profit.

crypto crypto-bot javascript nodejs puppeteer scraper scraping scrapper scrapping wallet

Last synced: 24 Jan 2025

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

https://github.com/pioug/cookbook

Recipes to start my umpteenth dev projects.

cloud-run frontend javascript puppeteer rollup vuejs

Last synced: 17 Jan 2025

https://github.com/rishi-raj-jain/grabscreen

GrabScreen - A Screenshot Generator

api chrome-aws-lambda nextjs puppeteer serverless

Last synced: 26 Dec 2024

https://github.com/paveldymkov/puppeteer-io

Library for tests with Puppeteer using Jest or Mocha

headless-chrome puppeteer testing

Last synced: 30 Jan 2025

https://github.com/dm94/another-autologin

Daily auto login to get things done

autologin nodejs puppeteer

Last synced: 06 Jan 2025

https://github.com/michalsn/sls-chrome-puppeteer

Run puppeteer with Serverless on AWS Lambda.

aws-lambda puppeteer serverless

Last synced: 26 Jan 2025

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel 蓋棉被純聊天.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/prantadas/nasa-fb

Description: The bot download a picuture from https://api.nasa.gov/planetary/apod and post it on facebook profile each day.

nasa-apod puppeteer typescript

Last synced: 22 Dec 2024

https://github.com/yanivefraim/react-node-tdd-workshop-example

A demo for my React/Node TDD workshop, using Puppeteer & Mocha :sunglasses:

javascript mocha nodejs puppeteer react tdd

Last synced: 26 Jan 2025

https://github.com/optimics/docker-puppeteer

Docker image that includes everything needed to run Puppeteer.js on Bitbucket Pipelines

bitbucket-pipelines docker nodejs puppeteer

Last synced: 06 Jan 2025

https://github.com/zbo14/robit

Easily configure and run browser automation jobs!

browser-automation puppeteer web-scraping

Last synced: 31 Jan 2025

https://github.com/naoki-00-ito/js-scraping

Webスクレイピングプラグラム

dotenv javascript nodejs puppeteer scraping

Last synced: 11 Jan 2025

https://github.com/shiv-source/slice-chrome-extension-automation

This project automates the viewing of advertisements through the Slice Chrome Extension. It is designed to view ads on your behalf, and credits for viewing these ads will be automatically added to your Slice account. You can monitor these credits through the Slice extension app.

automation puppeteer slice slice-extension

Last synced: 07 Jan 2025

https://github.com/se-madhusudan/puppeteer-demo

Screenshot and pdf generation with puppeteer, image-size, and pdfkit

image-size pdf pdfkit puppeteer screenshot

Last synced: 12 Jan 2025

https://github.com/jprando/pdfserver

gerar relatorios em pdf com puppeteer

bun guambiarra pdf puppeteer relatorio rta

Last synced: 23 Dec 2024

https://github.com/miscos/discord-web-crawler

A puppeteer based webcrawler posting results to a discord webhook

discord puppeteer webcrawler

Last synced: 23 Dec 2024

https://github.com/jexniemi/browserless-action-runner

Run Puppeteer or Playwright web scraper (or other browser tasks) easily in headless mode as a GitHub Action

actions browser browserless chromium headless marketplace-action playwright puppeteer scraper scraping web

Last synced: 23 Dec 2024

https://github.com/rushi0508/razorpay-attendance-automation

Will trigger github action as cron job and will mark my attendance in the razorpay application.

javascript puppeteer razorpay

Last synced: 12 Jan 2025

https://github.com/thewrlck/quotz

A Node.js application demonstrating the use of Puppeteer and Orama SDK to create a quote database and search API.

expressjs orama puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/wasabina67/puppeteer-example

Puppeteer example

puppeteer

Last synced: 23 Dec 2024

https://github.com/evgeniyarbatov/location-testing

E2E testing of pages with location

expressjs location mocha puppeteer

Last synced: 23 Dec 2024

https://github.com/redaezziani/scrape-data-store-jolt

Product Scraper for Jolt Store is a robust tool designed to automate the collection of product data from e-commerce websites. This project leverages Puppeteer for web scraping and Prisma Client for seamless database management, ensuring efficient integration of external product data into the Jolt Store.

nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/shyamsunder149/problem-solving-tracker

A Tracker to track my solves around leetcode, gfg, codeforces and codchef. Just It will be satisfying for me to watch it

puppeteer scraping typescript

Last synced: 23 Dec 2024

https://github.com/muratsercann/book-price-agent

This application retrieves book prices from 5 different stores based on a search query. It uses React for the client-side interface, a Node.js API for the backend, and Puppeteer for web scraping.

expressjs nodejs puppeteer puppeteer-extra puppeteer-extra-plugin-stealth react

Last synced: 23 Dec 2024

https://github.com/zewa666/au-puppeteer-example

A sample showing how an Aurelia app can be tested with Puppeteer

aurelia e2e-tests jest puppeteer typescript

Last synced: 15 Jan 2025

https://github.com/gamboavalentinabel/nodejs-puppeteer-example

Test code for the Docker image nodejs-puppeteer

docker nodejs puppeteer

Last synced: 23 Dec 2024

https://github.com/zaidkhalid44/irctc

Technologies used: JavaScript, Puppeteer, Tesseract.js, Jimp Description: Developed an automated system using Puppeteer and Tesseract.js to streamline IRCTC train ticket booking, handling login, captcha solving, and form filling. Automated login and form-filling tasks, reducing manual effort by approximately 90%.

jimp puppeteer tesseract

Last synced: 23 Dec 2024

https://github.com/sharif-minhaz/web-scraping-with-js

Web scraper extracts data from websites. In JavaScript, jsdom and Puppeteer are powerful tools for this task. jsdom is a lightweight DOM implementation that lets user manipulate and query static pages. Puppeteer is a Node.js library for controlling headless Chrome/Chromium, ideal for dynamic websites. It can simulate user interactions and take ss

bun jsdom puppeteer web-scraping

Last synced: 23 Dec 2024

https://github.com/jfmonsa/book_scrapper

A web scrapping CLI tool to get books and categories/subcategories from Z-Library

node-js postgresql puppeteer web-scraping z-lib z-library

Last synced: 23 Dec 2024

https://github.com/gabrielcstr/dota2protracker-scraper

Scraping meta heroes from dota2protracker.com

d2pt dota2 dota2protracker javascript puppeteer scraper

Last synced: 23 Dec 2024

https://github.com/dnascanner/ani-cli

A simple to use terminal tool to find your favorite anime

anime chrome chromium cli deno puppeteer

Last synced: 23 Dec 2024

https://github.com/gigaarpit/puppeteer-examples

Collection of practical examples and scripts utilizing Puppeteer

playwright puppeteer puppeteer-screenshot

Last synced: 23 Dec 2024

https://github.com/tushcmd/olo-scraper

This is a full-stack web scraping application that simulates browser-like interactions using a headless browser. Users can input a URL, and the application scrapes data and performs specified actions.

cors express nodejs puppeteer react tailwindcss typescript winston

Last synced: 23 Dec 2024

https://github.com/extrawest/ai-uni-summarizer

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.

ai groq groq-api nextjs openai puppeteer reactjs youtube

Last synced: 23 Dec 2024

https://github.com/pedromarques391/lastreleases

Projeto de web scraping

nodemailer puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/antoniowd/aws-lambda-pdf

The aws-lambda-pdf project is designed to generate PDFs from HTML content using AWS Lambda and Chromium. The generated PDF files are stored in an S3 bucket, and the application returns a signed URL for accessing the PDF file.

aws-lambda chromium pdf-generation puppeteer

Last synced: 23 Dec 2024

https://github.com/duranda/lambda-pdf-generator

Generate PDF from HTML remotely on AWS Lambda with the Chromium rendering engine

aws-lambda chromium pdf-generation puppeteer wkhtmltopdf

Last synced: 23 Dec 2024

https://github.com/spm999/invoice-generator

Invoice generator application built using Node.js, Express.js, Handlebars, and Puppeteer. It generates invoices in PDF format based on the provided data.

api-rest express hbs invoice-generator nodejs postman puppeteer template-engine templateengine

Last synced: 23 Dec 2024