Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/paveldymkov/puppeteer-io

Library for tests with Puppeteer using Jest or Mocha

headless-chrome puppeteer testing

Last synced: 03 Dec 2024

https://github.com/argshook/sitemap-to-html

CLI tool to generate HTML files for each link defined in sitemap.xml

crawlers html-snapshot puppeteer sitemap

Last synced: 14 Jan 2025

https://github.com/sj22032003/scrapper-basic-flipkart

Minor web scrapper using puppeteer to scrap data from Flipkart listing

bun puppeteer typescript

Last synced: 06 Jan 2025

https://github.com/kayantchian/fooddatascraper

FoodDataScraper is a browser extension that performs web scraping on predefined restaurant menu websites. It collects data from these menus and generates automated spreadsheets, optimizing the internal menu registration process for businesses.

csv data-science javascript papaparse puppeteer webscrapy

Last synced: 25 Jan 2025

https://github.com/prantadas/nasa-fb

Description: The bot download a picuture from https://api.nasa.gov/planetary/apod and post it on facebook profile each day.

nasa-apod puppeteer typescript

Last synced: 22 Dec 2024

https://github.com/yashkathe/download-wallpapers-cli

Search wallpapers from terminal directly and the script will download all the high resolution wallapers from the website

expressjs nodejs puppeteer script wallpaper web-scraping

Last synced: 25 Dec 2024

https://github.com/zachltech/duckduckgoscraper-firebase

Fork of a previous project of mine with Firebase Cloud Functions/Firestore integration.

firebase firebase-database firebase-functions javascript puppeteer

Last synced: 30 Dec 2024

https://gitlab.com/hajnyon-projects/slichta/slichta-scraper

Scrapes various websites for daily meal menus. https://slichta.vercel.app/

apify menus puppeteer restaurants scraper

Last synced: 23 Oct 2024

https://github.com/prixladi/site-capture-puppet

Worker service capturing sites using puppeteer. Part of Site Capture project - https://github.com/prixladi/site-capture

docker mongodb nodejs puppeteer redis

Last synced: 16 Jan 2025

https://github.com/cankorkmazim/google-ads-list

You can create a list of advertisements placed on Google through words.

google-ads google-crawler puppeteer

Last synced: 03 Dec 2024

https://github.com/jado4810/md2pdf

Typeset Markdown to PDF for publishing

markdown mermaid nodejs pdf puppeteer

Last synced: 03 Dec 2024

https://github.com/portrunban/node-vk-puppeteer-user

This app removes inactive users from the group Vkontakte. base on puppeteer

puppeteer vk vkontakte

Last synced: 02 Jan 2025

https://github.com/tuurdutoit/puppeteer-find

Find elements with Puppeteer based on their content

dom find puppeteer query search utility

Last synced: 14 Jan 2025

https://github.com/jprando/pdfserver

gerar relatorios em pdf com puppeteer

bun guambiarra pdf puppeteer relatorio rta

Last synced: 23 Dec 2024

https://github.com/miscos/discord-web-crawler

A puppeteer based webcrawler posting results to a discord webhook

discord puppeteer webcrawler

Last synced: 23 Dec 2024

https://github.com/jexniemi/browserless-action-runner

Run Puppeteer or Playwright web scraper (or other browser tasks) easily in headless mode as a GitHub Action

actions browser browserless chromium headless marketplace-action playwright puppeteer scraper scraping web

Last synced: 23 Dec 2024

https://github.com/giansalex/puppeteer-sample

Puppeteer Headless Chrome (Sample)

node puppeteer

Last synced: 20 Dec 2024

https://github.com/thewrlck/quotz

A Node.js application demonstrating the use of Puppeteer and Orama SDK to create a quote database and search API.

expressjs orama puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/wasabina67/puppeteer-example

Puppeteer example

puppeteer

Last synced: 23 Dec 2024

https://github.com/evgeniyarbatov/location-testing

E2E testing of pages with location

expressjs location mocha puppeteer

Last synced: 23 Dec 2024

https://github.com/redaezziani/scrape-data-store-jolt

Product Scraper for Jolt Store is a robust tool designed to automate the collection of product data from e-commerce websites. This project leverages Puppeteer for web scraping and Prisma Client for seamless database management, ensuring efficient integration of external product data into the Jolt Store.

nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/shyamsunder149/problem-solving-tracker

A Tracker to track my solves around leetcode, gfg, codeforces and codchef. Just It will be satisfying for me to watch it

puppeteer scraping typescript

Last synced: 23 Dec 2024

https://github.com/muratsercann/book-price-agent

This application retrieves book prices from 5 different stores based on a search query. It uses React for the client-side interface, a Node.js API for the backend, and Puppeteer for web scraping.

expressjs nodejs puppeteer puppeteer-extra puppeteer-extra-plugin-stealth react

Last synced: 23 Dec 2024

https://github.com/tuurdutoit/puppeteer-utils

A library of utility functions for Puppeteer

library puppeteer utility

Last synced: 14 Jan 2025

https://github.com/gamboavalentinabel/nodejs-puppeteer-example

Test code for the Docker image nodejs-puppeteer

docker nodejs puppeteer

Last synced: 23 Dec 2024

https://github.com/zaidkhalid44/irctc

Technologies used: JavaScript, Puppeteer, Tesseract.js, Jimp Description: Developed an automated system using Puppeteer and Tesseract.js to streamline IRCTC train ticket booking, handling login, captcha solving, and form filling. Automated login and form-filling tasks, reducing manual effort by approximately 90%.

jimp puppeteer tesseract

Last synced: 23 Dec 2024

https://github.com/sharif-minhaz/web-scraping-with-js

Web scraper extracts data from websites. In JavaScript, jsdom and Puppeteer are powerful tools for this task. jsdom is a lightweight DOM implementation that lets user manipulate and query static pages. Puppeteer is a Node.js library for controlling headless Chrome/Chromium, ideal for dynamic websites. It can simulate user interactions and take ss

bun jsdom puppeteer web-scraping

Last synced: 23 Dec 2024

https://github.com/jfmonsa/book_scrapper

A web scrapping CLI tool to get books and categories/subcategories from Z-Library

node-js postgresql puppeteer web-scraping z-lib z-library

Last synced: 23 Dec 2024

https://github.com/gabrielcstr/dota2protracker-scraper

Scraping meta heroes from dota2protracker.com

d2pt dota2 dota2protracker javascript puppeteer scraper

Last synced: 23 Dec 2024

https://github.com/dnascanner/ani-cli

A simple to use terminal tool to find your favorite anime

anime chrome chromium cli deno puppeteer

Last synced: 23 Dec 2024

https://github.com/gigaarpit/puppeteer-examples

Collection of practical examples and scripts utilizing Puppeteer

playwright puppeteer puppeteer-screenshot

Last synced: 23 Dec 2024

https://github.com/tushcmd/olo-scraper

This is a full-stack web scraping application that simulates browser-like interactions using a headless browser. Users can input a URL, and the application scrapes data and performs specified actions.

cors express nodejs puppeteer react tailwindcss typescript winston

Last synced: 23 Dec 2024

https://github.com/extrawest/ai-uni-summarizer

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.

ai groq groq-api nextjs openai puppeteer reactjs youtube

Last synced: 23 Dec 2024

https://github.com/pedromarques391/lastreleases

Projeto de web scraping

nodemailer puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/ssv445/js-rendering-proxy-docker

JS Rendering Proxy API to Handle JS Website in Your Crawler.

crawler proxy puppeteer

Last synced: 18 Jan 2025

https://github.com/antoniowd/aws-lambda-pdf

The aws-lambda-pdf project is designed to generate PDFs from HTML content using AWS Lambda and Chromium. The generated PDF files are stored in an S3 bucket, and the application returns a signed URL for accessing the PDF file.

aws-lambda chromium pdf-generation puppeteer

Last synced: 23 Dec 2024

https://github.com/duranda/lambda-pdf-generator

Generate PDF from HTML remotely on AWS Lambda with the Chromium rendering engine

aws-lambda chromium pdf-generation puppeteer wkhtmltopdf

Last synced: 23 Dec 2024

https://github.com/spm999/invoice-generator

Invoice generator application built using Node.js, Express.js, Handlebars, and Puppeteer. It generates invoices in PDF format based on the provided data.

api-rest express hbs invoice-generator nodejs postman puppeteer template-engine templateengine

Last synced: 23 Dec 2024

https://github.com/prantadas/play-scrapper

A Node.js-based scraper for extracting data from Google Play and the Apple App Store (Check the app's availability in a specific country). The scraper uses Puppeteer for automation and exports results to an Excel file.

excel-export puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/ailixter/chromatic

Chromium automation server

automation chromium nodejs pdf puppeteer server service

Last synced: 23 Dec 2024

https://github.com/daveanthonyc/webscraper-test

Webscraper using Puppeteer to scrape 7000+ rows of data.

dataminig nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/devzkhalil/puppeteer-facebook-unfriends-script

The Puppeteer Facebook Unfriends Script is a tool developed using Puppeteer, a Node.js library that provides a high-level API to control headless Chrome or Chromium browsers. This script is specifically crafted for automating the process of unfriending users on Facebook.

facebook facebook-unfriend facebook-unfriend-script puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/mushfiqurniazzz/word-meaning---webscraping

A basic Nodejs environmental function that takes in a word to search in a word-meaning website and then prints it in the terminal through web-scraping.

javascript nodejs puppeteer webscraping wordmeaning

Last synced: 23 Dec 2024

https://github.com/hid-gs/simple-jest-puppeteer-runner

Docker container for jest tests using puppeteer

docker javascript jest public puppeteer tests

Last synced: 25 Jan 2025

https://github.com/achanta3215/covid19indiascraper

To scrape covid 19 data from sources available

contributions-welcome covid-19 india node open-source puppeteer typescript

Last synced: 28 Dec 2024

https://github.com/mdato/dolar2030

puppeteer + heroku + express

express heroku puppeteer

Last synced: 07 Jan 2025

https://github.com/brightspace/d2l-beaker

A driver for Google Puppeteer to collect client-side performance metrics.

automation performance puppeteer

Last synced: 07 Jan 2025

https://github.com/radzionc/apartments-watcher

Opens new apartments for sale in Chrome

nodejs puppeteer

Last synced: 24 Dec 2024

https://github.com/aegis-dev/simple_mmo_simpler_bot

Simpler bot for SimpleMMO

bot js puppeteer

Last synced: 20 Jan 2025

https://github.com/mariamelashkar/wapibot-whatsapp-api-bot

A lightweight and scalable Node.js-based API for automating WhatsApp messaging using the whatsapp-web.js library. WapiBot allows sending individual or bulk messages, handling list responses, and integrating seamless WhatsApp automation into applications.

expressjs javascript nodejs puppeteer qrcode-generator qrcode-scanner restful-api whatsapp-api whatsapp-bot

Last synced: 26 Jan 2025

https://github.com/radzionc/medium-updater

Programatically Update Medium Stories CTAs

medium nodejs puppeteer

Last synced: 24 Dec 2024

https://github.com/kirk-en/nes-video-fetch

A web scraping tool designed to fetch download links for NES (Nintendo Entertainment System) long play videos based on game title. This tool currently supports pulling long plays and wiki info for 443 licensed NES titles.

puppeteer retrogaming scraping video-downloader video-processing

Last synced: 25 Jan 2025

https://github.com/pro-oc/pro-oc-dzs-proxy

REST API CORS Proxy server pro DZS registr.

cors-proxy-server dzs proxy-server puppeteer rest-api

Last synced: 14 Jan 2025

https://github.com/xredax/quran-hadith-poster

Automated Facebook bot for sharing Quran pages and Hadith content to groups.

automation facebook facebook-bot hadith islamic islamic-app nodejs puppeteer quran social-media

Last synced: 16 Dec 2024

https://github.com/brianpunzalan/nextjs-advanced-starter

Next.js Advanced Starter with Typescript, MaterialUI, Storybook, Jest, Puppeteer, Redux, ESLint, Prettier and more.

eslint jest material-ui nextjs prettier puppeteer redux storybook typescript

Last synced: 23 Dec 2024

https://github.com/athrvk/calibre-puppeteer-base

This repository contains a Dockerfile for creating a base image with Calibre and Puppeteer pre-installed. This image is built on top of Ubuntu 22.04 and includes all necessary dependencies for running Calibre and Puppeteer.

browserless calibre docker docker-image ebook-converter puppeteer

Last synced: 09 Dec 2024

https://github.com/beckkramer/puppeteer-traverse

Puppeteer utility to easily run a function you define per route on a set of routes.

crawler crawling nodejs puppeteer

Last synced: 19 Jan 2025

https://github.com/nia3zzz/word-meaning---webscraping

A basic Nodejs environmental function that takes in a word to search in a word-meaning website and then prints it in the terminal through web-scraping.

javascript nodejs puppeteer webscraping wordmeaning

Last synced: 19 Jan 2025

https://github.com/umuthopeyildirim/puppateer-screenshot

The Google Cloud function that can take screenshots of websites.

google-cloud-functions google-cloud-storage javascript puppeteer

Last synced: 11 Jan 2025

https://github.com/jonathanlinat/simple-nodejs-amazon-web-scraper

A very simple and automated tool to scrape Amazon.com results

amazon cheerio nodejs puppeteer web-scraper

Last synced: 14 Jan 2025

https://github.com/j-m/anvomywz1k

A community-based game review website

coursework game jest koa puppeteer review website

Last synced: 30 Dec 2024

https://github.com/iomerkoyuncu/website-to-file

Node.js library to capture image/pdf from url.

puppeteer url-to-image url-to-pdf

Last synced: 30 Oct 2024

https://github.com/kavindu-mane/html-to-pdf

Simple API for convert HTML to PDF. This API use puppeteer npm package as convertor.

bun hono html-to-pdf puppeteer

Last synced: 19 Dec 2024

https://github.com/kos/react-ssr-genie

A simple tool for simple server-side rendering needs

pdf puppeteer

Last synced: 24 Jan 2025

https://github.com/ainoya/cloudflare-dom-distiller

A Cloudflare Workers-based API for extracting and converting web page content to Markdown using DOM-Distiller and Turndown.

cloudflare cloudflare-workers puppeteer

Last synced: 10 Oct 2024

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Oct 2024

https://github.com/zbo14/hype-radio

CLI radio that plays the newest songs on Hype Machine.

audio browser-automation internet-radio javascript music nodejs puppeteer radio streaming

Last synced: 04 Dec 2024

https://github.com/zbo14/robit

Easily configure and run browser automation jobs!

browser-automation puppeteer web-scraping

Last synced: 04 Dec 2024

https://github.com/younusaliakash/web-automation-deep-link

Easily collect HackerNews links with hn.algolia.com. Swiftly process comments using BullMQ. Understand sentiments (positive, negative, neutral) effortlessly. Store data in Redis for quick access. Simplify your analysis, make informed decisions effortlessly.

deep-link puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/andriilive/stav-rizeni-mvcr-oamp-pupppetter

Browser automation to check the application status at Department for Asylum and Migration Policy, Czech Republic

czech czech-republic nodejs oamp puppeteer

Last synced: 17 Jan 2025

https://github.com/softonic/docker-puppeteer

Puppeteer docker image

docker-image puppeteer

Last synced: 21 Dec 2024

https://github.com/arthurweinmann/puppeteer-server

Run Puppeteer (browser automation) as a HTTP API

api puppeteer rpc

Last synced: 07 Jan 2025

https://github.com/vasani-arpit/puppeteer-extension-automation-example

Tutorial on how to add and use an extension programmatically in puppeteer

automation extensions node nodejs puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/shiv-source/slice-chrome-extension-automation

This project automates the viewing of advertisements through the Slice Chrome Extension. It is designed to view ads on your behalf, and credits for viewing these ads will be automatically added to your Slice account. You can monitor these credits through the Slice extension app.

automation puppeteer slice slice-extension

Last synced: 07 Jan 2025

https://github.com/mgoyal98/pdf-pipeline

PDF Pipeline is a Node.js app that reads messages from SQS, generates PDFs using Puppeteer and Mustache, uploads them to S3, and updates status via SQS or webhooks

docker docker-pdf document-generator microservice mustache node-pdf nodejs pdf-generation pdf-generator pdf-microservice puppeteer sqs webhook

Last synced: 21 Dec 2024

https://github.com/daviteixeira-dev/saucedemo-automation-with-puppeteer

Using the Puppeteer library to perform automated testing on Swag Labs' soucedemo.com website.

jest jest-puppeteer nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 09 Dec 2024

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automação que fornece informações dos elencos dos times da NBA. O sistema em questão é uma aplicação console que fornece opções de escolha, o usuário digita a opção que deseja e as informações são mostradas de acordo com essa opção.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Oct 2024

https://github.com/onfranciis/sustainobles-backend

Add donations and retrieve list as pdf using NodeJS and MongoDB

expressjs jest mongodb nodejs puppeteer typescript

Last synced: 16 Dec 2024

https://github.com/suryaxanden/google-search-with-puppeteer

Node JS script to scrape entity name and entity description from Google search.

googlesearch nodejs puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/mariusconjeaud/angular-with-api-calls

Angular with API calls template. Full Azure Pipeline with unit testing, e2e testing, code coverage and linting included.

angular azure-app-service azure-devops cobertura expressjs junit karma protractor puppeteer typescript

Last synced: 14 Dec 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 85 博文 83 Packages 30 Utils 23 Integrations 17 包 14 Testing 12 Rendering and web scraping 12 Services 12 渲染和网页抓取 11 Reporters 10 Examples 10 Language Support 9 Showcases 9 Official 9 官方 9 测试 8 例子 8 Related 6 License 6