Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/tushcmd/olo-scraper

This is a full-stack web scraping application that simulates browser-like interactions using a headless browser. Users can input a URL, and the application scrapes data and performs specified actions.

cors express nodejs puppeteer react tailwindcss typescript winston

Last synced: 23 Dec 2024

https://github.com/extrawest/ai-uni-summarizer

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.

ai groq groq-api nextjs openai puppeteer reactjs youtube

Last synced: 23 Dec 2024

https://github.com/pedromarques391/lastreleases

Projeto de web scraping

nodemailer puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/rayc2045/ghibli-crawler

Automatically download 1,178 studio Ghibli's work photos

axios crawler ghibli node node-js nodejs puppeteer rest-api restful restful-api

Last synced: 26 Jan 2025

https://github.com/antoniowd/aws-lambda-pdf

The aws-lambda-pdf project is designed to generate PDFs from HTML content using AWS Lambda and Chromium. The generated PDF files are stored in an S3 bucket, and the application returns a signed URL for accessing the PDF file.

aws-lambda chromium pdf-generation puppeteer

Last synced: 23 Dec 2024

https://github.com/duranda/lambda-pdf-generator

Generate PDF from HTML remotely on AWS Lambda with the Chromium rendering engine

aws-lambda chromium pdf-generation puppeteer wkhtmltopdf

Last synced: 23 Dec 2024

https://github.com/spm999/invoice-generator

Invoice generator application built using Node.js, Express.js, Handlebars, and Puppeteer. It generates invoices in PDF format based on the provided data.

api-rest express hbs invoice-generator nodejs postman puppeteer template-engine templateengine

Last synced: 23 Dec 2024

https://github.com/prantadas/play-scrapper

A Node.js-based scraper for extracting data from Google Play and the Apple App Store (Check the app's availability in a specific country). The scraper uses Puppeteer for automation and exports results to an Excel file.

excel-export puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/ailixter/chromatic

Chromium automation server

automation chromium nodejs pdf puppeteer server service

Last synced: 23 Dec 2024

https://github.com/daveanthonyc/webscraper-test

Webscraper using Puppeteer to scrape 7000+ rows of data.

dataminig nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/devzkhalil/puppeteer-facebook-unfriends-script

The Puppeteer Facebook Unfriends Script is a tool developed using Puppeteer, a Node.js library that provides a high-level API to control headless Chrome or Chromium browsers. This script is specifically crafted for automating the process of unfriending users on Facebook.

facebook facebook-unfriend facebook-unfriend-script puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/mushfiqurniazzz/word-meaning---webscraping

A basic Nodejs environmental function that takes in a word to search in a word-meaning website and then prints it in the terminal through web-scraping.

javascript nodejs puppeteer webscraping wordmeaning

Last synced: 23 Dec 2024

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 04 Jan 2025

https://github.com/arthurweinmann/puppeteer-server

Run Puppeteer (browser automation) as a HTTP API

api puppeteer rpc

Last synced: 07 Jan 2025

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 07 Jan 2025

https://github.com/ashutoshsce/nys-liquor-authority

Directly scrape records from https://www.tran.sla.ny.gov/JSP/query/PublicQueryAdvanceSearchPage.jsp and present it in datatable format

datatable expressjs mongodb node nys-liquor-authority puppeteer vuejs website-scraper

Last synced: 08 Feb 2025

https://github.com/kayyz1/llmscraper

LLM AI web scraper tool

openai puppeteer react remix typescript

Last synced: 10 Dec 2024

https://github.com/kimkykie/blog-pdf-converter

Convert messy web articles into clean PDFs. Perfect for reading, archiving, sharing, and content analysis. Strips the noise, keeps what matters.

nodejs pdf-generation pdfkit puppeteer

Last synced: 09 Feb 2025

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 04 Jan 2025

https://github.com/dkgee/tk_spa

nodejs案例 puppeteer

centos7 nodejs puppeteer windows-7

Last synced: 22 Dec 2024

https://github.com/brianpunzalan/nextjs-advanced-starter

Next.js Advanced Starter with Typescript, MaterialUI, Storybook, Jest, Puppeteer, Redux, ESLint, Prettier and more.

eslint jest material-ui nextjs prettier puppeteer redux storybook typescript

Last synced: 23 Dec 2024

https://github.com/athrvk/calibre-puppeteer-base

This repository contains a Dockerfile for creating a base image with Calibre and Puppeteer pre-installed. This image is built on top of Ubuntu 22.04 and includes all necessary dependencies for running Calibre and Puppeteer.

browserless calibre docker docker-image ebook-converter puppeteer

Last synced: 03 Feb 2025

https://github.com/umuthopeyildirim/puppateer-screenshot

The Google Cloud function that can take screenshots of websites.

google-cloud-functions google-cloud-storage javascript puppeteer

Last synced: 11 Jan 2025

https://github.com/vedovati-matteo/gpu-price-tracker

A sophisticated web scraper for tracking GPU prices across e-commerce platforms, featuring proxy rotation, CAPTCHA handling, and data visualization.

captcha-handling docker fullstack gpu-prices javascript mongodb next-js node-js proxy-rotation puppeteer telegram-bot web-scraping

Last synced: 21 Jan 2025

https://github.com/igor-starostenko/book-worm

Google maps bookmark import tool

automation bookmarks google-maps puppeteer

Last synced: 02 Feb 2025

https://github.com/andriilive/stav-rizeni-mvcr-oamp-pupppetter

Browser automation to check the application status at Department for Asylum and Migration Policy, Czech Republic

czech czech-republic nodejs oamp puppeteer

Last synced: 17 Jan 2025

https://github.com/engineervix/cv

Write your CV in Markdown and generate both a responsive web page and a professional PDF with minimal setup. Features modern tooling (Vite, Puppeteer), beautiful icons, and automated PDF generation via CI/CD. See example below 👇

cv markdown pdf-generation puppeteer resume vite

Last synced: 26 Jan 2025

https://github.com/horatiumarginean/mimirbot

Discord bot that contains various methods for retrieving and notifying me of the knowledge I find useful.

discord-js puppeteer

Last synced: 12 Oct 2024

https://github.com/vasani-arpit/puppeteer-extension-automation-example

Tutorial on how to add and use an extension programmatically in puppeteer

automation extensions node nodejs puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/bubblxs/steam-avatar-showcase

simple application that collects profile pictures from public steam profiles and publishes them on my tumblr.

javascript puppeteer steam tumblr web-scraping

Last synced: 01 Feb 2025

https://github.com/kayantchian/fooddatascraper

FoodDataScraper is a browser extension that performs web scraping on predefined restaurant menu websites. It collects data from these menus and generates automated spreadsheets, optimizing the internal menu registration process for businesses.

csv data-science javascript papaparse puppeteer webscrapy

Last synced: 25 Jan 2025

https://github.com/cityssm/node-faster-unofficial-api

An unofficial API for the FASTER Web fleet management system, relying on exported reports and complex parsers.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 23 Oct 2024

https://github.com/bettercallsundim/crote

aesthetic & colorful class routine generator

expressjs mongodb mongoose nextjs puppeteer shadcn-ui

Last synced: 06 Feb 2025

https://github.com/justshush/whatsapp-bot

This is a whatsapp bot that sends a message repeatedly to a person on your contacts.

bot nodejs puppeteer whatsapp whatsapp-web

Last synced: 25 Jan 2025

https://github.com/onfranciis/sustainobles-backend

Add donations and retrieve list as pdf using NodeJS, MongoDB and Puppeteer

expressjs jest mongodb nodejs puppeteer typescript

Last synced: 09 Feb 2025

https://github.com/jp7io/puppy

Simple website screenshot using AWS Lambda, Chromium, and Puppeteer.

chromium lambda puppeteer screenshot

Last synced: 20 Jan 2025

https://github.com/tamanobi/dokku-puppeteer-ss-server

Screenshot server using puppeteer on dokku

dokku puppeteer screenshot-server

Last synced: 21 Jan 2025

https://github.com/kimromi/kshot

📷 Tools to take screenshots.

javascript koajs puppeteer

Last synced: 17 Jan 2025

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 23 Dec 2024

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/kirk-en/nes-video-fetch

A web scraping tool designed to fetch download links for NES (Nintendo Entertainment System) long play videos based on game title. This tool currently supports pulling long plays and wiki info for 443 licensed NES titles.

puppeteer retrogaming scraping video-downloader video-processing

Last synced: 25 Jan 2025

https://github.com/runnin-n-gunnin/puppeteerpanellib

PuppeteerPanel is a User Control that embeds puppeteer's chromium window in a Windows Forms application. POC.

chromium crawling puppeteer puppeteer-sharp scraping winforms

Last synced: 09 Jan 2025

https://github.com/andrewjbateman/node-puppeteer-webscraper

:clipboard: Node.js with puppeteer to extract web content from Google Chrome

cheerio html5 javascript nodejs puppeteer webscrapping

Last synced: 27 Dec 2024

https://github.com/tomashubelbauer/playwright-pdf

Using Playwright Firefox to scrape PDFs

firefox pdf playwright puppeteer scraping

Last synced: 31 Dec 2024

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/vermajay/internshala-automation

Automatically apply to internships on Internshala using Google's Puppeteer high level API for chrome

api automation chrome google internships puppeteer

Last synced: 13 Oct 2024

https://github.com/devstar2004/sotodata

You can find any firm lawyers over the world.

css html linkedin nodejs php puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/tomashubelbauer/playwright-github-actions

Demonstrates using Playwright to control Firefox to take a screenshot of Hacker News in GitHub Actions

github-actions playwright puppeteer

Last synced: 31 Dec 2024

https://github.com/sskender/gmaps-screenshot

Save a screenshot from Google Maps of given coordinates without opening browser!

bot browser google google-maps maps node node-js nodejs puppeteer screenshot

Last synced: 26 Jan 2025

https://github.com/tomashubelbauer/shoot

A Node tool for capturing web page screenshots using Puppeteer

node npm npx puppeteer screenshot

Last synced: 31 Dec 2024

https://github.com/nubisub/tipsen2

Males buka sipadung ? Titip Absen aja

automation node-cron puppeteer

Last synced: 06 Nov 2024

https://github.com/louiscklaw/page-change-detect-tryout

page-change-detect-tryout

javascript puppeteer

Last synced: 20 Dec 2024

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Jan 2025

https://github.com/tomashubelbauer/puppeteer-deterministic-screenshot

Pondering about whether Puppeteer screenshots are deterministic

deterministic jpg png puppeteer reproducible-builds screenshot

Last synced: 31 Dec 2024

https://github.com/tomashubelbauer/puppeteer-deterministic-pdf

Making PDFs generated using Puppeteer deterministic by zeroing their date and time stamps

pdf puppeteer

Last synced: 31 Dec 2024

https://github.com/hutsoninc/stihl-scraper

Used to scrape data on Stihl products.

puppeteer stihl

Last synced: 27 Dec 2024

https://github.com/sojebsikder/extra-power

This is a simple project that helps other developer to achieve something different

express nodejs puppeteer typescript

Last synced: 09 Jan 2025

https://github.com/tomashubelbauer/cra-test-puppeteer

Testing CRA (Create React App) with Puppeteer

cra create-react-app puppeteer

Last synced: 31 Dec 2024

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Jan 2025

https://github.com/anujdhillxn/igbot

Automated bot for instagram using puppeteer and expressjs for posting, scraping and gathering followers

expressjs mongodb puppeteer typescript webscraping

Last synced: 31 Dec 2024

https://github.com/softplus/detweet

Remove Tweets via Puppeteer

nodejs puppeteer twitter twitter-api

Last synced: 23 Dec 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 23 Dec 2024

https://github.com/uday160386/test-automation-poc-demos

The consolidation of proofs of concept (POCs) using various open source tools is a strategic approach that can streamline development processes and enhance productivity

playwright-javascript puppeteer robotframework selenium

Last synced: 23 Dec 2024

https://github.com/yandeu/jenkins-puppeteer-docker

Use Puppeteer on Jenkins on Docker with Node.js and Jest.

docker jenkins jest nodejs puppeteer

Last synced: 05 Feb 2025

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 08 Jan 2025

https://github.com/mersocarlin/puppeteer

Run headless Chrome Node.js tests in a Docker container

automated-testing docker docker-image dockerfile puppeteer

Last synced: 23 Dec 2024

https://github.com/konojunya/puppeteer-react

[CODE SANDBOX] puppeteer e2e testing with React

e2e-tests puppeteer react

Last synced: 23 Dec 2024

https://github.com/afeiship/pptr-html

Get html by puppeteer.

crawl html pptr puppeteer spider

Last synced: 07 Feb 2025

https://github.com/shiv-source/slice-chrome-extension-automation

This project automates the viewing of advertisements through the Slice Chrome Extension. It is designed to view ads on your behalf, and credits for viewing these ads will be automatically added to your Slice account. You can monitor these credits through the Slice extension app.

automation puppeteer slice slice-extension

Last synced: 07 Jan 2025

https://github.com/sthotakura/remove-linkedin-connections

puppeteer script to remove linkedin connections

linkedin puppeteer

Last synced: 02 Jan 2025

https://github.com/francescocoding/harvest-time

🌽 Harvest Time is a Node-based web scraper that utilizes Puppeteer to get past the login page directly from the Node environment (programmatically).

nodejs puppeteer scraper scraping

Last synced: 08 Feb 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using ES Modules, esm, Mocha, Chai and Assert.

assert chai end-to-end-test-automation esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Expect.

commonjs cucumber end-to-end-test-automation expect puppeteer

Last synced: 11 Jan 2025

https://github.com/bhagyamudgal/time-fun-scraper

Node.js script to scrape time.fun and create a txt report

nodejs puppeteer typescript

Last synced: 17 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Assert.

assert commonjs end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 72 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 87 博文 86 Packages 30 Utils 23 Integrations 17 包 14 Testing 13 Rendering and web scraping 12 Services 12 渲染和网页抓取 11 Reporters 10 Examples 10 Language Support 9 Showcases 9 Official 9 官方 9 测试 9 例子 9 Guides 6 Related 6