Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/giansalex/puppeteer-sample

Puppeteer Headless Chrome (Sample)

node puppeteer

Last synced: 13 Feb 2025

https://github.com/mycase/puppeteer-har-server

An HTTP server that exposes functionality offered by puppeteer-har

har puppeteer puppeteer-har

Last synced: 22 Jan 2025

https://github.com/rushi0508/insta-reels-automation

Fetches the reels for different users including captions and stores it in AWS S3.

javascript nodejs puppeteer webscraping

Last synced: 22 Jan 2025

https://github.com/lucassimao/coinmarketcap-crawler

Crypto currencies market data from http://coinmarketcap.com/ crawled using puppteer + expressjs backend + Elasticsearch + React frontend

elasticsearch express nodejs puppeteer react

Last synced: 23 Jan 2025

https://github.com/jprando/lotofacil

Buscar informacoes do ultimo sorteio da lotofacil

javascript lotofacil puppeteer

Last synced: 28 Jan 2025

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 23 Dec 2024

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicação console que fornece informações dos elencos, próximas partidas e notícias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 12 Feb 2025

https://github.com/antoniowd/nitto-tire-crawler

Web scraper del sitio nittotire para la obtención de las características de sus neumáticos y analizar que autos pueden usarlo

mongodb nodejs puppeteer webcrawler webscraping

Last synced: 06 Feb 2025

https://github.com/pdehaan/send-puppeteer

Firefox Send v.Next screenshots.

firefox puppeteer send

Last synced: 12 Feb 2025

https://github.com/pdehaan/puppeteer-a11y-cli

Puppeteer <3 Axe

a11y axe puppeteer

Last synced: 12 Feb 2025

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 04 Feb 2025

https://github.com/manjillama/node-redis-ci

Simple React/Node application using MongoDB and Redis (database caching). Jest and puppeteer for automated browser testing and Travis for CI

google-oauth2 jest mongodb mongoose node puppeteer react redis travis-ci

Last synced: 22 Jan 2025

https://github.com/showlotus/lansite

Forwarding pages between machines in a LAN

lan nuxt puppeteer

Last synced: 08 Feb 2025

https://github.com/makelove/chromedp_examples

chromedp官方代码,中文注释

chromedp puppeteer

Last synced: 20 Jan 2025

https://github.com/marcinrek/seed

Cutup boilerplate with support of: react, hyperapp and more ...

boilerplate-template boilerplates hyperapp mocha puppeteer react scaffold webpack

Last synced: 28 Jan 2025

https://github.com/naoki-00-ito/js-scraping

Webスクレイピングプラグラム

dotenv javascript nodejs puppeteer scraping

Last synced: 11 Jan 2025

https://github.com/teitei-tk/example-puppeteer-google-functions

example Puppeteer on Google Cloud functions

cloud-functions puppeteer

Last synced: 03 Feb 2025

https://github.com/zewa666/au-puppeteer-example

A sample showing how an Aurelia app can be tested with Puppeteer

aurelia e2e-tests jest puppeteer typescript

Last synced: 15 Jan 2025

https://github.com/encoreshao/node-practices

Node.js Practices

javascript nodejs puppeteer

Last synced: 04 Feb 2025

https://github.com/volodymyr-kasap/puppeteer-div-screenshot

Example of how to take a screenshot of each HTML block using puppeteer and sharp

puppeteer screenshot sharp typescript

Last synced: 02 Feb 2025

https://github.com/rgglez/fc-webpage-screenshot

Aliyun FC function that takes a screenshot of a webpage, using puppeteer.

aliyun functioncompute javascript puppeteer screenshot webservice

Last synced: 28 Jan 2025

https://github.com/copha-project/copha

Open-Source Software For Managing Tasks

crawler framework nodejs puppeteer selenium

Last synced: 15 Jan 2025

https://github.com/stopsopa/state-of-puppeteer

🎎Bunch of test of my own puppeteer extensions

extension extensions puppeteer

Last synced: 06 Feb 2025

https://github.com/stopsopa/docker-puppeteer-html-scraper

(Deprecated -> use better https://github.com/stopsopa/html-scraper-browserless) Microservice tool to scraping html from "any" page

docker html-scraper node nodejs puppeteer scraper

Last synced: 06 Feb 2025

https://github.com/vi-ssh-al/flipkart-product-price-tracker

A MERN stack app to track Flipkart product prices, reviews, and ratings. Users can add product links to fetch details, view historical price changes, search by title, filter by price, and update product prices on demand.

expressjs mongodb nodejs puppeteer reactjs tailwindcss

Last synced: 15 Jan 2025

https://github.com/ellache/adjust_your_algo

Run puppeteer core in the background to modify your digital profile by navigating repeatedly to a specified set of webpages.

nodejs puppeteer puppeteer-core

Last synced: 04 Jan 2025

https://github.com/patrickschababerle/schabbi-webscraper

Small and easy to use NodeJS webcrawler project. Returns basic information about the crawled sites.

crawler puppeteer scraper scraping web-crawler

Last synced: 09 Feb 2025

https://github.com/zrna/cars-scraper

🚙 Scraping cars ads

javascript puppeteer scraper

Last synced: 09 Jan 2025

https://github.com/zahradnik-ondrej/jobscz-scraper

A simple data scraper of Jobs.cz written in multiple JS/TS libraries.

javascript jobs playwright puppeteer selenium typescript web-scraping

Last synced: 07 Jan 2025

https://github.com/ghdwlsgur/node-crawling

# puppeteer 라이브러리를 사용하여 웹크롤링하기

crawling node puppeteer

Last synced: 27 Dec 2024

https://github.com/anibalalpizar/puppeteer-overview

Control your browser using Javascript code, together with the Puppeteer library and Nodejs

nodejs puppeteer webscraping

Last synced: 08 Jan 2025

https://github.com/afeefrazick/io-web-scraper

Web Scraper utilized for gathering contact information from companies within the Sri Lankan software industry.

express puppeteer webscraper

Last synced: 04 Feb 2025

https://github.com/dutragames/bot-de-felicidades-facebook

Um simples bot que envia felicidades aos seus amigos no face!

bot facebook html-css-javascript nodejs puppeteer

Last synced: 19 Jan 2025

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 04 Jan 2025

https://github.com/louiscklaw/page-change-detect-tryout

page-change-detect-tryout

javascript puppeteer

Last synced: 13 Feb 2025

https://github.com/pioug/cookbook

Recipes to start my umpteenth dev projects.

cloud-run frontend javascript puppeteer rollup vuejs

Last synced: 17 Jan 2025

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 07 Jan 2025

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 04 Jan 2025

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/vaenow/crawler-chromeless

A chromeless crawler for coursera

chromeless coursera crawler puppeteer

Last synced: 06 Feb 2025

https://github.com/paveldymkov/puppeteer-io

Library for tests with Puppeteer using Jest or Mocha

headless-chrome puppeteer testing

Last synced: 30 Jan 2025

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/devstar2004/sotodata

You can find any firm lawyers over the world.

css html linkedin nodejs php puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Jan 2025

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Jan 2025

https://github.com/prantadas/nasa-fb

Description: The bot download a picuture from https://api.nasa.gov/planetary/apod and post it on facebook profile each day.

nasa-apod puppeteer typescript

Last synced: 22 Dec 2024

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 08 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using ES Modules, esm, Mocha, Chai and Assert.

assert chai end-to-end-test-automation esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Expect.

commonjs cucumber end-to-end-test-automation expect puppeteer

Last synced: 11 Jan 2025

https://github.com/kayantchian/fooddatascraper

FoodDataScraper is a browser extension that performs web scraping on predefined restaurant menu websites. It collects data from these menus and generates automated spreadsheets, optimizing the internal menu registration process for businesses.

csv data-science javascript papaparse puppeteer webscrapy

Last synced: 25 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Assert.

assert commonjs end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jasmine-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jasmine and Expect.

commonjs end-to-end-test-automation jasmine puppeteer puppeteer-commonjs-jasmine

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-babel-jest-expect

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, BabelJS, Jest and Expect.

babel end-to-end-test-automation es6 puppeteer

Last synced: 11 Jan 2025

https://github.com/kimkykie/blog-pdf-converter

Convert messy web articles into clean PDFs. Perfect for reading, archiving, sharing, and content analysis. Strips the noise, keeps what matters.

nodejs pdf-generation pdfkit puppeteer

Last synced: 09 Feb 2025

https://github.com/jprando/pdfserver

gerar relatorios em pdf com puppeteer

bun guambiarra pdf puppeteer relatorio rta

Last synced: 23 Dec 2024

https://github.com/miscos/discord-web-crawler

A puppeteer based webcrawler posting results to a discord webhook

discord puppeteer webcrawler

Last synced: 23 Dec 2024

https://github.com/jexniemi/browserless-action-runner

Run Puppeteer or Playwright web scraper (or other browser tasks) easily in headless mode as a GitHub Action

actions browser browserless chromium headless marketplace-action playwright puppeteer scraper scraping web

Last synced: 23 Dec 2024

https://github.com/kirk-en/nes-video-fetch

A web scraping tool designed to fetch download links for NES (Nintendo Entertainment System) long play videos based on game title. This tool currently supports pulling long plays and wiki info for 443 licensed NES titles.

puppeteer retrogaming scraping video-downloader video-processing

Last synced: 25 Jan 2025

https://github.com/thewrlck/quotz

A Node.js application demonstrating the use of Puppeteer and Orama SDK to create a quote database and search API.

expressjs orama puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/wasabina67/puppeteer-example

Puppeteer example

puppeteer

Last synced: 23 Dec 2024

https://github.com/evgeniyarbatov/location-testing

E2E testing of pages with location

expressjs location mocha puppeteer

Last synced: 23 Dec 2024

https://github.com/redaezziani/scrape-data-store-jolt

Product Scraper for Jolt Store is a robust tool designed to automate the collection of product data from e-commerce websites. This project leverages Puppeteer for web scraping and Prisma Client for seamless database management, ensuring efficient integration of external product data into the Jolt Store.

nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/shyamsunder149/problem-solving-tracker

A Tracker to track my solves around leetcode, gfg, codeforces and codchef. Just It will be satisfying for me to watch it

puppeteer scraping typescript

Last synced: 23 Dec 2024

https://github.com/muratsercann/book-price-agent

This application retrieves book prices from 5 different stores based on a search query. It uses React for the client-side interface, a Node.js API for the backend, and Puppeteer for web scraping.

expressjs nodejs puppeteer puppeteer-extra puppeteer-extra-plugin-stealth react

Last synced: 23 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Assert.

assert chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/gamboavalentinabel/nodejs-puppeteer-example

Test code for the Docker image nodejs-puppeteer

docker nodejs puppeteer

Last synced: 23 Dec 2024

https://github.com/zaidkhalid44/irctc

Technologies used: JavaScript, Puppeteer, Tesseract.js, Jimp Description: Developed an automated system using Puppeteer and Tesseract.js to streamline IRCTC train ticket booking, handling login, captcha solving, and form filling. Automated login and form-filling tasks, reducing manual effort by approximately 90%.

jimp puppeteer tesseract

Last synced: 23 Dec 2024

https://github.com/sharif-minhaz/web-scraping-with-js

Web scraper extracts data from websites. In JavaScript, jsdom and Puppeteer are powerful tools for this task. jsdom is a lightweight DOM implementation that lets user manipulate and query static pages. Puppeteer is a Node.js library for controlling headless Chrome/Chromium, ideal for dynamic websites. It can simulate user interactions and take ss

bun jsdom puppeteer web-scraping

Last synced: 23 Dec 2024

https://github.com/jfmonsa/book_scrapper

A web scrapping CLI tool to get books and categories/subcategories from Z-Library

node-js postgresql puppeteer web-scraping z-lib z-library

Last synced: 23 Dec 2024

https://github.com/gabrielcstr/dota2protracker-scraper

Scraping meta heroes from dota2protracker.com

d2pt dota2 dota2protracker javascript puppeteer scraper

Last synced: 23 Dec 2024

https://github.com/dnascanner/ani-cli

A simple to use terminal tool to find your favorite anime

anime chrome chromium cli deno puppeteer

Last synced: 23 Dec 2024

https://github.com/gigaarpit/puppeteer-examples

Collection of practical examples and scripts utilizing Puppeteer

playwright puppeteer puppeteer-screenshot

Last synced: 23 Dec 2024

https://github.com/tushcmd/olo-scraper

This is a full-stack web scraping application that simulates browser-like interactions using a headless browser. Users can input a URL, and the application scrapes data and performs specified actions.

cors express nodejs puppeteer react tailwindcss typescript winston

Last synced: 23 Dec 2024

https://github.com/extrawest/ai-uni-summarizer

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.

ai groq groq-api nextjs openai puppeteer reactjs youtube

Last synced: 23 Dec 2024

https://github.com/pedromarques391/lastreleases

Projeto de web scraping

nodemailer puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/hutsoninc/stihl-scraper

Used to scrape data on Stihl products.

puppeteer stihl

Last synced: 27 Dec 2024

https://github.com/antoniowd/aws-lambda-pdf

The aws-lambda-pdf project is designed to generate PDFs from HTML content using AWS Lambda and Chromium. The generated PDF files are stored in an S3 bucket, and the application returns a signed URL for accessing the PDF file.

aws-lambda chromium pdf-generation puppeteer

Last synced: 23 Dec 2024

https://github.com/duranda/lambda-pdf-generator

Generate PDF from HTML remotely on AWS Lambda with the Chromium rendering engine

aws-lambda chromium pdf-generation puppeteer wkhtmltopdf

Last synced: 23 Dec 2024

https://github.com/spm999/invoice-generator

Invoice generator application built using Node.js, Express.js, Handlebars, and Puppeteer. It generates invoices in PDF format based on the provided data.

api-rest express hbs invoice-generator nodejs postman puppeteer template-engine templateengine

Last synced: 23 Dec 2024

https://github.com/prantadas/play-scrapper

A Node.js-based scraper for extracting data from Google Play and the Apple App Store (Check the app's availability in a specific country). The scraper uses Puppeteer for automation and exports results to an Excel file.

excel-export puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/ailixter/chromatic

Chromium automation server

automation chromium nodejs pdf puppeteer server service

Last synced: 23 Dec 2024

https://github.com/daveanthonyc/webscraper-test

Webscraper using Puppeteer to scrape 7000+ rows of data.

dataminig nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/devzkhalil/puppeteer-facebook-unfriends-script

The Puppeteer Facebook Unfriends Script is a tool developed using Puppeteer, a Node.js library that provides a high-level API to control headless Chrome or Chromium browsers. This script is specifically crafted for automating the process of unfriending users on Facebook.

facebook facebook-unfriend facebook-unfriend-script puppeteer web-automation

Last synced: 23 Dec 2024