Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/jscalderon65/shopping-web-scraper-backend

Api dedicada a informar y notificar el cambio de precios de productos en tiendas virtuales. El producto que se desee vigilar se deberá registrar por medio de los métodos de la Api y una vez terminado dicho el proceso, la Api se encargará de notificar por medio de correo electrónico los cambios que se puedan presentar en los precios del producto.

express-js firebase-admin node-js puppeteer

Last synced: 11 Jan 2025

https://github.com/jonaylor89/beeline-bot

Bot to automate the browser to do my timesheet

automation docker nodejs puppeteer

Last synced: 11 Jan 2025

https://github.com/geodoo/game-of-shells

Game of shells

atdd jest puppeteer react tdd

Last synced: 12 Jan 2025

https://github.com/cocohfl/twitchremotecontrol

Remotely control Twitch streams running on your PC from any device.

nodejs puppeteer remote-control twitch

Last synced: 12 Jan 2025

https://github.com/molvqingtai/testing-library-extra

Add bySelector and byAttribute to @testing-library/dom

happy-dom jest jsdom playwright puppeteer testing-library testing-library-dom vitest

Last synced: 21 Dec 2024

https://github.com/anasfik/public-apis-json-api

An Api For The Collective Apis List Of Public-apis Repository Scrapped With Puppeteer/Typescript

api apis collection developement free list public-apis puppeteer software typescript web-scrapping

Last synced: 14 Jan 2025

https://github.com/anasfik/user-repositories-scrapper

a puppeteer script to get repositories data from user using puppeteer

javascript puppeteer repositories scrapper web-scraper web-scraping

Last synced: 14 Jan 2025

https://github.com/osfunapps/os-cheerio-helper-npm

an intuitive module to help with cheerio web scraping related functions

cheerio-node cheeriojs helper javascript node puppeteer webscraping

Last synced: 29 Nov 2024

https://github.com/harshsharma20503/trade-alert

Trade-Alert is a notification system that keeps users updated on critical news impacting their stock portfolios. It simplifies staying informed by delivering timely notifications for important articles, eliminating the need to monitor multiple platforms in today’s fast-paced market.

fcm-notifications firebase groq-api llm-pipeline puppeteer react-plotlyjs web-scraping

Last synced: 29 Dec 2024

https://github.com/raeesbhatti/vbully

Scrapes data off vBulletin websites

puppeteer scraper vbulletin

Last synced: 14 Dec 2024

https://github.com/seaqk/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 12 Jan 2025

https://github.com/thomasjvu/entry-level-jobs-scraper

Job scraper for entry-level roles for the Ground Zero project

puppeteer supabase

Last synced: 21 Nov 2024

https://github.com/tayyabmughal676/f1gpt_backend

Formula F1GPT Chat Unlock the power of AI-powered conversations! Built with Datastax, OpenAI, and more. Fork, explore, and enhance!

ai datastax genai genai-chatbot generative-ai gpt langchain langchain-js machine-learning ml open-source open-source-intelligence open-source-project openai openai-api puppeteer rag typescript

Last synced: 02 Jan 2025

https://github.com/kazutoshiyoc/mattermost-tools

Tools for convenient use of Mattermost

mattermost nodejs puppeteer

Last synced: 21 Nov 2024

https://github.com/mycase/puppeteer-har-server

An HTTP server that exposes functionality offered by puppeteer-har

har puppeteer puppeteer-har

Last synced: 21 Nov 2024

https://github.com/khalyomede/hypercharged

Generates a static, prerendered site from your original website.

html javascript node nodejs npm prerender prerendering puppeteer renderer rendering single-page-applications

Last synced: 21 Nov 2024

https://github.com/mpirescarvalho/image-generator

Image generator with Next.js server side rendering 🌀

nextjs puppeteer serverless ssg ssr vercel

Last synced: 21 Nov 2024

https://github.com/ajit24/anakin-scrap

This repository contains the code in puppeteer and node.js to find the latitude and longitude of all locations in Singapore

expressjs nodejs puppeteer

Last synced: 02 Jan 2025

https://github.com/justshush/whatsapp-bot

This is a whatsapp bot that sends a message repeatedly to a person on your contacts.

bot nodejs puppeteer whatsapp whatsapp-web

Last synced: 25 Nov 2024

https://github.com/dieffrei/sfdx-docker-image

Docker image to support SFDX builds - It is based on sfdx docker image + aditionals sfdx plugins

puppeteer salesforce sfdx

Last synced: 15 Dec 2024

https://github.com/jglchen/web-scrape

This is a next.js framework site to demonstrate web scraping cases and my expertise in web scraping.

cheerio docker nextjs nodejs puppeteer reactjs

Last synced: 19 Nov 2024

https://github.com/callaginn/kroger-sweeper

Download and categorize receipts from Kroger.com by scraping a user's purchases with puppeteer and playwright.

kroger kroger-api nodejs orders playwright puppeteer purchases receipt receipt-parser receipts scrape scraper

Last synced: 21 Nov 2024

https://github.com/adrianomonteiroweb/simplified-application-robot

Sistema para aplicação em vagas simplificadas no LinkedIn.

javascript nodejs object-oriented-programming poo puppeteer

Last synced: 21 Nov 2024

https://github.com/adrianomonteiroweb/scraping-puppeteer-express

Projeto para estudos de web scraping com puppeteer + express.

express expressjs nodejs pug puppeteer

Last synced: 21 Nov 2024

https://github.com/adrianomonteiroweb/puppeteer-studying

Repositório de estudos em Puppeteer.

javascript nodejs puppeteer

Last synced: 21 Nov 2024

https://github.com/rafinhadufluxo/losing

Buscador de cardápio do RU da UFFS, capturando em imagem em formato PNG 📸

javascript node-module nodejs puppet-module puppeteer puppeteer-screenshot

Last synced: 26 Dec 2024

https://github.com/dgvalerio/timesheet-express-assistant

Back-end of timesheet-next-assistant

express puppeteer typescript

Last synced: 21 Nov 2024

https://github.com/richardhosler/nextjs-redis-puppeteer-screenshot-capture-tool

Small tool to capture screenshots of websites, learning Redis and puppeteer

nextjs puppeteer redis

Last synced: 01 Dec 2024

https://github.com/expelledboy/threejs-manual-generator

Single-page Three.js documentation generator for use as docs in Cursor AI

cursor-ai documentation puppeteer single-page threejs web-scraping

Last synced: 01 Dec 2024

https://github.com/makelove/chromedp_examples

chromedp官方代码，中文注释

chromedp puppeteer

Last synced: 19 Nov 2024

https://github.com/rishi-raj-jain/grabscreen

GrabScreen - A Screenshot Generator

api chrome-aws-lambda nextjs puppeteer serverless

Last synced: 26 Dec 2024

https://github.com/oscarprdev/dev_resources

Simple resources site to store and list all the development resources I found insteresting. Developed with Typescript, Nextjs and Tailwind and a scrapping feature with Puppeteer.

nextjs postgresql puppeteer tailwind typescript

Last synced: 01 Dec 2024

https://github.com/maximemoreillon/ebanking_scraper

A web scraper for account balance and transactions on an e-banking interface

puppeteer

Last synced: 21 Nov 2024

https://github.com/maximemoreillon/ts3_scraper

Scraper designed to retrieve the list of transactions of a TS3 corporate credit card.

credit-card puppeteer ts3

Last synced: 21 Nov 2024

https://github.com/naoki-00-ito/js-scraping

Webスクレイピングプラグラム

dotenv javascript nodejs puppeteer scraping

Last synced: 11 Jan 2025

https://github.com/zewa666/au-puppeteer-example

A sample showing how an Aurelia app can be tested with Puppeteer

aurelia e2e-tests jest puppeteer typescript

Last synced: 15 Jan 2025

https://github.com/andrewjbateman/node-puppeteer-webscraper

:clipboard: Node.js with puppeteer to extract web content from Google Chrome

cheerio html5 javascript nodejs puppeteer webscrapping

Last synced: 27 Dec 2024

https://github.com/nkyazhin/puppeteer-rq

If you are writing puppeteer tests, and you want to mock your network responses easily – then this package will help you.

mocker puppeteer puppeteer-rq

Last synced: 25 Nov 2024

https://github.com/zenika/google-puppet

Some headless Chrome scripts to manipulate G Suite

chrome-headless google puppeteer

Last synced: 16 Nov 2024

https://github.com/arumie/recipe-scraper

Scraper for scraping recipes

deno puppeteer typescript

Last synced: 28 Nov 2024

https://github.com/heronlabs/node-alpine-puppeteer

Image for Node Alpine with Puppeteer

docker docker-hub docker-image node nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/jhowbhz/scrap-consultaprocessos-rj

Esse é um caso de estudo sobre puppeteer

nodejs processos processos-rj puppeteer rj webscrap

Last synced: 27 Nov 2024

https://github.com/alexpreynolds/flow-cytometry-visualization

Flow cytometry visualization demo using Jupyter, Plotly, and fcsparser

bioinformatics fcs jupyter jupyter-notebook plotly puppeteer python3 visualization

Last synced: 26 Dec 2024

https://github.com/rishi-raj-jain/html-og-image

A deployment of OG Image Generator to Layer0.

chrome-aws-lambda layer0 nextjs prettier puppeteer react react-dom

Last synced: 26 Dec 2024

https://github.com/alxzu/imm-puppeteer

Search the IMM website for free places for the vehicle controller

nodejs puppeteer scraper

Last synced: 10 Jan 2025

https://github.com/copha-project/copha

Open-Source Software For Managing Tasks

crawler framework nodejs puppeteer selenium

Last synced: 15 Jan 2025

https://github.com/dzmitry-duboyski/automation-framework-using-jest-and-puppeteer

Part #5: Automation Framework using Jest and Puppeteer for course https://www.udemy.com/course/automated-headless-browser-testing-with-puppeteer/

jest puppeteer

Last synced: 12 Jan 2025

https://github.com/tokisakikurumi2001/crawl_data

Crawl data from weather site

pandas-dataframe puppeteer weather

Last synced: 22 Nov 2024

https://github.com/mariusconjeaud/angular-with-api-calls

Angular with API calls template. Full Azure Pipeline with unit testing, e2e testing, code coverage and linting included.

angular azure-app-service azure-devops cobertura expressjs junit karma protractor puppeteer typescript

Last synced: 14 Dec 2024

https://github.com/vi-ssh-al/flipkart-product-price-tracker

A MERN stack app to track Flipkart product prices, reviews, and ratings. Users can add product links to fetch details, view historical price changes, search by title, filter by price, and update product prices on demand.

expressjs mongodb nodejs puppeteer reactjs tailwindcss

Last synced: 15 Jan 2025

https://github.com/lightbeem3296/stealth-chrome-automation

Completely undetectable chrome browser automation script. Even better than all the automation libraries including Selenium, Puppeteer, Playwright and so on.

automation bypass playwright puppeteer scraper selenium stealth-bot undetectable-browser

Last synced: 05 Jan 2025

https://github.com/omarkhairy21/nodens-assignment-

Simple Authentication MVC With Unit Testing and e2e testing

expressjs jest jwt jwt-authentication nodejs pugjs puppeteer semantic-ui

Last synced: 16 Nov 2024

https://github.com/k4u5h4l/automate-music-download

A headless chrome script to automate the process of downloading large amounts of FLAC (lossless) audio.

javascript nodejs puppeteer scraping

Last synced: 06 Jan 2025

https://github.com/francescocoding/harvest-time

🌽 Harvest Time is a Node-based web scraper that utilizes Puppeteer to get past the login page directly from the Node environment (programmatically).

nodejs puppeteer scraper scraping

Last synced: 15 Dec 2024

https://github.com/capjavert/crawlathon

Winning solution for Crawlathon Hackathon by ReversingLabs

automation crawling hackathon hackathon-project puppeteer scraping

Last synced: 01 Dec 2024

https://github.com/ashutoshsce/nys-liquor-authority

Directly scrape records from https://www.tran.sla.ny.gov/JSP/query/PublicQueryAdvanceSearchPage.jsp and present it in datatable format

datatable expressjs mongodb node nys-liquor-authority puppeteer vuejs website-scraper

Last synced: 16 Dec 2024

https://github.com/cavalluccijohann/scrapper-whentocop

Minimal repository for scraping websites like Whentocop and storing items in a database. This project utilizes TypeScript, Puppeteer, and PostgreSQL, with db0 as the database interface 🚀

bun commander db db0 docker docker-compose monorepo nuxt postgresql puppeteer scraper scraping scrapper ts typescript

Last synced: 22 Nov 2024

https://github.com/tanadelgigante/puppeteer-api-server

Api server to execute node.js scraping scripts

docker nodejs puppeteer scraping scripts

Last synced: 22 Nov 2024

https://github.com/archish27/rrweb-browser-test

RRWeb events to generating browser test scripts

cypress playwright puppeteer rrweb selenium

Last synced: 22 Nov 2024

https://github.com/ellache/adjust_your_algo

Run puppeteer core in the background to modify your digital profile by navigating repeatedly to a specified set of webpages.

nodejs puppeteer puppeteer-core

Last synced: 04 Jan 2025

https://github.com/se-madhusudan/puppeteer-demo

Screenshot and pdf generation with puppeteer, image-size, and pdfkit

image-size pdf pdfkit puppeteer screenshot

Last synced: 12 Jan 2025

https://github.com/rushi0508/razorpay-attendance-automation

Will trigger github action as cron job and will mark my attendance in the razorpay application.

javascript puppeteer razorpay

Last synced: 12 Jan 2025

https://github.com/yarosj/crossdomain-selector

Retrieves a selector from another site by a screenshot

crossdomain puppeteer screenshot selector

Last synced: 30 Nov 2024

https://github.com/zahradnik-ondrej/jobscz-scraper

A simple data scraper of Jobs.cz written in multiple JS/TS libraries.

javascript jobs playwright puppeteer selenium typescript web-scraping

Last synced: 07 Jan 2025

https://github.com/hid-gs/simple-jest-puppeteer-runner

Docker container for jest tests using puppeteer

docker javascript jest public puppeteer tests

Last synced: 26 Nov 2024

https://github.com/mrwh1te/sam

Social Automation Manager aka Sam

automation electron puppeteer social-media

Last synced: 08 Dec 2024

https://github.com/lezdcs/kick-push-key-checker

A tool for automatically extracting Pusher configuration from Kick.com and updating Firebase Remote Config.

deno firebase firebase-remote-config kick preact puppeteer pusher

Last synced: 26 Dec 2024

https://github.com/rakashash/webscrapperandsummarise

This project Contains a node.js App(Backend) for WebScrapping a url with summarising the scrapped data using LLM models form groq and storing it in Postgres.

groq groq-integration nodejs postgresql puppeteer sequelize sequelize-orm

Last synced: 08 Dec 2024

https://github.com/prixladi/site-capture-puppet

Worker service capturing sites using puppeteer. Part of Site Capture project - https://github.com/prixladi/site-capture

docker mongodb nodejs puppeteer redis

Last synced: 16 Nov 2024

https://github.com/vgvr0/scraper-puppeteer

This project uses Puppeteer, a Node.js library which provides a high-level API to control Chrome or Chromium over the DevTools Protocol. Puppeteer runs headless by default, but can be configured to run full (non-headless) Chrome or Chromium.

node-js-scraper puppeteer puppeteer-scraper puppeteer-scraping

Last synced: 26 Nov 2024

https://github.com/anibalalpizar/puppeteer-overview

Control your browser using Javascript code, together with the Puppeteer library and Nodejs

nodejs puppeteer webscraping

Last synced: 08 Jan 2025

https://github.com/prixladi/urlik

Url shortener service with advanced statistics.

asp-net-core docker docker-compose mongodb nextjs puppeteer react redis

Last synced: 16 Nov 2024

https://github.com/nerkarso/docker-puppeteer-example

This is a sample app that runs Puppeteer inside a Docker container

docker puppeteer

Last synced: 02 Dec 2024

https://github.com/situmorang-com/scrape-website-using-puppeteer-javascript

Scraping website such as amazon or tokopedia to automate notification using puppeteer in javascript

puppeteer scraper scraping-websites web-crawler web-scraping

Last synced: 26 Nov 2024

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 04 Jan 2025

https://github.com/b4dnewz/webpage-capture-cli

Capture the web in many ways from the command line

cli-tool cli-utility puppeteer puppeteer-screenshot screenshot webpage webshot website

Last synced: 12 Jan 2025

https://github.com/mgoyal98/pdf-pipeline

PDF Pipeline is a Node.js app that reads messages from SQS, generates PDFs using Puppeteer and Mustache, uploads them to S3, and updates status via SQS or webhooks

docker docker-pdf document-generator microservice mustache node-pdf nodejs pdf-generation pdf-generator pdf-microservice puppeteer sqs webhook

Last synced: 21 Dec 2024

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 07 Jan 2025

https://github.com/lnardon/kindlehighlightsscraper

A kindle highlights scraper using puppeteer

amazon javascript kindle puppeteer scraper

Last synced: 10 Jan 2025

https://github.com/demapy/flow

Flow - is an automatization builder tool that helps you automate repetitive tasks.

automation crypto javascript puppeteer react reactflow typescript zod

Last synced: 28 Nov 2024

https://github.com/go-on-the-way/e2e-puppeteer

前端端到端测试实践

e2e puppeteer resemblejs

Last synced: 02 Jan 2025

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 83 博文 82 Packages 30 Utils 23 Integrations 17 包 14 Testing 13 Rendering and web scraping 12 Services 12 渲染和网页抓取 11 Examples 10 Reporters 10 Language Support 9 Showcases 9 Official 9 官方 9 测试 9 例子 8 License 6 Related 6