Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/mattezekiel/get-commits-count

Get every commit ever made (Public)

bash javascript puppeteer scraper yaml

Last synced: 14 Jan 2025

https://github.com/ewliang/cnbc-premarket-web-scraper

A web scraper created using Puppeteer library on the backend to scrape the stock market prediction data off of CNBC's premarket page.

backend-development expressjs javascript node-js nodejs puppeteer stock-market web-scraper web-scraping webscraper

Last synced: 02 Jan 2025

https://github.com/blank-09/google-meet-automation

An automation software to join Google Meet meetings. The software uses the csv file to get the schedule of the meetings and joins the meeting at the scheduled time.

automation google-meet puppeteer

Last synced: 05 Nov 2024

https://github.com/rahulnisanth/trackitnow

The e-commerce price tracker and analyzer for best deals

bright-data cheerio-js cron-jobs nextjs14 puppeteer web-scraping-software

Last synced: 05 Nov 2024

https://github.com/guilhermebkel/semantic-search-llm-ai

🤖 That's a simple LLM semantic search that implements RAG concepts with help of LangChain and OpenAI API.

ai embeddings langchain openai-api puppeteer rag redis redis-vector-store retrieval-augmented-generation semantic-search-ai typescript

Last synced: 05 Nov 2024

https://github.com/hutsoninc/gmb-poster

Used to automate posting on Google MyBusiness

electron google mybusiness post puppeteer

Last synced: 27 Dec 2024

https://github.com/book000/moneyforward-collector

Export MoneyForward deposit/withdrawal statements in CSV and take a screenshot.

csv moneyforward nodejs puppeteer screenshot

Last synced: 13 Jan 2025

https://github.com/evanhalley/feature-image-generator

An example gulp script that generates feature images for social media from markdown text files containing frontmatter

gulp node puppeteer

Last synced: 30 Dec 2024

https://github.com/michaelcaxias/anime-web-scraping

Script de raspagem de dados de um site de anime, capturando dados como nome, número e video de episódios.

node puppeteer typescript web-scraping

Last synced: 02 Jan 2025

https://github.com/hutsoninc/yext-reviews-scraper

Used to scrape reviews from Yext.

puppeteer reviews yext

Last synced: 27 Dec 2024

https://github.com/deliteser112/node-cheerio-puppeteer-scraping-bot

Games Night App scraping bot using Node, Cheerio, Puppeteer

axios cheerio nodejs puppeteer

Last synced: 02 Jan 2025

https://github.com/devmunyi/puppeteer-web-automation

Using puppeteer to scrap and automate some repetitive web tasks

nodejs puppeteer typescript

Last synced: 14 Jan 2025

https://github.com/cclient/weizhishu-puppeteer

puppeteer抓取微博指数

chrome clawler puppeteer spider

Last synced: 16 Nov 2024

https://github.com/luqueee/moodle-rest-scraper

Rest API express with puppeteer library for scraping information of a user

express moodle puppeteer

Last synced: 21 Nov 2024

https://github.com/thomasjvu/entry-level-jobs-scraper

Job scraper for entry-level roles for the Ground Zero project

puppeteer supabase

Last synced: 21 Nov 2024

https://github.com/vermajay/internshala-automation

Automatically apply to internships on Internshala using Google's Puppeteer high level API for chrome

api automation chrome google internships puppeteer

Last synced: 13 Oct 2024

https://github.com/kazutoshiyoc/mattermost-tools

Tools for convenient use of Mattermost

mattermost nodejs puppeteer

Last synced: 21 Nov 2024

https://github.com/mycase/puppeteer-har-server

An HTTP server that exposes functionality offered by puppeteer-har

har puppeteer puppeteer-har

Last synced: 21 Nov 2024

https://github.com/mdato/dolar2030

puppeteer + heroku + express

express heroku puppeteer

Last synced: 07 Jan 2025

https://github.com/ribeirogab/puppeteer-currency-converter

Project to test the functionalities of the Node.js (version >= 13.4) using Puppeteer

currency-converter nodejs puppeteer scraper top-level-await

Last synced: 19 Nov 2024

https://github.com/mpirescarvalho/image-generator

Image generator with Next.js server side rendering 🌀

nextjs puppeteer serverless ssg ssr vercel

Last synced: 21 Nov 2024

https://github.com/jayvirrathi/nodejs-puppeteer

NodeJS Instagram Post Liker using Puppeteer

instagram nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/justshush/whatsapp-bot

This is a whatsapp bot that sends a message repeatedly to a person on your contacts.

bot nodejs puppeteer whatsapp whatsapp-web

Last synced: 25 Nov 2024

https://github.com/dieffrei/sfdx-docker-image

Docker image to support SFDX builds - It is based on sfdx docker image + aditionals sfdx plugins

puppeteer salesforce sfdx

Last synced: 15 Dec 2024

https://github.com/pioug/cookbook

Recipes to start my umpteenth dev projects.

cloud-run frontend javascript puppeteer rollup vuejs

Last synced: 16 Nov 2024

https://github.com/callaginn/kroger-sweeper

Download and categorize receipts from Kroger.com by scraping a user's purchases with puppeteer and playwright.

kroger kroger-api nodejs orders playwright puppeteer purchases receipt receipt-parser receipts scrape scraper

Last synced: 21 Nov 2024

https://github.com/adrianomonteiroweb/simplified-application-robot

Sistema para aplicação em vagas simplificadas no LinkedIn.

javascript nodejs object-oriented-programming poo puppeteer

Last synced: 21 Nov 2024

https://github.com/adrianomonteiroweb/scraping-puppeteer-express

Projeto para estudos de web scraping com puppeteer + express.

express expressjs nodejs pug puppeteer

Last synced: 21 Nov 2024

https://github.com/adrianomonteiroweb/puppeteer-studying

Repositório de estudos em Puppeteer.

javascript nodejs puppeteer

Last synced: 21 Nov 2024

https://github.com/dgvalerio/timesheet-express-assistant

Back-end of timesheet-next-assistant

express puppeteer typescript

Last synced: 21 Nov 2024

https://github.com/yarosj/crossdomain-selector

Retrieves a selector from another site by a screenshot

crossdomain puppeteer screenshot selector

Last synced: 30 Nov 2024

https://github.com/richardhosler/nextjs-redis-puppeteer-screenshot-capture-tool

Small tool to capture screenshots of websites, learning Redis and puppeteer

nextjs puppeteer redis

Last synced: 01 Dec 2024

https://github.com/expelledboy/threejs-manual-generator

Single-page Three.js documentation generator for use as docs in Cursor AI

cursor-ai documentation puppeteer single-page threejs web-scraping

Last synced: 01 Dec 2024

https://github.com/gabrielimartins7/robo_extrai_dados

Extraindo dados de outros sites com Puppeteer JS :robot:

instagram javascript puppeteer

Last synced: 24 Dec 2024

https://github.com/creativeprojects/gallerydownloader

Download images from a webpage using headless chrome

puppeteer

Last synced: 05 Jan 2025

https://github.com/jedrzejratajczak/scraper

Web Scraper with Discord Bot running as Windows process

cron discord-bot puppeteer sqlite web-scraping windows-process

Last synced: 28 Dec 2024

https://github.com/sirok1/lolz-auto-contests

Lolzteam | zelenka.guru app for auto-participation in draws

discord-webhook nodejs puppeteer telegram-bot

Last synced: 16 Nov 2024

https://github.com/oscarprdev/dev_resources

Simple resources site to store and list all the development resources I found insteresting. Developed with Typescript, Nextjs and Tailwind and a scrapping feature with Puppeteer.

nextjs postgresql puppeteer tailwind typescript

Last synced: 01 Dec 2024

https://github.com/maximemoreillon/ebanking_scraper

A web scraper for account balance and transactions on an e-banking interface

puppeteer

Last synced: 21 Nov 2024

https://github.com/maximemoreillon/ts3_scraper

Scraper designed to retrieve the list of transactions of a TS3 corporate credit card.

credit-card puppeteer ts3

Last synced: 21 Nov 2024

https://github.com/abduldevhub/react-mountain

A repository containing all of the React projects I made to test and learn new react concepts. Each project resides in its own dedicated folder.

css html javascript puppeteer react scss threejs typescript vite

Last synced: 21 Nov 2024

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website 📷

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/0xcadams/resume

Vue-based app to generate a Chase Adams resume.

puppeteer resume vuejs

Last synced: 28 Dec 2024

https://github.com/nkyazhin/puppeteer-rq

If you are writing puppeteer tests, and you want to mock your network responses easily – then this package will help you.

mocker puppeteer puppeteer-rq

Last synced: 25 Nov 2024

https://github.com/kernix13/puppeteer-web-scraper

How to use Puppeteer for web scaping

puppeteer

Last synced: 05 Jan 2025

https://github.com/ihoverlord/dx-currency

An API with Scrapped Data of 53 exchange rates against USD

api cheerio currency javascript nodejs puppeteer

Last synced: 05 Jan 2025

https://github.com/jhowbhz/scrap-consultaprocessos-rj

Esse é um caso de estudo sobre puppeteer

nodejs processos processos-rj puppeteer rj webscrap

Last synced: 27 Nov 2024

https://github.com/carelessinternet/schoolsoft-scraper

Unofficial SchoolSoft API made in Node.js

api node nodejs puppeteer puppeteer-core schoolsoft

Last synced: 29 Sep 2024

https://github.com/aliahmedm48/searchtweets

Node.js-based project that automates the process of scraping tweets from specified Twitter accounts to count mentions of stock tickers (e.g., $TSLA).

nodejs puppeteer twitter

Last synced: 21 Nov 2024

https://github.com/brightspace/d2l-beaker

A driver for Google Puppeteer to collect client-side performance metrics.

automation performance puppeteer

Last synced: 07 Jan 2025

https://github.com/rameshmane7218/get-cookies-from-url

Get-Cookies-From-Url

nodejs puppeteer

Last synced: 20 Dec 2024

https://github.com/hongzz0618/automated-test

unit testing e2e tests with Jest&puppeteer

e2e-tests jest puppeteer unittesting

Last synced: 28 Dec 2024

https://github.com/tokisakikurumi2001/crawl_data

Crawl data from weather site

pandas-dataframe puppeteer weather

Last synced: 22 Nov 2024

https://github.com/pedroaurelli/buy-scrapper

Web scrapper to observe e-commerce items to shop, and throw an user notification when prices down

nodejs puppeteer scrapper

Last synced: 02 Jan 2025

https://github.com/yandeu/jenkins-puppeteer-docker

Use Puppeteer on Jenkins on Docker with Node.js and Jest.

docker jenkins jest nodejs puppeteer

Last synced: 11 Dec 2024

https://github.com/lemonade-lab/lvyjs

为 nodejs 开发而设计的打包构建工具

esbuild lvyjs nodejs puppeteer rollup tsx

Last synced: 13 Jan 2025

https://github.com/canardconfit/puppeteer-docker

A simple docker image to run Puppeteer under arm64 architecture.

arm64 docker docker-image puppeteer

Last synced: 06 Dec 2024

https://github.com/apexcaptain/allergy-alert

오늘 날짜를 기준으로 모 대학의 학교 홈페이지에서 제공하는 식당 정보를 Crawling하여 회관별/메뉴 분류 별로 메뉴들과 메뉴 별 알러지 유발 식품에 대한 정보를 알려줍니다.

crawler docker expressjs puppeteer reactjs sqlite typescript

Last synced: 01 Dec 2024

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/capjavert/crawlathon

Winning solution for Crawlathon Hackathon by ReversingLabs

automation crawling hackathon hackathon-project puppeteer scraping

Last synced: 01 Dec 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/cavalluccijohann/scrapper-whentocop

Minimal repository for scraping websites like Whentocop and storing items in a database. This project utilizes TypeScript, Puppeteer, and PostgreSQL, with db0 as the database interface 🚀

bun commander db db0 docker docker-compose monorepo nuxt postgresql puppeteer scraper scraping scrapper ts typescript

Last synced: 22 Nov 2024

https://github.com/tanadelgigante/puppeteer-api-server

Api server to execute node.js scraping scripts

docker nodejs puppeteer scraping scripts

Last synced: 22 Nov 2024

https://github.com/archish27/rrweb-browser-test

RRWeb events to generating browser test scripts

cypress playwright puppeteer rrweb selenium

Last synced: 22 Nov 2024

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Oct 2024

https://github.com/aegis-dev/simple_mmo_simpler_bot

Simpler bot for SimpleMMO

bot js puppeteer

Last synced: 19 Nov 2024

https://github.com/robertoachar/screenshot-puppeteer

A playground for take a screenshot with Puppeteer.

playground puppeteer screenshot

Last synced: 26 Dec 2024

https://github.com/jglchen/web-scrape

This is a next.js framework site to demonstrate web scraping cases and my expertise in web scraping.

cheerio docker nextjs nodejs puppeteer reactjs

Last synced: 19 Nov 2024

https://github.com/hid-gs/simple-jest-puppeteer-runner

Docker container for jest tests using puppeteer

docker javascript jest public puppeteer tests

Last synced: 26 Nov 2024

https://github.com/ilhamlamp/menu-scrapper

learn scrapping with nest and puppeteer

nestjs puppeteer typescript

Last synced: 06 Dec 2024

https://github.com/mrwh1te/sam

Social Automation Manager aka Sam

automation electron puppeteer social-media

Last synced: 08 Dec 2024

https://github.com/demapy/flow

Flow - is an automatization builder tool that helps you automate repetitive tasks.

automation crypto javascript puppeteer react reactflow typescript zod

Last synced: 28 Nov 2024

https://github.com/tayyabmughal676/f1gpt_backend

Formula F1GPT Chat Unlock the power of AI-powered conversations! Built with Datastax, OpenAI, and more. Fork, explore, and enhance!

ai datastax genai genai-chatbot generative-ai gpt langchain langchain-js machine-learning ml open-source open-source-intelligence open-source-project openai openai-api puppeteer rag typescript

Last synced: 02 Jan 2025

https://github.com/rakashash/webscrapperandsummarise

This project Contains a node.js App(Backend) for WebScrapping a url with summarising the scrapped data using LLM models form groq and storing it in Postgres.

groq groq-integration nodejs postgresql puppeteer sequelize sequelize-orm

Last synced: 08 Dec 2024

https://github.com/ajit24/anakin-scrap

This repository contains the code in puppeteer and node.js to find the latitude and longitude of all locations in Singapore

expressjs nodejs puppeteer

Last synced: 02 Jan 2025

https://github.com/vgvr0/scraper-puppeteer

This project uses Puppeteer, a Node.js library which provides a high-level API to control Chrome or Chromium over the DevTools Protocol. Puppeteer runs headless by default, but can be configured to run full (non-headless) Chrome or Chromium.

node-js-scraper puppeteer puppeteer-scraper puppeteer-scraping

Last synced: 26 Nov 2024

https://github.com/rafinhadufluxo/losing

Buscador de cardápio do RU da UFFS, capturando em imagem em formato PNG 📸

javascript node-module nodejs puppet-module puppeteer puppeteer-screenshot

Last synced: 26 Dec 2024

https://github.com/anonymous961/scrapebooks

Just a repo to check puppeteer

neondb prisma puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/nerkarso/docker-puppeteer-example

This is a sample app that runs Puppeteer inside a Docker container

docker puppeteer

Last synced: 02 Dec 2024

https://github.com/situmorang-com/scrape-website-using-puppeteer-javascript

Scraping website such as amazon or tokopedia to automate notification using puppeteer in javascript

puppeteer scraper scraping-websites web-crawler web-scraping

Last synced: 26 Nov 2024

https://github.com/christianrich/generate-pdf-puppeteer

Generate a PDF with Puppeteer, Handlebars and Express

docker docker-compose express handlebars node-js pdf-generation puppeteer

Last synced: 29 Dec 2024

https://github.com/lameuler/astro-pdf

A simple Astro integration to generate PDFs from built pages.

astro astro-integration pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 23 Dec 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 83 博文 82 Packages 30 Utils 23 Integrations 17 包 14 Testing 13 Rendering and web scraping 12 Services 12 渲染和网页抓取 11 Reporters 10 Examples 10 Showcases 9 Language Support 9 测试 9 官方 9 Official 9 例子 8 License 6 Related 6