Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/rushi0508/insta-reels-automation

Fetches the reels for different users including captions and stores it in AWS S3.

javascript nodejs puppeteer webscraping

Last synced: 21 Nov 2024

https://github.com/kumarshivesh/aastey-newarrivals

Web Scraping data from E-Commerce Clothing Store Asstey

expressjs javascript nodejs puppeteer

Last synced: 17 Nov 2024

https://github.com/mhzmn/webscraper

A web scraper for drNutrition's products

nodejs puppeteer webscraper webscraping

Last synced: 17 Nov 2024

https://github.com/akihokurino/goerli-charger

goerli faucet auto charge

lambda nodejs puppeteer

Last synced: 05 Dec 2024

https://github.com/crusaderincode/article-saver-bot

This bot listens to incoming messages for valid URLs. When a URL is provided, the bot fetches the website content and returns it as a PDF file.

bot html-pdf-converter html-pdf-service nodejs open-source pdf-generation puppeteer telegraf telegram telegram-bot webscraping

Last synced: 20 Nov 2024

https://github.com/evans-costa/screenshot-pipeline

Keep screenshots of your webpage up-to-date.

github-actions jest jest-snapshots puppeteer

Last synced: 17 Nov 2024

https://github.com/dsc712/webscrapping-in-nodejs

Web scrapping static and dynamic sites using fetch,cheerio and puppeteer

axios cheerio express nodejs puppeteer

Last synced: 17 Nov 2024

https://github.com/60late/node.js-crawler

使用node.js+puppeteer+node-xlsx 爬取某网站数据并且导出到excel中的demo

node-xlsx nodejs puppeteer

Last synced: 17 Nov 2024

https://github.com/dzmitry-duboyski/automation-framework-using-jest-and-puppeteer

Part #5: Automation Framework using Jest and Puppeteer for course https://www.udemy.com/course/automated-headless-browser-testing-with-puppeteer/

jest puppeteer

Last synced: 12 Jan 2025

https://github.com/dm94/another-autologin

Daily auto login to get things done

autologin nodejs puppeteer

Last synced: 06 Jan 2025

https://github.com/neulandagentur/adobe-stock-image-bot

📷 Adobe-Stock image id => author name

adobe adobe-stock bot puppeteer

Last synced: 30 Nov 2024

https://github.com/silverbirder/silver-enigma

this repository is the tool to monitor the visual regression.

backstopjs circleci montoring puppeteer

Last synced: 20 Nov 2024

https://github.com/optimics/docker-puppeteer

Docker image that includes everything needed to run Puppeteer.js on Bitbucket Pipelines

bitbucket-pipelines docker nodejs puppeteer

Last synced: 06 Jan 2025

https://github.com/samthor/headless-test

Run Mocha tests in a headless browser

http mocha puppeteer test

Last synced: 17 Nov 2024

https://github.com/shuuji3/pukiwiki-bot

🥝 Bot to publish articles to Pukiwiki site

pukiwiki puppeteer

Last synced: 29 Nov 2024

https://github.com/beckkramer/puppeteer-traverse

Puppeteer utility to easily run a function you define per route on a set of routes.

crawler crawling nodejs puppeteer

Last synced: 18 Nov 2024

https://github.com/dutragames/bot-de-felicidades-facebook

Um simples bot que envia felicidades aos seus amigos no face!

bot facebook html-css-javascript nodejs puppeteer

Last synced: 18 Nov 2024

https://github.com/shadowshahriar/ogimage-with-browsersync-puppeteer

Generating Open Graph Images for multiple files using Puppeteer and Browsersync.

browser-sync github-actions js nodejs opengraph-images puppeteer

Last synced: 30 Nov 2024

https://github.com/seanghay/puppeteer-google-fonts

A docker image of puppeteer with all Google Fonts installed.

google-fonts puppeteer

Last synced: 22 Nov 2024

https://github.com/volodymyr-kasap/puppeteer-div-screenshot

Example of how to take a screenshot of each HTML block using puppeteer and sharp

puppeteer screenshot sharp typescript

Last synced: 07 Dec 2024

https://github.com/yusukeiwaki/capybara-puppeteer-driver

Headless Chrome driver for Capybara using puppeteer-ruby

capybara puppeteer

Last synced: 07 Dec 2024

https://github.com/yordadev/yorviewer

Yorviewer is a simple view bot that utilizes proxies and incognito.

bot nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/simran1002/event-web-scraper

Node.js scripts for web scraping events from Eventbrite, enhanced with Google search results. Extract, enrich, and analyze event data effortlessly for various applications.

cheerio eventbrite-api google-search-api nodejs puppeteer

Last synced: 20 Nov 2024

https://github.com/hamzahussyn/daraz-data-scrapper

Scrapes data from the site Daraz.pk and saves in a json file.

daraz darazpk data-science puppeteer scra scrapper

Last synced: 18 Nov 2024

https://github.com/se-madhusudan/puppeteer-demo

Screenshot and pdf generation with puppeteer, image-size, and pdfkit

image-size pdf pdfkit puppeteer screenshot

Last synced: 12 Jan 2025

https://github.com/konglingwen94/scraper

批量抓取社交平台数据的脚本库

javascript nodejs puppeteer

Last synced: 25 Dec 2024

https://github.com/trankhacbinhduong/nuxt-pdf-utils

Doing amazing things about pdf in the nuxt app :tada:

nuxt pdf-generation puppeteer

Last synced: 25 Dec 2024

https://github.com/devstar2004/sotodata

You can find any firm lawyers over the world.

css html linkedin nodejs php puppeteer webscraping

Last synced: 24 Nov 2024

https://github.com/zukarusan/chaant

Automation for playing chess in websites using puppeteer

api chess chess-bot chess-game chesscom javascript lichess puppeteer typescript

Last synced: 18 Nov 2024

https://github.com/chaudinh/insta-downloadeer

A NodeJS app for downloading Instagram "awesome" images. Actually for practicing "Clean Code" purpose :)

fs image-downloader instagram javascript nodejs puppeteer

Last synced: 18 Nov 2024

https://github.com/rushi0508/razorpay-attendance-automation

Will trigger github action as cron job and will mark my attendance in the razorpay application.

javascript puppeteer razorpay

Last synced: 12 Jan 2025

https://github.com/pigloverabbit520/salamandernodepuppeteer

Node官方镜像的基础上安装了puppeteer的依赖

nodejs puppeteer

Last synced: 18 Nov 2024

https://github.com/yammerjp/pocket-list

A list of websites in getpocket.com (third party application)

nextjs pocket puppeteer react

Last synced: 28 Dec 2024

https://github.com/agitmit/webpilot

WebPilot is a powerful, open-source, self-hosted tool that wraps headless browsers in a robust REST API, enabling seamless remote browser automation, page session management, in-memory isolation and more.

automation chromium headless-browsers open-source puppeteer remote-control rest-api scraping web webscraping

Last synced: 21 Nov 2024

https://github.com/arbaaz/puppeteer-typescript

A template to get started with puppeteer in typescript

puppeteer typescript

Last synced: 05 Dec 2024

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Nov 2024

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Nov 2024

https://github.com/mauricioromagnollo/currency-bot-conversor

A simple robot to convert currencies using Node JS and Puppeteer.

nodejs puppeteer typescript

Last synced: 07 Dec 2024

https://github.com/luqueee/moodle-rest-scraper

Rest API express with puppeteer library for scraping information of a user

express moodle puppeteer

Last synced: 21 Nov 2024

https://github.com/thomasjvu/entry-level-jobs-scraper

Job scraper for entry-level roles for the Ground Zero project

puppeteer supabase

Last synced: 21 Nov 2024

https://github.com/kazutoshiyoc/mattermost-tools

Tools for convenient use of Mattermost

mattermost nodejs puppeteer

Last synced: 21 Nov 2024

https://github.com/mycase/puppeteer-har-server

An HTTP server that exposes functionality offered by puppeteer-har

har puppeteer puppeteer-har

Last synced: 21 Nov 2024

https://github.com/gabrielimartins7/robo_extrai_dados

Extraindo dados de outros sites com Puppeteer JS :robot:

instagram javascript puppeteer

Last synced: 24 Dec 2024

https://github.com/mpirescarvalho/image-generator

Image generator with Next.js server side rendering 🌀

nextjs puppeteer serverless ssg ssr vercel

Last synced: 21 Nov 2024

https://github.com/arumie/recipe-scraper

Scraper for scraping recipes

deno puppeteer typescript

Last synced: 28 Nov 2024

https://github.com/justshush/whatsapp-bot

This is a whatsapp bot that sends a message repeatedly to a person on your contacts.

bot nodejs puppeteer whatsapp whatsapp-web

Last synced: 25 Nov 2024

https://github.com/dieffrei/sfdx-docker-image

Docker image to support SFDX builds - It is based on sfdx docker image + aditionals sfdx plugins

puppeteer salesforce sfdx

Last synced: 15 Dec 2024

https://github.com/callaginn/kroger-sweeper

Download and categorize receipts from Kroger.com by scraping a user's purchases with puppeteer and playwright.

kroger kroger-api nodejs orders playwright puppeteer purchases receipt receipt-parser receipts scrape scraper

Last synced: 21 Nov 2024

https://github.com/adrianomonteiroweb/simplified-application-robot

Sistema para aplicação em vagas simplificadas no LinkedIn.

javascript nodejs object-oriented-programming poo puppeteer

Last synced: 21 Nov 2024

https://github.com/adrianomonteiroweb/scraping-puppeteer-express

Projeto para estudos de web scraping com puppeteer + express.

express expressjs nodejs pug puppeteer

Last synced: 21 Nov 2024

https://github.com/adrianomonteiroweb/puppeteer-studying

Repositório de estudos em Puppeteer.

javascript nodejs puppeteer

Last synced: 21 Nov 2024

https://github.com/creativeprojects/gallerydownloader

Download images from a webpage using headless chrome

puppeteer

Last synced: 05 Jan 2025

https://github.com/dgvalerio/timesheet-express-assistant

Back-end of timesheet-next-assistant

express puppeteer typescript

Last synced: 21 Nov 2024

https://github.com/richardhosler/nextjs-redis-puppeteer-screenshot-capture-tool

Small tool to capture screenshots of websites, learning Redis and puppeteer

nextjs puppeteer redis

Last synced: 01 Dec 2024

https://github.com/expelledboy/threejs-manual-generator

Single-page Three.js documentation generator for use as docs in Cursor AI

cursor-ai documentation puppeteer single-page threejs web-scraping

Last synced: 01 Dec 2024

https://github.com/jedrzejratajczak/scraper

Web Scraper with Discord Bot running as Windows process

cron discord-bot puppeteer sqlite web-scraping windows-process

Last synced: 28 Dec 2024

https://github.com/sirok1/lolz-auto-contests

Lolzteam | zelenka.guru app for auto-participation in draws

discord-webhook nodejs puppeteer telegram-bot

Last synced: 16 Nov 2024

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website 📷

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/oscarprdev/dev_resources

Simple resources site to store and list all the development resources I found insteresting. Developed with Typescript, Nextjs and Tailwind and a scrapping feature with Puppeteer.

nextjs postgresql puppeteer tailwind typescript

Last synced: 01 Dec 2024

https://github.com/maximemoreillon/ebanking_scraper

A web scraper for account balance and transactions on an e-banking interface

puppeteer

Last synced: 21 Nov 2024

https://github.com/maximemoreillon/ts3_scraper

Scraper designed to retrieve the list of transactions of a TS3 corporate credit card.

credit-card puppeteer ts3

Last synced: 21 Nov 2024

https://github.com/0xcadams/resume

Vue-based app to generate a Chase Adams resume.

puppeteer resume vuejs

Last synced: 28 Dec 2024

https://github.com/kernix13/puppeteer-web-scraper

How to use Puppeteer for web scaping

puppeteer

Last synced: 05 Jan 2025

https://github.com/nkyazhin/puppeteer-rq

If you are writing puppeteer tests, and you want to mock your network responses easily – then this package will help you.

mocker puppeteer puppeteer-rq

Last synced: 25 Nov 2024

https://github.com/ihoverlord/dx-currency

An API with Scrapped Data of 53 exchange rates against USD

api cheerio currency javascript nodejs puppeteer

Last synced: 05 Jan 2025

https://github.com/rameshmane7218/get-cookies-from-url

Get-Cookies-From-Url

nodejs puppeteer

Last synced: 20 Dec 2024

https://github.com/jhowbhz/scrap-consultaprocessos-rj

Esse é um caso de estudo sobre puppeteer

nodejs processos processos-rj puppeteer rj webscrap

Last synced: 27 Nov 2024

https://github.com/hongzz0618/automated-test

unit testing e2e tests with Jest&puppeteer

e2e-tests jest puppeteer unittesting

Last synced: 28 Dec 2024

https://github.com/lemonade-lab/lvyjs

为 nodejs 开发而设计的打包构建工具

esbuild lvyjs nodejs puppeteer rollup tsx

Last synced: 13 Jan 2025

https://github.com/tokisakikurumi2001/crawl_data

Crawl data from weather site

pandas-dataframe puppeteer weather

Last synced: 22 Nov 2024

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Oct 2024

https://github.com/capjavert/crawlathon

Winning solution for Crawlathon Hackathon by ReversingLabs

automation crawling hackathon hackathon-project puppeteer scraping

Last synced: 01 Dec 2024

https://github.com/cavalluccijohann/scrapper-whentocop

Minimal repository for scraping websites like Whentocop and storing items in a database. This project utilizes TypeScript, Puppeteer, and PostgreSQL, with db0 as the database interface 🚀

bun commander db db0 docker docker-compose monorepo nuxt postgresql puppeteer scraper scraping scrapper ts typescript

Last synced: 22 Nov 2024

https://github.com/tanadelgigante/puppeteer-api-server

Api server to execute node.js scraping scripts

docker nodejs puppeteer scraping scripts

Last synced: 22 Nov 2024

https://github.com/archish27/rrweb-browser-test

RRWeb events to generating browser test scripts

cypress playwright puppeteer rrweb selenium

Last synced: 22 Nov 2024

https://github.com/hid-gs/simple-jest-puppeteer-runner

Docker container for jest tests using puppeteer

docker javascript jest public puppeteer tests

Last synced: 26 Nov 2024

https://github.com/mrwh1te/sam

Social Automation Manager aka Sam

automation electron puppeteer social-media

Last synced: 08 Dec 2024

https://github.com/rakashash/webscrapperandsummarise

This project Contains a node.js App(Backend) for WebScrapping a url with summarising the scrapped data using LLM models form groq and storing it in Postgres.

groq groq-integration nodejs postgresql puppeteer sequelize sequelize-orm

Last synced: 08 Dec 2024

https://github.com/vgvr0/scraper-puppeteer

This project uses Puppeteer, a Node.js library which provides a high-level API to control Chrome or Chromium over the DevTools Protocol. Puppeteer runs headless by default, but can be configured to run full (non-headless) Chrome or Chromium.

node-js-scraper puppeteer puppeteer-scraper puppeteer-scraping

Last synced: 26 Nov 2024

https://github.com/lameuler/astro-pdf

A simple Astro integration to generate PDFs from built pages.

astro astro-integration pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/nerkarso/docker-puppeteer-example

This is a sample app that runs Puppeteer inside a Docker container

docker puppeteer

Last synced: 02 Dec 2024