Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/captaincluster/sitesnap

A program that uses Puppeteer to visit the url given by the user and take a screenshot. The screenshot will then be saved for the user to view.

javascript nodejs puppeteer screenshot

Last synced: 31 Dec 2024

https://github.com/samthor/headless-test

Run Mocha tests in a headless browser

http mocha puppeteer test

Last synced: 18 Jan 2025

https://github.com/yordadev/yorviewer

Yorviewer is a simple view bot that utilizes proxies and incognito.

bot nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/konglingwen94/scraper

批量抓取社交平台数据的脚本库

javascript nodejs puppeteer

Last synced: 25 Dec 2024

https://github.com/evertonpavan/node-web-scraper-braesul

A web scraper built with Node.js using Puppeteer to get data of Braé Sul

javascript nodejs puppeteer

Last synced: 21 Jan 2025

https://github.com/trankhacbinhduong/nuxt-pdf-utils

Doing amazing things about pdf in the nuxt app :tada:

nuxt pdf-generation puppeteer

Last synced: 25 Dec 2024

https://github.com/mauricioromagnollo/currency-bot-conversor

A simple robot to convert currencies using Node JS and Puppeteer.

nodejs puppeteer typescript

Last synced: 02 Feb 2025

https://github.com/tokisakikurumi2001/crawl_data

Crawl data from weather site

pandas-dataframe puppeteer weather

Last synced: 22 Jan 2025

https://github.com/yammerjp/pocket-list

A list of websites in getpocket.com (third party application)

nextjs pocket puppeteer react

Last synced: 28 Dec 2024

https://github.com/oxylabs/bypass-captcha-puppeteer

A comprehensive tutorial with real code samples to learn how to bypass CAPTCHA with Puppeteer.

captcha puppeteer web-scraping

Last synced: 05 Feb 2025

https://github.com/flolu/bazel-node-puppeteer

Can't run Bazel nodejs_image with Puppeteer

bazel docker nodejs puppeteer rules-nodejs

Last synced: 09 Jan 2025

https://github.com/neulandagentur/adobe-stock-image-bot

📷 Adobe-Stock image id => author name

adobe adobe-stock bot puppeteer

Last synced: 29 Jan 2025

https://github.com/yarosj/crossdomain-selector

Retrieves a selector from another site by a screenshot

crossdomain puppeteer screenshot selector

Last synced: 29 Jan 2025

https://github.com/gabrielroot/notificado

Raspagem de dados (Web Scraping) no portal de notícias do IFNMG - Campus Januária

acessa campus-janu-ria hour nodejs notificado nunjucks postgresql puppeteer push-notifications pwa webscraping

Last synced: 28 Jan 2025

https://github.com/darkterminal/rest-screenshoot

REST Screenshoot is a free tool for capturing screenshots of webpages via a REST API. Free an always!

open-source puppeteer rest-api screenshoot

Last synced: 31 Dec 2024

https://github.com/gabrielimartins7/robo_extrai_dados

Extraindo dados de outros sites com Puppeteer JS :robot:

instagram javascript puppeteer

Last synced: 24 Dec 2024

https://github.com/creativeprojects/gallerydownloader

Download images from a webpage using headless chrome

puppeteer

Last synced: 05 Jan 2025

https://github.com/jedrzejratajczak/scraper

Web Scraper with Discord Bot running as Windows process

cron discord-bot puppeteer sqlite web-scraping windows-process

Last synced: 28 Dec 2024

https://github.com/luminati-io/javascript-scraping-libraries

The top JavaScript web scraping libraries, featuring key tools like Playwright, Puppeteer, and Cheerio, for efficient and scalable data extraction.

axios cheerio crawlee javascript node-curl nodejs playwright puppeteer web-scraping

Last synced: 20 Jan 2025

https://github.com/kumarshivesh/aastey-newarrivals

Web Scraping data from E-Commerce Clothing Store Asstey

expressjs javascript nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/mhzmn/webscraper

A web scraper for drNutrition's products

nodejs puppeteer webscraper webscraping

Last synced: 18 Jan 2025

https://github.com/tanadelgigante/puppeteer-api-server

Api server to execute node.js scraping scripts

docker nodejs puppeteer scraping scripts

Last synced: 23 Jan 2025

https://github.com/cavalluccijohann/scrapper-whentocop

Minimal repository for scraping websites like Whentocop and storing items in a database. This project utilizes TypeScript, Puppeteer, and PostgreSQL, with db0 as the database interface 🚀

bun commander db db0 docker docker-compose monorepo nuxt postgresql puppeteer scraper scraping scrapper ts typescript

Last synced: 23 Jan 2025

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website 📷

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/noriste/stackoverflow-52383438-cypress-issue

The same test run on Cypress/TestCafe/Puppeteer to check the strange behaviour of the former

cypress e2e-testing puppeteer testcafe

Last synced: 08 Feb 2025

https://github.com/0xcadams/resume

Vue-based app to generate a Chase Adams resume.

puppeteer resume vuejs

Last synced: 28 Dec 2024

https://github.com/kernix13/puppeteer-web-scraper

How to use Puppeteer for web scaping

puppeteer

Last synced: 05 Jan 2025

https://github.com/jonathanprojetos/open_food

Esta API fornece uma maneira simples de obter dados do site OpenFood usando Puppeteer. O website OpenFoodFacts é um website abrangente de produtos alimentícios, fornecendo informações detalhadas sobre ingredientes, valores nutricionais e muito mais.

nestjs nodejs puppeteer swagger

Last synced: 05 Feb 2025

https://github.com/ribeirogab/puppeteer-currency-converter

Project to test the functionalities of the Node.js (version >= 13.4) using Puppeteer

currency-converter nodejs puppeteer scraper top-level-await

Last synced: 20 Jan 2025

https://github.com/ihoverlord/dx-currency

An API with Scrapped Data of 53 exchange rates against USD

api cheerio currency javascript nodejs puppeteer

Last synced: 05 Jan 2025

https://github.com/benelliott/linkedin-batch-unfollow

Quick Node.js script to batch-unfollow people on LinkedIn using Puppeteer.

connections inquirer linkedin puppeteer unfollow

Last synced: 24 Jan 2025

https://github.com/luminati-io/captcha-solver

Effortlessly bypass CAPTCHAs with Bright Data's CAPTCHA Solver, featuring automated solving, user emulation, fingerprinting, and a robust proxy network.

captcha captcha-solver javascript playwright puppeteer python scraping-browser selenium web-scraping web-unblocker

Last synced: 05 Feb 2025

https://github.com/shadowshahriar/ogimage-with-browsersync-puppeteer

Generating Open Graph Images for multiple files using Puppeteer and Browsersync.

browser-sync github-actions js nodejs opengraph-images puppeteer

Last synced: 29 Jan 2025

https://github.com/doczilla-app/issues

This is the space where you can engage with us directly, report any issues you encounter, request new features, or propose updates to our documentation.

html-to-image html-to-pdf html-to-pdf-api html2image html2pdf puppeteer

Last synced: 26 Jan 2025

https://github.com/rameshmane7218/get-cookies-from-url

Get-Cookies-From-Url

nodejs puppeteer

Last synced: 20 Dec 2024

https://github.com/seanghay/puppeteer-google-fonts

A docker image of puppeteer with all Google Fonts installed.

google-fonts puppeteer

Last synced: 22 Jan 2025

https://github.com/yandeu/mocha-chai-nyc-puppeteer-example

Client/Server testing and code-coverage with Mocha, Chai, NYC (Istanbul) and Puppeteer

chai istanbul mocha nyc puppeteer

Last synced: 05 Feb 2025

https://github.com/richardhosler/nextjs-redis-puppeteer-screenshot-capture-tool

Small tool to capture screenshots of websites, learning Redis and puppeteer

nextjs puppeteer redis

Last synced: 29 Jan 2025

https://github.com/masreplay/html-to-image

Get s3 url from html file using node express

express html js nodejs puppeteer s3

Last synced: 05 Feb 2025

https://github.com/darioalbor/onepieceonline

Web Scraping of AnimeFLV to get all One Piece content in real-time 🍖🏴‍☠️

anime anime-scraper anime-streaming chakra-ui javascript puppeteer react scraping

Last synced: 19 Jan 2025

https://github.com/hongzz0618/automated-test

unit testing e2e tests with Jest&puppeteer

e2e-tests jest puppeteer unittesting

Last synced: 28 Dec 2024

https://github.com/simran1002/event-web-scraper

Node.js scripts for web scraping events from Eventbrite, enhanced with Google search results. Extract, enrich, and analyze event data effortlessly for various applications.

cheerio eventbrite-api google-search-api nodejs puppeteer

Last synced: 21 Jan 2025

https://github.com/lemonade-lab/lvyjs

为 nodejs 开发而设计的打包构建工具

esbuild lvyjs nodejs puppeteer rollup tsx

Last synced: 13 Jan 2025

https://github.com/0x46616c6b/follower

Follow URLs and tracks redirects

http-client nodejs puppeteer

Last synced: 23 Jan 2025

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/apexcaptain/allergy-alert

오늘 날짜를 기준으로 모 대학의 학교 홈페이지에서 제공하는 식당 정보를 Crawling하여 회관별/메뉴 분류 별로 메뉴들과 메뉴 별 알러지 유발 식품에 대한 정보를 알려줍니다.

crawler docker expressjs puppeteer reactjs sqlite typescript

Last synced: 29 Jan 2025

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Oct 2024

https://github.com/gfeelixsantos/puppliberator

App de automação para geração e disponibilização de documentos.

fomantic-ui javascript nodejs puppeteer typescript webservices

Last synced: 08 Feb 2025

https://github.com/udofia2/pupetteer_google_search

A web application that automates Google searches using Puppeteer with two methods: manual CAPTCHA solving and 2captcha API integration.

express expressjs puppeteer typescript

Last synced: 08 Feb 2025

https://github.com/thomasjvu/entry-level-jobs-scraper

Job scraper for entry-level roles for the Ground Zero project

puppeteer supabase

Last synced: 22 Jan 2025

https://github.com/kazutoshiyoc/mattermost-tools

Tools for convenient use of Mattermost

mattermost nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/cityssm/node-faster-report-exporter

On demand exports of selected reports from the FASTER Web Fleet Management System.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 11 Nov 2024

https://github.com/dieffrei/sfdx-docker-image

Docker image to support SFDX builds - It is based on sfdx docker image + aditionals sfdx plugins

puppeteer salesforce sfdx

Last synced: 08 Feb 2025

https://github.com/halo-design/halo-sentinel

ಠ_ಠ Scaffolding with the latest react components

eslint karma mobx mobx-react mocha puppeteer react-router-v4 react16 webpack3

Last synced: 31 Jan 2025

https://github.com/lameuler/astro-pdf

A simple Astro integration to generate PDFs from built pages.

astro astro-integration pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 23 Dec 2024

https://github.com/sneethan/sunbird_scanner

A simple script to read GoFundMe and Chuffed URLs from a Supabase database and scrape info about them.

gofundme puppeteer supabase

Last synced: 29 Jan 2025

https://github.com/expelledboy/threejs-manual-generator

Single-page Three.js documentation generator for use as docs in Cursor AI

cursor-ai documentation puppeteer single-page threejs web-scraping

Last synced: 29 Jan 2025

https://github.com/christiancesar/hunter

Scraping of the target web application, using puppeeter, node with typescript and best practices.

backend ddd factory-pattern fullstack-development mongodb-atlas nodejs observer-pattern poo puppeteer react tdd typescript

Last synced: 10 Oct 2024

https://github.com/samuel-adekunle/nike-buy-bot

Puppeteer bot to buy shoes from the UK SNKRS website

chromium nodejs puppeteer

Last synced: 05 Feb 2025

https://github.com/nerkarso/docker-puppeteer-example

Example to run Puppeteer inside a Docker container

docker puppeteer

Last synced: 29 Jan 2025

https://github.com/dkress59/screenshot-puppet

A nifty tool for Node.js to deliver screen shots via Express & Puppeteer

express express-js expressjs puppeteer puppeteer-screenshot

Last synced: 29 Jan 2025

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel 蓋棉被純聊天.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/oscarprdev/dev_resources

Simple resources site to store and list all the development resources I found insteresting. Developed with Typescript, Nextjs and Tailwind and a scrapping feature with Puppeteer.

nextjs postgresql puppeteer tailwind typescript

Last synced: 29 Jan 2025

https://github.com/yr72dpi/discordbotsitechecker

¤ Un bot Discord en NodeJs qui prend desnvoie le captures d'écran d'une URL spécifiée, puis envoie résultat dans un canal Discord avec le code HTTP.

discord nodejs puppeteer

Last synced: 05 Feb 2025

https://github.com/yr72dpi/mysql_error_google_scrapper

¤ This nodeJs script scrappes mysql errors found on google using puppeteer.

google mysql nodejs osint puppeteer scrapper scrapper-script

Last synced: 05 Feb 2025

https://github.com/nkyazhin/puppeteer-rq

If you are writing puppeteer tests, and you want to mock your network responses easily – then this package will help you.

mocker puppeteer puppeteer-rq

Last synced: 25 Jan 2025

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicação console que fornece informações dos elencos, próximas partidas e notícias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 10 Oct 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer

NodeJs version with all dependencies to run Puppeteer

docker nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/jhowbhz/scrap-consultaprocessos-rj

Esse é um caso de estudo sobre puppeteer

nodejs processos processos-rj puppeteer rj webscrap

Last synced: 26 Jan 2025

https://github.com/erenkucuker/amazon-asin-scraper

Webscraper api that allows get product data by asin from amazon

amazon asin express javascript puppeteer webscraping

Last synced: 05 Feb 2025

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Oct 2024

https://github.com/ashnel3/usherd

command-line puppeteer script manager

puppeteer web-scraping

Last synced: 20 Dec 2024

https://github.com/capjavert/crawlathon

Winning solution for Crawlathon Hackathon by ReversingLabs

automation crawling hackathon hackathon-project puppeteer scraping

Last synced: 29 Jan 2025

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 05 Feb 2025

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 05 Feb 2025

https://github.com/olmesm/visual-regression-container

[WIP] Runs visual regression tests inside an alpine docker container.

blink-diff docker puppeteer visual-regression

Last synced: 08 Feb 2025

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 05 Feb 2025

https://github.com/hideack/node_shutter

puppeteerによるスクリーンショット取得するシンプルなAPIを提供

puppeteer

Last synced: 05 Feb 2025

https://github.com/volodymyr-kasap/puppeteer-div-screenshot

Example of how to take a screenshot of each HTML block using puppeteer and sharp

puppeteer screenshot sharp typescript

Last synced: 02 Feb 2025

https://github.com/lucassimao/coinmarketcap-crawler

Crypto currencies market data from http://coinmarketcap.com/ crawled using puppteer + expressjs backend + Elasticsearch + React frontend

elasticsearch express nodejs puppeteer react

Last synced: 23 Jan 2025

https://github.com/patrickschababerle/schabbi-webscraper

Small and easy to use NodeJS webcrawler project. Returns basic information about the crawled sites.

crawler puppeteer scraper scraping web-crawler

Last synced: 09 Feb 2025

https://github.com/antoniowd/nitto-tire-crawler

Web scraper del sitio nittotire para la obtención de las características de sus neumáticos y analizar que autos pueden usarlo

mongodb nodejs puppeteer webcrawler webscraping

Last synced: 06 Feb 2025

https://github.com/yusukeiwaki/capybara-puppeteer-driver

Headless Chrome driver for Capybara using puppeteer-ruby

capybara puppeteer

Last synced: 02 Feb 2025

https://github.com/heronlabs/node-alpine-puppeteer

Image for Node Alpine with Puppeteer

docker docker-hub docker-image node nodejs puppeteer

Last synced: 13 Jan 2025