Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/flolu/bazel-node-puppeteer

Can't run Bazel nodejs_image with Puppeteer

bazel docker nodejs puppeteer rules-nodejs

Last synced: 09 Jan 2025

https://github.com/neulandagentur/adobe-stock-image-bot

📷 Adobe-Stock image id => author name

adobe adobe-stock bot puppeteer

Last synced: 29 Jan 2025

https://github.com/yarosj/crossdomain-selector

Retrieves a selector from another site by a screenshot

crossdomain puppeteer screenshot selector

Last synced: 29 Jan 2025

https://github.com/gabrielroot/notificado

Raspagem de dados (Web Scraping) no portal de notícias do IFNMG - Campus Januária

acessa campus-janu-ria hour nodejs notificado nunjucks postgresql puppeteer push-notifications pwa webscraping

Last synced: 28 Jan 2025

https://github.com/darkterminal/rest-screenshoot

REST Screenshoot is a free tool for capturing screenshots of webpages via a REST API. Free an always!

open-source puppeteer rest-api screenshoot

Last synced: 31 Dec 2024

https://github.com/ainoya/cloudflare-dom-distiller

A Cloudflare Workers-based API for extracting and converting web page content to Markdown using DOM-Distiller and Turndown.

cloudflare cloudflare-workers puppeteer

Last synced: 10 Oct 2024

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Oct 2024

https://github.com/kumarshivesh/aastey-newarrivals

Web Scraping data from E-Commerce Clothing Store Asstey

expressjs javascript nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/mhzmn/webscraper

A web scraper for drNutrition's products

nodejs puppeteer webscraper webscraping

Last synced: 18 Jan 2025

https://github.com/daviteixeira-dev/saucedemo-automation-with-puppeteer

Using the Puppeteer library to perform automated testing on Swag Labs' soucedemo.com website.

jest jest-puppeteer nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/tanadelgigante/puppeteer-api-server

Api server to execute node.js scraping scripts

docker nodejs puppeteer scraping scripts

Last synced: 23 Jan 2025

https://github.com/cavalluccijohann/scrapper-whentocop

Minimal repository for scraping websites like Whentocop and storing items in a database. This project utilizes TypeScript, Puppeteer, and PostgreSQL, with db0 as the database interface 🚀

bun commander db db0 docker docker-compose monorepo nuxt postgresql puppeteer scraper scraping scrapper ts typescript

Last synced: 23 Jan 2025

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automação que fornece informações dos elencos dos times da NBA. O sistema em questão é uma aplicação console que fornece opções de escolha, o usuário digita a opção que deseja e as informações são mostradas de acordo com essa opção.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Oct 2024

https://github.com/noriste/stackoverflow-52383438-cypress-issue

The same test run on Cypress/TestCafe/Puppeteer to check the strange behaviour of the former

cypress e2e-testing puppeteer testcafe

Last synced: 08 Feb 2025

https://github.com/joaopaulopmedeiros/playing-with-pptr

Using puppeteer for going to urls, accessing dom elements and taking screenshots

js puppeteer

Last synced: 30 Jan 2025

https://github.com/jonathanprojetos/open_food

Esta API fornece uma maneira simples de obter dados do site OpenFood usando Puppeteer. O website OpenFoodFacts é um website abrangente de produtos alimentícios, fornecendo informações detalhadas sobre ingredientes, valores nutricionais e muito mais.

nestjs nodejs puppeteer swagger

Last synced: 05 Feb 2025

https://github.com/sejori/instafans

Proof of concept instagram public profile scraper.

ejs express nodejs puppeteer scraper

Last synced: 02 Feb 2025

https://github.com/benelliott/linkedin-batch-unfollow

Quick Node.js script to batch-unfollow people on LinkedIn using Puppeteer.

connections inquirer linkedin puppeteer unfollow

Last synced: 24 Jan 2025

https://github.com/luminati-io/captcha-solver

Effortlessly bypass CAPTCHAs with Bright Data's CAPTCHA Solver, featuring automated solving, user emulation, fingerprinting, and a robust proxy network.

captcha captcha-solver javascript playwright puppeteer python scraping-browser selenium web-scraping web-unblocker

Last synced: 05 Feb 2025

https://github.com/shadowshahriar/ogimage-with-browsersync-puppeteer

Generating Open Graph Images for multiple files using Puppeteer and Browsersync.

browser-sync github-actions js nodejs opengraph-images puppeteer

Last synced: 29 Jan 2025

https://github.com/seanghay/puppeteer-google-fonts

A docker image of puppeteer with all Google Fonts installed.

google-fonts puppeteer

Last synced: 22 Jan 2025

https://github.com/yandeu/mocha-chai-nyc-puppeteer-example

Client/Server testing and code-coverage with Mocha, Chai, NYC (Istanbul) and Puppeteer

chai istanbul mocha nyc puppeteer

Last synced: 05 Feb 2025

https://github.com/richardhosler/nextjs-redis-puppeteer-screenshot-capture-tool

Small tool to capture screenshots of websites, learning Redis and puppeteer

nextjs puppeteer redis

Last synced: 29 Jan 2025

https://github.com/masreplay/html-to-image

Get s3 url from html file using node express

express html js nodejs puppeteer s3

Last synced: 05 Feb 2025

https://github.com/darioalbor/onepieceonline

Web Scraping of AnimeFLV to get all One Piece content in real-time 🍖🏴‍☠️

anime anime-scraper anime-streaming chakra-ui javascript puppeteer react scraping

Last synced: 19 Jan 2025

https://github.com/simran1002/event-web-scraper

Node.js scripts for web scraping events from Eventbrite, enhanced with Google search results. Extract, enrich, and analyze event data effortlessly for various applications.

cheerio eventbrite-api google-search-api nodejs puppeteer

Last synced: 21 Jan 2025

https://github.com/0x46616c6b/follower

Follow URLs and tracks redirects

http-client nodejs puppeteer

Last synced: 23 Jan 2025

https://github.com/apexcaptain/allergy-alert

오늘 날짜를 기준으로 모 대학의 학교 홈페이지에서 제공하는 식당 정보를 Crawling하여 회관별/메뉴 분류 별로 메뉴들과 메뉴 별 알러지 유발 식품에 대한 정보를 알려줍니다.

crawler docker expressjs puppeteer reactjs sqlite typescript

Last synced: 29 Jan 2025

https://github.com/gfeelixsantos/puppliberator

App de automação para geração e disponibilização de documentos.

fomantic-ui javascript nodejs puppeteer typescript webservices

Last synced: 08 Feb 2025

https://github.com/udofia2/pupetteer_google_search

A web application that automates Google searches using Puppeteer with two methods: manual CAPTCHA solving and 2captcha API integration.

express expressjs puppeteer typescript

Last synced: 08 Feb 2025

https://github.com/thomasjvu/entry-level-jobs-scraper

Job scraper for entry-level roles for the Ground Zero project

puppeteer supabase

Last synced: 22 Jan 2025

https://github.com/kazutoshiyoc/mattermost-tools

Tools for convenient use of Mattermost

mattermost nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/dieffrei/sfdx-docker-image

Docker image to support SFDX builds - It is based on sfdx docker image + aditionals sfdx plugins

puppeteer salesforce sfdx

Last synced: 08 Feb 2025

https://github.com/halo-design/halo-sentinel

ಠ_ಠ Scaffolding with the latest react components

eslint karma mobx mobx-react mocha puppeteer react-router-v4 react16 webpack3

Last synced: 31 Jan 2025

https://github.com/igor-starostenko/book-worm

Google maps bookmark import tool

automation bookmarks google-maps puppeteer

Last synced: 02 Feb 2025

https://github.com/sneethan/sunbird_scanner

A simple script to read GoFundMe and Chuffed URLs from a Supabase database and scrape info about them.

gofundme puppeteer supabase

Last synced: 29 Jan 2025

https://github.com/expelledboy/threejs-manual-generator

Single-page Three.js documentation generator for use as docs in Cursor AI

cursor-ai documentation puppeteer single-page threejs web-scraping

Last synced: 29 Jan 2025

https://github.com/samuel-adekunle/nike-buy-bot

Puppeteer bot to buy shoes from the UK SNKRS website

chromium nodejs puppeteer

Last synced: 05 Feb 2025

https://github.com/nerkarso/docker-puppeteer-example

Example to run Puppeteer inside a Docker container

docker puppeteer

Last synced: 29 Jan 2025

https://github.com/dkress59/screenshot-puppet

A nifty tool for Node.js to deliver screen shots via Express & Puppeteer

express express-js expressjs puppeteer puppeteer-screenshot

Last synced: 29 Jan 2025

https://github.com/oscarprdev/dev_resources

Simple resources site to store and list all the development resources I found insteresting. Developed with Typescript, Nextjs and Tailwind and a scrapping feature with Puppeteer.

nextjs postgresql puppeteer tailwind typescript

Last synced: 29 Jan 2025

https://github.com/yr72dpi/discordbotsitechecker

¤ Un bot Discord en NodeJs qui prend desnvoie le captures d'écran d'une URL spécifiée, puis envoie résultat dans un canal Discord avec le code HTTP.

discord nodejs puppeteer

Last synced: 05 Feb 2025

https://github.com/yr72dpi/mysql_error_google_scrapper

¤ This nodeJs script scrappes mysql errors found on google using puppeteer.

google mysql nodejs osint puppeteer scrapper scrapper-script

Last synced: 05 Feb 2025

https://github.com/bubblxs/steam-avatar-showcase

simple application that collects profile pictures from public steam profiles and publishes them on my tumblr.

javascript puppeteer steam tumblr web-scraping

Last synced: 01 Feb 2025

https://github.com/nkyazhin/puppeteer-rq

If you are writing puppeteer tests, and you want to mock your network responses easily – then this package will help you.

mocker puppeteer puppeteer-rq

Last synced: 25 Jan 2025

https://github.com/cityssm/node-faster-unofficial-api

An unofficial API for the FASTER Web fleet management system, relying on exported reports and complex parsers.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 23 Oct 2024

https://github.com/jhowbhz/scrap-consultaprocessos-rj

Esse é um caso de estudo sobre puppeteer

nodejs processos processos-rj puppeteer rj webscrap

Last synced: 26 Jan 2025

https://github.com/erenkucuker/amazon-asin-scraper

Webscraper api that allows get product data by asin from amazon

amazon asin express javascript puppeteer webscraping

Last synced: 05 Feb 2025

https://github.com/vermajay/internshala-automation

Automatically apply to internships on Internshala using Google's Puppeteer high level API for chrome

api automation chrome google internships puppeteer

Last synced: 13 Oct 2024

https://github.com/yandeu/jenkins-puppeteer-docker

Use Puppeteer on Jenkins on Docker with Node.js and Jest.

docker jenkins jest nodejs puppeteer

Last synced: 05 Feb 2025

https://github.com/capjavert/crawlathon

Winning solution for Crawlathon Hackathon by ReversingLabs

automation crawling hackathon hackathon-project puppeteer scraping

Last synced: 29 Jan 2025

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 05 Feb 2025

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 05 Feb 2025

https://github.com/olmesm/visual-regression-container

[WIP] Runs visual regression tests inside an alpine docker container.

blink-diff docker puppeteer visual-regression

Last synced: 08 Feb 2025

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 05 Feb 2025

https://github.com/hideack/node_shutter

puppeteerによるスクリーンショット取得するシンプルなAPIを提供

puppeteer

Last synced: 05 Feb 2025

https://github.com/anonymous961/scrapebooks

Just a repo to check puppeteer

neondb prisma puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/lucassimao/coinmarketcap-crawler

Crypto currencies market data from http://coinmarketcap.com/ crawled using puppteer + expressjs backend + Elasticsearch + React frontend

elasticsearch express nodejs puppeteer react

Last synced: 23 Jan 2025

https://github.com/megave/puppeteer-scripts

A few browser scripts made using puppeteer library in NodeJS

browser-automation nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/antoniowd/nitto-tire-crawler

Web scraper del sitio nittotire para la obtención de las características de sus neumáticos y analizar que autos pueden usarlo

mongodb nodejs puppeteer webcrawler webscraping

Last synced: 06 Feb 2025

https://github.com/showlotus/lansite

Forwarding pages between machines in a LAN

lan nuxt puppeteer

Last synced: 08 Feb 2025

https://github.com/teitei-tk/example-puppeteer-google-functions

example Puppeteer on Google Cloud functions

cloud-functions puppeteer

Last synced: 03 Feb 2025

https://github.com/damianravindupeiris/jobber-cli

A simple AI based Node-JS script to automate the job applying process.

ai nodejs open-ai puppeteer typescript web-scraping

Last synced: 05 Jan 2025

https://github.com/stopsopa/state-of-puppeteer

🎎Bunch of test of my own puppeteer extensions

extension extensions puppeteer

Last synced: 06 Feb 2025

https://github.com/stopsopa/docker-puppeteer-html-scraper

(Deprecated -> use better https://github.com/stopsopa/html-scraper-browserless) Microservice tool to scraping html from "any" page

docker html-scraper node nodejs puppeteer scraper

Last synced: 06 Feb 2025

https://github.com/zrna/cars-scraper

🚙 Scraping cars ads

javascript puppeteer scraper

Last synced: 09 Jan 2025

https://github.com/pioug/cookbook

Recipes to start my umpteenth dev projects.

cloud-run frontend javascript puppeteer rollup vuejs

Last synced: 17 Jan 2025

https://github.com/vaenow/crawler-chromeless

A chromeless crawler for coursera

chromeless coursera crawler puppeteer

Last synced: 06 Feb 2025

https://github.com/paveldymkov/puppeteer-io

Library for tests with Puppeteer using Jest or Mocha

headless-chrome puppeteer testing

Last synced: 30 Jan 2025

https://github.com/prantadas/nasa-fb

Description: The bot download a picuture from https://api.nasa.gov/planetary/apod and post it on facebook profile each day.

nasa-apod puppeteer typescript

Last synced: 22 Dec 2024

https://github.com/jprando/pdfserver

gerar relatorios em pdf com puppeteer

bun guambiarra pdf puppeteer relatorio rta

Last synced: 23 Dec 2024

https://github.com/miscos/discord-web-crawler

A puppeteer based webcrawler posting results to a discord webhook

discord puppeteer webcrawler

Last synced: 23 Dec 2024

https://github.com/jexniemi/browserless-action-runner

Run Puppeteer or Playwright web scraper (or other browser tasks) easily in headless mode as a GitHub Action

actions browser browserless chromium headless marketplace-action playwright puppeteer scraper scraping web

Last synced: 23 Dec 2024

https://github.com/thewrlck/quotz

A Node.js application demonstrating the use of Puppeteer and Orama SDK to create a quote database and search API.

expressjs orama puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/wasabina67/puppeteer-example

Puppeteer example

puppeteer

Last synced: 23 Dec 2024

https://github.com/evgeniyarbatov/location-testing

E2E testing of pages with location

expressjs location mocha puppeteer

Last synced: 23 Dec 2024

https://github.com/redaezziani/scrape-data-store-jolt

Product Scraper for Jolt Store is a robust tool designed to automate the collection of product data from e-commerce websites. This project leverages Puppeteer for web scraping and Prisma Client for seamless database management, ensuring efficient integration of external product data into the Jolt Store.

nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/shyamsunder149/problem-solving-tracker

A Tracker to track my solves around leetcode, gfg, codeforces and codchef. Just It will be satisfying for me to watch it

puppeteer scraping typescript

Last synced: 23 Dec 2024

https://github.com/muratsercann/book-price-agent

This application retrieves book prices from 5 different stores based on a search query. It uses React for the client-side interface, a Node.js API for the backend, and Puppeteer for web scraping.

expressjs nodejs puppeteer puppeteer-extra puppeteer-extra-plugin-stealth react

Last synced: 23 Dec 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer-example

Test code for the Docker image nodejs-puppeteer

docker nodejs puppeteer

Last synced: 23 Dec 2024

https://github.com/zaidkhalid44/irctc

Technologies used: JavaScript, Puppeteer, Tesseract.js, Jimp Description: Developed an automated system using Puppeteer and Tesseract.js to streamline IRCTC train ticket booking, handling login, captcha solving, and form filling. Automated login and form-filling tasks, reducing manual effort by approximately 90%.

jimp puppeteer tesseract

Last synced: 23 Dec 2024

https://github.com/sharif-minhaz/web-scraping-with-js

Web scraper extracts data from websites. In JavaScript, jsdom and Puppeteer are powerful tools for this task. jsdom is a lightweight DOM implementation that lets user manipulate and query static pages. Puppeteer is a Node.js library for controlling headless Chrome/Chromium, ideal for dynamic websites. It can simulate user interactions and take ss

bun jsdom puppeteer web-scraping

Last synced: 23 Dec 2024

https://github.com/jfmonsa/book_scrapper

A web scrapping CLI tool to get books and categories/subcategories from Z-Library

node-js postgresql puppeteer web-scraping z-lib z-library

Last synced: 23 Dec 2024

https://github.com/gabrielcstr/dota2protracker-scraper

Scraping meta heroes from dota2protracker.com

d2pt dota2 dota2protracker javascript puppeteer scraper

Last synced: 23 Dec 2024