Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/git-bhanu/scrapewave

🕷️ ScrapeWave: Dockerized web scraping using puppeteer.

chromium docker express javascript nodejs pinia-vuejs puppeteer socket-io sqlite3 vite vuejs3 vuetify

Last synced: 11 Jan 2025

https://github.com/leocode/puppeteer-service

Containerized Puppeteer which allows to render images and PDFs of given webpage or HTML code

docker pdf puppeteer screenshot

Last synced: 14 Feb 2025

https://github.com/thenamevishnu/web-screenshot

Leverages Puppeteer for seamless website screenshot capture. Input your desired URL, run the script, and obtain crisp snapshots. A user-friendly tool for developers and testers simplifying the process of website visualization.

node-telegram-bot-api nodejs puppeteer telegram-bot-api

Last synced: 12 Jan 2025

https://github.com/kunal00000/alertbounties

Get alerts for new bounties on Algora

puppeteer resend-email scrapper

Last synced: 12 Jan 2025

https://github.com/lastlink/re-store

for small business week 2019 #SmallBusinessWeek

nodejs parcel php puppeteer python serveo small small-business vuejs

Last synced: 19 Jan 2025

https://github.com/pottava/docker-puppeteer

GoogleChrome/puppeteer docker images

docker puppeteer

Last synced: 14 Feb 2025

https://github.com/condef5/freecodecamp-scraping

💻 App with webscraping to get the users score of freecodecamp

javascript node puppeteer webscraping

Last synced: 25 Jan 2025

https://github.com/pdsuwwz/koa-playwright-server

🎭 Playwright 实现的 Node.js 中间件 API 服务, 替换 Puppeteer, 基于 ESM + Rollup + Koa + TypeScript + Nodemon + PM2 + ESLint (v9) 用于快速爬取并合并多网页到 PDF 文件、图片高保真快照, 支持热更新、Cookie 、水印、页眉页脚注入

es generator module pdf playwright puppeteer rollup typescript upgrade

Last synced: 07 Feb 2025

https://github.com/gpenverne/pyppettheater

A simple way to make functionnal tests using Gherkin and puppeteer

gherkin puppeteer pyppeteer python

Last synced: 07 Feb 2025

https://github.com/afsh7n/crawly-automation

Crawly Automation is a lightweight, modular, and extensible web crawling framework built on top of Puppeteer. Whether you need to scrape data, automate browser interactions, manage CAPTCHAs, or handle advanced data extraction, Crawly Automation simplifies the process.

automation crawler nodejs puppeteer webscraping

Last synced: 07 Feb 2025

https://github.com/galaxiat/galaxiat.serve.seo

Node.JS package to serve React app and prerender path (cron)

crawler cron puppeteer seo seo-optimization ssr

Last synced: 15 Feb 2025

https://github.com/n0ky4/pcbusca

🔍 pesquisa simultânea de produtos de informática

price-comparison puppeteer web-scraping

Last synced: 08 Feb 2025

https://github.com/womb0comb0/gdsc-farmingdale-links-api

This initiative aims to offer a compelling alternative for GDSC communities seeking efficient means to keep their members informed.

api cheerio css express html javascript puppeteer pwa typescript vite

Last synced: 26 Dec 2024

https://github.com/lampask/educli

Tool to get your time restricted edupage tests instantly.

cli cli-app edupage node-js puppeteer typescript web-automation

Last synced: 09 Feb 2025

https://github.com/noriste/feti-workshop-e2e-testing-with-puppeteer

The reference repo of a workshop for FETI about browser automation (both for E2E testing and for web scraping) with Puppeteer. Workshop level: basic.

e2e-testing e2e-tests puppeteer scraping-websites testing-tools web

Last synced: 15 Feb 2025

https://github.com/urijhoruzij/parser

Parser that allows you to upload images of products from online stores.

node-js nodejs parser puppeteer

Last synced: 03 Feb 2025

https://github.com/samc621/business-insider

Takes the URL of a Business Insider article and PDF's it's raw content, bypassing the paywall.

axios jsdom nodejs puppeteer web-scraping

Last synced: 15 Feb 2025

https://github.com/codingchili/tls-privacy

ML with sklearn/pandas in Python to identify page loads for specific websites when TLS is used. Uses NodeJS/Puppeteer for traffic generation.

machine-learning nodejs pandas puppeteer python scapy security security-testing

Last synced: 12 Feb 2025

https://github.com/harryandriyan/amazsell

Amazon Review Sucker & Classifier Tool

express mongodb nodejs puppeteer react

Last synced: 21 Jan 2025

https://github.com/devrax/opencorpdrscrapper

Web scraper to extract company data from OpenCorporates

javascript nodejs puppeteer supabase

Last synced: 10 Jan 2025

https://github.com/saryniel/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 31 Oct 2024

https://github.com/akopcz2/redlert

Uptime Monitor

javascript monitor node puppeteer

Last synced: 31 Dec 2024

https://github.com/hdorgeval/puppeteer-core-starter

starter project for e2e tests with jest and puppeteer-core-controller

e2e jest puppeteer puppeteer-core

Last synced: 12 Feb 2025

https://github.com/pierrecholhot/krldf

Saves a webpage as PDF using Chrome's Puppeteer

headless javascript nodejs pdf pdf-generation puppeteer

Last synced: 15 Jan 2025

https://github.com/fauzaanu/puppeteer-server-guide

Meant as a guide explaining how to run puppeteer on a linux server

puppeteer

Last synced: 29 Jan 2025

https://github.com/lunneu/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 09 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Expect.

commonjs e2e-test e2e-testing e2e-tests end-to-end-test-automation jest puppeteer

Last synced: 11 Jan 2025

https://github.com/breqdev/cards

Generate card images based on user data and HTML templates.

api asyncio flask minio puppeteer pyppeteer python quart react website

Last synced: 03 Feb 2025

https://github.com/oxylabs/puppeteer-tutorial

Use this tutorial and learn how to perform web scraping using a headless browser.

headless-browser puppeteer web-scraping

Last synced: 17 Jan 2025

https://github.com/ryanbekhen/nest-puppeteer

NestJS Puppeteer is a module that allows you to use Puppeteer in your NestJS application.

nestjs nestjs-puppeteer puppeteer

Last synced: 20 Dec 2024

https://github.com/sokraglav13/end-to-end-testing-with-puppeteer

This project contains all the required components for an automation testing framework like Logger, Reporter, Video Recording, Test Data, Static Code Analysis, CI Integration, POM.

allure-report automated-testing end-to-end-testing mocha-chai nodejs puppeteer static-analysis testing ui-testing video-recording winston-logger

Last synced: 07 Dec 2024

https://github.com/dev100kg/puppeteer-sample-wsl

Puppeteer を WSL で実行するサンプル

nodejs puppeteer wsl wsl-ubuntu

Last synced: 24 Oct 2024

https://github.com/rakashash/webscrapperandsummarise

This project Contains a node.js App(Backend) for WebScrapping a url using puppeteer with summarising the scrapped data using LLM models from groq SDK and storing it in Postgres.

groq groq-integration nodejs postgresql puppeteer sequelize sequelize-orm

Last synced: 02 Feb 2025

https://github.com/emmanuel-rods/snapbot

SnapBot is an automation tool designed to help maintain Snap Streaks effortlessly. It logs into Snapchat, captures snaps with custom captions, and sends them to your best friends or groups, all through an easy-to-use script.

automation bot puppeteer snapchat streaks

Last synced: 23 Jan 2025

https://github.com/zbo14/hype-radio

CLI radio that plays the newest songs on Hype Machine.

audio browser-automation internet-radio javascript music nodejs puppeteer radio streaming

Last synced: 31 Jan 2025

https://github.com/njfamirm/auto-pwd

Run script on play with docker automatically.

automation play-with-docker puppeteer

Last synced: 11 Feb 2025

https://github.com/guilhermebkel/flight-price-comparator

This app makes an automatized computer searching for the best flight promotions all the night long and automatically buy a ticket when it is cheap enough.

automation node price-tracker puppeteer react webscraping

Last synced: 21 Jan 2025

https://github.com/petehouston/node-proshot

Handy tool to capture website screenshots using Puppeteer.

capture capture-website-screenshots javascript node nodejs puppeteer screenshot screenshots

Last synced: 06 Feb 2025

https://github.com/p1atdev/wordle-solver

Wordle Solver with Deno

deno puppeteer wordle

Last synced: 31 Dec 2024

https://github.com/redbaty/ezpdf

PDF Renderer using chrome puppeteer.

pdf puppeteer render

Last synced: 26 Dec 2024

https://github.com/ghoul007/puppeteer-snippets

Vscode puppeteer snippets extension

javascript nodejs puppeteer

Last synced: 10 Feb 2025

https://github.com/pranavbharadwaj007/hackerrank-automation

Hackerrank Automation with node.js

automation backend nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/pranavbharadwaj007/youtube-playlist-automation

Automate the youtube , scrap the data of playlist and creates a pdf doc of it

automation backend nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/ivankahl/web-scraping-benchmarks

Node.js that benchmarks scraping Reddit using Puppeteer, Playwright, Selenium, Nightmare, and Cypress.

cypress nightmare playwright puppeteer scraping selenium web

Last synced: 13 Jan 2025

https://github.com/circuit/conference-starter

Bot that starts a conference and dials out members on a scheduled time

bot circuit conference puppeteer sdk unify webrtc

Last synced: 09 Feb 2025

https://github.com/danielesteban/autocalamari

Automated Calamari Clock-In/Out

automation nodejs puppeteer

Last synced: 13 Feb 2025

https://github.com/zahradnik-ondrej/puppethelper

🧰 A Puppeteer utility package for web automation.

automation browser puppeteer qa web

Last synced: 10 Feb 2025

https://github.com/ianwalter/puppeteer-helper

An AVA helper that makes a Puppeteer page available to a test

ava ava-helper helper puppeteer webpack

Last synced: 20 Jan 2025

https://github.com/seashix/VRCGetApiData

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 20 Jan 2025

https://github.com/mathewsmachado/tl

A command-line translator.

javascript nodejs puppeteer translation

Last synced: 03 Jan 2025

https://github.com/elialm7/consultor-scraper-api

api scraper made using puppeter and express and typescript

expressjs puppeteer typescript

Last synced: 15 Feb 2025

https://github.com/xredax/quran-hadith-poster

Automated Facebook bot for sharing Quran pages and Hadith content to groups.

automation facebook facebook-bot hadith islamic islamic-app nodejs puppeteer quran social-media

Last synced: 08 Feb 2025

https://github.com/munhoz2k/newsapi

✉️ Sistema de envio de emails de notícias do mercado Financeiro ✉️

aws-ec2 express nodemailer puppeteer typescript

Last synced: 31 Jan 2025

https://github.com/xtruder/browserboi

Headless browser automation service for things that we can't do with official APIs

api automation browser puppeteer youtube

Last synced: 04 Jan 2025

https://github.com/joeylemon/scraper

a scraper for checking item availability at websites such as online retailers

nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/mobilerast/ssr-generator

SSR Generator is able to save your SPA as a rendered HTML. SSR For Angular, React.js, Vue.js.

angular-apps javascript nodejs puppeteer search-engines server-side-render server-side-rendering ssr ssr-generator

Last synced: 08 Jan 2025

https://github.com/jscalderon65/shopping-web-scraper-backend

Api dedicada a informar y notificar el cambio de precios de productos en tiendas virtuales. El producto que se desee vigilar se deberá registrar por medio de los métodos de la Api y una vez terminado dicho el proceso, la Api se encargará de notificar por medio de correo electrónico los cambios que se puedan presentar en los precios del producto.

express-js firebase-admin node-js puppeteer

Last synced: 11 Jan 2025

https://github.com/blank-09/google-meet-automation

An automation software to join Google Meet meetings. The software uses the csv file to get the schedule of the meetings and joins the meeting at the scheduled time.

automation google-meet puppeteer

Last synced: 05 Nov 2024

https://github.com/zanonnicola/scrape-my-likes

Scraping my likes from twitter using Puppeteer and NodeJS

nodejs puppeteer scaper twitter

Last synced: 26 Jan 2025

https://github.com/dbtek/xmgenerator

Generate exams from command line

cli pdf pug puppeteer

Last synced: 19 Jan 2025

https://github.com/scriptsmith/routerreboot

Reboot my cheap router

puppeteer typescript

Last synced: 15 Feb 2025

https://github.com/pdehaan/playwright-test

Testing playwright -- a Node library to automate the Chromium, WebKit and Firefox browsers.

chromium firefox playwright puppeteer webkit

Last synced: 12 Feb 2025

https://github.com/slickcharmer/screen-sharing-basic

Simple Screen Sharing Application using React and Node.js. You can use it on your project.

nodejs puppeteer react screen sharing

Last synced: 15 Jan 2025

https://github.com/book000/kindle-booklog

Amazon.co.jpで購入したKindle作品を取得して、ブクログに登録します。

booklog docker-image kindle puppeteer

Last synced: 13 Jan 2025

https://github.com/robert-kratz/google-maps-scraper

This is a pupeeter based scraper for Google Maps. This script will seach for the term you provide and scrape the information from the search results.

command-line-tool npm-package puppeteer typescript

Last synced: 10 Feb 2025

https://github.com/jonaylor89/beeline-bot

Bot to automate the browser to do my timesheet

automation docker nodejs puppeteer

Last synced: 11 Jan 2025

https://github.com/rahulnisanth/trackitnow

The e-commerce price tracker and analyzer for best deals

bright-data cheerio-js cron-jobs nextjs14 puppeteer web-scraping-software

Last synced: 05 Nov 2024

https://github.com/guilhermebkel/semantic-search-llm-ai

🤖 That's a simple LLM semantic search that implements RAG concepts with help of LangChain and OpenAI API.

ai embeddings langchain openai-api puppeteer rag redis redis-vector-store retrieval-augmented-generation semantic-search-ai typescript

Last synced: 05 Nov 2024

https://github.com/akashchouhan16/webscraping-cli

A command-line tool using node & puppeteer for web scraping.

chromium nodejs puppeteer

Last synced: 05 Feb 2025

https://github.com/nzambello/volto-staticrender-bots

Volto addon that adds an express middleware for static rendering for bots

bots googlebot plone puppeteer ssr volto volto-addon

Last synced: 09 Jan 2025

https://github.com/raeesbhatti/vbully

Scrapes data off vBulletin websites

puppeteer scraper vbulletin

Last synced: 07 Feb 2025

https://github.com/ttibensky/example-puppeteer

An example implementation of https://developers.google.com/web/tools/puppeteer/

chrome chromium headless-chrome node nodejs puppeteer puppeteer-screenshot

Last synced: 30 Jan 2025

https://github.com/geodoo/game-of-shells

Game of shells

atdd jest puppeteer react tdd

Last synced: 12 Jan 2025

https://github.com/vikramsamak/html-to-pdf-microservice

A simple microservice that converts HTML content to PDF using Puppeteer.

api-rest expressjs htmltopdf microservice nodejs puppeteer

Last synced: 08 Feb 2025

https://github.com/kavrillon/web-q5y

Perform web audits via Jest.

a11y audit e2e performance puppeteer seo

Last synced: 05 Feb 2025

https://github.com/cocohfl/twitchremotecontrol

Remotely control Twitch streams running on your PC from any device.

nodejs puppeteer remote-control twitch

Last synced: 12 Jan 2025

https://github.com/alexbelloni/spaceapps-teammembers

The Mural of Positions - NASA Space Apps Challenge 2020

crawling firebase javascript puppeteer react

Last synced: 05 Jan 2025

https://github.com/ondiekelijah/web-scraping-with-node.js-guide

Node.js Web Scraping Guide repository

cheerio puppeteer

Last synced: 10 Feb 2025

https://github.com/coderdotjs/html-to-pdf-node

This plugin will convert html page or public URL into PDF. This will work with Node.js

converter html-pdf nodejs npm npm-package pdf puppeteer serverside

Last synced: 18 Jan 2025

https://github.com/seaqk/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 12 Jan 2025

https://github.com/jweboy/chrome-headless

Puppeteer 与 Chrome Headless爬虫小demo

headless-chrome puppeteer

Last synced: 23 Jan 2025

https://github.com/willemverbuyst/willemverbuyst

Scrape the topics of my repos, convert those into badges and present them in an overview (with a cron job)

githubactions javascript mustache puppeteer

Last synced: 10 Dec 2024

https://github.com/mr-addict/api

Personal and public api center

api nodejs puppeteer serverless

Last synced: 12 Jan 2025

https://github.com/emmanuel-rods/indane-gas-booking-bot

A bot that books your Indane gas cylinder

automation booking bot javascript nodejs puppeteer

Last synced: 02 Jan 2025

https://github.com/zzarcon/page-favicon

Get any website favicon using Puppeteer

favicon page-favicon puppeteer scraping website-favicon

Last synced: 24 Jan 2025

https://github.com/tatsuyafujisaki/jkk-watcher

Check a vacant room in an apartment of JKK Tokyo

javascript jkk-tokyo puppeteer

Last synced: 05 Feb 2025

https://github.com/ujjawal-1999/pdf-generator-puppeteer

A simple web application that takes a url and page format as input and returns a pdf of the url.

heroku-buildpack heroku-deployment node-js puppeteer

Last synced: 22 Jan 2025

https://github.com/tomashubelbauer/globus

Scrapes the Globus PDF catalogue using Puppeteer

globus pdf-scraping puppeteer puppeteer-firefox

Last synced: 31 Dec 2024

https://github.com/fabiopf02/yt_scraper_api

This is a YouTube video data scraping api made in NodeJS

api-rest express mongoose node nodejs puppeteer scraper typescript youtube yt-data-api

Last synced: 15 Feb 2025

https://github.com/sleavely/pdf-lambda

HTML-to-PDF API with Handlebars support, hosted on AWS Lambda

aws-lambda cloudformation handlebars pdf-generation puppeteer

Last synced: 12 Jan 2025