Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website šŸ“·

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/anibalalpizar/puppeteer-overview

Control your browser using Javascript code, together with the Puppeteer library and Nodejs

nodejs puppeteer webscraping

Last synced: 11 Nov 2024

https://github.com/flolu/bazel-node-puppeteer

Can't run Bazel nodejs_image with Puppeteer

bazel docker nodejs puppeteer rules-nodejs

Last synced: 11 Nov 2024

https://github.com/ekamid/goodreads-book-scrapper

Scrap Goodreads Book information using Puppeteer

javascript puppeteer scrapper scrapping typescript

Last synced: 10 Nov 2024

https://github.com/rafaellaurindo/mercadolivre-scraper

Scraper to Mercado Livre products written in Node.js using Puppeteer.

bot mercadolivre nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/ihoverlord/dx-currency

An API with Scrapped Data of 53 exchange rates against USD

api cheerio currency javascript nodejs puppeteer

Last synced: 09 Nov 2024

https://github.com/louiscklaw/page-change-detect-tryout

page-change-detect-tryout

javascript puppeteer

Last synced: 24 Oct 2024

https://github.com/jayvirrathi/nodejs-puppeteer

NodeJS Instagram Post Liker using Puppeteer

instagram nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/umuthopeyildirim/puppateer-screenshot

The Google Cloud function that can take screenshots of websites.

google-cloud-functions google-cloud-storage javascript puppeteer

Last synced: 12 Nov 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de vĆ”rias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, populaĆ§Ć£o, gentĆ­lico e territĆ³rio.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 10 Oct 2024

https://github.com/jp7io/puppy

Simple website screenshot using AWS Lambda, Chromium, and Puppeteer.

chromium lambda puppeteer screenshot

Last synced: 12 Oct 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Oct 2024

https://github.com/lameuler/astro-pdf

A simple Astro integration to generate PDFs from built pages.

astro astro-integration pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/zrna/cars-scraper

šŸš™ Scraping cars ads

javascript puppeteer scraper

Last synced: 11 Nov 2024

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 05 Nov 2024

https://github.com/spm999/invoice-generator

Invoice generator application built using Node.js, Express.js, Handlebars, and Puppeteer. It generates invoices in PDF format based on the provided data.

api-rest express hbs invoice-generator nodejs postman puppeteer template-engine templateengine

Last synced: 05 Nov 2024

https://github.com/runnin-n-gunnin/puppeteerpanellib

PuppeteerPanel is a User Control that embeds puppeteer's chromium window in a Windows Forms application. POC.

chromium crawling puppeteer puppeteer-sharp scraping winforms

Last synced: 11 Nov 2024

https://github.com/sojebsikder/extra-power

This is a simple project that helps other developer to achieve something different

express nodejs puppeteer typescript

Last synced: 11 Nov 2024

https://github.com/christiancesar/hunter

Scraping of the target web application, using puppeeter, node with typescript and best practices.

backend ddd factory-pattern fullstack-development mongodb-atlas nodejs observer-pattern poo puppeteer react tdd typescript

Last synced: 10 Oct 2024

https://github.com/rn0x/puppeteerproxy

Puppeteer Proxy is a lightweight web proxy built with Node.js and Puppeteer and Express, designed to return HTML content from web pages using a headless Chrome browser.

express nodejs proxy proxy-puppeteer puppeteer

Last synced: 31 Oct 2024

https://github.com/kayyz1/llmscraper

LLM AI web scraper tool

openai puppeteer react remix typescript

Last synced: 22 Oct 2024

https://github.com/mushfiqurniazzz/word-meaning---webscraping

A basic Nodejs environmental function that takes in a word to search in a word-meaning website and then prints it in the terminal through web-scraping.

javascript nodejs puppeteer webscraping wordmeaning

Last synced: 05 Nov 2024

https://github.com/duranda/lambda-pdf-generator

Generate PDF from HTML remotely on AWS Lambda with the Chromium rendering engine

aws-lambda chromium pdf-generation puppeteer wkhtmltopdf

Last synced: 05 Nov 2024

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel č“‹ę£‰č¢«ē“”čŠå¤©.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/uday160386/test-automation-poc-demos

The consolidation of proofs of concept (POCs) using various open source tools is a strategic approach that can streamline development processes and enhance productivity

playwright-javascript puppeteer robotframework selenium

Last synced: 10 Oct 2024

https://github.com/tushcmd/olo-scraper

This is a full-stack web scraping application that simulates browser-like interactions using a headless browser. Users can input a URL, and the application scrapes data and performs specified actions.

cors express nodejs puppeteer react tailwindcss typescript winston

Last synced: 05 Nov 2024

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicaĆ§Ć£o console que fornece informaƧƵes dos elencos, prĆ³ximas partidas e notĆ­cias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 10 Oct 2024

https://github.com/nstseek/download-all-github-repos

Automated script that downloads every repo from a GitHub organization or user

automation download eslint github organization prettier puppeteer repositories repository scripting typescript user

Last synced: 15 Nov 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer

NodeJs version with all dependencies to run Puppeteer

docker nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/evgeniyarbatov/location-testing

E2E testing of pages with location

expressjs location mocha puppeteer

Last synced: 05 Nov 2024

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Oct 2024

https://github.com/stopsopa/docker-puppeteer-html-scraper

(Deprecated -> use better https://github.com/stopsopa/html-scraper-browserless) Microservice tool to scraping html from "any" page

docker html-scraper node nodejs puppeteer scraper

Last synced: 24 Oct 2024

https://github.com/stopsopa/state-of-puppeteer

šŸŽŽBunch of test of my own puppeteer extensions

extension extensions puppeteer

Last synced: 24 Oct 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 05 Nov 2024

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 24 Oct 2024

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 24 Oct 2024

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 21 Oct 2024

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 24 Oct 2024

https://github.com/yandeu/mocha-chai-nyc-puppeteer-example

Client/Server testing and code-coverage with Mocha, Chai, NYC (Istanbul) and Puppeteer

chai istanbul mocha nyc puppeteer

Last synced: 23 Oct 2024

https://github.com/pionl/docker-node-puppeteer-ready

šŸ³ Docker image based on official node with with GoogleChrome/puppeteer support

chrome docker docker-image nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/thundermiracle/costco-monitor

Monitor product's price & stock status. Send email when price is down or stock status is changed.

costco puppeteer

Last synced: 20 Oct 2024

https://github.com/se-madhusudan/puppeteer-demo

Screenshot and pdf generation with puppeteer, image-size, and pdfkit

image-size pdf pdfkit puppeteer screenshot

Last synced: 13 Nov 2024

https://github.com/rishi-raj-jain/html-og-image

A deployment of OG Image Generator to Layer0.

chrome-aws-lambda layer0 nextjs prettier puppeteer react react-dom

Last synced: 26 Oct 2024

https://github.com/rishi-raj-jain/grabscreen

GrabScreen - A Screenshot Generator

api chrome-aws-lambda nextjs puppeteer serverless

Last synced: 26 Oct 2024

https://github.com/akirak/docker-chromium

Docker image containing a Chromium executable for Puppeteer

chromium docker-image puppeteer

Last synced: 31 Oct 2024

https://github.com/rushi0508/razorpay-attendance-automation

Will trigger github action as cron job and will mark my attendance in the razorpay application.

javascript puppeteer razorpay

Last synced: 13 Nov 2024

https://github.com/cocohfl/twitchremotecontrol

Remotely control Twitch streams running on your PC from any device.

nodejs puppeteer remote-control twitch

Last synced: 13 Nov 2024

https://github.com/hideack/node_shutter

puppeteerć«ć‚ˆć‚‹ć‚¹ć‚ÆćƒŖćƒ¼ćƒ³ć‚·ćƒ§ćƒƒćƒˆå–å¾—ć™ć‚‹ć‚·ćƒ³ćƒ—ćƒ«ćŖAPIć‚’ęä¾›

puppeteer

Last synced: 24 Oct 2024

https://github.com/devmunyi/puppeteer-web-automation

Using puppeteer to scrap and automate some repetitive web tasks

nodejs puppeteer typescript

Last synced: 14 Nov 2024

https://github.com/jonathanlinat/simple-nodejs-amazon-web-scraper

A very simple and automated tool to scrape Amazon.com results

amazon cheerio nodejs puppeteer web-scraper

Last synced: 14 Nov 2024

https://github.com/stephlaf/puppeteer-airtable-tutorial

Tutorial to scrape the web using Puppeteer and store to Airtable

airtable-api javascript puppeteer scraping

Last synced: 20 Oct 2024

https://github.com/pro-oc/pro-oc-dzs-proxy

REST API CORS Proxy server pro DZS registr.

cors-proxy-server dzs proxy-server puppeteer rest-api

Last synced: 14 Nov 2024

https://github.com/francescocoding/harvest-time

šŸŒ½ Harvest Time is a Node-based web scraper that utilizes Puppeteer to get past the login page directly from the Node environment (programmatically).

nodejs puppeteer scraper scraping

Last synced: 28 Oct 2024

https://github.com/pdehaan/send-puppeteer

Firefox Send v.Next screenshots.

firefox puppeteer send

Last synced: 31 Oct 2024

https://github.com/lukmanrambe/sekawan-restaurant

Restaurant Catalogue Website. Submission for "Menjadi Front-End Web Developer Expert" (https://www.dicoding.com/academies/219) Dicoding Class

accessibility codeceptjs css html jasmine javascript karma karma-jasmine progressive-web-app puppeteer pwa semantic-html webpack workbox

Last synced: 31 Oct 2024

https://github.com/pdehaan/puppeteer-a11y-cli

Puppeteer <3 Axe

a11y axe puppeteer

Last synced: 31 Oct 2024

https://github.com/creativeprojects/gallerydownloader

Download images from a webpage using headless chrome

puppeteer

Last synced: 09 Nov 2024

https://github.com/sejori/instafans

Proof of concept instagram public profile scraper.

ejs express nodejs puppeteer scraper

Last synced: 17 Oct 2024

https://github.com/b4dnewz/webpage-capture-cli

Capture the web in many ways from the command line

cli-tool cli-utility puppeteer puppeteer-screenshot screenshot webpage webshot website

Last synced: 13 Nov 2024

https://github.com/igor-starostenko/book-worm

Google maps bookmark import tool

automation bookmarks google-maps puppeteer

Last synced: 17 Oct 2024

https://github.com/lightbeem3296/stealth-chrome-automation

Completely undetectable chrome browser automation script. Even better than all the automation libraries including Selenium, Puppeteer, Playwright and so on.

automation bypass playwright puppeteer scraper selenium stealth-bot undetectable-browser

Last synced: 09 Nov 2024

https://gitlab.com/hajnyon-projects/slichta/slichta-scraper

Scrapes various websites for daily meal menus. https://slichta.vercel.app/

apify menus puppeteer restaurants scraper

Last synced: 23 Oct 2024

https://github.com/jackdbd/regl-experiments

Regl experiments with React and Typescript

jest puppeteer react regl webgl webpack

Last synced: 17 Oct 2024

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 05 Nov 2024

https://github.com/cityssm/node-faster-report-exporter

On demand exports of selected reports from the FASTER Web Fleet Management System.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 11 Nov 2024

https://github.com/vasani-arpit/puppeteer-extension-automation-example

Tutorial on how to add and use an extension programmatically in puppeteer

automation extensions node nodejs puppeteer web-automation

Last synced: 05 Nov 2024

https://github.com/giansalex/puppeteer-sample

Puppeteer Headless Chrome (Sample)

node puppeteer

Last synced: 02 Nov 2024

https://github.com/daveanthonyc/webscraper-test

Webscraper using Puppeteer to scrape 7000+ rows of data.

dataminig nodejs puppeteer webscraping

Last synced: 05 Nov 2024

https://github.com/ainoya/cloudflare-dom-distiller

A Cloudflare Workers-based API for extracting and converting web page content to Markdown using DOM-Distiller and Turndown.

cloudflare cloudflare-workers puppeteer

Last synced: 10 Oct 2024

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Oct 2024

https://github.com/daviteixeira-dev/saucedemo-automation-with-puppeteer

Using the Puppeteer library to perform automated testing on Swag Labs' soucedemo.com website.

jest jest-puppeteer nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automaĆ§Ć£o que fornece informaƧƵes dos elencos dos times da NBA. O sistema em questĆ£o Ć© uma aplicaĆ§Ć£o console que fornece opƧƵes de escolha, o usuĆ”rio digita a opĆ§Ć£o que deseja e as informaƧƵes sĆ£o mostradas de acordo com essa opĆ§Ć£o.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Oct 2024

https://github.com/deadcoder0904/puppeteer

A demo of things automating generating screenshot, creating pdf & signing into Facebook with Puppeteer āœØ

pdf puppeteer screenshot sign-in

Last synced: 14 Nov 2024

https://github.com/derrmru/scrape-the-news

Proof of concept - Scrape News Outlets with Express JS

expressjs javascript nlp puppeteer

Last synced: 05 Nov 2024

https://github.com/michalsn/sls-chrome-puppeteer

Run puppeteer with Serverless on AWS Lambda.

aws-lambda puppeteer serverless

Last synced: 01 Oct 2024

https://github.com/masreplay/html-to-image

Get s3 url from html file using node express

express html js nodejs puppeteer s3

Last synced: 23 Oct 2024

https://github.com/cityssm/node-faster-unofficial-api

An unofficial API for the FASTER Web fleet management system, relying on exported reports and complex parsers.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 23 Oct 2024

https://github.com/antoniowd/aws-lambda-pdf

The aws-lambda-pdf project is designed to generate PDFs from HTML content using AWS Lambda and Chromium. The generated PDF files are stored in an S3 bucket, and the application returns a signed URL for accessing the PDF file.

aws-lambda chromium pdf-generation puppeteer

Last synced: 05 Nov 2024

https://github.com/dnascanner/ani-cli

A simple to use terminal tool to find your favorite anime

anime chrome chromium cli deno puppeteer

Last synced: 05 Nov 2024

https://github.com/jprando/pdfserver

gerar relatorios em pdf com puppeteer

bun guambiarra pdf puppeteer relatorio rta

Last synced: 05 Nov 2024

https://github.com/pedromarques391/lastreleases

Projeto de web scraping

nodemailer puppeteer typescript

Last synced: 05 Nov 2024