Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/tokuda109/techbookfest07-puppeteer-samples

技術書典7に出典した「実践マニアックテスト 〜Android・iOS・Web編〜」の「Puppeteerを使ったE2Eテストの始め方」のサンプルコード集

e2e javascript nodejs puppeteer

Last synced: 14 Nov 2024

https://github.com/raharrison/lynks-scraper

Web scraper for Lynks project. Extract screenshots, thumbnails, PDF's and metadata from given URL's

api express extract nodejs puppeteer scraper screenshot thumbnail

Last synced: 14 Oct 2024

https://github.com/josepedrodias/puppetmaster

drive multiple puppeteer controlled browsers with ease

automation multiplayer puppeteer

Last synced: 05 Nov 2024

https://github.com/encoreshao/puppeteer-typescript-starter

The most basic Puppeteer TypeScript starter

data-scraper json nodemon puppeteer structure typescript

Last synced: 21 Oct 2024

https://github.com/euberdeveloper/video-scraper-core

An npm package that provides an abstract class to scrape videos with Puppeteer

npm puppeteer scraper typescript video-scraper

Last synced: 21 Oct 2024

https://github.com/pmmmwh/cimg-puppeteer

A Docker "Convenience Image" built to run Puppeteer-related tasks on CircleCI.

circleci circleci-cimg convenience-image docker puppeteer

Last synced: 13 Oct 2024

https://github.com/nadavkli/react-to-pdf-ts

Transform React components into PDFs effortlessly! Leverage TypeScript and Puppeteer for high-quality, customizable PDFs with just a few lines of code.

nodejs pdf pdf-generation puppeteer react reactjs typescript

Last synced: 21 Oct 2024

https://github.com/kodie/stack-fanatic-cli

A CLI tool for checking the progress of the badge you are tracking on your Stack Overflow profile.

badge badges cli command-line command-line-tool google node node-js node-module nodejs puppeteer stack-overflow stackexchange stackoverflow

Last synced: 21 Oct 2024

https://github.com/aexynn/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 14 Oct 2024

https://github.com/mrseanryan/style-scraper

Scrape styles from a website using reliable computed styling via a headless browser [fonts, colors, border styles ...]

puppeteer scraping scraping-styling scraping-websites styling-css

Last synced: 07 Nov 2024

https://github.com/sinoryn/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 27 Sep 2024

https://github.com/ondiekelijah/web-scraping-with-node.js-guide

Node.js Web Scraping Guide repository

cheerio puppeteer

Last synced: 10 Oct 2024

https://github.com/gxiang314/url2pdf

a batch url to pdf converter

batch nodejs puppeteer typescript url2pdf webpage2pdf

Last synced: 10 Oct 2024

https://github.com/sjdonado/assessment-2-backend-un-202130

DSLLO APLICACIONES WEB BACKEND - Universidad del Norte, Colombia

http-server nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/kunal00000/scrape-from-webpage

Scrape data from a particular webpage.

github-api puppeteer scraping-websites

Last synced: 13 Nov 2024

https://github.com/eccenux/wikiploy-rollout-example

Wikipedia gadget example with Browserify as a build tool and Wikiploy for deployments.

puppeteer wikipedia wikiploy

Last synced: 06 Nov 2024

https://github.com/sergeytrasko/wordle-solver

Node.js and Puppeteer based solver for Wordle game

puppeteer wordle wordle-solver

Last synced: 30 Oct 2024

https://github.com/raeesbhatti/vbully

Scrapes data off vBulletin websites

puppeteer scraper vbulletin

Last synced: 26 Oct 2024

https://github.com/stefanzweifel/sidecar-browsershot-layer

AWS Lambda Layer containing puppeteer-core. Used by sidecar-browsershot

aws-lambda aws-lambda-layer puppeteer puppeteer-core

Last synced: 24 Oct 2024

https://github.com/wangshibiaoflytiger/spider_puppeteer

nodejs puppeteer爬虫开发脚手架

crawl nodejs puppeteer spider

Last synced: 10 Nov 2024

https://github.com/mobilerast/accessibility-checker

A tool for assessing website accessibility, leveraging Puppeteer and axe-core. It automates the process of detecting common accessibility issues, providing a quick and efficient means to ensure web content is accessible to all users, including those with disabilities.

accessibility accessibility-analysis accessibility-automation accessibility-testing accessible axe-core axe-puppeteer javascript nodejs puppeteer puppeteer-core puppeteer-demo validation violations

Last synced: 11 Nov 2024

https://github.com/ewliang/cnbc-premarket-web-scraper

A web scraper created using Puppeteer library on the backend to scrape the stock market prediction data off of CNBC's premarket page.

backend-development expressjs javascript node-js nodejs puppeteer stock-market web-scraper web-scraping webscraper

Last synced: 08 Nov 2024

https://github.com/progm/node-html2pdf

A simple node server to create pdf files from an URL, using puppeteer. It works as standalone or with AWS Lambda.

html2pdf nodejs pdf-generation puppeteer

Last synced: 28 Oct 2024

https://github.com/agusbw/snapy-og

Snap the page and generate an opengraph image 📸

hono puppeteer typescript

Last synced: 05 Nov 2024

https://github.com/pierrecholhot/krldf

Saves a webpage as PDF using Chrome's Puppeteer

headless javascript nodejs pdf pdf-generation puppeteer

Last synced: 15 Nov 2024

https://github.com/darkgl/node-xvfb-ts

Easily start and stop an X Virtual Frame Buffer from your node apps

buffer frame framebuffer headless playwright puppeteer typescript virtual xvfb xvfb-node xvfb-ts

Last synced: 10 Oct 2024

https://github.com/codingchili/tls-privacy

ML with sklearn/pandas in Python to identify page loads for specific websites when TLS is used. Uses NodeJS/Puppeteer for traffic generation.

machine-learning nodejs pandas puppeteer python scapy security security-testing

Last synced: 01 Nov 2024

https://github.com/njfamirm/auto-pwd

Run script on play with docker automatically.

automation play-with-docker puppeteer

Last synced: 14 Oct 2024

https://github.com/rahulnisanth/trackitnow

The e-commerce price tracker and analyzer for best deals

bright-data cheerio-js cron-jobs nextjs14 puppeteer web-scraping-software

Last synced: 05 Nov 2024

https://github.com/samc621/business-insider

Takes the URL of a Business Insider article and PDF's it's raw content, bypassing the paywall.

axios jsdom nodejs puppeteer web-scraping

Last synced: 05 Nov 2024

https://github.com/devrax/opencorpdrscrapper

Web scraper to extract company data from OpenCorporates

javascript nodejs puppeteer supabase

Last synced: 12 Nov 2024

https://github.com/stagas/vipu

run things in vite headless with node/puppeteer and alice-bob typed rpc

headless puppeteer rpc vite

Last synced: 31 Oct 2024

https://github.com/willemverbuyst/willemverbuyst

Scrape the topics of my repos, convert those into badges and present them in an overview (with a cron job)

githubactions javascript mustache puppeteer

Last synced: 02 Nov 2024

https://github.com/sidvishnoi/href-checker

Hyperlink checker for HTML pages which checks href attributes by actually visiting linked pages and also checking existence of URL fragments.

cli hacktoberfest hyperlink-auditing library link-checker link-checking puppeteer validator

Last synced: 29 Oct 2024

https://github.com/spekulatius/hacks

Several hacks and alpha code. Experiments - not stable at all, probably not maintained. Kids: Don't try this at home.

experiments hacks puppeteer scraping seo

Last synced: 12 Nov 2024

https://github.com/zahradnik-ondrej/puppethelper

A Puppeteer utility package for web automation.

automation browser puppeteer qa web

Last synced: 10 Oct 2024

https://github.com/cenfun/page-save-as

Page save as JPG/PNG/PDF

jpg page pdf png puppeteer save

Last synced: 18 Oct 2024

https://github.com/captaincluster/sitesnap

A program that uses Puppeteer to visit the url given by the user and take a screenshot. The screenshot will then be saved for the user to view.

javascript nodejs puppeteer screenshot

Last synced: 08 Nov 2024

https://github.com/darkterminal/rest-screenshoot

REST Screenshoot is a free tool for capturing screenshots of webpages via a REST API. Free an always!

open-source puppeteer rest-api screenshoot

Last synced: 08 Nov 2024

https://github.com/k4u5h4l/automate-music-download

A headless chrome script to automate the process of downloading large amounts of FLAC (lossless) audio.

javascript nodejs puppeteer scraping

Last synced: 10 Nov 2024

https://github.com/arthurweinmann/puppeteer-server

Run Puppeteer (browser automation) as a HTTP API

api puppeteer rpc

Last synced: 10 Nov 2024

https://github.com/pdehaan/send-puppeteer

Firefox Send v.Next screenshots.

firefox puppeteer send

Last synced: 31 Oct 2024

https://github.com/lukmanrambe/sekawan-restaurant

Restaurant Catalogue Website. Submission for "Menjadi Front-End Web Developer Expert" (https://www.dicoding.com/academies/219) Dicoding Class

accessibility codeceptjs css html jasmine javascript karma karma-jasmine progressive-web-app puppeteer pwa semantic-html webpack workbox

Last synced: 31 Oct 2024

https://github.com/pdehaan/puppeteer-a11y-cli

Puppeteer <3 Axe

a11y axe puppeteer

Last synced: 31 Oct 2024

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 09 Nov 2024

https://github.com/iadtya/web-summarizer

Web-summarizer scrapes the specific url to pipes that text data into gpt-3.5-turbo model to generate summary of the url and uses redis to cache the summary to save overhead price

expressjs nodejs openai-api puppeteer reactjs redis tailwindcss

Last synced: 09 Nov 2024

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 10 Nov 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 05 Nov 2024

https://github.com/andrei0x309/puppeteer-extra-plugin-browser-extension-interact

Puppeteer extra plugin to interact with browser extensions, highly experimental.

browser-extention-interaction puppeteer puppeteer-extra puppeteer-extra-plugin

Last synced: 09 Nov 2024

https://github.com/creativeprojects/gallerydownloader

Download images from a webpage using headless chrome

puppeteer

Last synced: 09 Nov 2024

https://github.com/sejori/instafans

Proof of concept instagram public profile scraper.

ejs express nodejs puppeteer scraper

Last synced: 17 Oct 2024

https://github.com/igor-starostenko/book-worm

Google maps bookmark import tool

automation bookmarks google-maps puppeteer

Last synced: 17 Oct 2024

https://gitlab.com/hajnyon-projects/slichta/slichta-scraper

Scrapes various websites for daily meal menus. https://slichta.vercel.app/

apify menus puppeteer restaurants scraper

Last synced: 23 Oct 2024

https://github.com/c0de-l00p/whatsapp-bot

Simple whatsapp bot made with node js and puppeteer

node puppeteer qrcode whatsapp

Last synced: 09 Nov 2024

https://github.com/pionl/docker-node-puppeteer-ready

🐳 Docker image based on official node with with GoogleChrome/puppeteer support

chrome docker docker-image nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/jackdbd/regl-experiments

Regl experiments with React and Typescript

jest puppeteer react regl webgl webpack

Last synced: 17 Oct 2024

https://github.com/giansalex/puppeteer-sample

Puppeteer Headless Chrome (Sample)

node puppeteer

Last synced: 02 Nov 2024

https://github.com/iirving/pdf-dynamic-node-template

server side generated PDF's from static handlebar html templates with external dynamic data

handlebars hbs node nodejs pdf pdf-generation puppeteer

Last synced: 14 Oct 2024

https://github.com/code-yeongyu/puppeteer-practice-melon-top100-crawler

My first puppeteer project using typescript. It prints melon top 100 chart with rank and song info!

melon puppeteer typescript

Last synced: 09 Nov 2024

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 09 Nov 2024

https://github.com/kos/react-ssr-genie

A simple tool for simple server-side rendering needs

pdf puppeteer

Last synced: 13 Oct 2024

https://github.com/mdato/dolar2030

puppeteer + heroku + express

express heroku puppeteer

Last synced: 10 Nov 2024

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 10 Nov 2024

https://github.com/lightbeem3296/stealth-chrome-automation

Completely undetectable chrome browser automation script. Even better than all the automation libraries including Selenium, Puppeteer, Playwright and so on.

automation bypass playwright puppeteer scraper selenium stealth-bot undetectable-browser

Last synced: 09 Nov 2024

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 09 Nov 2024

https://github.com/brightspace/d2l-beaker

A driver for Google Puppeteer to collect client-side performance metrics.

automation performance puppeteer

Last synced: 10 Nov 2024

https://github.com/matthewjselby/json-resume

Generate a resume in both HTML and PDF from a JSON file.

gulp handlebars html javascript json puppeteer resume sass

Last synced: 14 Nov 2024

https://github.com/ellache/adjust_your_algo

Run puppeteer core in the background to modify your digital profile by navigating repeatedly to a specified set of webpages.

nodejs puppeteer puppeteer-core

Last synced: 09 Nov 2024

https://github.com/daveanthonyc/webscraper-test

Webscraper using Puppeteer to scrape 7000+ rows of data.

dataminig nodejs puppeteer webscraping

Last synced: 05 Nov 2024

https://github.com/rajeshberwal/simple-node-web-scraper

Simple web scraper template that you can use to scrape data from a website.

javascript nodejs puppeteer scraper

Last synced: 09 Nov 2024

https://github.com/ainoya/cloudflare-dom-distiller

A Cloudflare Workers-based API for extracting and converting web page content to Markdown using DOM-Distiller and Turndown.

cloudflare cloudflare-workers puppeteer

Last synced: 10 Oct 2024

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Oct 2024

https://github.com/daviteixeira-dev/saucedemo-automation-with-puppeteer

Using the Puppeteer library to perform automated testing on Swag Labs' soucedemo.com website.

jest jest-puppeteer nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/tomaszrewak/react-app-puppeteer-component-testing

Guide on how to to configure puppeteer with a default (non-ejected) react app in order to test individual react components.

puppeteer react regression-testing visual-testing

Last synced: 09 Nov 2024

https://github.com/damianravindupeiris/jobber-cli

A simple AI based Node-JS script to automate the job applying process.

ai nodejs open-ai puppeteer typescript web-scraping

Last synced: 09 Nov 2024

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 05 Nov 2024

https://github.com/eltonsantos/gerador-de-pdf

Projeto desenvolvido - Vídeo: Vamos gerar PDF com NodeJS, Puppeteer, EJS e TailwindCSS - Instrutor: Mayk Brito - Link: https://www.youtube.com/watch?v=AoU7aEdTldE

ejs express html-pdf nodejs pdf puppeteer tailwindcss

Last synced: 12 Nov 2024

https://github.com/eltonsantos/calcular-horas-video-youtube

Simple Youtube Video Hour Calculator. - Vídeo: O último Code/Drops! Script que calcula horas de vídeo | Code/Drops #68 - Instrutor: Diego Fernandes & Mayk Brito - Link: https://www.youtube.com/watch?v=faekjlZuTFA

nodejs puppeteer

Last synced: 12 Nov 2024

https://github.com/f00b4r/2021-03-vercel-puppeteer-social-networks

🎁 How to use Puppeteer to generate images for social networks deployed to Vercel

f00b4r lambda network plugin puppeteer screenshot social vercel widget

Last synced: 14 Nov 2024

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 10 Nov 2024

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 11 Nov 2024

https://github.com/mobilerast/ssr-generator

SSR Generator is able to save your SPA as a rendered HTML. SSR For Angular, React.js, Vue.js.

angular-apps javascript nodejs puppeteer search-engines server-side-render server-side-rendering ssr ssr-generator

Last synced: 11 Nov 2024

https://github.com/khoiuna/business-qrcode-flyers

Generate web pages with QR code and screenshot them for businesses to use at trade shows.

bootstrap javascript php puppeteer python script

Last synced: 15 Nov 2024

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automação que fornece informações dos elencos dos times da NBA. O sistema em questão é uma aplicação console que fornece opções de escolha, o usuário digita a opção que deseja e as informações são mostradas de acordo com essa opção.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Oct 2024

https://github.com/0x46616c6b/follower

Follow URLs and tracks redirects

http-client nodejs puppeteer

Last synced: 13 Oct 2024

https://github.com/idan-sh/puppeteer-automation-jones

Home assignment for Jones - a Puppeteer JavaScript automation.

automation-testing javascript puppeteer

Last synced: 15 Nov 2024

https://github.com/derrmru/scrape-the-news

Proof of concept - Scrape News Outlets with Express JS

expressjs javascript nlp puppeteer

Last synced: 05 Nov 2024