Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/leckau/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 18 Dec 2024

https://github.com/angrykoala/wendigo-vue-plugin

A plugin for Wendigo with assertions regarding vue

automation browser javascript node plugin puppeteer vue vuendigo wendigo

Last synced: 18 Dec 2024

https://github.com/ajmeese7/dynamic-page-retrieval

Scrape data from JS-rendered pages

dynamic-content puppeteer scraping

Last synced: 18 Dec 2024

https://github.com/dreamjet31/county-lib-scraper

County Library Scraper

javascript nodejs puppeteer

Last synced: 18 Dec 2024

https://github.com/zoltan-nz/component-library-template

Component Library Starter Kit: React, TypeScript, Rollup, Jest, Eslint, Prettier

amd commonjs es6 eslint jest library packages prettier puppeteer react rollup typescript umd

Last synced: 18 Dec 2024

https://github.com/raharrison/lynks-scraper

Web scraper for Lynks project. Extract screenshots, thumbnails, PDF's and metadata from given URL's

api express extract nodejs puppeteer scraper screenshot thumbnail

Last synced: 19 Dec 2024

https://github.com/flazefy/gudangku-test

GudangKu helps you manage your belongings, from home supplies and food stock to furniture. Set reminders to remind you to cleaning or maybe time to restocking some of your home supplies. In this apps also have generate reports to create shopping or maintenance list. Test using Cypress & Puppeteer

automation cypress e2e integration-testing javascript puppeteer rest-api test-cases test-steps

Last synced: 24 Dec 2024

https://github.com/patrixr/pdf-render

A small webservice to generate PDFs out of webpages

hacktoberfest node pdf puppeteer webservice

Last synced: 25 Dec 2024

https://github.com/eccenux/wikiploy-rollout-example

Wikipedia gadget example with Browserify as a build tool and Wikiploy for deployments.

puppeteer wikipedia wikiploy

Last synced: 25 Dec 2024

https://github.com/hisasann/hisasann

My awesome README.md

github mustache puppeteer readme typescript

Last synced: 26 Dec 2024

https://github.com/womb0comb0/gdsc-farmingdale-links-api

This initiative aims to offer a compelling alternative for GDSC communities seeking efficient means to keep their members informed.

api cheerio css express html javascript puppeteer pwa typescript vite

Last synced: 26 Dec 2024

https://github.com/devrax/opencorpdrscrapper

Web scraper to extract company data from OpenCorporates

javascript nodejs puppeteer supabase

Last synced: 10 Jan 2025

https://github.com/oxylabs/puppeteer-tutorial

Use this tutorial and learn how to perform web scraping using a headless browser.

headless-browser puppeteer web-scraping

Last synced: 17 Jan 2025

https://github.com/emmanuel-rods/snapbot

SnapBot is an automation tool designed to help maintain Snap Streaks effortlessly. It logs into Snapchat, captures snaps with custom captions, and sends them to your best friends or groups, all through an easy-to-use script.

automation bot puppeteer snapchat streaks

Last synced: 23 Jan 2025

https://github.com/xtruder/browserboi

Headless browser automation service for things that we can't do with official APIs

api automation browser puppeteer youtube

Last synced: 04 Jan 2025

https://github.com/jonaylor89/beeline-bot

Bot to automate the browser to do my timesheet

automation docker nodejs puppeteer

Last synced: 11 Jan 2025

https://github.com/cocohfl/twitchremotecontrol

Remotely control Twitch streams running on your PC from any device.

nodejs puppeteer remote-control twitch

Last synced: 12 Jan 2025

https://github.com/coderdotjs/html-to-pdf-node

This plugin will convert html page or public URL into PDF. This will work with Node.js

converter html-pdf nodejs npm npm-package pdf puppeteer serverside

Last synced: 18 Jan 2025

https://github.com/seaqk/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 12 Jan 2025

https://github.com/mr-addict/api

Personal and public api center

api nodejs puppeteer serverless

Last synced: 12 Jan 2025

https://github.com/zzarcon/page-favicon

Get any website favicon using Puppeteer

favicon page-favicon puppeteer scraping website-favicon

Last synced: 24 Jan 2025

https://github.com/sleavely/pdf-lambda

HTML-to-PDF API with Handlebars support, hosted on AWS Lambda

aws-lambda cloudformation handlebars pdf-generation puppeteer

Last synced: 12 Jan 2025

https://github.com/encoreshao/puppeteer-typescript-starter

The most basic Puppeteer TypeScript starter

data-scraper json nodemon puppeteer structure typescript

Last synced: 12 Jan 2025

https://github.com/thatbeautifuldream/url2pdf

📸 Capturing Website Screenshots in PDF, PNG, JPG using Node.js, Puppeteer!

cli javascript nodejs pdf puppeteer url2pdf

Last synced: 26 Jan 2025

https://github.com/jado4810/md2pdf

Typeset Markdown to PDF for publishing

katex markdown mermaid nodejs pdf puppeteer

Last synced: 30 Jan 2025

https://github.com/tantelyrandriamazaoro/web-analyzer-backend

(Legacy) This is the backend for Mazaoro SARLU's lead magnet "Web Analyzer". This project analyzes websites using Google Lighthouse and returns a detailed report consumed by the frontend.

azure azure-app-service azure-container-registry azure-devops azure-pipelines cicd docker express lighthouse node puppeteer

Last synced: 18 Jan 2025

https://github.com/tostaylo/chrome-measure-user-perf

Automate user interaction performance testing using Puppeteer and Chrome Developer Tools Performance Timeline Traces.

chrome devtools performance performance-testing puppeteer

Last synced: 19 Jan 2025

https://github.com/cbebe/eclass-event-scraper

Scrapes for Calendar Events in eClass using Puppeteer

node puppeteer

Last synced: 24 Jan 2025

https://github.com/ryanweal/papercards

Generate nice bitmaps for Waveshare e-ink displays using Vue.js and Nuxt layouts, and puppeteer for scraping data and screenshots. All running on raspberry pi!

e-ink e-ink-wireless js node puppeteer raspberry-pi raspberrypi vue vuejs waveshare

Last synced: 19 Jan 2025

https://github.com/nickw444/abb-speedtest

Puppeteer script to run scheduled Aussie Broadband speed tests

abb-speedtest aussie-broadband puppeteer

Last synced: 19 Jan 2025

https://github.com/girkovarpa/yandex-image-scraper

Simple puppeteer script to scrape Yandex image search.

image puppeteer scrape scraper search yandex

Last synced: 24 Jan 2025

https://github.com/ahgsql/serp-cached

Google Serp Ranking Scraper With Cache Feature

caching puppeteer scraper serp

Last synced: 19 Jan 2025

https://github.com/gyandeeps/saavn-to-gaana

Convert saavn playlist to gaana playlist

gaana puppeteer saavn

Last synced: 24 Jan 2025

https://github.com/gughog/smtiv-webscrapper-tool

A web scrapper to scrape data from a smt iv related website.

javascript node puppeteer webscraping

Last synced: 31 Jan 2025

https://github.com/epilande/jester

🃏 Jest Puppeteer End-to-End

e2e jest puppeteer test

Last synced: 25 Jan 2025

https://github.com/altipla-consulting/pdfgen

Server to generate PDFs with puppeteer through a web API.

pdf puppeteer

Last synced: 25 Jan 2025

https://github.com/younusaliakash/web-automation-cookie-consent

Capture screenshots of a webpage with cookie consents, ads, and offers. Take one after removing the popup and another after accepting it. Ensure clarity and accuracy in your screenshots.

cookie-consent puppeteer web-automation

Last synced: 01 Feb 2025

https://github.com/younusaliakash/web-automation-invoice-printer

Automatic invoice generator with puppet.js and express.js that will convert an html invoice to pdf and download automatically

expressjs invoice-generator puppeteer web-automation

Last synced: 01 Feb 2025

https://github.com/younusaliakash/web-automation-deep-link

Easily collect HackerNews links with hn.algolia.com. Swiftly process comments using BullMQ. Understand sentiments (positive, negative, neutral) effortlessly. Store data in Redis for quick access. Simplify your analysis, make informed decisions effortlessly.

deep-link puppeteer web-automation

Last synced: 01 Feb 2025

https://github.com/younusaliakash/simple-ecommerce-crawler

Effortlessly manage ecommerce data using our cutting-edge solution! With Puppeteer.js, we extract product links, process them efficiently using BullMQ, and store key details in Redis. Experience seamless web scraping, precise data processing, and reliable storage, empowering businesses with accurate insights.

ecommerce-crawler puppeteer web-automation

Last synced: 01 Feb 2025

https://github.com/foysalbn/dte-electron

A tool to Automate DTE Stipend repeating task

dte dte-stipend electron puppeteer

Last synced: 01 Feb 2025

https://github.com/anibalalpizar/puppeteer-overview

Control your browser using Javascript code, together with the Puppeteer library and Nodejs

nodejs puppeteer webscraping

Last synced: 08 Jan 2025

https://github.com/dutragames/bot-de-felicidades-facebook

Um simples bot que envia felicidades aos seus amigos no face!

bot facebook html-css-javascript nodejs puppeteer

Last synced: 19 Jan 2025

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 04 Jan 2025

https://github.com/nkyazhin/puppeteer-rq

If you are writing puppeteer tests, and you want to mock your network responses easily – then this package will help you.

mocker puppeteer puppeteer-rq

Last synced: 25 Jan 2025

https://github.com/dzmitry-duboyski/automation-framework-using-jest-and-puppeteer

Part #5: Automation Framework using Jest and Puppeteer for course https://www.udemy.com/course/automated-headless-browser-testing-with-puppeteer/

jest puppeteer

Last synced: 12 Jan 2025

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 07 Jan 2025

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 04 Jan 2025

https://github.com/dkgee/tk_spa

nodejs案例 puppeteer

centos7 nodejs puppeteer windows-7

Last synced: 22 Dec 2024

https://github.com/jhowbhz/scrap-consultaprocessos-rj

Esse é um caso de estudo sobre puppeteer

nodejs processos processos-rj puppeteer rj webscrap

Last synced: 26 Jan 2025

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/devstar2004/sotodata

You can find any firm lawyers over the world.

css html linkedin nodejs php puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/austenstone/puppeteer-github

Puppeteering GitHub

puppeteer

Last synced: 15 Dec 2024

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Jan 2025

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Jan 2025

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 08 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using ES Modules, esm, Mocha, Chai and Assert.

assert chai end-to-end-test-automation esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/capjavert/crawlathon

Winning solution for Crawlathon Hackathon by ReversingLabs

automation crawling hackathon hackathon-project puppeteer scraping

Last synced: 29 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Expect.

commonjs cucumber end-to-end-test-automation expect puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Assert.

assert commonjs end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/lukmanrambe/sekawan-restaurant

Restaurant Catalogue Website. Submission for "Menjadi Front-End Web Developer Expert" (https://www.dicoding.com/academies/219) Dicoding Class

accessibility codeceptjs css html jasmine javascript karma karma-jasmine progressive-web-app puppeteer pwa semantic-html webpack workbox

Last synced: 18 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-jasmine-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jasmine and Expect.

commonjs end-to-end-test-automation jasmine puppeteer puppeteer-commonjs-jasmine

Last synced: 11 Jan 2025

https://github.com/cankorkmazim/google-ads-list

You can create a list of advertisements placed on Google through words.

google-ads google-crawler puppeteer

Last synced: 30 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-babel-jest-expect

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, BabelJS, Jest and Expect.

babel end-to-end-test-automation es6 puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Assert.

assert chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber, Chai and Expect.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/ghdwlsgur/node-crawling

# puppeteer 라이브러리를 사용하여 웹크롤링하기

crawling node puppeteer

Last synced: 27 Dec 2024

https://github.com/ssv445/js-rendering-proxy-docker

JS Rendering Proxy API to Handle JS Website in Your Crawler.

crawler proxy puppeteer

Last synced: 18 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-assert

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, ESM, Mocha and Assert.

assert e2e-test e2e-testing e2e-tests es6 esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Cucumber, Chai and Should.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/tuurdutoit/puppeteer-extensible

Exports all Puppeteer's classes, so they can be extended

puppeteer utility

Last synced: 07 Jan 2025

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 08 Jan 2025

https://github.com/andrewjbateman/node-puppeteer-webscraper

:clipboard: Node.js with puppeteer to extract web content from Google Chrome

cheerio html5 javascript nodejs puppeteer webscrapping

Last synced: 27 Dec 2024

https://github.com/riskers/sideex2puppeteer

sideex command to puppeteer command

puppeteer sideex

Last synced: 07 Jan 2025

https://github.com/evanhalley/hatjitbot

A simple Slackbot for requesting a Hatjitsu room for Agile/Scrum style story sizing.

hatjitsu javascript nodejs puppeteer slack slackbot

Last synced: 30 Dec 2024

https://github.com/lucassimao/coinmarketcap-crawler

Crypto currencies market data from http://coinmarketcap.com/ crawled using puppteer + expressjs backend + Elasticsearch + React frontend

elasticsearch express nodejs puppeteer react

Last synced: 23 Jan 2025

https://github.com/nikukyugamer/amount-of-your-dmm-mobile-traffic

DMM モバイル の「データ通信量」を取得してCSVで出力する

dmm mvno puppeteer rakuten scraping

Last synced: 14 Jan 2025

https://github.com/ujen5173/hashnode-clone

This is a full stack t3 app. This app is a clone version of Hashnode. It has all the features a hashnode has.

clone clone-app hashnode hashnode-clone next-auth nextjs prisma puppeteer t3-stack tailwindcss trpc web-scrapping

Last synced: 30 Dec 2024

https://github.com/tinkeringaround/occ

One-Click-Checker Electron App

electron puppeteer react testing tool typescript

Last synced: 08 Nov 2024

https://github.com/ekamid/goodreads-book-scrapper

Scrap Goodreads Book information using Puppeteer

javascript puppeteer scrapper scrapping typescript

Last synced: 08 Jan 2025

https://github.com/showlotus/lansite

Forwarding pages between machines in a LAN

lan nuxt puppeteer

Last synced: 15 Dec 2024

https://github.com/janumedia/puppeteer-ssr

Puppeteer SSR example

chromium node puppeteer ssr

Last synced: 29 Dec 2024

https://github.com/reshnivisionx/web_scrapping_react

I developed a web application that scrapes website content into PDFs, HTML snapshots, and screenshots using Puppeteer for automation. The data, along with scrape timestamps, is stored in MongoDB for retrieval and download. The frontend interface allows users to input URLs and select desired formats with ease.

axios expressjs mongodb nodejs puppeteer reactjs

Last synced: 30 Dec 2024

https://github.com/argshook/sitemap-to-html

CLI tool to generate HTML files for each link defined in sitemap.xml

crawlers html-snapshot puppeteer sitemap

Last synced: 14 Jan 2025

https://github.com/teitei-tk/example-puppeteer-google-functions

example Puppeteer on Google Cloud functions

cloud-functions puppeteer

Last synced: 08 Dec 2024