Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 04 Jan 2025

https://github.com/naoki-00-ito/js-scraping

Webスクレイピングプラグラム

dotenv javascript nodejs puppeteer scraping

Last synced: 11 Jan 2025

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 23 Dec 2024

https://github.com/dkgee/tk_spa

nodejs案例 puppeteer

centos7 nodejs puppeteer windows-7

Last synced: 22 Dec 2024

https://github.com/marcinrek/seed

Cutup boilerplate with support of: react, hyperapp and more ...

boilerplate-template boilerplates hyperapp mocha puppeteer react scaffold webpack

Last synced: 28 Jan 2025

https://github.com/makelove/chromedp_examples

chromedp官方代码,中文注释

chromedp puppeteer

Last synced: 20 Jan 2025

https://github.com/lemonade-lab/lvyjs

为 nodejs 开发而设计的打包构建工具

esbuild lvyjs nodejs puppeteer rollup tsx

Last synced: 13 Jan 2025

https://github.com/manjillama/node-redis-ci

Simple React/Node application using MongoDB and Redis (database caching). Jest and puppeteer for automated browser testing and Travis for CI

google-oauth2 jest mongodb mongoose node puppeteer react redis travis-ci

Last synced: 22 Jan 2025

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 04 Feb 2025

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/christiancesar/hunter

Scraping of the target web application, using puppeeter, node with typescript and best practices.

backend ddd factory-pattern fullstack-development mongodb-atlas nodejs observer-pattern poo puppeteer react tdd typescript

Last synced: 10 Oct 2024

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/jprando/lotofacil

Buscar informacoes do ultimo sorteio da lotofacil

javascript lotofacil puppeteer

Last synced: 28 Jan 2025

https://github.com/devstar2004/sotodata

You can find any firm lawyers over the world.

css html linkedin nodejs php puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/hongzz0618/automated-test

unit testing e2e tests with Jest&puppeteer

e2e-tests jest puppeteer unittesting

Last synced: 28 Dec 2024

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel 蓋棉被純聊天.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/rushi0508/insta-reels-automation

Fetches the reels for different users including captions and stores it in AWS S3.

javascript nodejs puppeteer webscraping

Last synced: 22 Jan 2025

https://github.com/mycase/puppeteer-har-server

An HTTP server that exposes functionality offered by puppeteer-har

har puppeteer puppeteer-har

Last synced: 22 Jan 2025

https://github.com/arfazhxss/app-sys

Automation System contains a series of scripts mostly written in bash and python that helps automate generation of multiple PDF documents at ones from Learning In Motion.

bash latex puppeteer python3 shell typescript

Last synced: 22 Jan 2025

https://github.com/luqueee/moodle-rest-scraper

Rest API express with puppeteer library for scraping information of a user

express moodle puppeteer

Last synced: 22 Jan 2025

https://github.com/abduldevhub/react-mountain

A repository containing all of the React projects I made to test and learn new react concepts. Each project resides in its own dedicated folder.

css html javascript puppeteer react scss threejs typescript vite

Last synced: 22 Jan 2025

https://github.com/aliahmedm48/searchtweets

Node.js-based project that automates the process of scraping tweets from specified Twitter accounts to count mentions of stock tickers (e.g., $TSLA).

nodejs puppeteer twitter

Last synced: 22 Jan 2025

https://github.com/kayantchian/fooddatascraper

FoodDataScraper is a browser extension that performs web scraping on predefined restaurant menu websites. It collects data from these menus and generates automated spreadsheets, optimizing the internal menu registration process for businesses.

csv data-science javascript papaparse puppeteer webscrapy

Last synced: 25 Jan 2025

https://github.com/joe-dakroub/prototype_respond_cli

Prototype CLI for a component framework

javascript nodejs puppeteer redom

Last synced: 28 Jan 2025

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicação console que fornece informações dos elencos, próximas partidas e notícias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 10 Oct 2024

https://github.com/sidvishnoi/subresources

List all subresources/assets (CSS/JS files, images, fonts, audio/video etc.) used in a document.

hacktoberfest http-dependencies puppeteer subresources

Last synced: 31 Jan 2025

https://github.com/Idan-sh/Puppeteer-Automation

a JavaScript web-form test automation using the Puppeteer library.

automation-testing javascript puppeteer

Last synced: 16 Jan 2025

https://github.com/gamboavalentinabel/nodejs-puppeteer

NodeJs version with all dependencies to run Puppeteer

docker nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/steel-dev/steel-puppeteer-starter

A starter project for using Puppeteer with Steel on Node.js & TypeScript

browser-automation puppeteer web-scraping

Last synced: 16 Jan 2025

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Jan 2025

https://github.com/sarukuku/dependency-checker

A command line tool that checks your web page's dependencies, what percentage of them are cross-origin or cross-domain and who's in control of them.

dependencies nodejs puppeteer whois

Last synced: 04 Feb 2025

https://github.com/kirk-en/nes-video-fetch

A web scraping tool designed to fetch download links for NES (Nintendo Entertainment System) long play videos based on game title. This tool currently supports pulling long plays and wiki info for 443 licensed NES titles.

puppeteer retrogaming scraping video-downloader video-processing

Last synced: 25 Jan 2025

https://github.com/60late/node.js-crawler

使用node.js+puppeteer+node-xlsx 爬取某网站数据并且导出到excel中的demo

node-xlsx nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/briankarlsayen/note-app-server

restful api for note-app-client

expressjs postgre puppeteer sequelize

Last synced: 22 Dec 2024

https://github.com/nstseek/download-all-github-repos

Automated script that downloads every repo from a GitHub organization or user

automation download eslint github organization prettier puppeteer repositories repository scripting typescript user

Last synced: 16 Jan 2025

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Jan 2025

https://github.com/arbaaz/puppeteer-typescript

A template to get started with puppeteer in typescript

puppeteer typescript

Last synced: 01 Feb 2025

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Oct 2024

https://github.com/rameshmane7218/get-cookies-from-url

Get-Cookies-From-Url

nodejs puppeteer

Last synced: 20 Dec 2024

https://github.com/wgbx/puppeteer-auto

puppeteer collection of applications

puppeteer

Last synced: 04 Feb 2025

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 08 Jan 2025

https://github.com/ashnel3/usherd

command-line puppeteer script manager

puppeteer web-scraping

Last synced: 20 Dec 2024

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using ES Modules, esm, Mocha, Chai and Assert.

assert chai end-to-end-test-automation esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Expect.

commonjs cucumber end-to-end-test-automation expect puppeteer

Last synced: 11 Jan 2025

https://github.com/afeiship/pptr-html

Get html by puppeteer.

crawl html pptr puppeteer spider

Last synced: 07 Feb 2025

https://github.com/jackdbd/regl-experiments

Regl experiments with React and Typescript

jest puppeteer react regl webgl webpack

Last synced: 02 Feb 2025

https://github.com/dsc712/webscrapping-in-nodejs

Web scrapping static and dynamic sites using fetch,cheerio and puppeteer

axios cheerio express nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Assert.

assert commonjs end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jasmine-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jasmine and Expect.

commonjs end-to-end-test-automation jasmine puppeteer puppeteer-commonjs-jasmine

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-babel-jest-expect

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, BabelJS, Jest and Expect.

babel end-to-end-test-automation es6 puppeteer

Last synced: 11 Jan 2025

https://github.com/callaginn/kroger-sweeper

Download and categorize receipts from Kroger.com by scraping a user's purchases with puppeteer and playwright.

kroger kroger-api nodejs orders playwright puppeteer purchases receipt receipt-parser receipts scrape scraper

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/scraping-puppeteer-express

Projeto para estudos de web scraping com puppeteer + express.

express expressjs nodejs pug puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/simplified-application-robot

Sistema para aplicação em vagas simplificadas no LinkedIn.

javascript nodejs object-oriented-programming poo puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/puppeteer-studying

Repositório de estudos em Puppeteer.

javascript nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Assert.

assert chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber, Chai and Expect.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/adrianhdezm/spa-boilerplate

A boilerplate for building Single-Page Applications with React and TypeScript

jest json-server puppeteer react typescript webpack

Last synced: 16 Nov 2024

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-assert

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, ESM, Mocha and Assert.

assert e2e-test e2e-testing e2e-tests es6 esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/dgvalerio/timesheet-express-assistant

Back-end of timesheet-next-assistant

express puppeteer typescript

Last synced: 22 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Cucumber, Chai and Should.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/tuurdutoit/puppeteer-extensible

Exports all Puppeteer's classes, so they can be extended

puppeteer utility

Last synced: 07 Jan 2025

https://github.com/matthewjselby/json-resume

Generate a resume in both HTML and PDF from a JSON file.

gulp handlebars html javascript json puppeteer resume sass

Last synced: 13 Jan 2025

https://github.com/volodymyr-kasap/puppeteer-div-screenshot

Example of how to take a screenshot of each HTML block using puppeteer and sharp

puppeteer screenshot sharp typescript

Last synced: 02 Feb 2025

https://github.com/doczilla-app/issues

This is the space where you can engage with us directly, report any issues you encounter, request new features, or propose updates to our documentation.

html-to-image html-to-pdf html-to-pdf-api html2image html2pdf puppeteer

Last synced: 26 Jan 2025

https://github.com/mahmutmft/finki-scraper-app

A web scraping tool for FINKI's course directory, designed to automatically collect and display course information from the Faculty of Computer Science. Built with modern web technologies, it provides dynamic, responsive, and secure data presentation.

automation javascript nodejs puppeteer web-scraping

Last synced: 04 Feb 2025

https://github.com/zenika/google-puppet

Some headless Chrome scripts to manipulate G Suite

chrome-headless google puppeteer

Last synced: 16 Jan 2025

https://github.com/omarkhairy21/nodens-assignment-

Simple Authentication MVC With Unit Testing and e2e testing

expressjs jest jwt jwt-authentication nodejs pugjs puppeteer semantic-ui

Last synced: 16 Jan 2025

https://github.com/ulyssear/scrap_retroachievements

Bot scraper of metacritic which retrieving platforms and video games

github-workflow nodejs puppeteer scraper

Last synced: 28 Jan 2025

https://github.com/mcecode/pdf-made-easy

A CLI application and library for developing and creating PDF documents.

cli document html json liquid pdf puppeteer template yaml

Last synced: 22 Jan 2025

https://github.com/mstephen19/kuhlosul-app

Full-Stack artist portfolio for Kuhlosul utilizing a custom SoundCloud-scraper library written in Node.js, Express, GraphQL, and React.

apollo-cache apollo-client cheerio context-api express graphql jwt jwt-authentication mongodb mongoose nodejs nodemailer puppeteer react react-router rebass sessionstorage

Last synced: 04 Feb 2025

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 08 Jan 2025

https://github.com/ihoverlord/dx-currency

An API with Scrapped Data of 53 exchange rates against USD

api cheerio currency javascript nodejs puppeteer

Last synced: 05 Jan 2025

https://github.com/deadcoder0904/puppeteer

A demo of things automating generating screenshot, creating pdf & signing into Facebook with Puppeteer ✨

pdf puppeteer screenshot sign-in

Last synced: 14 Jan 2025

https://github.com/maximemoreillon/ebanking_scraper

A web scraper for account balance and transactions on an e-banking interface

puppeteer

Last synced: 22 Jan 2025

https://github.com/maximemoreillon/ts3_scraper

Scraper designed to retrieve the list of transactions of a TS3 corporate credit card.

credit-card puppeteer ts3

Last synced: 22 Jan 2025

https://github.com/korigamik/vuemastery-downloader

Download every vuemastery course locally.

puppeteer typescript vuejs

Last synced: 07 Feb 2025

https://github.com/riskers/sideex2puppeteer

sideex command to puppeteer command

puppeteer sideex

Last synced: 07 Jan 2025

https://github.com/evanhalley/hatjitbot

A simple Slackbot for requesting a Hatjitsu room for Agile/Scrum style story sizing.

hatjitsu javascript nodejs puppeteer slack slackbot

Last synced: 30 Dec 2024

https://github.com/nikukyugamer/amount-of-your-dmm-mobile-traffic

DMM モバイル の「データ通信量」を取得してCSVで出力する

dmm mvno puppeteer rakuten scraping

Last synced: 14 Jan 2025