Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/louiscklaw/page-change-detect-tryout

page-change-detect-tryout

javascript puppeteer

Last synced: 20 Dec 2024

https://github.com/zachltech/duckduckgoscraper-firebase

Fork of a previous project of mine with Firebase Cloud Functions/Firestore integration.

firebase firebase-database firebase-functions javascript puppeteer

Last synced: 30 Dec 2024

https://github.com/nubisub/tipsen2

Males buka sipadung ? Titip Absen aja

automation node-cron puppeteer

Last synced: 06 Nov 2024

https://github.com/yashkathe/download-wallpapers-cli

Search wallpapers from terminal directly and the script will download all the high resolution wallapers from the website

expressjs nodejs puppeteer script wallpaper web-scraping

Last synced: 25 Dec 2024

https://github.com/sj22032003/scrapper-basic-flipkart

Minor web scrapper using puppeteer to scrap data from Flipkart listing

bun puppeteer typescript

Last synced: 06 Jan 2025

https://github.com/argshook/sitemap-to-html

CLI tool to generate HTML files for each link defined in sitemap.xml

crawlers html-snapshot puppeteer sitemap

Last synced: 14 Jan 2025

https://github.com/tamanobi/dokku-puppeteer-ss-server

Screenshot server using puppeteer on dokku

dokku puppeteer screenshot-server

Last synced: 21 Jan 2025

https://github.com/justshush/whatsapp-bot

This is a whatsapp bot that sends a message repeatedly to a person on your contacts.

bot nodejs puppeteer whatsapp whatsapp-web

Last synced: 25 Jan 2025

https://github.com/reshnivisionx/web_scrapping_react

I developed a web application that scrapes website content into PDFs, HTML snapshots, and screenshots using Puppeteer for automation. The data, along with scrape timestamps, is stored in MongoDB for retrieval and download. The frontend interface allows users to input URLs and select desired formats with ease.

axios expressjs mongodb nodejs puppeteer reactjs

Last synced: 30 Dec 2024

https://github.com/horatiumarginean/mimirbot

Discord bot that contains various methods for retrieving and notifying me of the knowledge I find useful.

discord-js puppeteer

Last synced: 12 Oct 2024

https://github.com/vedovati-matteo/gpu-price-tracker

A sophisticated web scraper for tracking GPU prices across e-commerce platforms, featuring proxy rotation, CAPTCHA handling, and data visualization.

captcha-handling docker fullstack gpu-prices javascript mongodb next-js node-js proxy-rotation puppeteer telegram-bot web-scraping

Last synced: 21 Jan 2025

https://github.com/janumedia/puppeteer-ssr

Puppeteer SSR example

chromium node puppeteer ssr

Last synced: 29 Dec 2024

https://github.com/ekamid/goodreads-book-scrapper

Scrap Goodreads Book information using Puppeteer

javascript puppeteer scrapper scrapping typescript

Last synced: 08 Jan 2025

https://github.com/ashutoshsce/nys-liquor-authority

Directly scrape records from https://www.tran.sla.ny.gov/JSP/query/PublicQueryAdvanceSearchPage.jsp and present it in datatable format

datatable expressjs mongodb node nys-liquor-authority puppeteer vuejs website-scraper

Last synced: 16 Dec 2024

https://github.com/tinkeringaround/occ

One-Click-Checker Electron App

electron puppeteer react testing tool typescript

Last synced: 08 Nov 2024

https://github.com/ujen5173/hashnode-clone

This is a full stack t3 app. This app is a clone version of Hashnode. It has all the features a hashnode has.

clone clone-app hashnode hashnode-clone next-auth nextjs prisma puppeteer t3-stack tailwindcss trpc web-scrapping

Last synced: 30 Dec 2024

https://github.com/nikukyugamer/amount-of-your-dmm-mobile-traffic

DMM モバイル の「データ通信量」を取得してCSVで出力する

dmm mvno puppeteer rakuten scraping

Last synced: 14 Jan 2025

https://github.com/kirk-en/nes-video-fetch

A web scraping tool designed to fetch download links for NES (Nintendo Entertainment System) long play videos based on game title. This tool currently supports pulling long plays and wiki info for 443 licensed NES titles.

puppeteer retrogaming scraping video-downloader video-processing

Last synced: 25 Jan 2025

https://github.com/evanhalley/hatjitbot

A simple Slackbot for requesting a Hatjitsu room for Agile/Scrum style story sizing.

hatjitsu javascript nodejs puppeteer slack slackbot

Last synced: 30 Dec 2024

https://github.com/riskers/sideex2puppeteer

sideex command to puppeteer command

puppeteer sideex

Last synced: 07 Jan 2025

https://github.com/k4u5h4l/automate-music-download

A headless chrome script to automate the process of downloading large amounts of FLAC (lossless) audio.

javascript nodejs puppeteer scraping

Last synced: 06 Jan 2025

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 08 Jan 2025

https://github.com/alxzu/imm-puppeteer

Search the IMM website for free places for the vehicle controller

nodejs puppeteer scraper

Last synced: 10 Jan 2025

https://github.com/tuurdutoit/puppeteer-extensible

Exports all Puppeteer's classes, so they can be extended

puppeteer utility

Last synced: 07 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Cucumber, Chai and Should.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-assert

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, ESM, Mocha and Assert.

assert e2e-test e2e-testing e2e-tests es6 esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber, Chai and Expect.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Assert.

assert chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-babel-jest-expect

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, BabelJS, Jest and Expect.

babel end-to-end-test-automation es6 puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jasmine-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jasmine and Expect.

commonjs end-to-end-test-automation jasmine puppeteer puppeteer-commonjs-jasmine

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Assert.

assert commonjs end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Expect.

commonjs cucumber end-to-end-test-automation expect puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using ES Modules, esm, Mocha, Chai and Assert.

assert chai end-to-end-test-automation esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 08 Jan 2025

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Jan 2025

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Jan 2025

https://github.com/khalyomede/hypercharged

Generates a static, prerendered site from your original website.

html javascript node nodejs npm prerender prerendering puppeteer renderer rendering single-page-applications

Last synced: 22 Jan 2025

https://github.com/the-phinisher/auto-netaccess

Automatic renewal of authorization for IITM netaccess

iitm netacces nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/austenstone/puppeteer-github

Puppeteering GitHub

puppeteer

Last synced: 15 Dec 2024

https://github.com/devstar2004/sotodata

You can find any firm lawyers over the world.

css html linkedin nodejs php puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/whosydd/cookie-format

format cookie for lib

cookie format puppeteer

Last synced: 20 Jan 2025

https://github.com/bllsglm/scrape-with-puppeteer

Scrape with Puppeteer

node-js puppeteer scraper

Last synced: 20 Jan 2025

https://github.com/baxsm/scrapway

Scrapway allows users to create powerful data scraping workflows and execute them either manually or via cron jobs. With an intuitive UI and support for various tasks such as user interactions, data extraction, storage, and result delivery – you can easily automate scraping operations with minimal effort.

cheerio nextjs openai puppeteer scraping shadcn-ui stripe tailwindcss

Last synced: 06 Dec 2024

https://github.com/dkgee/tk_spa

nodejs案例 puppeteer

centos7 nodejs puppeteer windows-7

Last synced: 22 Dec 2024

https://github.com/gonzalofh/travel-ban-updates

This script acts a web scraper for the Covid-19 travel restrictions page on the US Gov Travel website. It returns the last date that guidelines were updated.

covid covid-19 covid19 js nodejs puppeteer travel-ban travelban

Last synced: 20 Jan 2025

https://github.com/akihokurino/goerli-charger

goerli faucet auto charge

lambda nodejs puppeteer

Last synced: 05 Dec 2024

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 04 Jan 2025

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 07 Jan 2025

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 04 Jan 2025

https://github.com/dutragames/bot-de-felicidades-facebook

Um simples bot que envia felicidades aos seus amigos no face!

bot facebook html-css-javascript nodejs puppeteer

Last synced: 19 Jan 2025

https://github.com/anibalalpizar/puppeteer-overview

Control your browser using Javascript code, together with the Puppeteer library and Nodejs

nodejs puppeteer webscraping

Last synced: 08 Jan 2025

https://github.com/zahradnik-ondrej/jobscz-scraper

A simple data scraper of Jobs.cz written in multiple JS/TS libraries.

javascript jobs playwright puppeteer selenium typescript web-scraping

Last synced: 07 Jan 2025

https://github.com/ellache/adjust_your_algo

Run puppeteer core in the background to modify your digital profile by navigating repeatedly to a specified set of webpages.

nodejs puppeteer puppeteer-core

Last synced: 04 Jan 2025

https://github.com/dm94/another-autologin

Daily auto login to get things done

autologin nodejs puppeteer

Last synced: 06 Jan 2025

https://github.com/optimics/docker-puppeteer

Docker image that includes everything needed to run Puppeteer.js on Bitbucket Pipelines

bitbucket-pipelines docker nodejs puppeteer

Last synced: 06 Jan 2025

https://github.com/vi-ssh-al/flipkart-product-price-tracker

A MERN stack app to track Flipkart product prices, reviews, and ratings. Users can add product links to fetch details, view historical price changes, search by title, filter by price, and update product prices on demand.

expressjs mongodb nodejs puppeteer reactjs tailwindcss

Last synced: 15 Jan 2025

https://github.com/copha-project/copha

Open-Source Software For Managing Tasks

crawler framework nodejs puppeteer selenium

Last synced: 15 Jan 2025

https://github.com/zewa666/au-puppeteer-example

A sample showing how an Aurelia app can be tested with Puppeteer

aurelia e2e-tests jest puppeteer typescript

Last synced: 15 Jan 2025

https://github.com/naoki-00-ito/js-scraping

Webスクレイピングプラグラム

dotenv javascript nodejs puppeteer scraping

Last synced: 11 Jan 2025

https://github.com/rishi-raj-jain/grabscreen

GrabScreen - A Screenshot Generator

api chrome-aws-lambda nextjs puppeteer serverless

Last synced: 26 Dec 2024

https://github.com/shuuji3/pukiwiki-bot

🥝 Bot to publish articles to Pukiwiki site

pukiwiki puppeteer

Last synced: 29 Nov 2024

https://github.com/makelove/chromedp_examples

chromedp官方代码,中文注释

chromedp puppeteer

Last synced: 20 Jan 2025

https://github.com/samthor/headless-test

Run Mocha tests in a headless browser

http mocha puppeteer test

Last synced: 18 Jan 2025

https://github.com/manjillama/node-redis-ci

Simple React/Node application using MongoDB and Redis (database caching). Jest and puppeteer for automated browser testing and Travis for CI

google-oauth2 jest mongodb mongoose node puppeteer react redis travis-ci

Last synced: 22 Jan 2025

https://github.com/yordadev/yorviewer

Yorviewer is a simple view bot that utilizes proxies and incognito.

bot nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/konglingwen94/scraper

批量抓取社交平台数据的脚本库

javascript nodejs puppeteer

Last synced: 25 Dec 2024

https://github.com/trankhacbinhduong/nuxt-pdf-utils

Doing amazing things about pdf in the nuxt app :tada:

nuxt pdf-generation puppeteer

Last synced: 25 Dec 2024

https://github.com/yammerjp/pocket-list

A list of websites in getpocket.com (third party application)

nextjs pocket puppeteer react

Last synced: 28 Dec 2024

https://github.com/rushi0508/insta-reels-automation

Fetches the reels for different users including captions and stores it in AWS S3.

javascript nodejs puppeteer webscraping

Last synced: 22 Jan 2025

https://github.com/mycase/puppeteer-har-server

An HTTP server that exposes functionality offered by puppeteer-har

har puppeteer puppeteer-har

Last synced: 22 Jan 2025

https://github.com/arfazhxss/app-sys

Automation System contains a series of scripts mostly written in bash and python that helps automate generation of multiple PDF documents at ones from Learning In Motion.

bash latex puppeteer python3 shell typescript

Last synced: 22 Jan 2025

https://github.com/luqueee/moodle-rest-scraper

Rest API express with puppeteer library for scraping information of a user

express moodle puppeteer

Last synced: 22 Jan 2025

https://github.com/abduldevhub/react-mountain

A repository containing all of the React projects I made to test and learn new react concepts. Each project resides in its own dedicated folder.

css html javascript puppeteer react scss threejs typescript vite

Last synced: 22 Jan 2025

https://github.com/aliahmedm48/searchtweets

Node.js-based project that automates the process of scraping tweets from specified Twitter accounts to count mentions of stock tickers (e.g., $TSLA).

nodejs puppeteer twitter

Last synced: 22 Jan 2025

https://github.com/arbaaz/puppeteer-typescript

A template to get started with puppeteer in typescript

puppeteer typescript

Last synced: 05 Dec 2024

https://github.com/gabrielimartins7/robo_extrai_dados

Extraindo dados de outros sites com Puppeteer JS :robot:

instagram javascript puppeteer

Last synced: 24 Dec 2024

https://github.com/creativeprojects/gallerydownloader

Download images from a webpage using headless chrome

puppeteer

Last synced: 05 Jan 2025

https://github.com/Idan-sh/Puppeteer-Automation

a JavaScript web-form test automation using the Puppeteer library.

automation-testing javascript puppeteer

Last synced: 16 Jan 2025

https://github.com/jedrzejratajczak/scraper

Web Scraper with Discord Bot running as Windows process

cron discord-bot puppeteer sqlite web-scraping windows-process

Last synced: 28 Dec 2024

https://github.com/luminati-io/javascript-scraping-libraries

The top JavaScript web scraping libraries, featuring key tools like Playwright, Puppeteer, and Cheerio, for efficient and scalable data extraction.

axios cheerio crawlee javascript node-curl nodejs playwright puppeteer web-scraping

Last synced: 20 Jan 2025

https://github.com/steel-dev/steel-puppeteer-starter

A starter project for using Puppeteer with Steel on Node.js & TypeScript

browser-automation puppeteer web-scraping

Last synced: 16 Jan 2025

https://github.com/60late/node.js-crawler

使用node.js+puppeteer+node-xlsx 爬取某网站数据并且导出到excel中的demo

node-xlsx nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/briankarlsayen/note-app-server

restful api for note-app-client

expressjs postgre puppeteer sequelize

Last synced: 22 Dec 2024

https://github.com/nstseek/download-all-github-repos

Automated script that downloads every repo from a GitHub organization or user

automation download eslint github organization prettier puppeteer repositories repository scripting typescript user

Last synced: 16 Jan 2025