Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/achanta3215/covid19indiascraper

To scrape covid 19 data from sources available

contributions-welcome covid-19 india node open-source puppeteer typescript

Last synced: 28 Dec 2024

https://github.com/tuurdutoit/puppeteer-utils

A library of utility functions for Puppeteer

library puppeteer utility

Last synced: 14 Jan 2025

https://github.com/tuurdutoit/puppeteer-find

Find elements with Puppeteer based on their content

dom find puppeteer query search utility

Last synced: 14 Jan 2025

https://github.com/portrunban/node-vk-puppeteer-user

This app removes inactive users from the group Vkontakte. base on puppeteer

puppeteer vk vkontakte

Last synced: 02 Jan 2025

https://github.com/prixladi/site-capture-puppet

Worker service capturing sites using puppeteer. Part of Site Capture project - https://github.com/prixladi/site-capture

docker mongodb nodejs puppeteer redis

Last synced: 16 Jan 2025

https://github.com/zachltech/duckduckgoscraper-firebase

Fork of a previous project of mine with Firebase Cloud Functions/Firestore integration.

firebase firebase-database firebase-functions javascript puppeteer

Last synced: 30 Dec 2024

https://github.com/yashkathe/download-wallpapers-cli

Search wallpapers from terminal directly and the script will download all the high resolution wallapers from the website

expressjs nodejs puppeteer script wallpaper web-scraping

Last synced: 25 Dec 2024

https://github.com/sj22032003/scrapper-basic-flipkart

Minor web scrapper using puppeteer to scrap data from Flipkart listing

bun puppeteer typescript

Last synced: 06 Jan 2025

https://github.com/argshook/sitemap-to-html

CLI tool to generate HTML files for each link defined in sitemap.xml

crawlers html-snapshot puppeteer sitemap

Last synced: 14 Jan 2025

https://github.com/reshnivisionx/web_scrapping_react

I developed a web application that scrapes website content into PDFs, HTML snapshots, and screenshots using Puppeteer for automation. The data, along with scrape timestamps, is stored in MongoDB for retrieval and download. The frontend interface allows users to input URLs and select desired formats with ease.

axios expressjs mongodb nodejs puppeteer reactjs

Last synced: 30 Dec 2024

https://github.com/janumedia/puppeteer-ssr

Puppeteer SSR example

chromium node puppeteer ssr

Last synced: 29 Dec 2024

https://github.com/ekamid/goodreads-book-scrapper

Scrap Goodreads Book information using Puppeteer

javascript puppeteer scrapper scrapping typescript

Last synced: 08 Jan 2025

https://github.com/tinkeringaround/occ

One-Click-Checker Electron App

electron puppeteer react testing tool typescript

Last synced: 08 Nov 2024

https://github.com/ujen5173/hashnode-clone

This is a full stack t3 app. This app is a clone version of Hashnode. It has all the features a hashnode has.

clone clone-app hashnode hashnode-clone next-auth nextjs prisma puppeteer t3-stack tailwindcss trpc web-scrapping

Last synced: 30 Dec 2024

https://github.com/nikukyugamer/amount-of-your-dmm-mobile-traffic

DMM モバイル の「データ通信量」を取得してCSVで出力する

dmm mvno puppeteer rakuten scraping

Last synced: 14 Jan 2025

https://github.com/evanhalley/hatjitbot

A simple Slackbot for requesting a Hatjitsu room for Agile/Scrum style story sizing.

hatjitsu javascript nodejs puppeteer slack slackbot

Last synced: 30 Dec 2024

https://github.com/riskers/sideex2puppeteer

sideex command to puppeteer command

puppeteer sideex

Last synced: 07 Jan 2025

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 08 Jan 2025

https://github.com/tuurdutoit/puppeteer-extensible

Exports all Puppeteer's classes, so they can be extended

puppeteer utility

Last synced: 07 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Cucumber, Chai and Should.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-assert

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, ESM, Mocha and Assert.

assert e2e-test e2e-testing e2e-tests es6 esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber, Chai and Expect.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Assert.

assert chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-babel-jest-expect

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, BabelJS, Jest and Expect.

babel end-to-end-test-automation es6 puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jasmine-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jasmine and Expect.

commonjs end-to-end-test-automation jasmine puppeteer puppeteer-commonjs-jasmine

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jest-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jest and Assert.

assert commonjs end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Expect.

commonjs cucumber end-to-end-test-automation expect puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-assert

Puppeteer end-to-end test automation boilerplate, Using ES Modules, esm, Mocha, Chai and Assert.

assert chai end-to-end-test-automation esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 08 Jan 2025

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Jan 2025

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Jan 2025

https://github.com/austenstone/puppeteer-github

Puppeteering GitHub

puppeteer

Last synced: 15 Dec 2024

https://github.com/devstar2004/sotodata

You can find any firm lawyers over the world.

css html linkedin nodejs php puppeteer webscraping

Last synced: 24 Jan 2025

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/baxsm/scrapway

Scrapway allows users to create powerful data scraping workflows and execute them either manually or via cron jobs. With an intuitive UI and support for various tasks such as user interactions, data extraction, storage, and result delivery – you can easily automate scraping operations with minimal effort.

cheerio nextjs openai puppeteer scraping shadcn-ui stripe tailwindcss

Last synced: 06 Dec 2024

https://github.com/dkgee/tk_spa

nodejs案例 puppeteer

centos7 nodejs puppeteer windows-7

Last synced: 22 Dec 2024

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 04 Jan 2025

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 07 Jan 2025

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 04 Jan 2025

https://github.com/dutragames/bot-de-felicidades-facebook

Um simples bot que envia felicidades aos seus amigos no face!

bot facebook html-css-javascript nodejs puppeteer

Last synced: 19 Jan 2025

https://github.com/anibalalpizar/puppeteer-overview

Control your browser using Javascript code, together with the Puppeteer library and Nodejs

nodejs puppeteer webscraping

Last synced: 08 Jan 2025

https://github.com/zahradnik-ondrej/jobscz-scraper

A simple data scraper of Jobs.cz written in multiple JS/TS libraries.

javascript jobs playwright puppeteer selenium typescript web-scraping

Last synced: 07 Jan 2025

https://github.com/ellache/adjust_your_algo

Run puppeteer core in the background to modify your digital profile by navigating repeatedly to a specified set of webpages.

nodejs puppeteer puppeteer-core

Last synced: 04 Jan 2025

https://github.com/vi-ssh-al/flipkart-product-price-tracker

A MERN stack app to track Flipkart product prices, reviews, and ratings. Users can add product links to fetch details, view historical price changes, search by title, filter by price, and update product prices on demand.

expressjs mongodb nodejs puppeteer reactjs tailwindcss

Last synced: 15 Jan 2025

https://github.com/copha-project/copha

Open-Source Software For Managing Tasks

crawler framework nodejs puppeteer selenium

Last synced: 15 Jan 2025

https://github.com/zewa666/au-puppeteer-example

A sample showing how an Aurelia app can be tested with Puppeteer

aurelia e2e-tests jest puppeteer typescript

Last synced: 15 Jan 2025

https://github.com/naoki-00-ito/js-scraping

Webスクレイピングプラグラム

dotenv javascript nodejs puppeteer scraping

Last synced: 11 Jan 2025

https://github.com/rishi-raj-jain/grabscreen

GrabScreen - A Screenshot Generator

api chrome-aws-lambda nextjs puppeteer serverless

Last synced: 26 Dec 2024

https://github.com/makelove/chromedp_examples

chromedp官方代码,中文注释

chromedp puppeteer

Last synced: 20 Jan 2025

https://github.com/manjillama/node-redis-ci

Simple React/Node application using MongoDB and Redis (database caching). Jest and puppeteer for automated browser testing and Travis for CI

google-oauth2 jest mongodb mongoose node puppeteer react redis travis-ci

Last synced: 22 Jan 2025

https://github.com/rushi0508/insta-reels-automation

Fetches the reels for different users including captions and stores it in AWS S3.

javascript nodejs puppeteer webscraping

Last synced: 22 Jan 2025

https://github.com/mycase/puppeteer-har-server

An HTTP server that exposes functionality offered by puppeteer-har

har puppeteer puppeteer-har

Last synced: 22 Jan 2025

https://github.com/arfazhxss/app-sys

Automation System contains a series of scripts mostly written in bash and python that helps automate generation of multiple PDF documents at ones from Learning In Motion.

bash latex puppeteer python3 shell typescript

Last synced: 22 Jan 2025

https://github.com/luqueee/moodle-rest-scraper

Rest API express with puppeteer library for scraping information of a user

express moodle puppeteer

Last synced: 22 Jan 2025

https://github.com/abduldevhub/react-mountain

A repository containing all of the React projects I made to test and learn new react concepts. Each project resides in its own dedicated folder.

css html javascript puppeteer react scss threejs typescript vite

Last synced: 22 Jan 2025

https://github.com/aliahmedm48/searchtweets

Node.js-based project that automates the process of scraping tweets from specified Twitter accounts to count mentions of stock tickers (e.g., $TSLA).

nodejs puppeteer twitter

Last synced: 22 Jan 2025

https://github.com/Idan-sh/Puppeteer-Automation

a JavaScript web-form test automation using the Puppeteer library.

automation-testing javascript puppeteer

Last synced: 16 Jan 2025

https://github.com/steel-dev/steel-puppeteer-starter

A starter project for using Puppeteer with Steel on Node.js & TypeScript

browser-automation puppeteer web-scraping

Last synced: 16 Jan 2025

https://github.com/60late/node.js-crawler

使用node.js+puppeteer+node-xlsx 爬取某网站数据并且导出到excel中的demo

node-xlsx nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/briankarlsayen/note-app-server

restful api for note-app-client

expressjs postgre puppeteer sequelize

Last synced: 22 Dec 2024

https://github.com/nstseek/download-all-github-repos

Automated script that downloads every repo from a GitHub organization or user

automation download eslint github organization prettier puppeteer repositories repository scripting typescript user

Last synced: 16 Jan 2025

https://github.com/jackdbd/regl-experiments

Regl experiments with React and Typescript

jest puppeteer react regl webgl webpack

Last synced: 07 Dec 2024

https://github.com/dsc712/webscrapping-in-nodejs

Web scrapping static and dynamic sites using fetch,cheerio and puppeteer

axios cheerio express nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/callaginn/kroger-sweeper

Download and categorize receipts from Kroger.com by scraping a user's purchases with puppeteer and playwright.

kroger kroger-api nodejs orders playwright puppeteer purchases receipt receipt-parser receipts scrape scraper

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/scraping-puppeteer-express

Projeto para estudos de web scraping com puppeteer + express.

express expressjs nodejs pug puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/simplified-application-robot

Sistema para aplicação em vagas simplificadas no LinkedIn.

javascript nodejs object-oriented-programming poo puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/puppeteer-studying

Repositório de estudos em Puppeteer.

javascript nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianhdezm/spa-boilerplate

A boilerplate for building Single-Page Applications with React and TypeScript

jest json-server puppeteer react typescript webpack

Last synced: 16 Nov 2024

https://github.com/dgvalerio/timesheet-express-assistant

Back-end of timesheet-next-assistant

express puppeteer typescript

Last synced: 22 Jan 2025

https://github.com/zenika/google-puppet

Some headless Chrome scripts to manipulate G Suite

chrome-headless google puppeteer

Last synced: 16 Jan 2025

https://github.com/omarkhairy21/nodens-assignment-

Simple Authentication MVC With Unit Testing and e2e testing

expressjs jest jwt jwt-authentication nodejs pugjs puppeteer semantic-ui

Last synced: 16 Jan 2025

https://github.com/mcecode/pdf-made-easy

A CLI application and library for developing and creating PDF documents.

cli document html json liquid pdf puppeteer template yaml

Last synced: 22 Jan 2025

https://github.com/deadcoder0904/puppeteer

A demo of things automating generating screenshot, creating pdf & signing into Facebook with Puppeteer ✨

pdf puppeteer screenshot sign-in

Last synced: 14 Jan 2025

https://github.com/maximemoreillon/ebanking_scraper

A web scraper for account balance and transactions on an e-banking interface

puppeteer

Last synced: 22 Jan 2025

https://github.com/maximemoreillon/ts3_scraper

Scraper designed to retrieve the list of transactions of a TS3 corporate credit card.

credit-card puppeteer ts3

Last synced: 22 Jan 2025

https://github.com/zhoukekestar/puppeteer-scripts

puppeteer scripts

puppeteer

Last synced: 20 Jan 2025

https://github.com/cityssm/puppeteer-launch

Launch Puppeteer, falling back to system browsers when the cached ones aren't working or aren't available.

puppeteer puppeteer-firefox

Last synced: 07 Dec 2024

https://github.com/khoiuna/business-qrcode-flyers

Generate web pages with QR code and screenshot them for businesses to use at trade shows.

bootstrap javascript php puppeteer python script

Last synced: 15 Jan 2025

https://github.com/prixladi/urlik

Url shortener service with advanced statistics.

asp-net-core docker docker-compose mongodb nextjs puppeteer react redis

Last synced: 16 Jan 2025

https://github.com/igor-starostenko/book-worm

Google maps bookmark import tool

automation bookmarks google-maps puppeteer

Last synced: 07 Dec 2024

https://github.com/viniciusamelio/rift_crawler

Um scraper criado em TS e seguindo práticas de arquitetura limpa.

clean-architecture puppeteer scraping typescript

Last synced: 22 Dec 2024

https://github.com/noriste/stackoverflow-52383438-cypress-issue

The same test run on Cypress/TestCafe/Puppeteer to check the strange behaviour of the former

cypress e2e-testing puppeteer testcafe

Last synced: 15 Dec 2024

https://github.com/captaincluster/sitesnap

A program that uses Puppeteer to visit the url given by the user and take a screenshot. The screenshot will then be saved for the user to view.

javascript nodejs puppeteer screenshot

Last synced: 31 Dec 2024