Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/marcinrek/seed

Cutup boilerplate with support of: react, hyperapp and more ...

boilerplate-template boilerplates hyperapp mocha puppeteer react scaffold webpack

Last synced: 28 Jan 2025

https://github.com/makelove/chromedp_examples

chromedp官方代码,中文注释

chromedp puppeteer

Last synced: 20 Jan 2025

https://github.com/manjillama/node-redis-ci

Simple React/Node application using MongoDB and Redis (database caching). Jest and puppeteer for automated browser testing and Travis for CI

google-oauth2 jest mongodb mongoose node puppeteer react redis travis-ci

Last synced: 22 Jan 2025

https://github.com/gabrielimartins7/robo_extrai_dados

Extraindo dados de outros sites com Puppeteer JS :robot:

instagram javascript puppeteer

Last synced: 24 Dec 2024

https://github.com/tetreum/puppeteer-for-crawling

Daily use crawling methods for puppeteer

crawler crawling puppeteer

Last synced: 04 Feb 2025

https://github.com/creativeprojects/gallerydownloader

Download images from a webpage using headless chrome

puppeteer

Last synced: 05 Jan 2025

https://github.com/jprando/lotofacil

Buscar informacoes do ultimo sorteio da lotofacil

javascript lotofacil puppeteer

Last synced: 28 Jan 2025

https://github.com/jedrzejratajczak/scraper

Web Scraper with Discord Bot running as Windows process

cron discord-bot puppeteer sqlite web-scraping windows-process

Last synced: 28 Dec 2024

https://github.com/luminati-io/javascript-scraping-libraries

The top JavaScript web scraping libraries, featuring key tools like Playwright, Puppeteer, and Cheerio, for efficient and scalable data extraction.

axios cheerio crawlee javascript node-curl nodejs playwright puppeteer web-scraping

Last synced: 20 Jan 2025

https://github.com/rushi0508/insta-reels-automation

Fetches the reels for different users including captions and stores it in AWS S3.

javascript nodejs puppeteer webscraping

Last synced: 22 Jan 2025

https://github.com/mycase/puppeteer-har-server

An HTTP server that exposes functionality offered by puppeteer-har

har puppeteer puppeteer-har

Last synced: 22 Jan 2025

https://github.com/arfazhxss/app-sys

Automation System contains a series of scripts mostly written in bash and python that helps automate generation of multiple PDF documents at ones from Learning In Motion.

bash latex puppeteer python3 shell typescript

Last synced: 22 Jan 2025

https://github.com/luqueee/moodle-rest-scraper

Rest API express with puppeteer library for scraping information of a user

express moodle puppeteer

Last synced: 22 Jan 2025

https://github.com/abduldevhub/react-mountain

A repository containing all of the React projects I made to test and learn new react concepts. Each project resides in its own dedicated folder.

css html javascript puppeteer react scss threejs typescript vite

Last synced: 22 Jan 2025

https://github.com/aliahmedm48/searchtweets

Node.js-based project that automates the process of scraping tweets from specified Twitter accounts to count mentions of stock tickers (e.g., $TSLA).

nodejs puppeteer twitter

Last synced: 22 Jan 2025

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website 📷

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/joe-dakroub/prototype_respond_cli

Prototype CLI for a component framework

javascript nodejs puppeteer redom

Last synced: 28 Jan 2025

https://github.com/0xcadams/resume

Vue-based app to generate a Chase Adams resume.

puppeteer resume vuejs

Last synced: 28 Dec 2024

https://github.com/kernix13/puppeteer-web-scraper

How to use Puppeteer for web scaping

puppeteer

Last synced: 05 Jan 2025

https://github.com/sidvishnoi/subresources

List all subresources/assets (CSS/JS files, images, fonts, audio/video etc.) used in a document.

hacktoberfest http-dependencies puppeteer subresources

Last synced: 31 Jan 2025

https://github.com/ribeirogab/puppeteer-currency-converter

Project to test the functionalities of the Node.js (version >= 13.4) using Puppeteer

currency-converter nodejs puppeteer scraper top-level-await

Last synced: 20 Jan 2025

https://github.com/ghdwlsgur/node-crawling

# puppeteer 라이브러리를 사용하여 웹크롤링하기

crawling node puppeteer

Last synced: 27 Dec 2024

https://github.com/Idan-sh/Puppeteer-Automation

a JavaScript web-form test automation using the Puppeteer library.

automation-testing javascript puppeteer

Last synced: 16 Jan 2025

https://github.com/steel-dev/steel-puppeteer-starter

A starter project for using Puppeteer with Steel on Node.js & TypeScript

browser-automation puppeteer web-scraping

Last synced: 16 Jan 2025

https://github.com/ihoverlord/dx-currency

An API with Scrapped Data of 53 exchange rates against USD

api cheerio currency javascript nodejs puppeteer

Last synced: 05 Jan 2025

https://github.com/sarukuku/dependency-checker

A command line tool that checks your web page's dependencies, what percentage of them are cross-origin or cross-domain and who's in control of them.

dependencies nodejs puppeteer whois

Last synced: 04 Feb 2025

https://github.com/60late/node.js-crawler

使用node.js+puppeteer+node-xlsx 爬取某网站数据并且导出到excel中的demo

node-xlsx nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/briankarlsayen/note-app-server

restful api for note-app-client

expressjs postgre puppeteer sequelize

Last synced: 22 Dec 2024

https://github.com/nstseek/download-all-github-repos

Automated script that downloads every repo from a GitHub organization or user

automation download eslint github organization prettier puppeteer repositories repository scripting typescript user

Last synced: 16 Jan 2025

https://github.com/arbaaz/puppeteer-typescript

A template to get started with puppeteer in typescript

puppeteer typescript

Last synced: 01 Feb 2025

https://github.com/doczilla-app/issues

This is the space where you can engage with us directly, report any issues you encounter, request new features, or propose updates to our documentation.

html-to-image html-to-pdf html-to-pdf-api html2image html2pdf puppeteer

Last synced: 26 Jan 2025

https://github.com/wgbx/puppeteer-auto

puppeteer collection of applications

puppeteer

Last synced: 04 Feb 2025

https://github.com/rameshmane7218/get-cookies-from-url

Get-Cookies-From-Url

nodejs puppeteer

Last synced: 20 Dec 2024

https://github.com/hongzz0618/automated-test

unit testing e2e tests with Jest&puppeteer

e2e-tests jest puppeteer unittesting

Last synced: 28 Dec 2024

https://github.com/lemonade-lab/lvyjs

为 nodejs 开发而设计的打包构建工具

esbuild lvyjs nodejs puppeteer rollup tsx

Last synced: 13 Jan 2025

https://github.com/jackdbd/regl-experiments

Regl experiments with React and Typescript

jest puppeteer react regl webgl webpack

Last synced: 02 Feb 2025

https://github.com/dsc712/webscrapping-in-nodejs

Web scrapping static and dynamic sites using fetch,cheerio and puppeteer

axios cheerio express nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/callaginn/kroger-sweeper

Download and categorize receipts from Kroger.com by scraping a user's purchases with puppeteer and playwright.

kroger kroger-api nodejs orders playwright puppeteer purchases receipt receipt-parser receipts scrape scraper

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/scraping-puppeteer-express

Projeto para estudos de web scraping com puppeteer + express.

express expressjs nodejs pug puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/simplified-application-robot

Sistema para aplicação em vagas simplificadas no LinkedIn.

javascript nodejs object-oriented-programming poo puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/puppeteer-studying

Repositório de estudos em Puppeteer.

javascript nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianhdezm/spa-boilerplate

A boilerplate for building Single-Page Applications with React and TypeScript

jest json-server puppeteer react typescript webpack

Last synced: 16 Nov 2024

https://github.com/dgvalerio/timesheet-express-assistant

Back-end of timesheet-next-assistant

express puppeteer typescript

Last synced: 22 Jan 2025

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Oct 2024

https://github.com/zenika/google-puppet

Some headless Chrome scripts to manipulate G Suite

chrome-headless google puppeteer

Last synced: 16 Jan 2025

https://github.com/omarkhairy21/nodens-assignment-

Simple Authentication MVC With Unit Testing and e2e testing

expressjs jest jwt jwt-authentication nodejs pugjs puppeteer semantic-ui

Last synced: 16 Jan 2025

https://github.com/ulyssear/scrap_retroachievements

Bot scraper of metacritic which retrieving platforms and video games

github-workflow nodejs puppeteer scraper

Last synced: 28 Jan 2025

https://github.com/mcecode/pdf-made-easy

A CLI application and library for developing and creating PDF documents.

cli document html json liquid pdf puppeteer template yaml

Last synced: 22 Jan 2025

https://github.com/mstephen19/kuhlosul-app

Full-Stack artist portfolio for Kuhlosul utilizing a custom SoundCloud-scraper library written in Node.js, Express, GraphQL, and React.

apollo-cache apollo-client cheerio context-api express graphql jwt jwt-authentication mongodb mongoose nodejs nodemailer puppeteer react react-router rebass sessionstorage

Last synced: 04 Feb 2025

https://github.com/lameuler/astro-pdf

A simple Astro integration to generate PDFs from built pages.

astro astro-integration pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 23 Dec 2024

https://github.com/deadcoder0904/puppeteer

A demo of things automating generating screenshot, creating pdf & signing into Facebook with Puppeteer ✨

pdf puppeteer screenshot sign-in

Last synced: 14 Jan 2025

https://github.com/maximemoreillon/ebanking_scraper

A web scraper for account balance and transactions on an e-banking interface

puppeteer

Last synced: 22 Jan 2025

https://github.com/maximemoreillon/ts3_scraper

Scraper designed to retrieve the list of transactions of a TS3 corporate credit card.

credit-card puppeteer ts3

Last synced: 22 Jan 2025

https://github.com/christiancesar/hunter

Scraping of the target web application, using puppeeter, node with typescript and best practices.

backend ddd factory-pattern fullstack-development mongodb-atlas nodejs observer-pattern poo puppeteer react tdd typescript

Last synced: 10 Oct 2024

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel 蓋棉被純聊天.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/vgvr0/scraper-puppeteer

This project uses Puppeteer, a Node.js library which provides a high-level API to control Chrome or Chromium over the DevTools Protocol. Puppeteer runs headless by default, but can be configured to run full (non-headless) Chrome or Chromium.

node-js-scraper puppeteer puppeteer-scraper puppeteer-scraping

Last synced: 25 Jan 2025

https://github.com/zhoukekestar/puppeteer-scripts

puppeteer scripts

puppeteer

Last synced: 20 Jan 2025

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicação console que fornece informações dos elencos, próximas partidas e notícias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 10 Oct 2024

https://github.com/cityssm/puppeteer-launch

Launch Puppeteer, falling back to system browsers when the cached ones aren't working or aren't available.

puppeteer puppeteer-firefox

Last synced: 07 Dec 2024

https://github.com/khoiuna/business-qrcode-flyers

Generate web pages with QR code and screenshot them for businesses to use at trade shows.

bootstrap javascript php puppeteer python script

Last synced: 15 Jan 2025

https://github.com/gamboavalentinabel/nodejs-puppeteer

NodeJs version with all dependencies to run Puppeteer

docker nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/prixladi/urlik

Url shortener service with advanced statistics.

asp-net-core docker docker-compose mongodb nextjs puppeteer react redis

Last synced: 16 Jan 2025

https://github.com/viniciusamelio/rift_crawler

Um scraper criado em TS e seguindo práticas de arquitetura limpa.

clean-architecture puppeteer scraping typescript

Last synced: 22 Dec 2024

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Oct 2024

https://github.com/captaincluster/sitesnap

A program that uses Puppeteer to visit the url given by the user and take a screenshot. The screenshot will then be saved for the user to view.

javascript nodejs puppeteer screenshot

Last synced: 31 Dec 2024

https://github.com/ashnel3/usherd

command-line puppeteer script manager

puppeteer web-scraping

Last synced: 20 Dec 2024

https://github.com/evertonpavan/node-web-scraper-braesul

A web scraper built with Node.js using Puppeteer to get data of Braé Sul

javascript nodejs puppeteer

Last synced: 21 Jan 2025

https://github.com/tokisakikurumi2001/crawl_data

Crawl data from weather site

pandas-dataframe puppeteer weather

Last synced: 22 Jan 2025

https://github.com/oxylabs/bypass-captcha-puppeteer

A comprehensive tutorial with real code samples to learn how to bypass CAPTCHA with Puppeteer.

captcha puppeteer web-scraping

Last synced: 05 Feb 2025

https://github.com/flolu/bazel-node-puppeteer

Can't run Bazel nodejs_image with Puppeteer

bazel docker nodejs puppeteer rules-nodejs

Last synced: 09 Jan 2025

https://github.com/neulandagentur/adobe-stock-image-bot

📷 Adobe-Stock image id => author name

adobe adobe-stock bot puppeteer

Last synced: 29 Jan 2025

https://github.com/yarosj/crossdomain-selector

Retrieves a selector from another site by a screenshot

crossdomain puppeteer screenshot selector

Last synced: 29 Jan 2025

https://github.com/gabrielroot/notificado

Raspagem de dados (Web Scraping) no portal de notícias do IFNMG - Campus Januária

acessa campus-janu-ria hour nodejs notificado nunjucks postgresql puppeteer push-notifications pwa webscraping

Last synced: 28 Jan 2025

https://github.com/darkterminal/rest-screenshoot

REST Screenshoot is a free tool for capturing screenshots of webpages via a REST API. Free an always!

open-source puppeteer rest-api screenshoot

Last synced: 31 Dec 2024

https://github.com/volodymyr-kasap/puppeteer-div-screenshot

Example of how to take a screenshot of each HTML block using puppeteer and sharp

puppeteer screenshot sharp typescript

Last synced: 02 Feb 2025

https://github.com/kumarshivesh/aastey-newarrivals

Web Scraping data from E-Commerce Clothing Store Asstey

expressjs javascript nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/mhzmn/webscraper

A web scraper for drNutrition's products

nodejs puppeteer webscraper webscraping

Last synced: 18 Jan 2025

https://github.com/tanadelgigante/puppeteer-api-server

Api server to execute node.js scraping scripts

docker nodejs puppeteer scraping scripts

Last synced: 23 Jan 2025

https://github.com/cavalluccijohann/scrapper-whentocop

Minimal repository for scraping websites like Whentocop and storing items in a database. This project utilizes TypeScript, Puppeteer, and PostgreSQL, with db0 as the database interface 🚀

bun commander db db0 docker docker-compose monorepo nuxt postgresql puppeteer scraper scraping scrapper ts typescript

Last synced: 23 Jan 2025