Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/iadtya/web-summarizer

Web-summarizer scrapes the specific url to pipes that text data into gpt-3.5-turbo model to generate summary of the url and uses redis to cache the summary to save overhead price

expressjs nodejs openai-api puppeteer reactjs redis tailwindcss

Last synced: 03 Jan 2025

https://github.com/creativeprojects/gallerydownloader

Download images from a webpage using headless chrome

puppeteer

Last synced: 05 Jan 2025

https://github.com/jedrzejratajczak/scraper

Web Scraper with Discord Bot running as Windows process

cron discord-bot puppeteer sqlite web-scraping windows-process

Last synced: 28 Dec 2024

https://github.com/andrei0x309/puppeteer-extra-plugin-browser-extension-interact

Puppeteer extra plugin to interact with browser extensions, highly experimental.

browser-extention-interaction puppeteer puppeteer-extra puppeteer-extra-plugin

Last synced: 03 Jan 2025

https://github.com/team-bloblow/bloblow-puppeteer

블로그를 불러오다 🍃

dockerfile express puppeteer

Last synced: 17 Jan 2025

https://github.com/luminati-io/javascript-scraping-libraries

The top JavaScript web scraping libraries, featuring key tools like Playwright, Puppeteer, and Cheerio, for efficient and scalable data extraction.

axios cheerio crawlee javascript node-curl nodejs playwright puppeteer web-scraping

Last synced: 20 Jan 2025

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website 📷

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/rchrdlss3/spotify-scraper

Obtain data from Spotify regarding your favorite artist or album. Utilizes Puppeteer.

artists music npm npm-package puppeteer scrape spotify web

Last synced: 05 Jan 2025

https://github.com/rayc2045/ghibli-crawler

Automatically download 1,178 studio Ghibli's work photos

axios crawler ghibli node node-js nodejs puppeteer rest-api restful restful-api

Last synced: 26 Jan 2025

https://github.com/0xcadams/resume

Vue-based app to generate a Chase Adams resume.

puppeteer resume vuejs

Last synced: 28 Dec 2024

https://github.com/c0de-l00p/whatsapp-bot

Simple whatsapp bot made with node js and puppeteer

node puppeteer qrcode whatsapp

Last synced: 03 Jan 2025

https://github.com/kayyz1/llmscraper

LLM AI web scraper tool

openai puppeteer react remix typescript

Last synced: 10 Dec 2024

https://github.com/kernix13/puppeteer-web-scraper

How to use Puppeteer for web scaping

puppeteer

Last synced: 05 Jan 2025

https://github.com/hutsoninc/stihl-scraper

Used to scrape data on Stihl products.

puppeteer stihl

Last synced: 27 Dec 2024

https://github.com/tazeg/screenshots

Web sites url screenshots

nodejs puppeteer screenshots

Last synced: 17 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber and Assert.

assert commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-should

Puppeteer end-to-end test automation boilerplate, Using ES Modules, esm, Mocha, Chai and Should.

chai end-to-end-test-automation esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/yuriyvyatkin/ahj-hw-4-testing

ДЗ к лекции «Организация тестирования (Unit, E2E)» курса «Продвинутый JavaScript в браузере» Нетологии

card-validator jest js jsdom puppeteer

Last synced: 04 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-jasmine-assert

Puppeteer end-to-end test automation boilerplate, using CommonJS, Jasmine and Assert.

assert commonjs end-to-end-test-automation jasmine puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-assert

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Cucumber, Chai and Assert.

assert chai commonjs cucumber puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-assert

Puppeteer end-to-end test automation boilerplate project. Using commonjs, mocha and assert.

assert commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-chai-expect

Puppeteer end-to-end test automation boilerplate project. Using ES6 modules, ESM, mocha and chai.

chai es6 esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-typescript-ts-jest-jest-assert

Puppeteer end-to-end test automation boilerplate, Using TypeScript, ts-jest, Jest and Assert.

assert end-to-end-test-automation jest puppeteer puppeteer-typescript ts-jest typescript

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-typescript-ts-node-jasmine-assert

Puppeteer end-to-end test automation boilerplate, Using TypeScript, ts-node, Jasmine and Assert.

assert end-to-end-test-automation jasmine puppeteer typescript

Last synced: 11 Jan 2025

https://github.com/ribeirogab/puppeteer-currency-converter

Project to test the functionalities of the Node.js (version >= 13.4) using Puppeteer

currency-converter nodejs puppeteer scraper top-level-await

Last synced: 20 Jan 2025

https://github.com/ihoverlord/dx-currency

An API with Scrapped Data of 53 exchange rates against USD

api cheerio currency javascript nodejs puppeteer

Last synced: 05 Jan 2025

https://github.com/code-yeongyu/puppeteer-practice-melon-top100-crawler

My first puppeteer project using typescript. It prints melon top 100 chart with rank and song info!

melon puppeteer typescript

Last synced: 04 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Should.

chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/doczilla-app/issues

This is the space where you can engage with us directly, report any issues you encounter, request new features, or propose updates to our documentation.

html-to-image html-to-pdf html-to-pdf-api html2image html2pdf puppeteer

Last synced: 26 Jan 2025

https://github.com/rameshmane7218/get-cookies-from-url

Get-Cookies-From-Url

nodejs puppeteer

Last synced: 20 Dec 2024

https://github.com/hongzz0618/automated-test

unit testing e2e tests with Jest&puppeteer

e2e-tests jest puppeteer unittesting

Last synced: 28 Dec 2024

https://github.com/eltonsantos/calcular-horas-video-youtube

Simple Youtube Video Hour Calculator. - Vídeo: O último Code/Drops! Script que calcula horas de vídeo | Code/Drops #68 - Instrutor: Diego Fernandes & Mayk Brito - Link: https://www.youtube.com/watch?v=faekjlZuTFA

nodejs puppeteer

Last synced: 11 Jan 2025

https://github.com/lemonade-lab/lvyjs

为 nodejs 开发而设计的打包构建工具

esbuild lvyjs nodejs puppeteer rollup tsx

Last synced: 13 Jan 2025

https://github.com/bettercallsundim/crote

aesthetic & colorful class routine generator

expressjs mongodb mongoose nextjs puppeteer shadcn-ui

Last synced: 13 Dec 2024

https://github.com/dhairyash-1/url-content-summarizer

This project is a Web URL Summarizer, utilizing Puppeteer for web scraping and the ChatGPT API to deliver concise summaries of extracted content. Built with React, TypeScript, and ExpressJS.

browserless chatgpt-api epxressjs puppeteer reactjs typescript

Last synced: 04 Jan 2025

https://github.com/eltonsantos/gerador-de-pdf

Projeto desenvolvido - Vídeo: Vamos gerar PDF com NodeJS, Puppeteer, EJS e TailwindCSS - Instrutor: Mayk Brito - Link: https://www.youtube.com/watch?v=AoU7aEdTldE

ejs express html-pdf nodejs pdf puppeteer tailwindcss

Last synced: 11 Jan 2025

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Oct 2024

https://github.com/nuzulul/hookrender

hookrender adalah bot instagram menggunkan puppeteer di render

bot instagram javascript node-js nodejs puppeteer render

Last synced: 11 Jan 2025

https://github.com/lameuler/astro-pdf

A simple Astro integration to generate PDFs from built pages.

astro astro-integration pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 23 Dec 2024

https://github.com/christiancesar/hunter

Scraping of the target web application, using puppeeter, node with typescript and best practices.

backend ddd factory-pattern fullstack-development mongodb-atlas nodejs observer-pattern poo puppeteer react tdd typescript

Last synced: 10 Oct 2024

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel 蓋棉被純聊天.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicação console que fornece informações dos elencos, próximas partidas e notícias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 10 Oct 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer

NodeJs version with all dependencies to run Puppeteer

docker nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/captaincluster/sitesnap

A program that uses Puppeteer to visit the url given by the user and take a screenshot. The screenshot will then be saved for the user to view.

javascript nodejs puppeteer screenshot

Last synced: 31 Dec 2024

https://github.com/situmorang-com/scrape-website-using-puppeteer-javascript

Scraping website such as amazon or tokopedia to automate notification using puppeteer in javascript

puppeteer scraper scraping-websites web-crawler web-scraping

Last synced: 26 Jan 2025

https://github.com/noriste/stackoverflow-52383438-cypress-issue

The same test run on Cypress/TestCafe/Puppeteer to check the strange behaviour of the former

cypress e2e-testing puppeteer testcafe

Last synced: 15 Dec 2024

https://github.com/sejori/instafans

Proof of concept instagram public profile scraper.

ejs express nodejs puppeteer scraper

Last synced: 07 Dec 2024

https://github.com/viniciusamelio/rift_crawler

Um scraper criado em TS e seguindo práticas de arquitetura limpa.

clean-architecture puppeteer scraping typescript

Last synced: 22 Dec 2024

https://github.com/igor-starostenko/book-worm

Google maps bookmark import tool

automation bookmarks google-maps puppeteer

Last synced: 07 Dec 2024

https://github.com/jp7io/puppy

Simple website screenshot using AWS Lambda, Chromium, and Puppeteer.

chromium lambda puppeteer screenshot

Last synced: 20 Jan 2025

https://github.com/evertonpavan/node-web-scraper-braesul

A web scraper built with Node.js using Puppeteer to get data of Braé Sul

javascript nodejs puppeteer

Last synced: 21 Jan 2025

https://github.com/prixladi/urlik

Url shortener service with advanced statistics.

asp-net-core docker docker-compose mongodb nextjs puppeteer react redis

Last synced: 16 Jan 2025

https://github.com/tokisakikurumi2001/crawl_data

Crawl data from weather site

pandas-dataframe puppeteer weather

Last synced: 22 Jan 2025

https://github.com/gabrielczar/tests-for-api-interest-points

BDD tests for API Interest Points

bdd chai cucumber-js puppeteer tests

Last synced: 19 Jan 2025

https://github.com/khoiuna/business-qrcode-flyers

Generate web pages with QR code and screenshot them for businesses to use at trade shows.

bootstrap javascript php puppeteer python script

Last synced: 15 Jan 2025

https://github.com/cityssm/puppeteer-launch

Launch Puppeteer, falling back to system browsers when the cached ones aren't working or aren't available.

puppeteer puppeteer-firefox

Last synced: 07 Dec 2024

https://github.com/zhoukekestar/puppeteer-scripts

puppeteer scripts

puppeteer

Last synced: 20 Jan 2025

https://github.com/vgvr0/scraper-puppeteer

This project uses Puppeteer, a Node.js library which provides a high-level API to control Chrome or Chromium over the DevTools Protocol. Puppeteer runs headless by default, but can be configured to run full (non-headless) Chrome or Chromium.

node-js-scraper puppeteer puppeteer-scraper puppeteer-scraping

Last synced: 25 Jan 2025

https://github.com/flolu/bazel-node-puppeteer

Can't run Bazel nodejs_image with Puppeteer

bazel docker nodejs puppeteer rules-nodejs

Last synced: 09 Jan 2025

https://github.com/gabrielroot/notificado

Raspagem de dados (Web Scraping) no portal de notícias do IFNMG - Campus Januária

acessa campus-janu-ria hour nodejs notificado nunjucks postgresql puppeteer push-notifications pwa webscraping

Last synced: 30 Nov 2024

https://github.com/t2leaf/t2-puppeteer-plugin-block-resources

Blocks unnecessary resources like images, fonts, and stylesheets to optimize performance and speed up page loads.

automation performance puppeteer puppeteer-extra resource-optimization web-scraping

Last synced: 11 Jan 2025

https://github.com/darkterminal/rest-screenshoot

REST Screenshoot is a free tool for capturing screenshots of webpages via a REST API. Free an always!

open-source puppeteer rest-api screenshoot

Last synced: 31 Dec 2024

https://github.com/maximemoreillon/ts3_scraper

Scraper designed to retrieve the list of transactions of a TS3 corporate credit card.

credit-card puppeteer ts3

Last synced: 22 Jan 2025

https://github.com/t2leaf/t2-puppeteer-plugin-random-ua

Helping to improve web scraping and automation by evading detection.

puppeteer puppeteer-plugin puppeteer-random-ua random-user-agent user-agent

Last synced: 11 Jan 2025

https://github.com/maximemoreillon/ebanking_scraper

A web scraper for account balance and transactions on an e-banking interface

puppeteer

Last synced: 22 Jan 2025

https://github.com/deadcoder0904/puppeteer

A demo of things automating generating screenshot, creating pdf & signing into Facebook with Puppeteer ✨

pdf puppeteer screenshot sign-in

Last synced: 14 Jan 2025

https://github.com/mcecode/pdf-made-easy

A CLI application and library for developing and creating PDF documents.

cli document html json liquid pdf puppeteer template yaml

Last synced: 22 Jan 2025

https://github.com/omarkhairy21/nodens-assignment-

Simple Authentication MVC With Unit Testing and e2e testing

expressjs jest jwt jwt-authentication nodejs pugjs puppeteer semantic-ui

Last synced: 16 Jan 2025

https://github.com/kumarshivesh/aastey-newarrivals

Web Scraping data from E-Commerce Clothing Store Asstey

expressjs javascript nodejs puppeteer

Last synced: 18 Jan 2025

https://github.com/mhzmn/webscraper

A web scraper for drNutrition's products

nodejs puppeteer webscraper webscraping

Last synced: 18 Jan 2025

https://github.com/zenika/google-puppet

Some headless Chrome scripts to manipulate G Suite

chrome-headless google puppeteer

Last synced: 16 Jan 2025

https://github.com/dgvalerio/timesheet-express-assistant

Back-end of timesheet-next-assistant

express puppeteer typescript

Last synced: 22 Jan 2025

https://github.com/rynthebest/walletscrapper

A Puppeteer scraper that collects top trader data from gmgn.ai, processes coin rankings, filters duplicates, and extracts trader details like address and profit.

crypto crypto-bot javascript nodejs puppeteer scraper scraping scrapper scrapping wallet

Last synced: 24 Jan 2025

https://github.com/adrianhdezm/spa-boilerplate

A boilerplate for building Single-Page Applications with React and TypeScript

jest json-server puppeteer react typescript webpack

Last synced: 16 Nov 2024

https://github.com/tanadelgigante/puppeteer-api-server

Api server to execute node.js scraping scripts

docker nodejs puppeteer scraping scripts

Last synced: 23 Jan 2025

https://github.com/cavalluccijohann/scrapper-whentocop

Minimal repository for scraping websites like Whentocop and storing items in a database. This project utilizes TypeScript, Puppeteer, and PostgreSQL, with db0 as the database interface 🚀

bun commander db db0 docker docker-compose monorepo nuxt postgresql puppeteer scraper scraping scrapper ts typescript

Last synced: 23 Jan 2025

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Oct 2024

https://github.com/adrianomonteiroweb/puppeteer-studying

Repositório de estudos em Puppeteer.

javascript nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/simplified-application-robot

Sistema para aplicação em vagas simplificadas no LinkedIn.

javascript nodejs object-oriented-programming poo puppeteer

Last synced: 22 Jan 2025

https://github.com/adrianomonteiroweb/scraping-puppeteer-express

Projeto para estudos de web scraping com puppeteer + express.

express expressjs nodejs pug puppeteer

Last synced: 22 Jan 2025

https://github.com/stephlaf/puppeteer-airtable-tutorial

Tutorial to scrape the web using Puppeteer and store to Airtable

airtable-api javascript puppeteer scraping

Last synced: 23 Jan 2025

https://github.com/se-madhusudan/puppeteer-demo

Screenshot and pdf generation with puppeteer, image-size, and pdfkit

image-size pdf pdfkit puppeteer screenshot

Last synced: 12 Jan 2025

https://github.com/neulandagentur/adobe-stock-image-bot

📷 Adobe-Stock image id => author name

adobe adobe-stock bot puppeteer

Last synced: 30 Nov 2024

https://github.com/rushi0508/razorpay-attendance-automation

Will trigger github action as cron job and will mark my attendance in the razorpay application.

javascript puppeteer razorpay

Last synced: 12 Jan 2025

https://github.com/callaginn/kroger-sweeper

Download and categorize receipts from Kroger.com by scraping a user's purchases with puppeteer and playwright.

kroger kroger-api nodejs orders playwright puppeteer purchases receipt receipt-parser receipts scrape scraper

Last synced: 22 Jan 2025

https://github.com/dsc712/webscrapping-in-nodejs

Web scrapping static and dynamic sites using fetch,cheerio and puppeteer

axios cheerio express nodejs puppeteer

Last synced: 18 Jan 2025