Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/t2bamboo/t2-puppeteer-plugin-random-ua

Helping to improve web scraping and automation by evading detection.

puppeteer puppeteer-plugin puppeteer-random-ua random-user-agent user-agent

Last synced: 21 Jan 2025

https://github.com/t2bamboo/t2-puppeteer-plugin-block-resources

Blocks unnecessary resources like images, fonts, and stylesheets to optimize performance and speed up page loads.

automation performance puppeteer puppeteer-extra resource-optimization web-scraping

Last synced: 21 Jan 2025

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Jan 2025

https://github.com/jedrzejratajczak/scraper

Web Scraper with Discord Bot running as Windows process

cron discord-bot puppeteer sqlite web-scraping windows-process

Last synced: 28 Dec 2024

https://github.com/sidvishnoi/all-requests

Find all local and remote sub-resources and HTTP requests in a HTML document.

http-dependencies http-requests puppeteer scraper sub-resource subresource

Last synced: 09 Feb 2025

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 11 Jan 2025

https://github.com/damianravindupeiris/jobber-cli

A simple AI based Node-JS script to automate the job applying process.

ai nodejs open-ai puppeteer typescript web-scraping

Last synced: 05 Jan 2025

https://github.com/megave/puppeteer-scripts

A few browser scripts made using puppeteer library in NodeJS

browser-automation nodejs puppeteer

Last synced: 10 Feb 2025

https://github.com/anonymous961/scrapebooks

Just a repo to check puppeteer

neondb prisma puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/derrmru/scrape-the-news

Proof of concept - Scrape News Outlets with Express JS

expressjs javascript nlp puppeteer

Last synced: 23 Dec 2024

https://github.com/sthotakura/remove-linkedin-connections

puppeteer script to remove linkedin connections

linkedin puppeteer

Last synced: 02 Jan 2025

https://github.com/eric-philippe/crilstats-webscrapping

Web scraping for statistics and analytics.

api puppeteer resacril rest webscraping

Last synced: 06 Feb 2025

https://github.com/christianrich/generate-pdf-puppeteer

Generate a PDF with Puppeteer, Handlebars and Express

docker docker-compose express handlebars node-js pdf-generation puppeteer

Last synced: 29 Dec 2024

https://github.com/arnavk-09/clone-html-site

⛓️ Script to clone website elements...

browserless html-css-javascript html5 node pptr puppeteer

Last synced: 06 Feb 2025

https://github.com/yandeu/jenkins-puppeteer-docker

Use Puppeteer on Jenkins on Docker with Node.js and Jest.

docker jenkins jest nodejs puppeteer

Last synced: 05 Feb 2025

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Feb 2025

https://github.com/luminati-io/javascript-scraping-libraries

The top JavaScript web scraping libraries, featuring key tools like Playwright, Puppeteer, and Cheerio, for efficient and scalable data extraction.

axios cheerio crawlee javascript node-curl nodejs playwright puppeteer web-scraping

Last synced: 20 Jan 2025

https://github.com/luifean/randomflix-api

API desenvolvida a fim de prover informações de filmes da sua lista da Netflix. Faz uso do conceito de web scraping como data source.

cors express javascript nodejs puppeteer

Last synced: 01 Jan 2025

https://github.com/luifean/dicio-api

API desenvolvida para obter o significado de palavras através de mineração de dados

express javascript nodejs puppeteer

Last synced: 01 Jan 2025

https://github.com/luifean/github-web-api

API criada a fim de copiar a API original do GitHub, porém utilizando o conceito de mineração de dados

express javascript nodejs puppeteer typescript webscraping

Last synced: 01 Jan 2025

https://github.com/pionl/docker-node-puppeteer-ready

🐳 Docker image based on official node with with GoogleChrome/puppeteer support

chrome docker docker-image nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Feb 2025

https://github.com/amoutonbrady/jobs-scraper

Simple scraper to fetch and centralized jobs in one place

jobs puppeteer scraper

Last synced: 24 Dec 2024

https://github.com/gabrielamoura25/finaltask---carvalho-aleixo

Este é um projeto de web scraper desenvolvido em Node.js utilizando a biblioteca Puppeteer para extrair informações do produto garlic press do site da Amazon.

javascript puppeteer

Last synced: 07 Feb 2025

https://github.com/christiancesar/hunter

Scraping of the target web application, using puppeeter, node with typescript and best practices.

backend ddd factory-pattern fullstack-development mongodb-atlas nodejs observer-pattern poo puppeteer react tdd typescript

Last synced: 10 Feb 2025

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel 蓋棉被純聊天.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Feb 2025

https://github.com/johan-perso/screenshothtml

Screenshot HTML code, from your NodeJS Code

puppeteer scrapping-nodejs

Last synced: 23 Jan 2025

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

corn-job docker email-verification expressjs jwt-authentication load-balancer mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Feb 2025

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicação console que fornece informações dos elencos, próximas partidas e notícias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 10 Feb 2025

https://github.com/gamboavalentinabel/nodejs-puppeteer

NodeJs version with all dependencies to run Puppeteer

docker nodejs puppeteer

Last synced: 10 Feb 2025

https://github.com/nubisub/tipsen

Males buka sipadung ? Titip Absen aja

automation puppeteer

Last synced: 24 Dec 2024

https://github.com/danvictorgithub/gpt-teer

A rework to my depricated project gpt-wright project using Puppeteer

express gpt4o puppeteer

Last synced: 10 Jan 2025

https://github.com/carelessinternet/schoolsoft-scraper

Unofficial SchoolSoft API made in Node.js

api node nodejs puppeteer puppeteer-core schoolsoft

Last synced: 23 Jan 2025

https://github.com/hawtim/collection

Code collection about demos, snippets, documents, etc...

es6 expressjs nodejs puppeteer pwa typescript vue

Last synced: 18 Dec 2024

https://github.com/shuklaritvik06/bms-type-api

A web scraper api built using puppeteer and typescript which scrapes live data from bms website

api puppeteer typescript

Last synced: 17 Jan 2025

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Feb 2025

https://github.com/jp7io/puppy

Simple website screenshot using AWS Lambda, Chromium, and Puppeteer.

chromium lambda puppeteer screenshot

Last synced: 20 Jan 2025

https://github.com/pdehaan/puppeteer-a11y-cli

Puppeteer <3 Axe

a11y axe puppeteer

Last synced: 19 Dec 2024

https://github.com/pdehaan/send-puppeteer

Firefox Send v.Next screenshots.

firefox puppeteer send

Last synced: 19 Dec 2024

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website 📷

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/akirak/docker-chromium

Docker image containing a Chromium executable for Puppeteer

chromium docker-image puppeteer

Last synced: 19 Dec 2024

https://github.com/iamafnansk/personal-whatsapp-api

API to send message via Whatsapp Web

express nodejs puppeteer whatsapp-api

Last synced: 24 Dec 2024

https://github.com/bambooom/puppeteer-examples

just some snippets about how to use puppeteer

puppeteer

Last synced: 23 Jan 2025

https://github.com/florian-catalin-elisei/pdf-generator

This application combines React on the client side and Puppeteer with Express on the server side to generate PDF receipts. React, along with Axios, handles user input and HTTP requests, while Puppeteer on the server side creates PDFs using the submitted data.

axios cors css express file-saver html javascript puppeteer react

Last synced: 19 Dec 2024

https://github.com/minho42/og-image

Open Graph image generations

nodejs og-image opengraph-images puppeteer satori

Last synced: 19 Dec 2024

https://github.com/luminati-io/scraping-browser

Scraping Browser is an automated headless browser for effortless web scraping with Puppeteer, Selenium, and Playwright.

captcha-solving headless-browser headless-browsers javascript nodejs playwright proxy-server puppeteer python scraping-browser selenium web-scraping

Last synced: 08 Feb 2025

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Feb 2025

https://github.com/radzionc/twitter-outreach-cli

Half-automatically Reach Followers of a specific Profile

nodejs puppeteer twitter-api

Last synced: 24 Dec 2024

https://github.com/radzionc/music-alarm

Alarm with Yandex-music

nodejs puppeteer

Last synced: 24 Dec 2024

https://github.com/radzionc/linkedin-connector

Connect With Customers From Email List on LinkedIn With Automation

dynamodb nodejs puppeteer

Last synced: 24 Dec 2024

https://github.com/0xcadams/resume

Vue-based app to generate a Chase Adams resume.

puppeteer resume vuejs

Last synced: 28 Dec 2024

https://github.com/kernix13/puppeteer-web-scraper

How to use Puppeteer for web scaping

puppeteer

Last synced: 05 Jan 2025

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automação que fornece informações dos elencos dos times da NBA. O sistema em questão é uma aplicação console que fornece opções de escolha, o usuário digita a opção que deseja e as informações são mostradas de acordo com essa opção.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Feb 2025

https://github.com/thegreatbonnie/puppeteer-web-automation-javascript

Example code of end to end web automation testing using Puppeteer JavaScript

puppeteer test-automation testing testing-tools web-automation-testing

Last synced: 25 Dec 2024

https://github.com/crusaderincode/article-saver-bot

This bot listens to incoming messages for valid URLs. When a URL is provided, the bot fetches the website content and returns it as a PDF file.

bot html-pdf-converter html-pdf-service nodejs open-source pdf-generation puppeteer telegraf telegram telegram-bot webscraping

Last synced: 21 Jan 2025

https://github.com/bernietv/workflows-app

Create AI Powered Workflows to scrape the Web

clerk cron nextjs14 prisma puppeteer reactflow stripe tailwindcss

Last synced: 25 Dec 2024

https://github.com/f00b4r/2021-03-vercel-puppeteer-social-networks

🎁 How to use Puppeteer to generate images for social networks deployed to Vercel

f00b4r lambda network plugin puppeteer screenshot social vercel widget

Last synced: 13 Jan 2025

https://github.com/kavindu-mane/html-to-pdf

Simple API for convert HTML to PDF. This API use puppeteer npm package as convertor.

bun hono html-to-pdf puppeteer

Last synced: 19 Dec 2024

https://github.com/jayvirrathi/nodejs-puppeteer

NodeJS Instagram Post Liker using Puppeteer

instagram nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/pedroaurelli/buy-scrapper

Web scrapper to observe e-commerce items to shop, and throw an user notification when prices down

nodejs puppeteer scrapper

Last synced: 02 Jan 2025

https://github.com/thundermiracle/costco-monitor

Monitor product's price & stock status. Send email when price is down or stock status is changed.

costco puppeteer

Last synced: 03 Feb 2025

https://github.com/pdehaan/firefox-monitor-puppeteer-scan

Scan for breached emails using Puppeteer. Because why not.

firefoxmonitor hibp puppeteer

Last synced: 29 Dec 2024

https://github.com/robertoachar/screenshot-puppeteer

A playground for take a screenshot with Puppeteer.

playground puppeteer screenshot

Last synced: 26 Dec 2024

https://github.com/yuiseki/ppptr

Simple CLI tool and npm package just take screenshot of Web page with puppeteer in minutes

nodejs npm npm-package puppeteer screenshot typescript

Last synced: 21 Dec 2024

https://github.com/tayyabmughal676/f1gpt_backend

Formula F1GPT Chat Unlock the power of AI-powered conversations! Built with Datastax, OpenAI, and more. Fork, explore, and enhance!

ai datastax genai genai-chatbot generative-ai gpt langchain langchain-js machine-learning ml open-source open-source-intelligence open-source-project openai openai-api puppeteer rag typescript

Last synced: 02 Jan 2025

https://github.com/stephlaf/puppeteer-airtable-tutorial

Tutorial to scrape the web using Puppeteer and store to Airtable

airtable-api javascript puppeteer scraping

Last synced: 03 Feb 2025

https://github.com/ajit24/anakin-scrap

This repository contains the code in puppeteer and node.js to find the latitude and longitude of all locations in Singapore

expressjs nodejs puppeteer

Last synced: 02 Jan 2025

https://github.com/rafinhadufluxo/losing

Buscador de cardápio do RU da UFFS, capturando em imagem em formato PNG 📸

javascript node-module nodejs puppet-module puppeteer puppeteer-screenshot

Last synced: 26 Dec 2024

https://github.com/bubao/puppeteer-html2pdf-generator

服务器端的 html 生成 pdf

html pdf pdf-generation puppeteer

Last synced: 03 Feb 2025

https://github.com/rajeshberwal/simple-node-web-scraper

Simple web scraper template that you can use to scrape data from a website.

javascript nodejs puppeteer scraper

Last synced: 04 Jan 2025

https://github.com/micalevisk/ecampus-ufam-crawler

🚧 Command Line Interface (CLI) tool that automates common tasks for https://ecampus.ufam.edu.br users.

nodejs-cli puppeteer ufam ufam-cli

Last synced: 28 Oct 2024

https://github.com/matthewjselby/json-resume

Generate a resume in both HTML and PDF from a JSON file.

gulp handlebars html javascript json puppeteer resume sass

Last synced: 13 Jan 2025

https://github.com/swebi/orderly

Orderly scrapes SRM Academia to fetch the current day order and seamlessly syncs your class schedule with Google Calendar. Just log in once, save your timetable, your calendar will update automatically every day.

bull bullmq express google-api google-calendar magic-ui postgresql prisma puppeteer react redis shadcn-ui

Last synced: 02 Feb 2025

https://github.com/alexpreynolds/flow-cytometry-visualization

Flow cytometry visualization demo using Jupyter, Plotly, and fcsparser

bioinformatics fcs jupyter jupyter-notebook plotly puppeteer python3 visualization

Last synced: 26 Dec 2024

https://github.com/essamamdani/deepseek-operator

DeepSeek Operator - OpenAI Operator Alternative (Run Locally for FREE)

ai browserbase browserless deepseek-r1 groq javascript playwright puppeteer scrapping

Last synced: 30 Jan 2025

https://github.com/ghdwlsgur/node-crawling

# puppeteer 라이브러리를 사용하여 웹크롤링하기

crawling node puppeteer

Last synced: 27 Dec 2024

https://github.com/giansalex/puppeteer-sample

Puppeteer Headless Chrome (Sample)

node puppeteer

Last synced: 20 Dec 2024

https://github.com/lukmanrambe/sekawan-restaurant

Restaurant Catalogue Website. Submission for "Menjadi Front-End Web Developer Expert" (https://www.dicoding.com/academies/219) Dicoding Class

accessibility codeceptjs css html jasmine javascript karma karma-jasmine progressive-web-app puppeteer pwa semantic-html webpack workbox

Last synced: 18 Dec 2024

https://github.com/gabrielweyer/ui-tests

Writing UI tests with Selenium Web Driver and Puppeteer

github-actions puppeteer selenium-webdriver ui-testing

Last synced: 14 Oct 2024

https://github.com/lezdcs/kick-push-key-checker

A tool for automatically extracting Pusher configuration from Kick.com and updating Firebase Remote Config.

deno firebase firebase-remote-config kick preact puppeteer pusher

Last synced: 26 Dec 2024

https://github.com/vermajay/internshala-automation

Automatically apply to internships on Internshala using Google's Puppeteer high level API for chrome

api automation chrome google internships puppeteer

Last synced: 13 Oct 2024

https://github.com/angrykoala/wendigo-plugin

Bootstraping of a wendigo plugin

automation browser chrome puppeteer template wendigo

Last synced: 10 Feb 2025

https://github.com/lnardon/kindlehighlightsscraper

A kindle highlights scraper using puppeteer

amazon javascript kindle puppeteer scraper

Last synced: 10 Jan 2025

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 72 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 87 博文 86 Packages 30 Utils 23 Integrations 17 包 14 Testing 13 Rendering and web scraping 12 Services 12 渲染和网页抓取 11 Reporters 10 Examples 10 Language Support 9 Showcases 9 Official 9 官方 9 测试 9 例子 9 Guides 6 Related 6