Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/marinoffdev/emag-price-scraper

eMAG price scraper built with Puppeteer and MongoDB.

automation batch-script emag javascript mongodb nodejs puppeteer scraper script

Last synced: 16 Nov 2024

https://github.com/lebrancconvas/from-web-to-sheet

Automation Project for scraping Web Content to the Google Sheet.

google-sheets google-sheets-api puppeteer web-automation web-scraping

Last synced: 08 Jan 2025

https://github.com/lebrancconvas/math-game-automation

Using Puppeteer to make the web automation for playing mathematical game.

personal-project puppeteer side-project web-automation web-scraping

Last synced: 08 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-es-modules-babel-jest-assert

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, BabelJS, Jest and Assert.

assert babel babeljs e2e-test e2e-testing e2e-tests es6 jest modules puppeteer

Last synced: 11 Oct 2024

https://github.com/muhamed-didovic/tcdown

Course downloader for teachable platform written in nodejs using puppeteer and yt-dlp

courses download downloader nodejs puppeteer scraper teachable teachable-dl teachable-downloader teachable-scraper teacheable-download yt-dlp yt-dlp-wrapper

Last synced: 14 Nov 2024

https://github.com/zzarcon/save-image

Save remote images locally with ease 🌈💾

image-processing puppeteer remote save scraping utility

Last synced: 04 Jan 2025

https://github.com/shikanon/jsrender

基于koa + puppeteer 构建的 SSR 服务端渲染,可以帮助网站SEO优化

puppeteer seotools ssr

Last synced: 22 Nov 2024

https://github.com/lebrancconvas/auto-searching

Automatic Searching on any search engine with Puppeteer.

personal-project puppeteer side-project web-automation web-development

Last synced: 08 Jan 2025

https://github.com/18520339/puppeteer-ecommerce-scraper

A npm package for Client-side rendering approach to extract product data from ecommerce websites using undetectable puppeteer-cluster with pagination support

pagination proxy puppeteer puppeteer-cluster scraper undetectable

Last synced: 23 Oct 2024

https://github.com/zbo14/puppetshow

A command-line utility for sequentially viewing webpages in a browser window

browser-automation bug-bounty chromium cli puppeteer recon url urls

Last synced: 21 Oct 2024

https://github.com/vxern/realmeye_cli

A powerful CLI application for interacting with RealmEye from the command-line. – Features trade offer auto-refresh to ensure offers always show up at the top, item name shortenings and abbreviations, and full trade offer addition/removal support. – RealmEye does not expose a public API, therefore this application operates on Puppeteer.

api cli command-line dart listings puppeteer realmeye realmeye-api rotmg trade trade-offers

Last synced: 04 Jan 2025

https://github.com/suraj-sella/youtube-scraping

A Venture Forward Into Youtube Scraping (Starting With Downloading)

javascript nodejs puppeteer youtube-dl youtube-scraper

Last synced: 20 Nov 2024

https://github.com/leafyeexyz/markdownpaper

Writing academic papers with Markdown / 命令行小程序, 从 Markdown 生成学术论文 PDF、HTML、DOCX

bnu bun bun-js bun-sh cli javascript psychology puppeteer puppeteer-core typescript

Last synced: 10 Oct 2024

https://github.com/adeelibr/understaning-node-fs-and-puppeteer

Node FS (File System) & Google Puppeteer

fs javascript nodejs puppeteer scripts

Last synced: 18 Nov 2024

https://github.com/doyourbest96/next-scraper

This is user scraping project using next.js and puppeteer

nextjs puppeteer supabase tailwindcss

Last synced: 03 Nov 2024

https://github.com/rwu823/ts-jest-puppeteer

:repeat: Run your tests using Jest & Puppeteer with TypeScript.

jest puppeteer typescript

Last synced: 10 Nov 2024

https://github.com/alperen/automated-ui-tests

Puppeteer based automated UI Test Examples with Mocha, Chai (Educational Purpose)

chai mocha-chai mocha-reporter mocha-tests mochajs puppeteer test-reporting

Last synced: 28 Sep 2024

https://github.com/sonyarianto/klikbca-check-balance-with-puppeteer

Check BCA balance through KlikBCA with Puppeteer.

automation bank dotenv klikbca nodejs npm puppeteer

Last synced: 11 Oct 2024

https://github.com/andreiigna/take-screenshots

📸 Take clean website screenshots

chrome chromium javascript puppeteer screenshot

Last synced: 13 Oct 2024

https://github.com/mmarkelov/jest-lighthouse

Helper functions to simplify jest integration with lighthouse

e2e-tests expect jest lighthouse playwright puppeteer testing

Last synced: 07 Dec 2024

https://github.com/menduz/titere

Run browser tests from command line

mocha puppeteer typescript

Last synced: 15 Oct 2024

https://github.com/osfunapps/os-puppeteer-helper-npm

an intuitive module to help with puppeteer related functions

helper javascript node-module puppeteer

Last synced: 29 Nov 2024

https://github.com/juffalow/node-react-seo-example

An example of server side rendering ( for SEO purposes )

nodejs puppeteer react seo server-side-rendering

Last synced: 14 Dec 2024

https://github.com/marcuwynu23/gdork

gdork is a command-line tool for performing Google dork searches using Puppeteer, a headless browser.

advance googlesearch headless javascript npm puppeteer search searchengine webscraping yarn

Last synced: 25 Dec 2024

https://github.com/wangtao0101/jest-puppeteer-enhancer

An enhancer for jest puppeteer with auto-screenshot feature, more readable error and nice markdown reporter.

auto-screenshot jest jest-puppeteer puppeteer

Last synced: 17 Nov 2024

https://github.com/tako8ki/puppeteer-thumbnail

The API for converting HTML to image(support Japanese and English)

docke docker-compose node puppeteer

Last synced: 16 Nov 2024

https://github.com/devture/browserless

Library for communicating with the https://www.browserless.io/ API (generating PDFs, etc.)

browserless chrome pdf pdf-generation puppeteer

Last synced: 07 Nov 2024

https://github.com/tostaylo/front-end-framework-bench

Automated browser rendering performance benchmarking suite for front-end frameworks. Results -> https://front-end-framework-bench.torretaylor.me/

automated-testing framework framework-bench puppeteer react rust rust-wasm svelte vue web web-components

Last synced: 10 Jan 2025

https://github.com/ayushsoni1010/graphify

💹 Transform data into stunning PDF reports with dynamic charts and seamless integration. Explore the power of data visualization.

chartjs htmltopdf nodejs openai pdf-generation puppeteer reactjs tailwindcss

Last synced: 13 Dec 2024

https://github.com/iaematt/blogdomat

Blog simples e minimalista desenvolvido com Next.js, Reactjs, styled-components, markdown e claro Typescript.

blog markdown next nextjs puppeteer react reactjs styled-components typescript vercel

Last synced: 01 Jan 2025

https://github.com/l-portet/yellow-scraper

Data scraper of french yellow pages (Pages Jaunes)

extract node pages-jaunes parsing puppeteer scraper yellow-pages yellow-scraper

Last synced: 06 Dec 2024

https://github.com/nsourov/instagram-comment-bot

Instagram comment bot in electron and puppeteer

electron puppeteer

Last synced: 30 Dec 2024

https://github.com/robertsaupe/node-screenshots

make automatic pixel perfect screenshots built using Node.js & puppeteer

cli nodejs puppeteer puppeteer-screenshot screenshot screenshot-utility utility

Last synced: 14 Nov 2024

https://github.com/neet/puppeteer-ipc

Lightweight wrapper for mutual communication on Puppeteer, inspired by Electron

ipc puppeteer

Last synced: 29 Oct 2024

https://github.com/xatta-trone/extension-stats-scrapper

Crawl statistical data for extensions, then save it as a JSON/PDF file using GitHub Actions

chrome-extension firefox-extension github handlebars puppeteer webscrappingnode

Last synced: 28 Nov 2024

https://github.com/dna-engine/load-web-page-puppeteer-mocha

Minimal example of loading a web page into puppeteer and testing with mocha

javascript localhost mocha nodejs puppeteer testing url

Last synced: 12 Nov 2024

https://github.com/nazemmahmud/symfony-scraping

web scraping with symfony 6, puppeteer, redis, docker with crud operation, some unit tests

cloudflare crud-api docker docker-compose phpunit proxy-server puppeteer redis symfony6 unit-test

Last synced: 21 Dec 2024

https://github.com/squishy123/amine

Anime Streaming App

js nodejs puppeteer scraper streaming-video

Last synced: 12 Dec 2024

https://github.com/lonzzi/juejin-auto-checkin

掘金自动签到脚本

bun checkin cronjob puppeteer

Last synced: 10 Oct 2024

https://github.com/deadcoder0904/tailwind-cheatsheet-puppeteer

Tailwind Cheatsheet in JSON made using Puppeteer

cheatsheet cheatsheets puppeteer tailwind tailwindcss

Last synced: 14 Nov 2024

https://github.com/entrptaher/playground-puppeteer-xvfb

Example of how you can run puppeteer on server with xvfb, docker and so on

docker hacktoberfest nodejs puppeteer xvfb

Last synced: 19 Nov 2024

https://github.com/ccuffs/uffs-sga-scraping

Sistema para coletar dados do portal do coordenador de forma automatizada

academic brazil nodejs puppeteer scraper scraping-websites uffs university

Last synced: 12 Dec 2024

https://github.com/git-bhanu/scrapewave

🕷️ ScrapeWave: Dockerized web scraping using puppeteer.

chromium docker express javascript nodejs pinia-vuejs puppeteer socket-io sqlite3 vite vuejs3 vuetify

Last synced: 10 Oct 2024

https://github.com/cwchentw/twse-price-notify

Notifications for stocks and ETFs in TWSE

notification puppeteer twse twstock

Last synced: 17 Nov 2024

https://github.com/thenamevishnu/web-screenshot

Leverages Puppeteer for seamless website screenshot capture. Input your desired URL, run the script, and obtain crisp snapshots. A user-friendly tool for developers and testers simplifying the process of website visualization.

node-telegram-bot-api nodejs puppeteer telegram-bot-api

Last synced: 13 Nov 2024

https://github.com/idreamshen/goofish-friend-trading-bot

闲鱼人才市场机器人。自动雇佣、淘汰,自动派活,自动领取奖励

bot goofish nodejs puppeteer

Last synced: 27 Sep 2024

https://github.com/ymtszw/blick

Tech-presentation hub app, powered by Antikythera and Elm

bulma elixir elm puppeteer

Last synced: 21 Nov 2024

https://github.com/thandon263/puppeteer

This sample application demonstrates how to use Headless Chrome via the Puppeteer module to take screenshots of webpages on Google App Engine Node.js standard environment. Firebase <=> NodeJS <=> Google App Engine <=> Firebase

es2018 javascript nodejs nodejs-server-api puppeteer search-engine

Last synced: 06 Jan 2025

https://github.com/leocode/puppeteer-service

Containerized Puppeteer which allows to render images and PDFs of given webpage or HTML code

docker pdf puppeteer screenshot

Last synced: 22 Dec 2024

https://github.com/instasales/instagram-puppeteer

NodeJS Instagram API SDK. Сan be applied to Serverless https://instasales.github.io/instagram-puppeteer/

instagram puppeteer

Last synced: 11 Oct 2024

https://github.com/zbo14/sourcery

A CLI that starts a Chromium browser window and parses URLs, domains, and endpoints from response payloads

browser-automation cli endpoints puppeteer source-files urls web-application-security web-security

Last synced: 19 Nov 2024

https://github.com/evanhalley/lighthouse-pizza-teer

This is sample code on how to use Puppeteer alongside Lighthouse to run analysis on webpages behind an authentication wall.

lighthouse nodejs pizza puppeteer

Last synced: 08 Nov 2024

https://github.com/romainberger/messenger-media-downloader

Download all media from a Messenger conversation from the command line.

backup download messenger puppeteer

Last synced: 21 Dec 2024

https://github.com/tomashubelbauer/scrape-github-invoices

Download invoices from the GitHub billing page to your Downloads automatically using Puppeteer.

github invoices puppeteer scraper scraping scraping-websites

Last synced: 31 Dec 2024

https://github.com/evanhalley/get-me-the-gif

A serverless app that can free those GIFs embedded in tweets, into GIFs you can use.

ffmpeg javascript nodejs puppeteer serverless

Last synced: 30 Dec 2024

https://github.com/nomansiddiqui0000/goodreads_quotes-scraper

This scraper, developed in Node.js using the Puppeteer library, is designed to scrape 100 pages, collecting approximately 8,000 records. Each record contains a quote, the writer's name, and an image link.

nodejs puppeteer quote-api quote-generator quote-scrapper quotes-generator scraper

Last synced: 10 Oct 2024

https://github.com/leafney/alpine-puppeteer

Alpine Docker Puppeteer Environment

alpine docker pm2 puppeteer

Last synced: 14 Nov 2024

https://github.com/davidcralph/discord-teams-status

Sync your Discord status to Microsoft Teams

discord discord-js discordjs microsoft-teams puppeteer status teams

Last synced: 19 Nov 2024

https://github.com/ajmeese7/dynamic-page-retrieval

Scrape data from JS-rendered pages

dynamic-content puppeteer scraping

Last synced: 18 Dec 2024

https://github.com/dfa1234/iux-node

node api for sending email with a pdf attached, corresponding to the given webpage url

nodejs puppeteer

Last synced: 21 Dec 2024

https://github.com/mehradevesh2022/hackerrank-automation

This is a project called hackerrank automation. Using Puppeter.

automation chromium hackerrank hackerrank-automation nodejs nodejs-library puppeteer

Last synced: 09 Dec 2024

https://github.com/danielesteban/autocalamari

Automated Calamari Clock-In/Out

automation nodejs puppeteer

Last synced: 21 Dec 2024

https://github.com/xandao-dev/rpa-challenge

Automating input filling in rpachallenge.com website

automation nodejs puppeteer rpa

Last synced: 21 Dec 2024

https://github.com/pdsuwwz/koa-playwright-server

🎭 Playwright 实现的 Node.js 中间件 API 服务, 替换 Puppeteer, 基于 ESM + Rollup + Koa + TypeScript + Nodemon + PM2 + ESLint (v9) 用于快速爬取并合并多网页到 PDF 文件、图片高保真快照, 支持热更新、Cookie 、水印、页眉页脚注入

es generator module pdf playwright puppeteer rollup typescript upgrade

Last synced: 14 Dec 2024

https://github.com/prohetamine/erlasty

⚡️ react server render by puppeteer for search bots

puppeteer react server-rendering ssr

Last synced: 19 Nov 2024

https://github.com/rebrowser/rebrowser-puppeteer

A drop-in replacement for puppeteer patched with rebrowser-patches. It allows to pass modern automation detection tests.

automation bot bot-detection captcha chrome headless puppeteer rebrowser rebrowser-patches scraping web-scraping

Last synced: 20 Oct 2024

https://github.com/evanhalley/feature-image-generator

An example gulp script that generates feature images for social media from markdown text files containing frontmatter

gulp node puppeteer

Last synced: 30 Dec 2024

https://github.com/shellyln/mdne-electron

Markdown Neo Edit for Electron - A simple markdown and code editor powered by Markdown-it, Ace and Electron.

ace code-editor editor electron lisp liyad lsx markdown markdown-editor markdown-it markdown-to-html menneu pdf puppeteer pwa

Last synced: 19 Dec 2024

https://github.com/petehouston/node-proshot

Handy tool to capture website screenshots using Puppeteer.

capture capture-website-screenshots javascript node nodejs puppeteer screenshot screenshots

Last synced: 13 Dec 2024

https://github.com/redbaty/ezpdf

PDF Renderer using chrome puppeteer.

pdf puppeteer render

Last synced: 26 Dec 2024

https://github.com/guilhermebkel/semantic-search-llm-ai

🤖 That's a simple LLM semantic search that implements RAG concepts with help of LangChain and OpenAI API.

ai embeddings langchain openai-api puppeteer rag redis redis-vector-store retrieval-augmented-generation semantic-search-ai typescript

Last synced: 05 Nov 2024

https://github.com/rahulnisanth/trackitnow

The e-commerce price tracker and analyzer for best deals

bright-data cheerio-js cron-jobs nextjs14 puppeteer web-scraping-software

Last synced: 05 Nov 2024

https://github.com/blank-09/google-meet-automation

An automation software to join Google Meet meetings. The software uses the csv file to get the schedule of the meetings and joins the meeting at the scheduled time.

automation google-meet puppeteer

Last synced: 05 Nov 2024

https://github.com/ykon550/puppenomist

Puppenomist = Scraper for the Economist with Puppeteer

economist puppeteer puppeteer-demo webscraping

Last synced: 30 Nov 2024

https://github.com/aexynn/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 14 Oct 2024

https://github.com/philecker/time-keeper

📱Node.js application utilizing Puppeteer for logging into Deltek and retrieving current amount of PTO.

deltek puppeteer

Last synced: 29 Dec 2024

https://github.com/adamtylerlynch/puppeteer-multiarch

Creating Multi-Arch docker images for ARM64/x86 (amd64) using CodeBuild from Jenkins. Headless browsing with Chromium and Puppeteer.

aarch64-linux arm arm64 chromium codebuild docker docker-image multi-arch-images multiarch puppeteer

Last synced: 14 Dec 2024

https://github.com/portrunban/node-badoo-autolike-bot

Badoo autolike bot. Node JS, puppeteer

autolike automated badoo bot like liker nodejs parser puppeteer

Last synced: 02 Jan 2025

https://github.com/cenfun/page-save-as

Page save as JPG/PNG/PDF

jpg page pdf png puppeteer save

Last synced: 07 Dec 2024

https://github.com/hadynz/puppeteer-goodreads

Scrapes private Kindle highlights for a Goodreads user using automation by headless chrome

automation goodreads headless-chrome puppeteer

Last synced: 29 Nov 2024

https://github.com/moaj257/b-ok.org

:rocket: A simple, clean, fast and elegant books webapp. :fire:

b-ok-api book-api full-stack-application nextjs puppeteer react ui ux web-app web-scraping

Last synced: 19 Dec 2024

https://github.com/micalevisk/pergamum-ufam-bot

Tarefas automatizadas para o https://pergamum.ufam.edu.br. Powered by Puppeteer. Works well with GitHub Actions workflow.

hacktoberfest puppeteer task-automation ufam ufam-cli

Last synced: 28 Oct 2024

https://github.com/sjdonado/assessment-2-backend-un-202130

DSLLO APLICACIONES WEB BACKEND - Universidad del Norte, Colombia

http-server nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/leafyeexyz/ehentaisearcher

一个用来检索被 e-hentai 官方屏蔽的 tag 的工具 / A tool to retrieve tags that are blocked by the e-hentai

comic comics deno e-hentai exhentai jsr manga puppeteer scraper typescript

Last synced: 14 Dec 2024

https://github.com/ewliang/cnbc-premarket-web-scraper

A web scraper created using Puppeteer library on the backend to scrape the stock market prediction data off of CNBC's premarket page.

backend-development expressjs javascript node-js nodejs puppeteer stock-market web-scraper web-scraping webscraper

Last synced: 02 Jan 2025

https://github.com/laurazard/millennium-scraper

Scraper to fetch transactions from your Millennium BCP account and add them into YNAB

puppeteer ynab

Last synced: 18 Dec 2024