Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/l-portet/doctoscrap

👨‍⚕️ 🤖 Doctolib data scraper

doctolib extract node parsing puppeteer scraper

Last synced: 06 Dec 2024

https://github.com/laurazard/millennium-scraper

Scraper to fetch transactions from your Millennium BCP account and add them into YNAB

puppeteer ynab

Last synced: 18 Dec 2024

https://github.com/leafyeexyz/ehentaisearcher

一个用来检索被 e-hentai 官方屏蔽的 tag 的工具 / A tool to retrieve tags that are blocked by the e-hentai

comic comics deno e-hentai exhentai jsr manga puppeteer scraper typescript

Last synced: 14 Dec 2024

https://github.com/micalevisk/pergamum-ufam-bot

Tarefas automatizadas para o https://pergamum.ufam.edu.br. Powered by Puppeteer. Works well with GitHub Actions workflow.

hacktoberfest puppeteer task-automation ufam ufam-cli

Last synced: 28 Oct 2024

https://github.com/moaj257/b-ok.org

:rocket: A simple, clean, fast and elegant books webapp. :fire:

b-ok-api book-api full-stack-application nextjs puppeteer react ui ux web-app web-scraping

Last synced: 19 Dec 2024

https://github.com/hadynz/puppeteer-goodreads

Scrapes private Kindle highlights for a Goodreads user using automation by headless chrome

automation goodreads headless-chrome puppeteer

Last synced: 29 Nov 2024

https://github.com/bybetas/h2i

A simple HTML to Image API

html puppeteer rendering

Last synced: 10 Oct 2024

https://github.com/cenfun/page-save-as

Page save as JPG/PNG/PDF

jpg page pdf png puppeteer save

Last synced: 07 Dec 2024

https://github.com/adamtylerlynch/puppeteer-multiarch

Creating Multi-Arch docker images for ARM64/x86 (amd64) using CodeBuild from Jenkins. Headless browsing with Chromium and Puppeteer.

aarch64-linux arm arm64 chromium codebuild docker docker-image multi-arch-images multiarch puppeteer

Last synced: 14 Dec 2024

https://github.com/philecker/time-keeper

📱Node.js application utilizing Puppeteer for logging into Deltek and retrieving current amount of PTO.

deltek puppeteer

Last synced: 29 Dec 2024

https://github.com/zahradnik-ondrej/puppethelper

A Puppeteer utility package for web automation.

automation browser puppeteer qa web

Last synced: 10 Oct 2024

https://github.com/oxylabs/puppeteer-tutorial

Use this tutorial and learn how to perform web scraping using a headless browser.

headless-browser puppeteer web-scraping

Last synced: 17 Jan 2025

https://github.com/aexynn/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 14 Oct 2024

https://github.com/ykon550/puppenomist

Puppenomist = Scraper for the Economist with Puppeteer

economist puppeteer puppeteer-demo webscraping

Last synced: 30 Nov 2024

https://github.com/pranavbharadwaj007/youtube-playlist-automation

Automate the youtube , scrap the data of playlist and creates a pdf doc of it

automation backend nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/pranavbharadwaj007/hackerrank-automation

Hackerrank Automation with node.js

automation backend nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/redbaty/ezpdf

PDF Renderer using chrome puppeteer.

pdf puppeteer render

Last synced: 26 Dec 2024

https://github.com/petehouston/node-proshot

Handy tool to capture website screenshots using Puppeteer.

capture capture-website-screenshots javascript node nodejs puppeteer screenshot screenshots

Last synced: 13 Dec 2024

https://github.com/breqdev/cards

Generate card images based on user data and HTML templates.

api asyncio flask minio puppeteer pyppeteer python quart react website

Last synced: 20 Oct 2024

https://github.com/devrax/opencorpdrscrapper

Web scraper to extract company data from OpenCorporates

javascript nodejs puppeteer supabase

Last synced: 10 Jan 2025

https://github.com/shellyln/mdne-electron

Markdown Neo Edit for Electron - A simple markdown and code editor powered by Markdown-it, Ace and Electron.

ace code-editor editor electron lisp liyad lsx markdown markdown-editor markdown-it markdown-to-html menneu pdf puppeteer pwa

Last synced: 19 Dec 2024

https://github.com/ivankahl/web-scraping-benchmarks

Node.js that benchmarks scraping Reddit using Puppeteer, Playwright, Selenium, Nightmare, and Cypress.

cypress nightmare playwright puppeteer scraping selenium web

Last synced: 13 Jan 2025

https://github.com/ttsukagoshi/axe-test

テキストファイルで指定する複数のウェブページに対して、Deque社提供のaxe-coreを使ったウェブアクセシビリティ検査を一括実行する、Node.js上のスクリプト

a11y axe-core puppeteer web-accessibility

Last synced: 23 Oct 2024

https://github.com/womb0comb0/gdsc-farmingdale-links-api

This initiative aims to offer a compelling alternative for GDSC communities seeking efficient means to keep their members informed.

api cheerio css express html javascript puppeteer pwa typescript vite

Last synced: 26 Dec 2024

https://github.com/rebrowser/rebrowser-puppeteer

A drop-in replacement for puppeteer patched with rebrowser-patches. It allows to pass modern automation detection tests.

automation bot bot-detection captcha chrome headless puppeteer rebrowser rebrowser-patches scraping web-scraping

Last synced: 20 Oct 2024

https://github.com/pdsuwwz/koa-playwright-server

🎭 Playwright 实现的 Node.js 中间件 API 服务, 替换 Puppeteer, 基于 ESM + Rollup + Koa + TypeScript + Nodemon + PM2 + ESLint (v9) 用于快速爬取并合并多网页到 PDF 文件、图片高保真快照, 支持热更新、Cookie 、水印、页眉页脚注入

es generator module pdf playwright puppeteer rollup typescript upgrade

Last synced: 14 Dec 2024

https://github.com/danielesteban/autocalamari

Automated Calamari Clock-In/Out

automation nodejs puppeteer

Last synced: 21 Dec 2024

https://github.com/mehradevesh2022/hackerrank-automation

This is a project called hackerrank automation. Using Puppeter.

automation chromium hackerrank hackerrank-automation nodejs nodejs-library puppeteer

Last synced: 09 Dec 2024

https://github.com/book000/kindle-booklog

Amazon.co.jpで購入したKindle作品を取得して、ブクログに登録します。

booklog docker-image kindle puppeteer

Last synced: 13 Jan 2025

https://github.com/codingchili/tls-privacy

ML with sklearn/pandas in Python to identify page loads for specific websites when TLS is used. Uses NodeJS/Puppeteer for traffic generation.

machine-learning nodejs pandas puppeteer python scapy security security-testing

Last synced: 19 Dec 2024

https://github.com/hisasann/hisasann

My awesome README.md

github mustache puppeteer readme typescript

Last synced: 26 Dec 2024

https://github.com/raeesbhatti/vbully

Scrapes data off vBulletin websites

puppeteer scraper vbulletin

Last synced: 14 Dec 2024

https://github.com/harshsharma20503/trade-alert

Trade-Alert is a notification system that keeps users updated on critical news impacting their stock portfolios. It simplifies staying informed by delivering timely notifications for important articles, eliminating the need to monitor multiple platforms in today’s fast-paced market.

fcm-notifications firebase groq-api llm-pipeline puppeteer react-plotlyjs web-scraping

Last synced: 29 Dec 2024

https://github.com/osfunapps/os-cheerio-helper-npm

an intuitive module to help with cheerio web scraping related functions

cheerio-node cheeriojs helper javascript node puppeteer webscraping

Last synced: 29 Nov 2024

https://github.com/eccenux/wikiploy-rollout-example

Wikipedia gadget example with Browserify as a build tool and Wikiploy for deployments.

puppeteer wikipedia wikiploy

Last synced: 25 Dec 2024

https://github.com/patrixr/pdf-render

A small webservice to generate PDFs out of webpages

hacktoberfest node pdf puppeteer webservice

Last synced: 25 Dec 2024

https://github.com/flazefy/gudangku-test

GudangKu helps you manage your belongings, from home supplies and food stock to furniture. Set reminders to remind you to cleaning or maybe time to restocking some of your home supplies. In this apps also have generate reports to create shopping or maintenance list. Test using Cypress & Puppeteer

automation cypress e2e integration-testing javascript puppeteer rest-api test-cases test-steps

Last synced: 24 Dec 2024

https://github.com/progm/node-html2pdf

A simple node server to create pdf files from an URL, using puppeteer. It works as standalone or with AWS Lambda.

html2pdf nodejs pdf-generation puppeteer

Last synced: 21 Dec 2024

https://github.com/molvqingtai/testing-library-extra

Add bySelector and byAttribute to @testing-library/dom

happy-dom jest jsdom playwright puppeteer testing-library testing-library-dom vitest

Last synced: 21 Dec 2024

https://github.com/raharrison/lynks-scraper

Web scraper for Lynks project. Extract screenshots, thumbnails, PDF's and metadata from given URL's

api express extract nodejs puppeteer scraper screenshot thumbnail

Last synced: 19 Dec 2024

https://github.com/anasfik/public-apis-json-api

An Api For The Collective Apis List Of Public-apis Repository Scrapped With Puppeteer/Typescript

api apis collection developement free list public-apis puppeteer software typescript web-scrapping

Last synced: 14 Jan 2025

https://github.com/anasfik/user-repositories-scrapper

a puppeteer script to get repositories data from user using puppeteer

javascript puppeteer repositories scrapper web-scraper web-scraping

Last synced: 14 Jan 2025

https://github.com/zoltan-nz/component-library-template

Component Library Starter Kit: React, TypeScript, Rollup, Jest, Eslint, Prettier

amd commonjs es6 eslint jest library packages prettier puppeteer react rollup typescript umd

Last synced: 18 Dec 2024

https://github.com/dreamjet31/county-lib-scraper

County Library Scraper

javascript nodejs puppeteer

Last synced: 18 Dec 2024

https://github.com/ajmeese7/dynamic-page-retrieval

Scrape data from JS-rendered pages

dynamic-content puppeteer scraping

Last synced: 18 Dec 2024

https://github.com/rebrowser/rebrowser-puppeteer-core

A drop-in replacement for puppeteer-core patched with rebrowser-patches. It allows to pass modern automation detection tests.

automation bot bot-detection captcha headless puppeteer rebrowser rebrowser-patches scraping web-scraping

Last synced: 12 Oct 2024

https://github.com/dfa1234/iux-node

node api for sending email with a pdf attached, corresponding to the given webpage url

nodejs puppeteer

Last synced: 21 Dec 2024

https://github.com/angrykoala/wendigo-vue-plugin

A plugin for Wendigo with assertions regarding vue

automation browser javascript node plugin puppeteer vue vuendigo wendigo

Last synced: 18 Dec 2024

https://github.com/volny/hn-postbot

Scrapes TM for today's submitted stories, checks if they've already been posted on HN, posts them.

bot chrome-headless hacker-news puppeteer scraper techmeme

Last synced: 14 Jan 2025

https://github.com/xandao-dev/rpa-challenge

Automating input filling in rpachallenge.com website

automation nodejs puppeteer rpa

Last synced: 21 Dec 2024

https://github.com/leckau/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 18 Dec 2024

https://github.com/sridharbandi/non-selenium-javascript-getting-started-examples

Non Selenium Javascript Getting Started Examples (Starter Templates)

cucumber es6 jasmine mocha nightmarejs page-object-model puppeteer testcafe

Last synced: 14 Jan 2025

https://github.com/sergeytrasko/wordle-solver

Node.js and Puppeteer based solver for Wordle game

puppeteer wordle wordle-solver

Last synced: 17 Dec 2024

https://github.com/prohetamine/erlasty

⚡️ react server render by puppeteer for search bots

puppeteer react server-rendering ssr

Last synced: 19 Nov 2024

https://github.com/jackfallows/qunit-puppeteer-runner

Runs QUnit tests in a Puppeteer instance and compiles results to JUnit XML

puppeteer qunit

Last synced: 17 Dec 2024

https://github.com/circuit/conference-starter

Bot that starts a conference and dials out members on a scheduled time

bot circuit conference puppeteer sdk unify webrtc

Last synced: 17 Dec 2024

https://github.com/petehouston/mshot-cli

CLI to take screenshots for multiple website at one using Puppeteer.

capture cli puppeteer puppeteer-screenshot screenshot screenshot-utility screenshots

Last synced: 13 Dec 2024

https://github.com/devmunyi/puppeteer-web-automation

Using puppeteer to scrap and automate some repetitive web tasks

nodejs puppeteer typescript

Last synced: 14 Jan 2025

https://github.com/evanhalley/feature-image-generator

An example gulp script that generates feature images for social media from markdown text files containing frontmatter

gulp node puppeteer

Last synced: 30 Dec 2024

https://github.com/mugarate12/instagram_scraping_aws_lambda_function

functions created to get information of instagram page of user every day, put and update in database and send this to client side to http request

aws-lambda javascript puppeteer sequelizejs serverless-framework

Last synced: 13 Dec 2024

https://github.com/stefanzweifel/sidecar-browsershot-layer

AWS Lambda Layer containing puppeteer-core. Used by sidecar-browsershot

aws-lambda aws-lambda-layer puppeteer puppeteer-core

Last synced: 13 Dec 2024

https://github.com/guilhermebkel/semantic-search-llm-ai

🤖 That's a simple LLM semantic search that implements RAG concepts with help of LangChain and OpenAI API.

ai embeddings langchain openai-api puppeteer rag redis redis-vector-store retrieval-augmented-generation semantic-search-ai typescript

Last synced: 05 Nov 2024

https://github.com/rahulnisanth/trackitnow

The e-commerce price tracker and analyzer for best deals

bright-data cheerio-js cron-jobs nextjs14 puppeteer web-scraping-software

Last synced: 05 Nov 2024

https://github.com/blank-09/google-meet-automation

An automation software to join Google Meet meetings. The software uses the csv file to get the schedule of the meetings and joins the meeting at the scheduled time.

automation google-meet puppeteer

Last synced: 05 Nov 2024

https://github.com/squishy123/twist-scraper

Scraper Endpoints for twist.moe

anime javascript nodejs puppeteer scraping

Last synced: 12 Dec 2024

https://github.com/mattezekiel/get-commits-count

Get every commit ever made (Public)

bash javascript puppeteer scraper yaml

Last synced: 14 Jan 2025

https://github.com/tyom/memify

Create memes on the fly

canvas konva micro node now puppeteer serverless vue

Last synced: 24 Dec 2024

https://github.com/portrunban/node-badoo-autolike-bot

Badoo autolike bot. Node JS, puppeteer

autolike automated badoo bot like liker nodejs parser puppeteer

Last synced: 02 Jan 2025

https://github.com/sidvishnoi/href-checker

Hyperlink checker for HTML pages which checks href attributes by actually visiting linked pages and also checking existence of URL fragments.

cli hacktoberfest hyperlink-auditing library link-checker link-checking puppeteer validator

Last synced: 17 Dec 2024

https://github.com/sjdonado/assessment-2-backend-un-202130

DSLLO APLICACIONES WEB BACKEND - Universidad del Norte, Colombia

http-server nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/ewliang/cnbc-premarket-web-scraper

A web scraper created using Puppeteer library on the backend to scrape the stock market prediction data off of CNBC's premarket page.

backend-development expressjs javascript node-js nodejs puppeteer stock-market web-scraper web-scraping webscraper

Last synced: 02 Jan 2025

https://github.com/geodoo/game-of-shells

Game of shells

atdd jest puppeteer react tdd

Last synced: 12 Jan 2025

https://github.com/tatsuyafujisaki/jkk-watcher

Check a vacant room in an apartment of JKK Tokyo

javascript jkk-tokyo puppeteer

Last synced: 12 Dec 2024

https://github.com/akashchouhan16/webscraping-cli

A command-line tool using node & puppeteer for web scraping.

chromium nodejs puppeteer

Last synced: 12 Dec 2024

https://github.com/platzi-master-c8/research-jobplacement

This is all the ETL process for the job placement cell 🔍

pandas pipeline puppeteer webscraping

Last synced: 11 Dec 2024

https://github.com/hiagoisoppo/trybe-futebol-club

Aplicação web full stack, desenvolvida em monorepo com o objetivo de registrar e organizar a pontuação em um campeonato de futebol fictício.

axios bcrypt chai docker expressjs jest joi jsonwebtoken mocha mysql nodejs nodemon puppeteer reactjs router-dom sequelize sinon testing-library tsnode typescript

Last synced: 10 Oct 2024

https://github.com/tomashubelbauer/globus

Scrapes the Globus PDF catalogue using Puppeteer

globus pdf-scraping puppeteer puppeteer-firefox

Last synced: 31 Dec 2024

https://github.com/book000/moneyforward-collector

Export MoneyForward deposit/withdrawal statements in CSV and take a screenshot.

csv moneyforward nodejs puppeteer screenshot

Last synced: 13 Jan 2025

https://github.com/willemverbuyst/willemverbuyst

Scrape the topics of my repos, convert those into badges and present them in an overview (with a cron job)

githubactions javascript mustache puppeteer

Last synced: 10 Dec 2024

https://github.com/michaelcaxias/anime-web-scraping

Script de raspagem de dados de um site de anime, capturando dados como nome, número e video de episódios.

node puppeteer typescript web-scraping

Last synced: 02 Jan 2025

https://github.com/deliteser112/node-cheerio-puppeteer-scraping-bot

Games Night App scraping bot using Node, Cheerio, Puppeteer

axios cheerio nodejs puppeteer

Last synced: 02 Jan 2025

https://github.com/sooluh/moodle-auto-attendance

:robot: Automated machines for attendance in Moodle using Puppeteer.

attendance crontab moodle moodle-auto-attendance nodejs puppeteer

Last synced: 01 Oct 2024

https://github.com/marknjunge/ams-parse

A web scraper for Strathmore's AMS student's module

cheerio puppeteer strathmore webscraping

Last synced: 23 Dec 2024

https://github.com/hallee/resume

My résumé, built from a GitHub README.md

eleventy js markdown neat puppeteer readme-as-resume resume

Last synced: 23 Nov 2024