Puppeteer | Ecosyste.ms: Awesome

https://github.com/samc621/business-insider

Takes the URL of a Business Insider article and PDF's it's raw content, bypassing the paywall.

axios jsdom nodejs puppeteer web-scraping

Last synced: 23 Dec 2024

https://github.com/coin-mirror/maplibre-gl-renderer

Rendering MapLibre maps on server-side into pictures with full maplibre style spec support.

maplibre maplibre-gl puppeteer static-image

Last synced: 01 Feb 2025

https://github.com/elialm7/consultor-scraper-api

api scraper made using puppeter and express and typescript

expressjs puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/noriste/feti-workshop-e2e-testing-with-puppeteer

The reference repo of a workshop for FETI about browser automation (both for E2E testing and for web scraping) with Puppeteer. Workshop level: basic.

e2e-testing e2e-tests puppeteer scraping-websites testing-tools web

Last synced: 23 Dec 2024

https://github.com/balaji-atoa/puppe-pdf

an npm package to convert HTML or any website to pdf flawlessly in seconds using puppeteer/chromium!

htmlpdf htmltopdf node pdf pdf-generation puppeteer

Last synced: 17 Nov 2024

https://github.com/kevcui/testing-toolbox

🛠️ Handy single-file scripts to help with testing, or daily hacking

bash bash-script bash-scripting cli puppeteer script testing testing-toolbox toolbox

Last synced: 31 Jan 2025

https://github.com/kevcui/ludwig-token-fetcher

:ticket: Fetch ludwig token using puppeteer

javascript puppeteer script

Last synced: 31 Jan 2025

https://github.com/platzi-master-c8/research-jobplacement

This is all the ETL process for the job placement cell 🔍

pandas pipeline puppeteer webscraping

Last synced: 05 Feb 2025

https://github.com/kevcui/putility

:wrench: Puppeteer script-kit

puppeteer scripting scriptkit

Last synced: 31 Jan 2025

https://github.com/lunneu/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 09 Dec 2024

https://github.com/vikramsamak/html-to-pdf-microservice

A simple microservice that converts HTML content to PDF using Puppeteer.

api-rest expressjs htmltopdf microservice nodejs puppeteer

Last synced: 08 Feb 2025

https://github.com/sirok1/lolz-auto-contests

Lolzteam | zelenka.guru app for auto-participation in draws

discord-webhook nodejs puppeteer telegram-bot

Last synced: 16 Jan 2025

https://github.com/prohetamine/erlasty

⚡️ react server render by puppeteer for search bots

puppeteer react server-rendering ssr

Last synced: 20 Jan 2025

https://github.com/aymanabusura/formfillingbot

This project is a form-filling bot that automates form submissions on specified URLs using a server powered by Puppeteer.

axios cors expressjs nodejs puppeteer reactjs

Last synced: 20 Jan 2025

https://github.com/zbo14/giturls

A command-line tool that searches GitHub for URLs

browser-automation bug-bounty cli puppeteer recon web-scraping

Last synced: 31 Jan 2025

https://github.com/cage1016/screenshot-as-a-service-demo

GCPUG Taiwan Meetup #29: screenshot as a service demo code

chromeless phantomjs puppeteer screenshot

Last synced: 25 Jan 2025

https://github.com/hashd/learnstack

To read is good, To practice is divine.

all-in-one elixir experiments learning-by-doing phoenix-framework playground puppeteer

Last synced: 18 Dec 2024

https://github.com/rebrowser/rebrowser-puppeteer-core

A drop-in replacement for puppeteer-core patched with rebrowser-patches. It allows to pass modern automation detection tests.

automation bot bot-detection captcha headless puppeteer rebrowser rebrowser-patches scraping web-scraping

Last synced: 12 Oct 2024

https://github.com/carloslfu/smartest

Simple e2e tests and automated screenshoots using Puppeteer

e2e integration puppeteer test

Last synced: 09 Feb 2025

https://github.com/sokraglav13/end-to-end-testing-with-puppeteer

This project contains all the required components for an automation testing framework like Logger, Reporter, Video Recording, Test Data, Static Code Analysis, CI Integration, POM.

allure-report automated-testing end-to-end-testing mocha-chai nodejs puppeteer static-analysis testing ui-testing video-recording winston-logger

Last synced: 07 Dec 2024

https://github.com/dmehra2102/advance-node

This is the advance node project where I'm using redis for caching and Jest for writing test for my project.

javascript jest nodejs passport puppeteer redis

Last synced: 01 Feb 2025

https://github.com/deptno/nsdi

㉿ nsdi downloader built on puppeteer

crawler downloader nsdi openapi puppeteer

Last synced: 31 Dec 2024

https://github.com/tantelyrandriamazaoro/charbon-cli

A Command Line Interface to automate/assist the job search and application process.

automations dependency-injection google-custom-search-api nodejs object-oriented-programming openai-api puppeteer sqlite typescript web-scraping

Last synced: 25 Jan 2025

https://github.com/slickcharmer/screen-sharing-basic

Simple Screen Sharing Application using React and Node.js. You can use it on your project.

nodejs puppeteer react screen sharing

Last synced: 15 Jan 2025

https://github.com/sidvishnoi/href-checker

Hyperlink checker for HTML pages which checks href attributes by actually visiting linked pages and also checking existence of URL fragments.

cli hacktoberfest hyperlink-auditing library link-checker link-checking puppeteer validator

Last synced: 09 Feb 2025

https://github.com/pdehaan/playwright-test

Testing playwright -- a Node library to automate the Chromium, WebKit and Firefox browsers.

chromium firefox playwright puppeteer webkit

Last synced: 19 Dec 2024

https://github.com/gughog/smtiv-webscrapper-tool

A web scrapper to scrape data from a smt iv related website.

javascript node puppeteer webscraping

Last synced: 31 Jan 2025

https://github.com/p1atdev/wordle-solver

Wordle Solver with Deno

deno puppeteer wordle

Last synced: 31 Dec 2024

https://github.com/akopcz2/redlert

Uptime Monitor

javascript monitor node puppeteer

Last synced: 31 Dec 2024

https://github.com/uiuxarghya/ogiaas

📈 ( OGIaaS ) Open Graph Image as a Service - Generate cards for Twitter, Facebook, Slack, etc on the go.

hacktoberfest headless-chrome og ogiaas open-graph open-graph-protocol open-source puppeteer uiuxarghya vercel vercel-serverless

Last synced: 18 Jan 2025

https://github.com/cenfun/page-save-as

Page save as JPG/PNG/PDF

jpg page pdf png puppeteer save

Last synced: 02 Feb 2025

https://github.com/i62navpm/vue-front-app

Front app + Google cloud tools

appengine bigquery firebase firestore-database google-cloud google-functions google-storage puppeteer

Last synced: 17 Jan 2025

https://github.com/joeylemon/scraper

a scraper for checking item availability at websites such as online retailers

nodejs puppeteer

Last synced: 22 Jan 2025

https://github.com/leafyeexyz/ehentaisearcher

一个用来检索被 e-hentai 官方屏蔽的 tag 的工具 / A tool to retrieve tags that are blocked by the e-hentai

comic comics deno e-hentai exhentai jsr manga puppeteer scraper typescript

Last synced: 07 Feb 2025

https://github.com/euberdeveloper/bbb-video-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served by BBB

npm puppeteer scraper typescript video-scraper

Last synced: 04 Feb 2025

https://github.com/stopsopa/docker-puppeteer-pdf-generator

Microservice tool to generate pdf from any url/page

chromium docker google-chrome microservice node-js nodejs pdf pdf-generation puppeteer

Last synced: 06 Feb 2025

https://github.com/lencx/learn-puppeteer

puppeteer 学习笔记

demo puppeteer puppeteer-demo

Last synced: 02 Feb 2025

https://github.com/rubriclab/trigger-ai-copy

Improve your landing page copy with AI.

gpt-4-turbo puppeteer triggerdev

Last synced: 05 Jan 2025

https://github.com/guilhermebkel/semantic-search-llm-ai

🤖 That's a simple LLM semantic search that implements RAG concepts with help of LangChain and OpenAI API.

ai embeddings langchain openai-api puppeteer rag redis redis-vector-store retrieval-augmented-generation semantic-search-ai typescript

Last synced: 05 Nov 2024

https://github.com/urijhoruzij/parser

Parser that allows you to upload images of products from online stores.

node-js nodejs parser puppeteer

Last synced: 03 Feb 2025

https://github.com/rahulnisanth/trackitnow

The e-commerce price tracker and analyzer for best deals

bright-data cheerio-js cron-jobs nextjs14 puppeteer web-scraping-software

Last synced: 05 Nov 2024

https://github.com/stagas/run-in-client

runs a single function in the client using puppeteer and esbuild

esbuild function puppeteer test testing typescript

Last synced: 23 Dec 2024

https://github.com/leckau/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 18 Dec 2024

https://github.com/euberdeveloper/video-scraper-core

An npm package that provides an abstract class to scrape videos with Puppeteer

npm puppeteer scraper typescript video-scraper

Last synced: 04 Feb 2025

https://github.com/mehradevesh2022/hackerrank-automation

This is a project called hackerrank automation. Using Puppeter.

automation chromium hackerrank hackerrank-automation nodejs nodejs-library puppeteer

Last synced: 03 Feb 2025

https://github.com/tkdn/chroco

[experimental] Chroco operates `puppeteer` with commandable, pluggable settings.

chrome cli experimental headless puppeteer scenario

Last synced: 29 Jan 2025

https://github.com/c0b41/puppeteer-adblock

Chrome puppeter adblock example..

adblock chrome puppeteer

Last synced: 22 Jan 2025

https://github.com/epilande/jester

🃏 Jest Puppeteer End-to-End

e2e jest puppeteer test

Last synced: 25 Jan 2025

https://github.com/ykon550/puppenomist

Puppenomist = Scraper for the Economist with Puppeteer

economist puppeteer puppeteer-demo webscraping

Last synced: 29 Jan 2025

https://github.com/shishir1337/google-lens-image-sources-api

A high-performance Node.js application leveraging Puppeteer and Express to efficiently extract and display related sources from Google Lens based on image URLs. Features include advanced caching, rate limiting, and optimized error handling to ensure a smooth and scalable user experience.

caching express-js image-search nodejs performance-optimization puppeteer rate-limiting seo-friendly web-scraping

Last synced: 10 Oct 2024

https://github.com/blank-09/google-meet-automation

An automation software to join Google Meet meetings. The software uses the csv file to get the schedule of the meetings and joins the meeting at the scheduled time.

automation google-meet puppeteer

Last synced: 05 Nov 2024

https://github.com/ajmeese7/dynamic-page-retrieval

Scrape data from JS-rendered pages

dynamic-content puppeteer scraping

Last synced: 10 Feb 2025

https://github.com/hiagoisoppo/trybe-futebol-club

Aplicação web full stack, desenvolvida em monorepo com o objetivo de registrar e organizar a pontuação em um campeonato de futebol fictício.

axios bcrypt chai docker expressjs jest joi jsonwebtoken mocha mysql nodejs nodemon puppeteer reactjs router-dom sequelize sinon testing-library tsnode typescript

Last synced: 22 Jan 2025

https://github.com/michaelcaxias/anime-web-scraping

Script de raspagem de dados de um site de anime, capturando dados como nome, número e video de episódios.

node puppeteer typescript web-scraping

Last synced: 02 Jan 2025

https://github.com/adamtylerlynch/puppeteer-multiarch

Creating Multi-Arch docker images for ARM64/x86 (amd64) using CodeBuild from Jenkins. Headless browsing with Chromium and Puppeteer.

aarch64-linux arm arm64 chromium codebuild docker docker-image multi-arch-images multiarch puppeteer

Last synced: 07 Feb 2025

https://github.com/glaucusec/pricedrop-detective

PriceDrop-Detective is a Node.js project designed to help users track price changes for products, with a focus on products listed on Amazon. By providing a product's URL, this website can monitor the product daily for any changes in its price.

axios bulma nodejs npm puppeteer react uuid

Last synced: 18 Dec 2024

https://github.com/zoltan-nz/component-library-template

Component Library Starter Kit: React, TypeScript, Rollup, Jest, Eslint, Prettier

amd commonjs es6 eslint jest library packages prettier puppeteer react rollup typescript umd

Last synced: 18 Dec 2024

https://github.com/ujjawal-1999/pdf-generator-puppeteer

A simple web application that takes a url and page format as input and returns a pdf of the url.

heroku-buildpack heroku-deployment node-js puppeteer

Last synced: 22 Jan 2025

https://github.com/santosl2/link-preview

See your URL's preview's

api-routes chrome-aws-lambda link-preview nextjs puppeteer

Last synced: 28 Jan 2025

https://github.com/mrseanryan/style-scraper

Scrape styles from a website using reliable computed styling via a headless browser [fonts, colors, border styles ...]

puppeteer scraping scraping-styling scraping-websites styling-css

Last synced: 28 Dec 2024

https://github.com/altipla-consulting/pdfgen

Server to generate PDFs with puppeteer through a web API.

pdf puppeteer

Last synced: 25 Jan 2025

https://github.com/circuit/conference-starter

Bot that starts a conference and dials out members on a scheduled time

bot circuit conference puppeteer sdk unify webrtc

Last synced: 09 Feb 2025

https://github.com/cclient/weizhishu-puppeteer

puppeteer抓取微博指数

chrome clawler puppeteer spider

Last synced: 16 Jan 2025

https://github.com/moaj257/b-ok.org

:rocket: A simple, clean, fast and elegant books webapp. :fire:

b-ok-api book-api full-stack-application nextjs puppeteer react ui ux web-app web-scraping

Last synced: 19 Dec 2024

https://github.com/tarektouati/gcp-synthetic-monitoring

Example of GCP synthetic monitor with puppeter

gcp javascript monitoring puppeteer testing-library

Last synced: 08 Feb 2025

https://github.com/progm/node-html2pdf

A simple node server to create pdf files from an URL, using puppeteer. It works as standalone or with AWS Lambda.

html2pdf nodejs pdf-generation puppeteer

Last synced: 21 Dec 2024

https://github.com/sridharbandi/non-selenium-javascript-getting-started-examples

Non Selenium Javascript Getting Started Examples (Starter Templates)

cucumber es6 jasmine mocha nightmarejs page-object-model puppeteer testcafe

Last synced: 14 Jan 2025

https://github.com/raharrison/lynks-scraper

Web scraper for Lynks project. Extract screenshots, thumbnails, PDF's and metadata from given URL's

api express extract nodejs puppeteer scraper screenshot thumbnail

Last synced: 19 Dec 2024

https://github.com/tomaszrewak/react-app-puppeteer-component-testing

Guide on how to to configure puppeteer with a default (non-ejected) react app in order to test individual react components.

puppeteer react regression-testing visual-testing

Last synced: 05 Jan 2025

https://github.com/hamzahussyn/daraz-data-scrapper

Scrapes data from the site Daraz.pk and saves in a json file.

daraz darazpk data-science puppeteer scra scrapper

Last synced: 19 Jan 2025

https://github.com/zukarusan/chaant

Automation for playing chess in websites using puppeteer

api chess chess-bot chess-game chesscom javascript lichess puppeteer typescript

Last synced: 19 Jan 2025

https://github.com/chaudinh/insta-downloadeer

A NodeJS app for downloading Instagram "awesome" images. Actually for practicing "Clean Code" purpose :)

fs image-downloader instagram javascript nodejs puppeteer

Last synced: 19 Jan 2025

https://github.com/chaudinh/cron

This is...

cronjob-scheduler javascript puppeteer server-side-rendering

Last synced: 19 Jan 2025

https://github.com/pigloverabbit520/salamandernodepuppeteer

Node官方镜像的基础上安装了puppeteer的依赖

nodejs puppeteer

Last synced: 19 Jan 2025

https://github.com/dpbm/opendatasus-crawler

A simple crawler using puppeteer

brazil chrome crawler csv datasus nodejs opendatasus pdf puppeteer screenshot sus

Last synced: 19 Jan 2025

https://github.com/bhagyamudgal/custom-puppeteer-server

A custom express server to use puppeteer for generating screenshots, pdfs, etc.

expressjs nodejs puppeteer typescript

Last synced: 24 Jan 2025

https://github.com/rchrdlss3/spotify-scraper

Obtain data from Spotify regarding your favorite artist or album. Utilizes Puppeteer.

artists music npm npm-package puppeteer scrape spotify web

Last synced: 05 Jan 2025

https://github.com/joswinemmanuel/info-collector

Info Collector gathers information from multiple search engines ( Google, Bing, Yahoo ), performs searches with a specified term, retrieves results, and saves them to separate files.

javascript nodemon puppeteer

Last synced: 31 Jan 2025

https://github.com/afeiship/ushell-module-puppeteer

Unix config for puppeteer.

centos chrome headless mac module puppeteer ubuntu ushell

Last synced: 07 Feb 2025

https://github.com/baxsm/scrapway

Scrapway allows users to create powerful data scraping workflows and execute them either manually or via cron jobs. With an intuitive UI and support for various tasks such as user interactions, data extraction, storage, and result delivery – you can easily automate scraping operations with minimal effort.

cheerio nextjs openai puppeteer scraping shadcn-ui stripe tailwindcss

Last synced: 01 Feb 2025

https://github.com/ryoichi-obara/search-youtube-url

Get url from YouTube search result.

ecmascript javascript node node-js nodejs puppeteer scraper webscraper webscraping youtube

Last synced: 25 Jan 2025

https://github.com/ryoichi-obara/hatenablog-mixed-content-finder

Mixed Content Finder for hatenablog with Puppeteer.

hacktoberfest node node-js node-module puppeteer puppeteer-core web-scraper web-scraping

Last synced: 25 Jan 2025

https://github.com/kayantchian/fooddatascraper

FoodDataScraper is a browser extension that performs web scraping on predefined restaurant menu websites. It collects data from these menus and generates automated spreadsheets, optimizing the internal menu registration process for businesses.

csv data-science javascript papaparse puppeteer webscrapy

Last synced: 25 Jan 2025

https://github.com/kirk-en/nes-video-fetch

A web scraping tool designed to fetch download links for NES (Nintendo Entertainment System) long play videos based on game title. This tool currently supports pulling long plays and wiki info for 443 licensed NES titles.

puppeteer retrogaming scraping video-downloader video-processing

Last synced: 25 Jan 2025

https://github.com/rayc2045/ghibli-crawler

Automatically download 1,178 studio Ghibli's work photos

axios crawler ghibli node node-js nodejs puppeteer rest-api restful restful-api

Last synced: 26 Jan 2025

https://github.com/afeiship/pptr-html

Get html by puppeteer.

crawl html pptr puppeteer spider

Last synced: 07 Feb 2025

https://github.com/kayyz1/llmscraper

LLM AI web scraper tool

openai puppeteer react remix typescript

Last synced: 10 Dec 2024

https://github.com/kimkykie/blog-pdf-converter

Convert messy web articles into clean PDFs. Perfect for reading, archiving, sharing, and content analysis. Strips the noise, keeps what matters.

nodejs pdf-generation pdfkit puppeteer

Last synced: 09 Feb 2025

https://github.com/korigamik/vuemastery-downloader

Download every vuemastery course locally.

puppeteer typescript vuejs

Last synced: 07 Feb 2025

https://github.com/hid-gs/simple-jest-puppeteer-runner

Docker container for jest tests using puppeteer

docker javascript jest public puppeteer tests

Last synced: 25 Jan 2025

https://github.com/an0ncer/pwa-sitemap

Репозиторий с веб-скрапером на Node.js и Puppeteer. Создайте sitemap.xml для индексации веб-сайтов.

nodejs puppeteer sitemap web-crawling web-scraper

Last synced: 31 Jan 2025

https://github.com/jsardev/icons8-scraper

Scraper which downloads icons from icons8 in bulk

automation puppeteer scraper

Last synced: 25 Jan 2025

https://github.com/hutsoninc/stihl-scraper

Used to scrape data on Stihl products.

puppeteer stihl

Last synced: 27 Dec 2024

https://github.com/gabrielamoura25/finaltask---carvalho-aleixo

Este é um projeto de web scraper desenvolvido em Node.js utilizando a biblioteca Puppeteer para extrair informações do produto garlic press do site da Amazon.

javascript puppeteer

Last synced: 07 Feb 2025