Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/wasabina67/puppeteer-example

Puppeteer example

puppeteer

Last synced: 23 Dec 2024

https://github.com/evgeniyarbatov/location-testing

E2E testing of pages with location

expressjs location mocha puppeteer

Last synced: 23 Dec 2024

https://github.com/redaezziani/scrape-data-store-jolt

Product Scraper for Jolt Store is a robust tool designed to automate the collection of product data from e-commerce websites. This project leverages Puppeteer for web scraping and Prisma Client for seamless database management, ensuring efficient integration of external product data into the Jolt Store.

nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/shyamsunder149/problem-solving-tracker

A Tracker to track my solves around leetcode, gfg, codeforces and codchef. Just It will be satisfying for me to watch it

puppeteer scraping typescript

Last synced: 23 Dec 2024

https://github.com/muratsercann/book-price-agent

This application retrieves book prices from 5 different stores based on a search query. It uses React for the client-side interface, a Node.js API for the backend, and Puppeteer for web scraping.

expressjs nodejs puppeteer puppeteer-extra puppeteer-extra-plugin-stealth react

Last synced: 23 Dec 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer-example

Test code for the Docker image nodejs-puppeteer

docker nodejs puppeteer

Last synced: 23 Dec 2024

https://github.com/zaidkhalid44/irctc

Technologies used: JavaScript, Puppeteer, Tesseract.js, Jimp Description: Developed an automated system using Puppeteer and Tesseract.js to streamline IRCTC train ticket booking, handling login, captcha solving, and form filling. Automated login and form-filling tasks, reducing manual effort by approximately 90%.

jimp puppeteer tesseract

Last synced: 23 Dec 2024

https://github.com/sharif-minhaz/web-scraping-with-js

Web scraper extracts data from websites. In JavaScript, jsdom and Puppeteer are powerful tools for this task. jsdom is a lightweight DOM implementation that lets user manipulate and query static pages. Puppeteer is a Node.js library for controlling headless Chrome/Chromium, ideal for dynamic websites. It can simulate user interactions and take ss

bun jsdom puppeteer web-scraping

Last synced: 23 Dec 2024

https://github.com/jfmonsa/book_scrapper

A web scrapping CLI tool to get books and categories/subcategories from Z-Library

node-js postgresql puppeteer web-scraping z-lib z-library

Last synced: 23 Dec 2024

https://github.com/gabrielcstr/dota2protracker-scraper

Scraping meta heroes from dota2protracker.com

d2pt dota2 dota2protracker javascript puppeteer scraper

Last synced: 23 Dec 2024

https://github.com/dnascanner/ani-cli

A simple to use terminal tool to find your favorite anime

anime chrome chromium cli deno puppeteer

Last synced: 23 Dec 2024

https://github.com/gigaarpit/puppeteer-examples

Collection of practical examples and scripts utilizing Puppeteer

playwright puppeteer puppeteer-screenshot

Last synced: 23 Dec 2024

https://github.com/tushcmd/olo-scraper

This is a full-stack web scraping application that simulates browser-like interactions using a headless browser. Users can input a URL, and the application scrapes data and performs specified actions.

cors express nodejs puppeteer react tailwindcss typescript winston

Last synced: 23 Dec 2024

https://github.com/extrawest/ai-uni-summarizer

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.

ai groq groq-api nextjs openai puppeteer reactjs youtube

Last synced: 23 Dec 2024

https://github.com/pedromarques391/lastreleases

Projeto de web scraping

nodemailer puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/antoniowd/aws-lambda-pdf

The aws-lambda-pdf project is designed to generate PDFs from HTML content using AWS Lambda and Chromium. The generated PDF files are stored in an S3 bucket, and the application returns a signed URL for accessing the PDF file.

aws-lambda chromium pdf-generation puppeteer

Last synced: 23 Dec 2024

https://github.com/duranda/lambda-pdf-generator

Generate PDF from HTML remotely on AWS Lambda with the Chromium rendering engine

aws-lambda chromium pdf-generation puppeteer wkhtmltopdf

Last synced: 23 Dec 2024

https://github.com/spm999/invoice-generator

Invoice generator application built using Node.js, Express.js, Handlebars, and Puppeteer. It generates invoices in PDF format based on the provided data.

api-rest express hbs invoice-generator nodejs postman puppeteer template-engine templateengine

Last synced: 23 Dec 2024

https://github.com/prantadas/play-scrapper

A Node.js-based scraper for extracting data from Google Play and the Apple App Store (Check the app's availability in a specific country). The scraper uses Puppeteer for automation and exports results to an Excel file.

excel-export puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/ailixter/chromatic

Chromium automation server

automation chromium nodejs pdf puppeteer server service

Last synced: 23 Dec 2024

https://github.com/daveanthonyc/webscraper-test

Webscraper using Puppeteer to scrape 7000+ rows of data.

dataminig nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/devzkhalil/puppeteer-facebook-unfriends-script

The Puppeteer Facebook Unfriends Script is a tool developed using Puppeteer, a Node.js library that provides a high-level API to control headless Chrome or Chromium browsers. This script is specifically crafted for automating the process of unfriending users on Facebook.

facebook facebook-unfriend facebook-unfriend-script puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/mushfiqurniazzz/word-meaning---webscraping

A basic Nodejs environmental function that takes in a word to search in a word-meaning website and then prints it in the terminal through web-scraping.

javascript nodejs puppeteer webscraping wordmeaning

Last synced: 23 Dec 2024

https://github.com/xredax/quran-hadith-poster

Automated Facebook bot for sharing Quran pages and Hadith content to groups.

automation facebook facebook-bot hadith islamic islamic-app nodejs puppeteer quran social-media

Last synced: 16 Dec 2024

https://github.com/brianpunzalan/nextjs-advanced-starter

Next.js Advanced Starter with Typescript, MaterialUI, Storybook, Jest, Puppeteer, Redux, ESLint, Prettier and more.

eslint jest material-ui nextjs prettier puppeteer redux storybook typescript

Last synced: 23 Dec 2024

https://github.com/athrvk/calibre-puppeteer-base

This repository contains a Dockerfile for creating a base image with Calibre and Puppeteer pre-installed. This image is built on top of Ubuntu 22.04 and includes all necessary dependencies for running Calibre and Puppeteer.

browserless calibre docker docker-image ebook-converter puppeteer

Last synced: 03 Feb 2025

https://github.com/umuthopeyildirim/puppateer-screenshot

The Google Cloud function that can take screenshots of websites.

google-cloud-functions google-cloud-storage javascript puppeteer

Last synced: 11 Jan 2025

https://github.com/andriilive/stav-rizeni-mvcr-oamp-pupppetter

Browser automation to check the application status at Department for Asylum and Migration Policy, Czech Republic

czech czech-republic nodejs oamp puppeteer

Last synced: 17 Jan 2025

https://github.com/vasani-arpit/puppeteer-extension-automation-example

Tutorial on how to add and use an extension programmatically in puppeteer

automation extensions node nodejs puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/onfranciis/sustainobles-backend

Add donations and retrieve list as pdf using NodeJS and MongoDB

expressjs jest mongodb nodejs puppeteer typescript

Last synced: 16 Dec 2024

https://github.com/kimromi/kshot

📷 Tools to take screenshots.

javascript koajs puppeteer

Last synced: 17 Jan 2025

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 23 Dec 2024

https://github.com/runnin-n-gunnin/puppeteerpanellib

PuppeteerPanel is a User Control that embeds puppeteer's chromium window in a Windows Forms application. POC.

chromium crawling puppeteer puppeteer-sharp scraping winforms

Last synced: 09 Jan 2025

https://github.com/tomashubelbauer/playwright-pdf

Using Playwright Firefox to scrape PDFs

firefox pdf playwright puppeteer scraping

Last synced: 31 Dec 2024

https://github.com/tomashubelbauer/playwright-github-actions

Demonstrates using Playwright to control Firefox to take a screenshot of Hacker News in GitHub Actions

github-actions playwright puppeteer

Last synced: 31 Dec 2024

https://github.com/tomashubelbauer/shoot

A Node tool for capturing web page screenshots using Puppeteer

node npm npx puppeteer screenshot

Last synced: 31 Dec 2024

https://github.com/tomashubelbauer/puppeteer-deterministic-screenshot

Pondering about whether Puppeteer screenshots are deterministic

deterministic jpg png puppeteer reproducible-builds screenshot

Last synced: 31 Dec 2024

https://github.com/tomashubelbauer/puppeteer-deterministic-pdf

Making PDFs generated using Puppeteer deterministic by zeroing their date and time stamps

pdf puppeteer

Last synced: 31 Dec 2024

https://github.com/sojebsikder/extra-power

This is a simple project that helps other developer to achieve something different

express nodejs puppeteer typescript

Last synced: 09 Jan 2025

https://github.com/tomashubelbauer/cra-test-puppeteer

Testing CRA (Create React App) with Puppeteer

cra create-react-app puppeteer

Last synced: 31 Dec 2024

https://github.com/anujdhillxn/igbot

Automated bot for instagram using puppeteer and expressjs for posting, scraping and gathering followers

expressjs mongodb puppeteer typescript webscraping

Last synced: 31 Dec 2024

https://github.com/softplus/detweet

Remove Tweets via Puppeteer

nodejs puppeteer twitter twitter-api

Last synced: 23 Dec 2024

https://github.com/hazemkrimi/media-source-scraper

An api that scrapes the source of media from a given url (Facebook, YouTube, Podcasts)

expressjs facebook ffmpeg nodejs puppeteer scraper youtube

Last synced: 23 Dec 2024

https://github.com/uday160386/test-automation-poc-demos

The consolidation of proofs of concept (POCs) using various open source tools is a strategic approach that can streamline development processes and enhance productivity

playwright-javascript puppeteer robotframework selenium

Last synced: 23 Dec 2024

https://github.com/mersocarlin/puppeteer

Run headless Chrome Node.js tests in a Docker container

automated-testing docker docker-image dockerfile puppeteer

Last synced: 23 Dec 2024

https://github.com/konojunya/puppeteer-react

[CODE SANDBOX] puppeteer e2e testing with React

e2e-tests puppeteer react

Last synced: 23 Dec 2024

https://github.com/yr72dpi/mysql_error_google_scrapper

¤ This nodeJs script scrappes mysql errors found on google using puppeteer.

google mysql nodejs osint puppeteer scrapper scrapper-script

Last synced: 11 Dec 2024

https://github.com/erenkucuker/amazon-asin-scraper

Webscraper api that allows get product data by asin from amazon

amazon asin express javascript puppeteer webscraping

Last synced: 11 Dec 2024

https://github.com/akashchouhan16/webshot

:camera_flash: Automate web snapshots and saves to local.

javascript nodejs prompt-toolkit puppeteer

Last synced: 12 Dec 2024

https://github.com/yoannchb-pro/chromespeechrecognition

Access chrome SpeechRecognition with puppeteer in headless mode

chrome puppeteer speech-recognition speech-to-text

Last synced: 12 Dec 2024

https://github.com/christophe77/ssxss

XSS scanner using puppeteer with nodeJS

express javascript puppeteer xss xss-detection

Last synced: 12 Dec 2024

https://github.com/hideack/node_shutter

puppeteerによるスクリーンショット取得するシンプルなAPIを提供

puppeteer

Last synced: 12 Dec 2024

https://github.com/bhagyamudgal/time-fun-scraper

Node.js script to scrape time.fun and create a txt report

nodejs puppeteer typescript

Last synced: 17 Jan 2025

https://github.com/idan-sh/puppeteer-automation

a JavaScript web-form test automation using the Puppeteer library.

automation-testing javascript puppeteer

Last synced: 17 Jan 2025

https://github.com/sidvishnoi/all-requests

Find all local and remote sub-resources and HTTP requests in a HTML document.

http-dependencies http-requests puppeteer scraper sub-resource subresource

Last synced: 17 Dec 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 11 Jan 2025

https://github.com/antoniowd/nitto-tire-crawler

Web scraper del sitio nittotire para la obtención de las características de sus neumáticos y analizar que autos pueden usarlo

mongodb nodejs puppeteer webcrawler webscraping

Last synced: 12 Dec 2024

https://github.com/wlun001/html-image-headless

Example of convert HTML to image with Headless environment

docker headless-chrome nodejs puppeteer

Last synced: 17 Dec 2024

https://github.com/derrmru/scrape-the-news

Proof of concept - Scrape News Outlets with Express JS

expressjs javascript nlp puppeteer

Last synced: 23 Dec 2024

https://github.com/eric-philippe/crilstats-webscrapping

Web scraping for statistics and analytics.

api puppeteer resacril rest webscraping

Last synced: 12 Dec 2024

https://github.com/stopsopa/state-of-puppeteer

🎎Bunch of test of my own puppeteer extensions

extension extensions puppeteer

Last synced: 12 Dec 2024

https://github.com/stopsopa/docker-puppeteer-html-scraper

(Deprecated -> use better https://github.com/stopsopa/html-scraper-browserless) Microservice tool to scraping html from "any" page

docker html-scraper node nodejs puppeteer scraper

Last synced: 12 Dec 2024

https://github.com/arnavk-09/clone-html-site

⛓️ Script to clone website elements...

browserless html-css-javascript html5 node pptr puppeteer

Last synced: 13 Dec 2024

https://github.com/luifean/randomflix-api

API desenvolvida a fim de prover informações de filmes da sua lista da Netflix. Faz uso do conceito de web scraping como data source.

cors express javascript nodejs puppeteer

Last synced: 01 Jan 2025

https://github.com/luifean/dicio-api

API desenvolvida para obter o significado de palavras através de mineração de dados

express javascript nodejs puppeteer

Last synced: 01 Jan 2025

https://github.com/luifean/github-web-api

API criada a fim de copiar a API original do GitHub, porém utilizando o conceito de mineração de dados

express javascript nodejs puppeteer typescript webscraping

Last synced: 01 Jan 2025

https://github.com/pionl/docker-node-puppeteer-ready

🐳 Docker image based on official node with with GoogleChrome/puppeteer support

chrome docker docker-image nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/amoutonbrady/jobs-scraper

Simple scraper to fetch and centralized jobs in one place

jobs puppeteer scraper

Last synced: 24 Dec 2024

https://github.com/angrykoala/wendigo-plugin

Bootstraping of a wendigo plugin

automation browser chrome puppeteer template wendigo

Last synced: 18 Dec 2024

https://github.com/johan-perso/screenshothtml

Screenshot HTML code, from your NodeJS Code

puppeteer scrapping-nodejs

Last synced: 23 Jan 2025

https://github.com/nubisub/tipsen

Males buka sipadung ? Titip Absen aja

automation puppeteer

Last synced: 24 Dec 2024

https://github.com/danvictorgithub/gpt-teer

A rework to my depricated project gpt-wright project using Puppeteer

express gpt4o puppeteer

Last synced: 10 Jan 2025

https://github.com/carelessinternet/schoolsoft-scraper

Unofficial SchoolSoft API made in Node.js

api node nodejs puppeteer puppeteer-core schoolsoft

Last synced: 23 Jan 2025

https://github.com/hawtim/collection

Code collection about demos, snippets, documents, etc...

es6 expressjs nodejs puppeteer pwa typescript vue

Last synced: 18 Dec 2024

https://github.com/shuklaritvik06/bms-type-api

A web scraper api built using puppeteer and typescript which scrapes live data from bms website

api puppeteer typescript

Last synced: 17 Jan 2025

https://github.com/pdehaan/puppeteer-a11y-cli

Puppeteer <3 Axe

a11y axe puppeteer

Last synced: 19 Dec 2024

https://github.com/pdehaan/send-puppeteer

Firefox Send v.Next screenshots.

firefox puppeteer send

Last synced: 19 Dec 2024