Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/portrunban/node-vk-puppeteer-user

This app removes inactive users from the group Vkontakte. base on puppeteer

puppeteer vk vkontakte

Last synced: 02 Jan 2025

https://github.com/tomaszrewak/react-app-puppeteer-component-testing

Guide on how to to configure puppeteer with a default (non-ejected) react app in order to test individual react components.

puppeteer react regression-testing visual-testing

Last synced: 05 Jan 2025

https://github.com/johan-perso/screenshothtml

Screenshot HTML code, from your NodeJS Code

puppeteer scrapping-nodejs

Last synced: 23 Nov 2024

https://github.com/softonic/docker-puppeteer

Puppeteer docker image

docker-image puppeteer

Last synced: 21 Dec 2024

https://github.com/lukmanrambe/sekawan-restaurant

Restaurant Catalogue Website. Submission for "Menjadi Front-End Web Developer Expert" (https://www.dicoding.com/academies/219) Dicoding Class

accessibility codeceptjs css html jasmine javascript karma karma-jasmine progressive-web-app puppeteer pwa semantic-html webpack workbox

Last synced: 18 Dec 2024

https://github.com/rchrdlss3/spotify-scraper

Obtain data from Spotify regarding your favorite artist or album. Utilizes Puppeteer.

artists music npm npm-package puppeteer scrape spotify web

Last synced: 05 Jan 2025

https://github.com/doczilla-app/issues

This is the space where you can engage with us directly, report any issues you encounter, request new features, or propose updates to our documentation.

html-to-image html-to-pdf html-to-pdf-api html2image html2pdf puppeteer

Last synced: 27 Nov 2024

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 04 Jan 2025

https://github.com/canardconfit/puppeteer-docker

A simple docker image to run Puppeteer under arm64 architecture.

arm64 docker docker-image puppeteer

Last synced: 06 Dec 2024

https://github.com/tuurdutoit/puppeteer-find

Find elements with Puppeteer based on their content

dom find puppeteer query search utility

Last synced: 14 Jan 2025

https://gitlab.com/hajnyon-projects/slichta/slichta-scraper

Scrapes various websites for daily meal menus. https://slichta.vercel.app/

apify menus puppeteer restaurants scraper

Last synced: 23 Oct 2024

https://github.com/horatiumarginean/mimirbot

Discord bot that contains various methods for retrieving and notifying me of the knowledge I find useful.

discord-js puppeteer

Last synced: 12 Oct 2024

https://github.com/younusaliakash/web-automation-cookie-consent

Capture screenshots of a webpage with cookie consents, ads, and offers. Take one after removing the popup and another after accepting it. Ensure clarity and accuracy in your screenshots.

cookie-consent puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/showlotus/lansite

Forwarding pages between machines in a LAN

lan nuxt puppeteer

Last synced: 15 Dec 2024

https://github.com/yanivefraim/react-node-tdd-workshop-example

A demo for my React/Node TDD workshop, using Puppeteer & Mocha :sunglasses:

javascript mocha nodejs puppeteer react tdd

Last synced: 28 Nov 2024

https://github.com/dkgee/tk_spa

nodejs案例 puppeteer

centos7 nodejs puppeteer windows-7

Last synced: 22 Dec 2024

https://github.com/baxsm/scrapway

Scrapway allows users to create powerful data scraping workflows and execute them either manually or via cron jobs. With an intuitive UI and support for various tasks such as user interactions, data extraction, storage, and result delivery – you can easily automate scraping operations with minimal effort.

cheerio nextjs openai puppeteer scraping shadcn-ui stripe tailwindcss

Last synced: 06 Dec 2024

https://github.com/teitei-tk/example-puppeteer-google-functions

example Puppeteer on Google Cloud functions

cloud-functions puppeteer

Last synced: 08 Dec 2024

https://github.com/zhaoyiming0803/demo-puppeteer

puppeteer 应用伪代码

nodejs puppeteer

Last synced: 28 Nov 2024

https://github.com/tuurdutoit/puppeteer-utils

A library of utility functions for Puppeteer

library puppeteer utility

Last synced: 14 Jan 2025

https://github.com/giansalex/puppeteer-sample

Puppeteer Headless Chrome (Sample)

node puppeteer

Last synced: 20 Dec 2024

https://github.com/bubao/puppeteer-html2pdf-generator

服务器端的 html 生成 pdf

html pdf pdf-generation puppeteer

Last synced: 08 Dec 2024

https://github.com/stephlaf/puppeteer-airtable-tutorial

Tutorial to scrape the web using Puppeteer and store to Airtable

airtable-api javascript puppeteer scraping

Last synced: 11 Dec 2024

https://github.com/iadtya/web-summarizer

Web-summarizer scrapes the specific url to pipes that text data into gpt-3.5-turbo model to generate summary of the url and uses redis to cache the summary to save overhead price

expressjs nodejs openai-api puppeteer reactjs redis tailwindcss

Last synced: 03 Jan 2025

https://github.com/sskender/gmaps-screenshot

Save a screenshot from Google Maps of given coordinates without opening browser!

bot browser google google-maps maps node node-js nodejs puppeteer screenshot

Last synced: 28 Nov 2024

https://github.com/zrna/cars-scraper

🚙 Scraping cars ads

javascript puppeteer scraper

Last synced: 09 Jan 2025

https://github.com/nubisub/tipsen2

Males buka sipadung ? Titip Absen aja

automation node-cron puppeteer

Last synced: 06 Nov 2024

https://github.com/thundermiracle/costco-monitor

Monitor product's price & stock status. Send email when price is down or stock status is changed.

costco puppeteer

Last synced: 08 Dec 2024

https://github.com/jp7io/puppy

Simple website screenshot using AWS Lambda, Chromium, and Puppeteer.

chromium lambda puppeteer screenshot

Last synced: 19 Nov 2024

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Jan 2025

https://github.com/younusaliakash/web-automation-deep-link

Easily collect HackerNews links with hn.algolia.com. Swiftly process comments using BullMQ. Understand sentiments (positive, negative, neutral) effortlessly. Store data in Redis for quick access. Simplify your analysis, make informed decisions effortlessly.

deep-link puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/austenstone/puppeteer-github

Puppeteering GitHub

puppeteer

Last synced: 15 Dec 2024

https://github.com/paveldymkov/puppeteer-io

Library for tests with Puppeteer using Jest or Mocha

headless-chrome puppeteer testing

Last synced: 03 Dec 2024

https://github.com/achanta3215/covid19indiascraper

To scrape covid 19 data from sources available

contributions-welcome covid-19 india node open-source puppeteer typescript

Last synced: 28 Dec 2024

https://github.com/kavindu-mane/html-to-pdf

Simple API for convert HTML to PDF. This API use puppeteer npm package as convertor.

bun hono html-to-pdf puppeteer

Last synced: 19 Dec 2024

https://github.com/andrei0x309/puppeteer-extra-plugin-browser-extension-interact

Puppeteer extra plugin to interact with browser extensions, highly experimental.

browser-extention-interaction puppeteer puppeteer-extra puppeteer-extra-plugin

Last synced: 03 Jan 2025

https://github.com/prantadas/nasa-fb

Description: The bot download a picuture from https://api.nasa.gov/planetary/apod and post it on facebook profile each day.

nasa-apod puppeteer typescript

Last synced: 22 Dec 2024

https://github.com/louiscklaw/page-change-detect-tryout

page-change-detect-tryout

javascript puppeteer

Last synced: 20 Dec 2024

https://github.com/marcinrek/seed

Cutup boilerplate with support of: react, hyperapp and more ...

boilerplate-template boilerplates hyperapp mocha puppeteer react scaffold webpack

Last synced: 29 Nov 2024

https://github.com/mdato/dolar2030

puppeteer + heroku + express

express heroku puppeteer

Last synced: 07 Jan 2025

https://github.com/vedovati-matteo/gpu-price-tracker

A sophisticated web scraper for tracking GPU prices across e-commerce platforms, featuring proxy rotation, CAPTCHA handling, and data visualization.

captcha-handling docker fullstack gpu-prices javascript mongodb next-js node-js proxy-rotation puppeteer telegram-bot web-scraping

Last synced: 03 Dec 2024

https://github.com/ainoya/cloudflare-dom-distiller

A Cloudflare Workers-based API for extracting and converting web page content to Markdown using DOM-Distiller and Turndown.

cloudflare cloudflare-workers puppeteer

Last synced: 10 Oct 2024

https://github.com/cankorkmazim/google-ads-list

You can create a list of advertisements placed on Google through words.

google-ads google-crawler puppeteer

Last synced: 03 Dec 2024

https://github.com/jado4810/md2pdf

Typeset Markdown to PDF for publishing

markdown mermaid nodejs pdf puppeteer

Last synced: 03 Dec 2024

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Oct 2024

https://github.com/jprando/pdfserver

gerar relatorios em pdf com puppeteer

bun guambiarra pdf puppeteer relatorio rta

Last synced: 23 Dec 2024

https://github.com/miscos/discord-web-crawler

A puppeteer based webcrawler posting results to a discord webhook

discord puppeteer webcrawler

Last synced: 23 Dec 2024

https://github.com/jexniemi/browserless-action-runner

Run Puppeteer or Playwright web scraper (or other browser tasks) easily in headless mode as a GitHub Action

actions browser browserless chromium headless marketplace-action playwright puppeteer scraper scraping web

Last synced: 23 Dec 2024

https://github.com/apexcaptain/allergy-alert

오늘 날짜를 기준으로 모 대학의 학교 홈페이지에서 제공하는 식당 정보를 Crawling하여 회관별/메뉴 분류 별로 메뉴들과 메뉴 별 알러지 유발 식품에 대한 정보를 알려줍니다.

crawler docker expressjs puppeteer reactjs sqlite typescript

Last synced: 01 Dec 2024

https://github.com/thewrlck/quotz

A Node.js application demonstrating the use of Puppeteer and Orama SDK to create a quote database and search API.

expressjs orama puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/wasabina67/puppeteer-example

Puppeteer example

puppeteer

Last synced: 23 Dec 2024

https://github.com/evgeniyarbatov/location-testing

E2E testing of pages with location

expressjs location mocha puppeteer

Last synced: 23 Dec 2024

https://github.com/redaezziani/scrape-data-store-jolt

Product Scraper for Jolt Store is a robust tool designed to automate the collection of product data from e-commerce websites. This project leverages Puppeteer for web scraping and Prisma Client for seamless database management, ensuring efficient integration of external product data into the Jolt Store.

nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/shyamsunder149/problem-solving-tracker

A Tracker to track my solves around leetcode, gfg, codeforces and codchef. Just It will be satisfying for me to watch it

puppeteer scraping typescript

Last synced: 23 Dec 2024

https://github.com/muratsercann/book-price-agent

This application retrieves book prices from 5 different stores based on a search query. It uses React for the client-side interface, a Node.js API for the backend, and Puppeteer for web scraping.

expressjs nodejs puppeteer puppeteer-extra puppeteer-extra-plugin-stealth react

Last synced: 23 Dec 2024

https://github.com/bambooom/puppeteer-examples

just some snippets about how to use puppeteer

puppeteer

Last synced: 23 Nov 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer-example

Test code for the Docker image nodejs-puppeteer

docker nodejs puppeteer

Last synced: 23 Dec 2024

https://github.com/zaidkhalid44/irctc

Technologies used: JavaScript, Puppeteer, Tesseract.js, Jimp Description: Developed an automated system using Puppeteer and Tesseract.js to streamline IRCTC train ticket booking, handling login, captcha solving, and form filling. Automated login and form-filling tasks, reducing manual effort by approximately 90%.

jimp puppeteer tesseract

Last synced: 23 Dec 2024

https://github.com/sharif-minhaz/web-scraping-with-js

Web scraper extracts data from websites. In JavaScript, jsdom and Puppeteer are powerful tools for this task. jsdom is a lightweight DOM implementation that lets user manipulate and query static pages. Puppeteer is a Node.js library for controlling headless Chrome/Chromium, ideal for dynamic websites. It can simulate user interactions and take ss

bun jsdom puppeteer web-scraping

Last synced: 23 Dec 2024

https://github.com/jfmonsa/book_scrapper

A web scrapping CLI tool to get books and categories/subcategories from Z-Library

node-js postgresql puppeteer web-scraping z-lib z-library

Last synced: 23 Dec 2024

https://github.com/gabrielcstr/dota2protracker-scraper

Scraping meta heroes from dota2protracker.com

d2pt dota2 dota2protracker javascript puppeteer scraper

Last synced: 23 Dec 2024

https://github.com/dnascanner/ani-cli

A simple to use terminal tool to find your favorite anime

anime chrome chromium cli deno puppeteer

Last synced: 23 Dec 2024

https://github.com/gigaarpit/puppeteer-examples

Collection of practical examples and scripts utilizing Puppeteer

playwright puppeteer puppeteer-screenshot

Last synced: 23 Dec 2024

https://github.com/tushcmd/olo-scraper

This is a full-stack web scraping application that simulates browser-like interactions using a headless browser. Users can input a URL, and the application scrapes data and performs specified actions.

cors express nodejs puppeteer react tailwindcss typescript winston

Last synced: 23 Dec 2024

https://github.com/extrawest/ai-uni-summarizer

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.

ai groq groq-api nextjs openai puppeteer reactjs youtube

Last synced: 23 Dec 2024

https://github.com/pedromarques391/lastreleases

Projeto de web scraping

nodemailer puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/kayyz1/llmscraper

LLM AI web scraper tool

openai puppeteer react remix typescript

Last synced: 10 Dec 2024

https://github.com/antoniowd/aws-lambda-pdf

The aws-lambda-pdf project is designed to generate PDFs from HTML content using AWS Lambda and Chromium. The generated PDF files are stored in an S3 bucket, and the application returns a signed URL for accessing the PDF file.

aws-lambda chromium pdf-generation puppeteer

Last synced: 23 Dec 2024

https://github.com/duranda/lambda-pdf-generator

Generate PDF from HTML remotely on AWS Lambda with the Chromium rendering engine

aws-lambda chromium pdf-generation puppeteer wkhtmltopdf

Last synced: 23 Dec 2024

https://github.com/spm999/invoice-generator

Invoice generator application built using Node.js, Express.js, Handlebars, and Puppeteer. It generates invoices in PDF format based on the provided data.

api-rest express hbs invoice-generator nodejs postman puppeteer template-engine templateengine

Last synced: 23 Dec 2024

https://github.com/prantadas/play-scrapper

A Node.js-based scraper for extracting data from Google Play and the Apple App Store (Check the app's availability in a specific country). The scraper uses Puppeteer for automation and exports results to an Excel file.

excel-export puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/ailixter/chromatic

Chromium automation server

automation chromium nodejs pdf puppeteer server service

Last synced: 23 Dec 2024

https://github.com/daveanthonyc/webscraper-test

Webscraper using Puppeteer to scrape 7000+ rows of data.

dataminig nodejs puppeteer webscraping

Last synced: 23 Dec 2024

https://github.com/devzkhalil/puppeteer-facebook-unfriends-script

The Puppeteer Facebook Unfriends Script is a tool developed using Puppeteer, a Node.js library that provides a high-level API to control headless Chrome or Chromium browsers. This script is specifically crafted for automating the process of unfriending users on Facebook.

facebook facebook-unfriend facebook-unfriend-script puppeteer web-automation

Last synced: 23 Dec 2024

https://github.com/mushfiqurniazzz/word-meaning---webscraping

A basic Nodejs environmental function that takes in a word to search in a word-meaning website and then prints it in the terminal through web-scraping.

javascript nodejs puppeteer webscraping wordmeaning

Last synced: 23 Dec 2024

https://github.com/c0de-l00p/whatsapp-bot

Simple whatsapp bot made with node js and puppeteer

node puppeteer qrcode whatsapp

Last synced: 03 Jan 2025

https://github.com/aegis-dev/simple_mmo_simpler_bot

Simpler bot for SimpleMMO

bot js puppeteer

Last synced: 19 Nov 2024

https://github.com/brightspace/d2l-beaker

A driver for Google Puppeteer to collect client-side performance metrics.

automation performance puppeteer

Last synced: 07 Jan 2025

https://github.com/gabrielweyer/ui-tests

Writing UI tests with Selenium Web Driver and Puppeteer

github-actions puppeteer selenium-webdriver ui-testing

Last synced: 14 Oct 2024

https://github.com/ilhamlamp/menu-scrapper

learn scrapping with nest and puppeteer

nestjs puppeteer typescript

Last synced: 06 Dec 2024

https://github.com/daviteixeira-dev/saucedemo-automation-with-puppeteer

Using the Puppeteer library to perform automated testing on Swag Labs' soucedemo.com website.

jest jest-puppeteer nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/hutsoninc/stihl-scraper

Used to scrape data on Stihl products.

puppeteer stihl

Last synced: 27 Dec 2024

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 08 Jan 2025

https://github.com/xredax/quran-hadith-poster

Automated Facebook bot for sharing Quran pages and Hadith content to groups.

automation facebook facebook-bot hadith islamic islamic-app nodejs puppeteer quran social-media

Last synced: 16 Dec 2024

https://github.com/brianpunzalan/nextjs-advanced-starter

Next.js Advanced Starter with Typescript, MaterialUI, Storybook, Jest, Puppeteer, Redux, ESLint, Prettier and more.

eslint jest material-ui nextjs prettier puppeteer redux storybook typescript

Last synced: 23 Dec 2024