Puppeteer | Ecosyste.ms: Awesome

https://github.com/tokuda109/techbookfest07-puppeteer-samples

技術書典7に出典した「実践マニアックテスト〜Android・iOS・Web編〜」の「Puppeteerを使ったE2Eテストの始め方」のサンプルコード集

e2e javascript nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/marknjunge/ams-parse

A web scraper for Strathmore's AMS student's module

cheerio puppeteer strathmore webscraping

Last synced: 23 Dec 2024

https://github.com/ondiekelijah/web-scraping-with-node.js-guide

Node.js Web Scraping Guide repository

cheerio puppeteer

Last synced: 10 Oct 2024

https://github.com/ajmeese7/dynamic-page-retrieval

Scrape data from JS-rendered pages

dynamic-content puppeteer scraping

Last synced: 18 Dec 2024

https://github.com/dreamjet31/county-lib-scraper

County Library Scraper

javascript nodejs puppeteer

Last synced: 18 Dec 2024

https://github.com/zoltan-nz/component-library-template

Component Library Starter Kit: React, TypeScript, Rollup, Jest, Eslint, Prettier

amd commonjs es6 eslint jest library packages prettier puppeteer react rollup typescript umd

Last synced: 18 Dec 2024

https://github.com/adamtylerlynch/puppeteer-multiarch

Creating Multi-Arch docker images for ARM64/x86 (amd64) using CodeBuild from Jenkins. Headless browsing with Chromium and Puppeteer.

aarch64-linux arm arm64 chromium codebuild docker docker-image multi-arch-images multiarch puppeteer

Last synced: 14 Dec 2024

https://github.com/jscalderon65/shopping-web-scraper-backend

Api dedicada a informar y notificar el cambio de precios de productos en tiendas virtuales. El producto que se desee vigilar se deberá registrar por medio de los métodos de la Api y una vez terminado dicho el proceso, la Api se encargará de notificar por medio de correo electrónico los cambios que se puedan presentar en los precios del producto.

express-js firebase-admin node-js puppeteer

Last synced: 11 Jan 2025

https://github.com/raharrison/lynks-scraper

Web scraper for Lynks project. Extract screenshots, thumbnails, PDF's and metadata from given URL's

api express extract nodejs puppeteer scraper screenshot thumbnail

Last synced: 19 Dec 2024

https://github.com/scriptsmith/routerreboot

Reboot my cheap router

puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/carloslfu/smartest

Simple e2e tests and automated screenshoots using Puppeteer

e2e integration puppeteer test

Last synced: 16 Dec 2024

https://github.com/harryandriyan/amazsell

Amazon Review Sucker & Classifier Tool

express mongodb nodejs puppeteer react

Last synced: 20 Nov 2024

https://github.com/sooluh/moodle-auto-attendance

:robot: Automated machines for attendance in Moodle using Puppeteer.

attendance crontab moodle moodle-auto-attendance nodejs puppeteer

Last synced: 01 Oct 2024

https://github.com/philecker/time-keeper

📱Node.js application utilizing Puppeteer for logging into Deltek and retrieving current amount of PTO.

deltek puppeteer

Last synced: 29 Dec 2024

https://github.com/wlun001/html-image-headless

Example of convert HTML to image with Headless environment

docker headless-chrome nodejs puppeteer

Last synced: 17 Dec 2024

https://github.com/danielzlatanov/youtube-watch-later-scraper

🕸️ scrape your youtube watch later playlist in seconds

automation browser-automation cli-progress data-extraction exceljs javascript node open-source playlist-scraper puppeteer puppeteer-extra scraping-tool stealth-plugin task-automation video-sorting watch-later web-automation web-scraping youtube youtube-scraper

Last synced: 28 Nov 2024

https://github.com/arumie/recipe-scraper

Scraper for scraping recipes

deno puppeteer typescript

Last synced: 28 Nov 2024

https://github.com/demapy/flow

Flow - is an automatization builder tool that helps you automate repetitive tasks.

automation crypto javascript puppeteer react reactflow typescript zod

Last synced: 28 Nov 2024

https://github.com/andrewjbateman/node-puppeteer-webscraper

:clipboard: Node.js with puppeteer to extract web content from Google Chrome

cheerio html5 javascript nodejs puppeteer webscrapping

Last synced: 27 Dec 2024

https://github.com/ghdwlsgur/node-crawling

# puppeteer 라이브러리를 사용하여 웹크롤링하기

crawling node puppeteer

Last synced: 27 Dec 2024

https://github.com/younusaliakash/web-automation-cookie-consent

Capture screenshots of a webpage with cookie consents, ads, and offers. Take one after removing the popup and another after accepting it. Ensure clarity and accuracy in your screenshots.

cookie-consent puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/younusaliakash/web-automation-deep-link

Easily collect HackerNews links with hn.algolia.com. Swiftly process comments using BullMQ. Understand sentiments (positive, negative, neutral) effortlessly. Store data in Redis for quick access. Simplify your analysis, make informed decisions effortlessly.

deep-link puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/younusaliakash/web-automation-invoice-printer

Automatic invoice generator with puppet.js and express.js that will convert an html invoice to pdf and download automatically

expressjs invoice-generator puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/younusaliakash/simple-ecommerce-crawler

Effortlessly manage ecommerce data using our cutting-edge solution! With Puppeteer.js, we extract product links, process them efficiently using BullMQ, and store key details in Redis. Experience seamless web scraping, precise data processing, and reliable storage, empowering businesses with accurate insights.

ecommerce-crawler puppeteer web-automation

Last synced: 05 Dec 2024

https://github.com/dzmitry-duboyski/automation-framework-using-jest-and-puppeteer

Part #5: Automation Framework using Jest and Puppeteer for course https://www.udemy.com/course/automated-headless-browser-testing-with-puppeteer/

jest puppeteer

Last synced: 12 Jan 2025

https://github.com/danielmark0116/matchlytics-fs-scrapper

⚽️ MATCHLYTICS ⚽️ NodeJS + TS

express node nodejs postgres postgresql puppeteer scrapper typeorm typescript

Last synced: 05 Jan 2025

https://github.com/cityssm/node-faster-report-exporter

On demand exports of selected reports from the FASTER Web Fleet Management System.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 11 Nov 2024

https://github.com/geodoo/bdd

bdd codecept gherkin puppeteer

Last synced: 12 Jan 2025

https://github.com/0x46616c6b/follower

Follow URLs and tracks redirects

http-client nodejs puppeteer

Last synced: 22 Nov 2024

https://github.com/bettercallsundim/crote

aesthetic & colorful class routine generator

expressjs mongodb mongoose nextjs puppeteer shadcn-ui

Last synced: 13 Dec 2024

https://github.com/nstseek/download-all-github-repos

Automated script that downloads every repo from a GitHub organization or user

automation download eslint github organization prettier puppeteer repositories repository scripting typescript user

Last synced: 15 Nov 2024

https://github.com/hutsoninc/stihl-scraper

Used to scrape data on Stihl products.

puppeteer stihl

Last synced: 27 Dec 2024

https://github.com/kayyz1/llmscraper

LLM AI web scraper tool

openai puppeteer react remix typescript

Last synced: 10 Dec 2024

https://github.com/jp7io/puppy

Simple website screenshot using AWS Lambda, Chromium, and Puppeteer.

chromium lambda puppeteer screenshot

Last synced: 19 Nov 2024

https://github.com/rchrdlss3/spotify-scraper

Obtain data from Spotify regarding your favorite artist or album. Utilizes Puppeteer.

artists music npm npm-package puppeteer scrape spotify web

Last synced: 05 Jan 2025

https://github.com/tomaszrewak/react-app-puppeteer-component-testing

Guide on how to to configure puppeteer with a default (non-ejected) react app in order to test individual react components.

puppeteer react regression-testing visual-testing

Last synced: 05 Jan 2025

https://github.com/michaelcaxias/google-forms-vote-bot

Script criado em Puppeteer para votar inumeras vezes em uma determinada opção de um formulário do Google.

javascript node puppeteer typescript

Last synced: 02 Jan 2025

https://github.com/arnavk-09/tila-dashboard

🌸 GitHub actions powered website monitoring/uptime dashboard....

browserless chartjs cms dashboard demo-app deno github-actions-enabled lume-website nunjucks puppeteer static status-page tailwindcss tila uptimerobot workflow

Last synced: 19 Dec 2024

https://github.com/aadameiaa/colory-scraper

colors nodejs puppeteer typescript

Last synced: 17 Nov 2024

https://github.com/nitor-infotech-oss/bdd-puppeteer-boilerplate

Repository containing examples for Puppeteer usage with BDD. The BDD tool used is GaugeJs

bdd javascript nodejs puppeteer test-automation testing

Last synced: 05 Dec 2024

https://github.com/damianravindupeiris/jobber-cli

A simple AI based Node-JS script to automate the job applying process.

ai nodejs open-ai puppeteer typescript web-scraping

Last synced: 05 Jan 2025

https://github.com/megave/puppeteer-scripts

A few browser scripts made using puppeteer library in NodeJS

browser-automation nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/silvestrodecaro/puppeteer-cluster-with-fingerprints

Example code of using puppeteer-cluster and puppeteer-with-fingerprints together

automation browser browser-fingerprint browser-fingerprinting chrome chromedriver chromium cluster fingerprint fingerprinting fingerprints puppeteer puppeteer-cluster puppeteer-with-fingerprints stealth

Last synced: 10 Oct 2024

https://github.com/anonymous961/scrapebooks

Just a repo to check puppeteer

neondb prisma puppeteer typescript

Last synced: 23 Dec 2024

https://github.com/yandeu/jenkins-puppeteer-docker

Use Puppeteer on Jenkins on Docker with Node.js and Jest.

docker jenkins jest nodejs puppeteer

Last synced: 11 Dec 2024

https://github.com/aliahmedm48/searchtweets

Node.js-based project that automates the process of scraping tweets from specified Twitter accounts to count mentions of stock tickers (e.g., $TSLA).

nodejs puppeteer twitter

Last synced: 21 Nov 2024

https://github.com/carelessinternet/schoolsoft-scraper

Unofficial SchoolSoft API made in Node.js

api node nodejs puppeteer puppeteer-core schoolsoft

Last synced: 29 Sep 2024

https://github.com/abduldevhub/react-mountain

A repository containing all of the React projects I made to test and learn new react concepts. Each project resides in its own dedicated folder.

css html javascript puppeteer react scss threejs typescript vite

Last synced: 21 Nov 2024

https://github.com/vermajay/internshala-automation

Automatically apply to internships on Internshala using Google's Puppeteer high level API for chrome

api automation chrome google internships puppeteer

Last synced: 13 Oct 2024

https://github.com/vyomshm/rcscraper

Serverless api for getting vehicle registration details for a given number plate

aws-lambda express nodejs puppeteer serverless

Last synced: 29 Nov 2024

https://github.com/cityssm/node-faster-unofficial-api

An unofficial API for the FASTER Web fleet management system, relying on exported reports and complex parsers.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 23 Oct 2024

https://github.com/javapuppteernodejs/web-scraping-puppeteer

captcha captcha-breaking captcha-recognition captcha-services-for-recaptcha-v2 captcha-solver captcha-solving captcha-web-scraping nodejs nodejs-api puppeteer puppeteer-extra-plugin web-scraping web-scraping-api web-scraping-captcha web-scraping-nodejs web-scraping-puppeteer web-scraping-python web-scraping-software web-scraping-tutorials

Last synced: 19 Dec 2024

https://github.com/bubblxs/steam-avatar-showcase

simple application that collects profile pictures from public steam profiles and publishes them on my tumblr.

javascript puppeteer steam tumblr web-scraping

Last synced: 05 Dec 2024

https://github.com/lucassimao/coinmarketcap-crawler

Crypto currencies market data from http://coinmarketcap.com/ crawled using puppteer + expressjs backend + Elasticsearch + React frontend

elasticsearch express nodejs puppeteer react

Last synced: 23 Nov 2024

https://github.com/michalsn/sls-chrome-puppeteer

Run puppeteer with Serverless on AWS Lambda.

aws-lambda puppeteer serverless

Last synced: 01 Oct 2024

https://github.com/faytranevozter/playlist-bot

Telegram bot for YouTube Music with playlist management, lyrics, and collaborative voting

chatbot inline-query music-automation music-telegram-integration nodejs playlist-management playlist-queue prisma puppeteer telegraf telegram-bot youtube-music

Last synced: 19 Nov 2024

https://github.com/joaopaulopmedeiros/playing-with-pptr

Using puppeteer for going to urls, accessing dom elements and taking screenshots

js puppeteer

Last synced: 03 Dec 2024

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automação que fornece informações dos elencos dos times da NBA. O sistema em questão é uma aplicação console que fornece opções de escolha, o usuário digita a opção que deseja e as informações são mostradas de acordo com essa opção.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Oct 2024

https://github.com/code-with-amine/realpriceapi

cheerio express nodejs puppeteer webscraping

Last synced: 27 Sep 2024

https://github.com/daviteixeira-dev/saucedemo-automation-with-puppeteer

Using the Puppeteer library to perform automated testing on Swag Labs' soucedemo.com website.

jest jest-puppeteer nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Oct 2024

https://github.com/ainoya/cloudflare-dom-distiller

A Cloudflare Workers-based API for extracting and converting web page content to Markdown using DOM-Distiller and Turndown.

cloudflare cloudflare-workers puppeteer

Last synced: 10 Oct 2024

https://github.com/kavindu-mane/html-to-pdf

Simple API for convert HTML to PDF. This API use puppeteer npm package as convertor.

bun hono html-to-pdf puppeteer

Last synced: 19 Dec 2024

https://github.com/giansalex/puppeteer-sample

Puppeteer Headless Chrome (Sample)

node puppeteer

Last synced: 20 Dec 2024

https://github.com/juliecherner/places-of-the-world

Full Stack Project

css expressjs jest mongo-atlas mongodb mongoose mui nodejs puppeteer react reacthooks

Last synced: 13 Jan 2025

https://gitlab.com/hajnyon-projects/slichta/slichta-scraper

Scrapes various websites for daily meal menus. https://slichta.vercel.app/

apify menus puppeteer restaurants scraper

Last synced: 23 Oct 2024

https://github.com/lukmanrambe/sekawan-restaurant

Restaurant Catalogue Website. Submission for "Menjadi Front-End Web Developer Expert" (https://www.dicoding.com/academies/219) Dicoding Class

accessibility codeceptjs css html jasmine javascript karma karma-jasmine progressive-web-app puppeteer pwa semantic-html webpack workbox

Last synced: 18 Dec 2024

https://github.com/francescocoding/harvest-time

🌽 Harvest Time is a Node-based web scraper that utilizes Puppeteer to get past the login page directly from the Node environment (programmatically).

nodejs puppeteer scraper scraping

Last synced: 15 Dec 2024

https://github.com/lightbeem3296/stealth-chrome-automation

Completely undetectable chrome browser automation script. Even better than all the automation libraries including Selenium, Puppeteer, Playwright and so on.

automation bypass playwright puppeteer scraper selenium stealth-bot undetectable-browser

Last synced: 05 Jan 2025

https://github.com/heronlabs/node-alpine-puppeteer

Image for Node Alpine with Puppeteer

docker docker-hub docker-image node nodejs puppeteer

Last synced: 13 Jan 2025

https://github.com/darkksideyoda/moivescheduler

Movie Search, Schedule And Watch List

eslint prettier puppeteer pwa react reactjs redux-toolkit router-dom tailwindcss typescript vite

Last synced: 13 Jan 2025

https://github.com/ashnel3/usherd

command-line puppeteer script manager

puppeteer web-scraping

Last synced: 20 Dec 2024

https://github.com/raphxels/vma-puppeteer

Node js app, using puppeteer to cast vote in the MTV VMA award

award bot mtv puppeteer vma votes

Last synced: 10 Oct 2024

https://github.com/jihefel/internubel-website-scraping

This repository contains a Puppeteer-based script for scraping product details from Internubel's website.

nodejs puppeteer scraper scraping scraping-websites

Last synced: 10 Oct 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer

NodeJs version with all dependencies to run Puppeteer

docker nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/bastosmatheus/bot-corinthians

Esse projeto consiste em uma aplicação console que fornece informações dos elencos, próximas partidas e notícias referentes ao Corinthians.

nodejs puppeteer readline-sync typescript

Last synced: 10 Oct 2024

https://github.com/rayc2045/discord-chatinbed-cotton-collector

A program that automatically collects cotton in the Discord channel 蓋棉被純聊天.

discord discord-bot discord-js discord-time-bot puppeteer puppeteer-core

Last synced: 10 Oct 2024

https://github.com/christiancesar/hunter

Scraping of the target web application, using puppeeter, node with typescript and best practices.

backend ddd factory-pattern fullstack-development mongodb-atlas nodejs observer-pattern poo puppeteer react tdd typescript

Last synced: 10 Oct 2024

https://github.com/lostmypillow/jdms

Automated generation of Daily Media Scans

bun cheerio daisyui docxtemplater electron express puppeteer tailwindcss

Last synced: 23 Dec 2024

https://github.com/lameuler/astro-pdf

A simple Astro integration to generate PDFs from built pages.

astro astro-integration pdf pdf-generation puppeteer

Last synced: 10 Oct 2024

https://github.com/candeagainn/sequelize-puppeteer

This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.

automation puppeteer sequelize sql

Last synced: 10 Oct 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand