Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/thomasjvu/entry-level-jobs-scraper

Job scraper for entry-level roles for the Ground Zero project

puppeteer supabase

Last synced: 12 Oct 2024

https://github.com/luqueee/moodle-rest-scraper

Rest API express with puppeteer library for scraping information of a user

express moodle puppeteer

Last synced: 12 Oct 2024

https://github.com/the-phinisher/auto-netaccess

Automatic renewal of authorization for IITM netaccess

iitm netacces nodejs puppeteer

Last synced: 12 Oct 2024

https://github.com/rushi0508/insta-reels-automation

Fetches the reels for different users including captions and stores it in AWS S3.

javascript nodejs puppeteer webscraping

Last synced: 12 Oct 2024

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Nov 2024

https://github.com/radzionc/twitter-outreach-cli

Half-automatically Reach Followers of a specific Profile

nodejs puppeteer twitter-api

Last synced: 06 Nov 2024

https://github.com/radzionc/music-alarm

Alarm with Yandex-music

nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/radzionc/medium-updater

Programatically Update Medium Stories CTAs

medium nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/radzionc/linkedin-connector

Connect With Customers From Email List on LinkedIn With Automation

dynamodb nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/radzionc/apartments-watcher

Opens new apartments for sale in Chrome

nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/redaezziani/scrape-data-store-jolt

Product Scraper for Jolt Store is a robust tool designed to automate the collection of product data from e-commerce websites. This project leverages Puppeteer for web scraping and Prisma Client for seamless database management, ensuring efficient integration of external product data into the Jolt Store.

nodejs puppeteer webscraping

Last synced: 05 Nov 2024

https://github.com/miscos/discord-web-crawler

A puppeteer based webcrawler posting results to a discord webhook

discord puppeteer webcrawler

Last synced: 05 Nov 2024

https://github.com/zaidkhalid44/irctc

Technologies used: JavaScript, Puppeteer, Tesseract.js, Jimp Description: Developed an automated system using Puppeteer and Tesseract.js to streamline IRCTC train ticket booking, handling login, captcha solving, and form filling. Automated login and form-filling tasks, reducing manual effort by approximately 90%.

jimp puppeteer tesseract

Last synced: 05 Nov 2024

https://github.com/gamboavalentinabel/nodejs-puppeteer-example

Test code for the Docker image nodejs-puppeteer

docker nodejs puppeteer

Last synced: 05 Nov 2024

https://github.com/thewrlck/quotz

A Node.js application demonstrating the use of Puppeteer and Orama SDK to create a quote database and search API.

expressjs orama puppeteer typescript

Last synced: 05 Nov 2024

https://github.com/muratsercann/book-price-agent

This application retrieves book prices from 5 different stores based on a search query. It uses React for the client-side interface, a Node.js API for the backend, and Puppeteer for web scraping.

expressjs nodejs puppeteer puppeteer-extra puppeteer-extra-plugin-stealth react

Last synced: 05 Nov 2024

https://github.com/shyamsunder149/problem-solving-tracker

A Tracker to track my solves around leetcode, gfg, codeforces and codchef. Just It will be satisfying for me to watch it

puppeteer scraping typescript

Last synced: 05 Nov 2024

https://github.com/jexniemi/browserless-action-runner

Run Puppeteer or Playwright web scraper (or other browser tasks) easily in headless mode as a GitHub Action

actions browser browserless chromium headless marketplace-action playwright puppeteer scraper scraping web

Last synced: 05 Nov 2024

https://github.com/gigaarpit/puppeteer-examples

Collection of practical examples and scripts utilizing Puppeteer

playwright puppeteer puppeteer-screenshot

Last synced: 05 Nov 2024

https://github.com/wasabina67/puppeteer-example

Puppeteer example

puppeteer

Last synced: 05 Nov 2024

https://github.com/sharif-minhaz/web-scraping-with-js

Web scraper extracts data from websites. In JavaScript, jsdom and Puppeteer are powerful tools for this task. jsdom is a lightweight DOM implementation that lets user manipulate and query static pages. Puppeteer is a Node.js library for controlling headless Chrome/Chromium, ideal for dynamic websites. It can simulate user interactions and take ss

bun jsdom puppeteer web-scraping

Last synced: 05 Nov 2024

https://github.com/gabrielcstr/dota2protracker-scraper

Scraping meta heroes from dota2protracker.com

d2pt dota2 dota2protracker javascript puppeteer scraper

Last synced: 05 Nov 2024

https://github.com/extrawest/ai-uni-summarizer

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.

ai groq groq-api nextjs openai puppeteer reactjs youtube

Last synced: 05 Nov 2024

https://github.com/jfmonsa/book_scrapper

A web scrapping CLI tool to get books and categories/subcategories from Z-Library

node-js postgresql puppeteer web-scraping z-lib z-library

Last synced: 05 Nov 2024

https://github.com/antoniowd/aws-lambda-pdf

The aws-lambda-pdf project is designed to generate PDFs from HTML content using AWS Lambda and Chromium. The generated PDF files are stored in an S3 bucket, and the application returns a signed URL for accessing the PDF file.

aws-lambda chromium pdf-generation puppeteer

Last synced: 05 Nov 2024

https://github.com/dnascanner/ani-cli

A simple to use terminal tool to find your favorite anime

anime chrome chromium cli deno puppeteer

Last synced: 05 Nov 2024

https://github.com/jprando/pdfserver

gerar relatorios em pdf com puppeteer

bun guambiarra pdf puppeteer relatorio rta

Last synced: 05 Nov 2024

https://github.com/pedromarques391/lastreleases

Projeto de web scraping

nodemailer puppeteer typescript

Last synced: 05 Nov 2024

https://github.com/ailixter/chromatic

Chromium automation server

automation chromium nodejs pdf puppeteer server service

Last synced: 05 Nov 2024

https://github.com/prantadas/play-scrapper

A Node.js-based scraper for extracting data from Google Play and the Apple App Store (Check the app's availability in a specific country). The scraper uses Puppeteer for automation and exports results to an Excel file.

excel-export puppeteer typescript

Last synced: 05 Nov 2024

https://github.com/devzkhalil/puppeteer-facebook-unfriends-script

The Puppeteer Facebook Unfriends Script is a tool developed using Puppeteer, a Node.js library that provides a high-level API to control headless Chrome or Chromium browsers. This script is specifically crafted for automating the process of unfriending users on Facebook.

facebook facebook-unfriend facebook-unfriend-script puppeteer web-automation

Last synced: 05 Nov 2024

https://github.com/brianpunzalan/nextjs-advanced-starter

Next.js Advanced Starter with Typescript, MaterialUI, Storybook, Jest, Puppeteer, Redux, ESLint, Prettier and more.

eslint jest material-ui nextjs prettier puppeteer redux storybook typescript

Last synced: 05 Nov 2024

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 05 Nov 2024

https://github.com/luifean/dicio-api

API desenvolvida para obter o significado de palavras através de mineração de dados

express javascript nodejs puppeteer

Last synced: 08 Nov 2024

https://github.com/luifean/randomflix-api

API desenvolvida a fim de prover informações de filmes da sua lista da Netflix. Faz uso do conceito de web scraping como data source.

cors express javascript nodejs puppeteer

Last synced: 08 Nov 2024

https://github.com/beckkramer/puppeteer-traverse

Puppeteer utility to easily run a function you define per route on a set of routes.

crawler crawling nodejs puppeteer

Last synced: 18 Nov 2024

https://github.com/achanta3215/covid19indiascraper

To scrape covid 19 data from sources available

contributions-welcome covid-19 india node open-source puppeteer typescript

Last synced: 07 Nov 2024

https://github.com/prixladi/urlik

Url shortener service with advanced statistics.

asp-net-core docker docker-compose mongodb nextjs puppeteer react redis

Last synced: 16 Nov 2024

https://github.com/prixladi/site-capture-puppet

Worker service capturing sites using puppeteer. Part of Site Capture project - https://github.com/prixladi/site-capture

docker mongodb nodejs puppeteer redis

Last synced: 16 Nov 2024

https://github.com/robertoachar/screenshot-puppeteer

A playground for take a screenshot with Puppeteer.

playground puppeteer screenshot

Last synced: 06 Nov 2024

https://github.com/yordadev/yorviewer

Yorviewer is a simple view bot that utilizes proxies and incognito.

bot nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/amoutonbrady/jobs-scraper

Simple scraper to fetch and centralized jobs in one place

jobs puppeteer scraper

Last synced: 05 Nov 2024

https://github.com/hawtim/collection

Code collection about demos, snippets, documents, etc...

es6 expressjs nodejs puppeteer pwa typescript vue

Last synced: 13 Oct 2024

https://github.com/yashkathe/download-wallpapers-cli

Search wallpapers from terminal directly and the script will do its work to download all the high resolution wallapers from the website

expressjs nodejs puppeteer script wallpaper web-scraping

Last synced: 06 Nov 2024

https://github.com/optimics/docker-puppeteer

Docker image that includes everything needed to run Puppeteer.js on Bitbucket Pipelines

bitbucket-pipelines docker nodejs puppeteer

Last synced: 10 Nov 2024

https://github.com/sj22032003/scrapper-basic-flipkart

Minor web scrapper using puppeteer to scrap data from Flipkart listing

bun puppeteer typescript

Last synced: 10 Nov 2024

https://github.com/marcuwynu23/gdork

gdork is a command-line tool for performing Google dork searches using Puppeteer, a headless browser.

advance googlesearch headless javascript npm puppeteer search searchengine webscraping yarn

Last synced: 06 Nov 2024

https://github.com/sirok1/lolz-auto-contests

Lolzteam | zelenka.guru app for auto-participation in draws

discord-webhook nodejs puppeteer telegram-bot

Last synced: 16 Nov 2024

https://github.com/tayyabmughal676/f1gpt_backend

Formula F1GPT Chat Unlock the power of AI-powered conversations! Built with Datastax, OpenAI, and more. Fork, explore, and enhance!

ai datastax genai genai-chatbot generative-ai gpt langchain langchain-js machine-learning ml open-source open-source-intelligence open-source-project openai openai-api puppeteer rag typescript

Last synced: 08 Nov 2024

https://github.com/ajit24/anakin-scrap

This repository contains the code in puppeteer and node.js to find the latitude and longitude of all locations in Singapore

expressjs nodejs puppeteer

Last synced: 08 Nov 2024

https://github.com/shresht7/web-screenshot-action

GitHub Action to take a screenshots of a website 📷

github-actions puppeteer screenshot

Last synced: 28 Oct 2024

https://github.com/christianrich/generate-pdf-puppeteer

Generate a PDF with Puppeteer, Handlebars and Express

docker docker-compose express handlebars node-js pdf-generation puppeteer

Last synced: 07 Nov 2024

https://github.com/alexpreynolds/flow-cytometry-visualization

Flow cytometry visualization demo using Jupyter, Plotly, and fcsparser

bioinformatics fcs jupyter jupyter-notebook plotly puppeteer python3 visualization

Last synced: 07 Nov 2024

https://github.com/janumedia/puppeteer-ssr

Puppeteer SSR example

chromium node puppeteer ssr

Last synced: 07 Nov 2024

https://github.com/louiscklaw/page-change-detect-tryout

page-change-detect-tryout

javascript puppeteer

Last synced: 24 Oct 2024

https://github.com/jayvirrathi/nodejs-puppeteer

NodeJS Instagram Post Liker using Puppeteer

instagram nodejs puppeteer

Last synced: 11 Nov 2024

https://github.com/michaelcaxias/google-forms-vote-bot

Script criado em Puppeteer para votar inumeras vezes em uma determinada opção de um formulário do Google.

javascript node puppeteer typescript

Last synced: 08 Nov 2024

https://github.com/dutragames/bot-de-felicidades-facebook

Um simples bot que envia felicidades aos seus amigos no face!

bot facebook html-css-javascript nodejs puppeteer

Last synced: 18 Nov 2024

https://github.com/sthotakura/remove-linkedin-connections

puppeteer script to remove linkedin connections

linkedin puppeteer

Last synced: 08 Nov 2024

https://github.com/j-m/anvomywz1k

A community-based game review website

coursework game jest koa puppeteer review website

Last synced: 07 Nov 2024

https://github.com/tinkeringaround/occ

One-Click-Checker Electron App

electron puppeteer react testing tool typescript

Last synced: 08 Nov 2024

https://github.com/ujen5173/hashnode-clone

This is a full stack t3 app. This app is a clone version of Hashnode. It has all the features a hashnode has.

clone clone-app hashnode hashnode-clone next-auth nextjs prisma puppeteer t3-stack tailwindcss trpc web-scrapping

Last synced: 08 Nov 2024

https://github.com/evanhalley/hatjitbot

A simple Slackbot for requesting a Hatjitsu room for Agile/Scrum style story sizing.

hatjitsu javascript nodejs puppeteer slack slackbot

Last synced: 08 Nov 2024

https://github.com/cityssm/node-faster-report-exporter

On demand exports of selected reports from the FASTER Web Fleet Management System.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 11 Nov 2024

https://github.com/riskers/sideex2puppeteer

sideex command to puppeteer command

puppeteer sideex

Last synced: 10 Nov 2024

https://github.com/nurriyad/cp-scrapper

Get User Data from all popular competitive programming site using Nitro and Headless Browser

nitro nitrojs nodejs puppeteer

Last synced: 09 Nov 2024

https://github.com/go-on-the-way/e2e-puppeteer

前端端到端测试实践

e2e puppeteer resemblejs

Last synced: 09 Nov 2024

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/zachltech/duckduckgoscraper-firebase

Fork of a previous project of mine with Firebase Cloud Functions/Firestore integration.

firebase firebase-database firebase-functions javascript puppeteer

Last synced: 08 Nov 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 10 Oct 2024

https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker

This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.

docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping

Last synced: 10 Oct 2024

https://github.com/danvictorgithub/gpt-teer

A rework to my depricated project gpt-wright project using Puppeteer

express gpt4o puppeteer

Last synced: 11 Nov 2024

https://github.com/reshnivisionx/web_scrapping_react

I developed a web application that scrapes website content into PDFs, HTML snapshots, and screenshots using Puppeteer for automation. The data, along with scrape timestamps, is stored in MongoDB for retrieval and download. The frontend interface allows users to input URLs and select desired formats with ease.

axios expressjs mongodb nodejs puppeteer reactjs

Last synced: 08 Nov 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-mocha-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Mocha, Chai and Should.

chai commonjs end-to-end-test-automation mocha puppeteer

Last synced: 12 Nov 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Cucumber, Chai and Should.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 12 Nov 2024

Puppeteer Awesome Lists
awesome-puppeteer 93 awesome-playwright 71 awesome-puppeteer-zh 61
Puppeteer Categories
Articles 74 博文 72 Packages 29 Utils 23 Integrations 17 包 14 Testing 13 Services 12 渲染和网页抓取 11 Rendering and web scraping 11 Reporters 10 Examples 10 Language Support 9 Showcases 9 Official 9 官方 9 测试 9 例子 8 Guides 6 License 6