Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Puppeteer
Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.
- GitHub: https://github.com/topics/puppeteer
- Repo: https://github.com/puppeteer/puppeteer
- Created by: Google
- Released: 2018
- Related Topics: automation, chromium,
- Last updated: 2024-11-15 00:23:57 UTC
- JSON Representation
https://github.com/luifean/dicio-api
API desenvolvida para obter o significado de palavras através de mineração de dados
express javascript nodejs puppeteer
Last synced: 08 Nov 2024
https://github.com/idan-sh/puppeteer-automation-jones
Home assignment for Jones - a Puppeteer JavaScript automation.
automation-testing javascript puppeteer
Last synced: 15 Nov 2024
https://github.com/noriste/stackoverflow-52383438-cypress-issue
The same test run on Cypress/TestCafe/Puppeteer to check the strange behaviour of the former
cypress e2e-testing puppeteer testcafe
Last synced: 27 Oct 2024
https://github.com/jfmonsa/book_scrapper
A web scrapping CLI tool to get books and categories/subcategories from Z-Library
node-js postgresql puppeteer web-scraping z-lib z-library
Last synced: 05 Nov 2024
https://github.com/extrawest/ai-uni-summarizer
This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.
ai groq groq-api nextjs openai puppeteer reactjs youtube
Last synced: 05 Nov 2024
https://github.com/iadtya/web-summarizer-client
Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git
ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server
Last synced: 09 Nov 2024
https://github.com/iadtya/web-summarizer
Web-summarizer scrapes the specific url to pipes that text data into gpt-3.5-turbo model to generate summary of the url and uses redis to cache the summary to save overhead price
expressjs nodejs openai-api puppeteer reactjs redis tailwindcss
Last synced: 09 Nov 2024
https://github.com/sajdoko/larashot
Laravel web app to generate website screenshot.
browsershot laravel puppeteer screenshot
Last synced: 10 Nov 2024
https://github.com/gabrielcstr/dota2protracker-scraper
Scraping meta heroes from dota2protracker.com
d2pt dota2 dota2protracker javascript puppeteer scraper
Last synced: 05 Nov 2024
https://github.com/andrei0x309/puppeteer-extra-plugin-browser-extension-interact
Puppeteer extra plugin to interact with browser extensions, highly experimental.
browser-extention-interaction puppeteer puppeteer-extra puppeteer-extra-plugin
Last synced: 09 Nov 2024
https://github.com/sharif-minhaz/web-scraping-with-js
Web scraper extracts data from websites. In JavaScript, jsdom and Puppeteer are powerful tools for this task. jsdom is a lightweight DOM implementation that lets user manipulate and query static pages. Puppeteer is a Node.js library for controlling headless Chrome/Chromium, ideal for dynamic websites. It can simulate user interactions and take ss
bun jsdom puppeteer web-scraping
Last synced: 05 Nov 2024
https://github.com/luifean/randomflix-api
API desenvolvida a fim de prover informações de filmes da sua lista da Netflix. Faz uso do conceito de web scraping como data source.
cors express javascript nodejs puppeteer
Last synced: 08 Nov 2024
https://github.com/abduldevhub/react-mountain
A repository containing all of the React projects I made to test and learn new react concepts. Each project resides in its own dedicated folder.
css html javascript puppeteer react scss threejs typescript vite
Last synced: 12 Oct 2024
https://github.com/carelessinternet/schoolsoft-scraper
Unofficial SchoolSoft API made in Node.js
api node nodejs puppeteer puppeteer-core schoolsoft
Last synced: 29 Sep 2024
https://github.com/gigaarpit/puppeteer-examples
Collection of practical examples and scripts utilizing Puppeteer
playwright puppeteer puppeteer-screenshot
Last synced: 05 Nov 2024
https://github.com/c0de-l00p/whatsapp-bot
Simple whatsapp bot made with node js and puppeteer
node puppeteer qrcode whatsapp
Last synced: 09 Nov 2024
https://github.com/jexniemi/browserless-action-runner
Run Puppeteer or Playwright web scraper (or other browser tasks) easily in headless mode as a GitHub Action
actions browser browserless chromium headless marketplace-action playwright puppeteer scraper scraping web
Last synced: 05 Nov 2024
https://github.com/shyamsunder149/problem-solving-tracker
A Tracker to track my solves around leetcode, gfg, codeforces and codchef. Just It will be satisfying for me to watch it
Last synced: 05 Nov 2024
https://github.com/muratsercann/book-price-agent
This application retrieves book prices from 5 different stores based on a search query. It uses React for the client-side interface, a Node.js API for the backend, and Puppeteer for web scraping.
expressjs nodejs puppeteer puppeteer-extra puppeteer-extra-plugin-stealth react
Last synced: 05 Nov 2024
https://github.com/aliahmedm48/searchtweets
Node.js-based project that automates the process of scraping tweets from specified Twitter accounts to count mentions of stock tickers (e.g., $TSLA).
Last synced: 12 Oct 2024
https://github.com/thewrlck/quotz
A Node.js application demonstrating the use of Puppeteer and Orama SDK to create a quote database and search API.
expressjs orama puppeteer typescript
Last synced: 05 Nov 2024
https://github.com/javapuppteernodejs/cloudflare-turnstile
anti-bot cloudflare puppeteer turnstile
Last synced: 12 Oct 2024
https://github.com/steel-dev/steel-puppeteer-starter
A starter project for using Puppeteer with Steel on Node.js & TypeScript
browser-automation puppeteer web-scraping
Last synced: 15 Nov 2024
https://github.com/javapuppteernodejs/recaptcha-puppeteer
captcha captcha-solver captcha-solving cloudflare cloudflare-api cloudflare-java cloudflare-turnstile cloudflare-turnstile-api cloudflare-turnstile-bypass cloudflare-turnstile-captcha-solver cloudflare-turnstile-solver machine-learning puppeteer puppeteer-extra-plugin
Last synced: 05 Nov 2024
https://github.com/code-yeongyu/puppeteer-practice-melon-top100-crawler
My first puppeteer project using typescript. It prints melon top 100 chart with rank and song info!
Last synced: 09 Nov 2024
https://github.com/gamboavalentinabel/nodejs-puppeteer-example
Test code for the Docker image nodejs-puppeteer
Last synced: 05 Nov 2024
https://github.com/euberdeveloper/tum-conf-scraper
This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)
npm puppeteer scraper typescript video-scraper
Last synced: 09 Nov 2024
https://github.com/zaidkhalid44/irctc
Technologies used: JavaScript, Puppeteer, Tesseract.js, Jimp Description: Developed an automated system using Puppeteer and Tesseract.js to streamline IRCTC train ticket booking, handling login, captcha solving, and form filling. Automated login and form-filling tasks, reducing manual effort by approximately 90%.
Last synced: 05 Nov 2024
https://github.com/miscos/discord-web-crawler
A puppeteer based webcrawler posting results to a discord webhook
Last synced: 05 Nov 2024
https://github.com/redaezziani/scrape-data-store-jolt
Product Scraper for Jolt Store is a robust tool designed to automate the collection of product data from e-commerce websites. This project leverages Puppeteer for web scraping and Prisma Client for seamless database management, ensuring efficient integration of external product data into the Jolt Store.
Last synced: 05 Nov 2024
https://github.com/flazefy/gudangku-test
Automation test using cypress, puppeteer
automation cypress e2e integration-testing javascript puppeteer rest-api test-cases test-steps
Last synced: 06 Nov 2024
https://github.com/candeagainn/sequelize-puppeteer
This project is a Football Team Management System developed using Node.js and Sequelize ORM with a MySQL database. The system manages data related to football teams, including coaches, players, stadiums, matches, and competitions.
automation puppeteer sequelize sql
Last synced: 10 Oct 2024
https://github.com/mdato/aws-puppeteer
node express with puppeteer + aws-lambda
aws-lambda express node puppeteer
Last synced: 10 Nov 2024
https://github.com/radzionc/apartments-watcher
Opens new apartments for sale in Chrome
Last synced: 06 Nov 2024
https://github.com/tronghieu60s/data-thptqg
Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.
Last synced: 09 Nov 2024
https://github.com/radzionc/linkedin-connector
Connect With Customers From Email List on LinkedIn With Automation
Last synced: 06 Nov 2024
https://github.com/brightspace/d2l-beaker
A driver for Google Puppeteer to collect client-side performance metrics.
automation performance puppeteer
Last synced: 10 Nov 2024
https://github.com/anupamakib/telescope-livetv-backend-nodejs-docker
This application continuously fetch embed link of TV channels that are live in YouTube & keep updating the channel database. For user authentication, I have used JWT authentication. Web scraping needs more CPU, so I created a 3rd party microservice for web scraping with enough CPU. I have used Node.js, Express.js & MongoDB to implement the system.
docker email-verification expressjs jwt-authentication load-balancer microservices mongoose mvc-architecture nodejs nodemailer puppeteer web-scraping
Last synced: 10 Oct 2024
https://github.com/radzionc/medium-updater
Programatically Update Medium Stories CTAs
Last synced: 06 Nov 2024
https://github.com/kumarshivesh/aastey-newarrivals
Web Scraping data from E-Commerce Clothing Store Asstey
expressjs javascript nodejs puppeteer
Last synced: 17 Nov 2024
https://github.com/kazutoshiyoc/mattermost-tools
Tools for convenient use of Mattermost
Last synced: 12 Oct 2024
https://github.com/matthewjselby/json-resume
Generate a resume in both HTML and PDF from a JSON file.
gulp handlebars html javascript json puppeteer resume sass
Last synced: 14 Nov 2024
https://github.com/ellache/adjust_your_algo
Run puppeteer core in the background to modify your digital profile by navigating repeatedly to a specified set of webpages.
nodejs puppeteer puppeteer-core
Last synced: 09 Nov 2024
https://github.com/rajeshberwal/simple-node-web-scraper
Simple web scraper template that you can use to scrape data from a website.
javascript nodejs puppeteer scraper
Last synced: 09 Nov 2024
https://github.com/heronlabs/node-alpine-puppeteer
Image for Node Alpine with Puppeteer
docker docker-hub docker-image node nodejs puppeteer
Last synced: 13 Nov 2024
https://github.com/radzionc/twitter-outreach-cli
Half-automatically Reach Followers of a specific Profile
Last synced: 06 Nov 2024
https://github.com/tomaszrewak/react-app-puppeteer-component-testing
Guide on how to to configure puppeteer with a default (non-ejected) react app in order to test individual react components.
puppeteer react regression-testing visual-testing
Last synced: 09 Nov 2024
https://github.com/damianravindupeiris/jobber-cli
A simple AI based Node-JS script to automate the job applying process.
ai nodejs open-ai puppeteer typescript web-scraping
Last synced: 09 Nov 2024
https://github.com/mhzmn/webscraper
A web scraper for drNutrition's products
nodejs puppeteer webscraper webscraping
Last synced: 17 Nov 2024
https://github.com/zukarusan/chaant
Automation for playing chess in websites using puppeteer
api chess chess-bot chess-game chesscom javascript lichess puppeteer typescript
Last synced: 18 Nov 2024
https://github.com/1j01/pangram-tester
Checks pangrams and assists in constructing them.
alphabet chatgpt grammar holoalphabetic linguistics pangram pangrams puppeteer sentence text web-application
Last synced: 10 Nov 2024
https://github.com/juliecherner/places-of-the-world
Full Stack Project
css expressjs jest mongo-atlas mongodb mongoose mui nodejs puppeteer react reacthooks
Last synced: 13 Nov 2024
https://github.com/eltonsantos/gerador-de-pdf
Projeto desenvolvido - Vídeo: Vamos gerar PDF com NodeJS, Puppeteer, EJS e TailwindCSS - Instrutor: Mayk Brito - Link: https://www.youtube.com/watch?v=AoU7aEdTldE
ejs express html-pdf nodejs pdf puppeteer tailwindcss
Last synced: 12 Nov 2024
https://github.com/eltonsantos/calcular-horas-video-youtube
Simple Youtube Video Hour Calculator. - Vídeo: O último Code/Drops! Script que calcula horas de vídeo | Code/Drops #68 - Instrutor: Diego Fernandes & Mayk Brito - Link: https://www.youtube.com/watch?v=faekjlZuTFA
Last synced: 12 Nov 2024
https://github.com/f00b4r/2021-03-vercel-puppeteer-social-networks
🎁 How to use Puppeteer to generate images for social networks deployed to Vercel
f00b4r lambda network plugin puppeteer screenshot social vercel widget
Last synced: 14 Nov 2024
https://github.com/crud0626/howshare
cloudinary mongodb next-auth nextjs prisma puppeteer tailwindcss typescript zustand
Last synced: 17 Oct 2024
https://github.com/rorpage/puppeteer-screenshot
Puppeteer screenshot adapted from a Zeit Now function
puppeteer screenshot zeit zeit-now zeithq
Last synced: 10 Nov 2024
https://github.com/giansalex/puppeteer-sample
Puppeteer Headless Chrome (Sample)
Last synced: 02 Nov 2024
https://github.com/juangm/webtest
Compare different web E2E frameworks against a simple application
cypress-example javascript playwright-typescript puppeteer python test-automation
Last synced: 11 Nov 2024
https://github.com/ofadiman/nvim-codeshot
Take a code screenshot in neovim.
lua neovim neovim-plugin nvim nvim-plugin plugin puppeteer screenshot shiki typescript
Last synced: 12 Nov 2024
https://github.com/mobilerast/ssr-generator
SSR Generator is able to save your SPA as a rendered HTML. SSR For Angular, React.js, Vue.js.
angular-apps javascript nodejs puppeteer search-engines server-side-render server-side-rendering ssr ssr-generator
Last synced: 11 Nov 2024
https://github.com/evans-costa/screenshot-pipeline
Keep screenshots of your webpage up-to-date.
github-actions jest jest-snapshots puppeteer
Last synced: 17 Nov 2024
https://github.com/iomerkoyuncu/website-to-file
Node.js library to capture image/pdf from url.
puppeteer url-to-image url-to-pdf
Last synced: 30 Oct 2024
https://github.com/angrykoala/wendigo-plugin
Bootstraping of a wendigo plugin
automation browser chrome puppeteer template wendigo
Last synced: 30 Oct 2024
https://github.com/nowaalex/masters-parsed
https://masterspl.com/ parser
docker docker-compose fastify headless-chrome nginx nodejs parser puppeteer react react-query tailwindcss typescript vitejs
Last synced: 30 Oct 2024
https://github.com/iamafnansk/personal-whatsapp-api
API to send message via Whatsapp Web
express nodejs puppeteer whatsapp-api
Last synced: 06 Nov 2024
https://gitlab.com/hajnyon-projects/slichta/slichta-scraper
Scrapes various websites for daily meal menus. https://slichta.vercel.app/
apify menus puppeteer restaurants scraper
Last synced: 23 Oct 2024
https://github.com/igor-starostenko/book-worm
Google maps bookmark import tool
automation bookmarks google-maps puppeteer
Last synced: 17 Oct 2024
https://github.com/wlun001/html-image-headless
Example of convert HTML to image with Headless environment
docker headless-chrome nodejs puppeteer
Last synced: 29 Oct 2024
https://github.com/creativeprojects/gallerydownloader
Download images from a webpage using headless chrome
Last synced: 09 Nov 2024
https://github.com/mariusconjeaud/angular-with-api-calls
Angular with API calls template. Full Azure Pipeline with unit testing, e2e testing, code coverage and linting included.
angular azure-app-service azure-devops cobertura expressjs junit karma protractor puppeteer typescript
Last synced: 27 Oct 2024
https://github.com/zombotron/reegex
- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.
javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy
Last synced: 10 Oct 2024
https://github.com/anonymous961/scrapebooks
Just a repo to check puppeteer
neondb prisma puppeteer typescript
Last synced: 05 Nov 2024
https://github.com/cboulanger/qx-puppeteer
UI testing of a qooxdoo application with puppeteer
Last synced: 27 Oct 2024
https://github.com/silvestrodecaro/puppeteer-cluster-with-fingerprints
Example code of using puppeteer-cluster and puppeteer-with-fingerprints together
automation browser browser-fingerprint browser-fingerprinting chrome chromedriver chromium cluster fingerprint fingerprinting fingerprints puppeteer puppeteer-cluster puppeteer-with-fingerprints stealth
Last synced: 10 Oct 2024
https://github.com/anibalalpizar/puppeteer-overview
Control your browser using Javascript code, together with the Puppeteer library and Nodejs
Last synced: 11 Nov 2024
https://github.com/pdsuwwz/koa-playwright-server
🎭 Playwright 实现的 Node.js 中间件 API 服务, 替换 Puppeteer, 基于 ESM + Rollup + Koa + TypeScript + Nodemon + PM2 + ESLint (v9) 用于快速爬取并合并多网页到 PDF 文件、图片高保真快照, 支持热更新、Cookie 、水印、页眉页脚注入
es generator module pdf playwright puppeteer rollup typescript upgrade
Last synced: 27 Oct 2024
https://github.com/megave/puppeteer-scripts
A few browser scripts made using puppeteer library in NodeJS
browser-automation nodejs puppeteer
Last synced: 10 Oct 2024
https://github.com/flolu/bazel-node-puppeteer
Can't run Bazel nodejs_image with Puppeteer
bazel docker nodejs puppeteer rules-nodejs
Last synced: 11 Nov 2024
https://github.com/lukmanrambe/sekawan-restaurant
Restaurant Catalogue Website. Submission for "Menjadi Front-End Web Developer Expert" (https://www.dicoding.com/academies/219) Dicoding Class
accessibility codeceptjs css html jasmine javascript karma karma-jasmine progressive-web-app puppeteer pwa semantic-html webpack workbox
Last synced: 31 Oct 2024
https://github.com/rafaellaurindo/mercadolivre-scraper
Scraper to Mercado Livre products written in Node.js using Puppeteer.
bot mercadolivre nodejs puppeteer
Last synced: 11 Nov 2024
https://github.com/pioug/cookbook
Recipes to start my umpteenth dev projects.
cloud-run frontend javascript puppeteer rollup vuejs
Last synced: 16 Nov 2024
