Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/ardwiinoo/v1-scrap-tools

Scrapper tools untuk megambil data komentar dari video youtube

js puppeteer

Last synced: 07 Nov 2024

https://github.com/aexynn/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 14 Oct 2024

https://github.com/zhaoqize/easy-dict

🤓 一个命令行词典

cool dictionaries nodejs puppeteer tools translation

Last synced: 05 Nov 2024

https://github.com/encoreshao/puppeteer-typescript-starter

The most basic Puppeteer TypeScript starter

data-scraper json nodemon puppeteer structure typescript

Last synced: 21 Oct 2024

https://github.com/euberdeveloper/video-scraper-core

An npm package that provides an abstract class to scrape videos with Puppeteer

npm puppeteer scraper typescript video-scraper

Last synced: 21 Oct 2024

https://github.com/tokuda109/techbookfest07-puppeteer-samples

技術書典7に出典した「実践マニアックテスト 〜Android・iOS・Web編〜」の「Puppeteerを使ったE2Eテストの始め方」のサンプルコード集

e2e javascript nodejs puppeteer

Last synced: 14 Nov 2024

https://github.com/nadavkli/react-to-pdf-ts

Transform React components into PDFs effortlessly! Leverage TypeScript and Puppeteer for high-quality, customizable PDFs with just a few lines of code.

nodejs pdf pdf-generation puppeteer react reactjs typescript

Last synced: 21 Oct 2024

https://github.com/kodie/stack-fanatic-cli

A CLI tool for checking the progress of the badge you are tracking on your Stack Overflow profile.

badge badges cli command-line command-line-tool google node node-js node-module nodejs puppeteer stack-overflow stackexchange stackoverflow

Last synced: 21 Oct 2024

https://github.com/guilhermebkel/semantic-search-llm-ai

🤖 That's a simple LLM semantic search that implements RAG concepts with help of LangChain and OpenAI API.

ai embeddings langchain openai-api puppeteer rag redis redis-vector-store retrieval-augmented-generation semantic-search-ai typescript

Last synced: 05 Nov 2024

https://github.com/euberdeveloper/bbb-video-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served by BBB

npm puppeteer scraper typescript video-scraper

Last synced: 21 Oct 2024

https://github.com/sinoryn/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 27 Sep 2024

https://github.com/akashchouhan16/webscraping-cli

A command-line tool using node & puppeteer for web scraping.

chromium nodejs puppeteer

Last synced: 24 Oct 2024

https://github.com/gxiang314/url2pdf

a batch url to pdf converter

batch nodejs puppeteer typescript url2pdf webpage2pdf

Last synced: 10 Oct 2024

https://github.com/stefanzweifel/sidecar-browsershot-layer

AWS Lambda Layer containing puppeteer-core. Used by sidecar-browsershot

aws-lambda aws-lambda-layer puppeteer puppeteer-core

Last synced: 24 Oct 2024

https://github.com/sjdonado/assessment-2-backend-un-202130

DSLLO APLICACIONES WEB BACKEND - Universidad del Norte, Colombia

http-server nodejs puppeteer

Last synced: 06 Nov 2024

https://github.com/cenfun/page-save-as

Page save as JPG/PNG/PDF

jpg page pdf png puppeteer save

Last synced: 18 Oct 2024

https://github.com/raeesbhatti/vbully

Scrapes data off vBulletin websites

puppeteer scraper vbulletin

Last synced: 26 Oct 2024

https://github.com/wangshibiaoflytiger/spider_puppeteer

nodejs puppeteer爬虫开发脚手架

crawl nodejs puppeteer spider

Last synced: 10 Nov 2024

https://github.com/bboydflo/perf-matters

this repo contains some tools to extract/report performance of specific webpageges (wip)

performance-metrics performance-testing psi puppeteer

Last synced: 07 Nov 2024

https://github.com/eccenux/wikiploy-rollout-example

Wikipedia gadget example with Browserify as a build tool and Wikiploy for deployments.

puppeteer wikipedia wikiploy

Last synced: 06 Nov 2024

https://github.com/ewliang/cnbc-premarket-web-scraper

A web scraper created using Puppeteer library on the backend to scrape the stock market prediction data off of CNBC's premarket page.

backend-development expressjs javascript node-js nodejs puppeteer stock-market web-scraper web-scraping webscraper

Last synced: 08 Nov 2024

https://github.com/josepedrodias/puppetmaster

drive multiple puppeteer controlled browsers with ease

automation multiplayer puppeteer

Last synced: 05 Nov 2024

https://github.com/mobilerast/accessibility-checker

A tool for assessing website accessibility, leveraging Puppeteer and axe-core. It automates the process of detecting common accessibility issues, providing a quick and efficient means to ensure web content is accessible to all users, including those with disabilities.

accessibility accessibility-analysis accessibility-automation accessibility-testing accessible axe-core axe-puppeteer javascript nodejs puppeteer puppeteer-core puppeteer-demo validation violations

Last synced: 11 Nov 2024

https://github.com/ondiekelijah/web-scraping-with-node.js-guide

Node.js Web Scraping Guide repository

cheerio puppeteer

Last synced: 10 Oct 2024

https://github.com/saryniel/vrcgetapidata

[W.I.P. but usable] A Scraper/API user & API Website for VRChat to retrieve information directly from the site & the API to obtain information on a user (friend) such as groups joined, group represented, profile, rank, etc...

api axios express friend group profile puppeteer rank scraper ts typescript vrchat vrchat-api

Last synced: 31 Oct 2024

https://github.com/tarektouati/gcp-synthetic-monitoring

Example of GCP synthetic monitor with puppeter

gcp javascript monitoring puppeteer testing-library

Last synced: 28 Oct 2024

https://github.com/squishy123/twist-scraper

Scraper Endpoints for twist.moe

anime javascript nodejs puppeteer scraping

Last synced: 24 Oct 2024

https://github.com/slickcharmer/screen-sharing-basic

Simple Screen Sharing Application using React and Node.js. You can use it on your project.

nodejs puppeteer react screen sharing

Last synced: 15 Nov 2024

https://github.com/devrax/opencorpdrscrapper

Web scraper to extract company data from OpenCorporates

javascript nodejs puppeteer supabase

Last synced: 12 Nov 2024

https://github.com/ttibensky/example-puppeteer

An example implementation of https://developers.google.com/web/tools/puppeteer/

chrome chromium headless-chrome node nodejs puppeteer puppeteer-screenshot

Last synced: 15 Oct 2024

https://github.com/sefinek/node-page-capturer

Captures a screenshot of any webpage. And that's all 📷

puppeteer screenshot website-screenshot website-screenshot-capturer website-screenshots

Last synced: 30 Oct 2024

https://github.com/steel-dev/steel-puppeteer-starter

A starter project for using Puppeteer with Steel on Node.js & TypeScript

browser-automation puppeteer web-scraping

Last synced: 15 Nov 2024

https://github.com/e2e-boilerplate/puppeteer-typescript-ts-node-jasmine-assert

Puppeteer end-to-end test automation boilerplate, Using TypeScript, ts-node, Jasmine and Assert.

assert end-to-end-test-automation jasmine puppeteer typescript

Last synced: 12 Nov 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 10 Oct 2024

https://github.com/vermajay/internshala-automation

Automatically apply to internships on Internshala using Google's Puppeteer high level API for chrome

api automation chrome google internships puppeteer

Last synced: 13 Oct 2024

https://github.com/captaincluster/sitesnap

A program that uses Puppeteer to visit the url given by the user and take a screenshot. The screenshot will then be saved for the user to view.

javascript nodejs puppeteer screenshot

Last synced: 08 Nov 2024

https://github.com/darkterminal/rest-screenshoot

REST Screenshoot is a free tool for capturing screenshots of webpages via a REST API. Free an always!

open-source puppeteer rest-api screenshoot

Last synced: 08 Nov 2024

https://github.com/afeiship/pptr-html

Get html by puppeteer.

crawl html pptr puppeteer spider

Last synced: 27 Oct 2024

https://github.com/noriste/stackoverflow-52383438-cypress-issue

The same test run on Cypress/TestCafe/Puppeteer to check the strange behaviour of the former

cypress e2e-testing puppeteer testcafe

Last synced: 27 Oct 2024

https://github.com/arthurweinmann/puppeteer-server

Run Puppeteer (browser automation) as a HTTP API

api puppeteer rpc

Last synced: 10 Nov 2024

https://github.com/abduldevhub/react-mountain

A repository containing all of the React projects I made to test and learn new react concepts. Each project resides in its own dedicated folder.

css html javascript puppeteer react scss threejs typescript vite

Last synced: 12 Oct 2024

https://github.com/carelessinternet/schoolsoft-scraper

Unofficial SchoolSoft API made in Node.js

api node nodejs puppeteer puppeteer-core schoolsoft

Last synced: 29 Sep 2024

https://github.com/beckkramer/puppeteer-traverse

Puppeteer utility to easily run a function you define per route on a set of routes.

crawler crawling nodejs puppeteer

Last synced: 12 Oct 2024

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 09 Nov 2024

https://github.com/iadtya/web-summarizer

Web-summarizer scrapes the specific url to pipes that text data into gpt-3.5-turbo model to generate summary of the url and uses redis to cache the summary to save overhead price

expressjs nodejs openai-api puppeteer reactjs redis tailwindcss

Last synced: 09 Nov 2024

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 10 Nov 2024

https://github.com/rushi0508/insta-reels-automation

Fetches the reels for different users including captions and stores it in AWS S3.

javascript nodejs puppeteer webscraping

Last synced: 12 Oct 2024

https://github.com/andrei0x309/puppeteer-extra-plugin-browser-extension-interact

Puppeteer extra plugin to interact with browser extensions, highly experimental.

browser-extention-interaction puppeteer puppeteer-extra puppeteer-extra-plugin

Last synced: 09 Nov 2024

https://github.com/hiakshatjain/travelease

TravelEase is a web scraping-based ticket booking and travel planning system built with Next.js, Prisma, PostgreSQL, and Puppeteer. It streamlines travel arrangements by automating ticket searches, bookings, and itinerary planning, providing users with a seamless travel experience. #nextjs

brightdata docker nextjs14 postgresql puppeteer redis shadcn-ui stripe tailwindcss typescript zustand

Last synced: 10 Oct 2024

https://github.com/samthor/headless-test

Run Mocha tests in a headless browser

http mocha puppeteer test

Last synced: 12 Oct 2024

https://github.com/aliahmedm48/searchtweets

Node.js-based project that automates the process of scraping tweets from specified Twitter accounts to count mentions of stock tickers (e.g., $TSLA).

nodejs puppeteer twitter

Last synced: 12 Oct 2024

https://github.com/c0de-l00p/whatsapp-bot

Simple whatsapp bot made with node js and puppeteer

node puppeteer qrcode whatsapp

Last synced: 09 Nov 2024

https://github.com/zhaoyiming0803/demo-puppeteer

puppeteer 应用伪代码

nodejs puppeteer

Last synced: 14 Oct 2024

https://github.com/lightbeem3296/stealth-chrome-automation

Completely undetectable chrome browser automation script. Even better than all the automation libraries including Selenium, Puppeteer, Playwright and so on.

automation bypass playwright puppeteer scraper selenium stealth-bot undetectable-browser

Last synced: 09 Nov 2024

https://github.com/kazutoshiyoc/mattermost-tools

Tools for convenient use of Mattermost

mattermost nodejs puppeteer

Last synced: 12 Oct 2024

https://github.com/yandeu/jenkins-puppeteer-docker

Use Puppeteer on Jenkins on Docker with Node.js and Jest.

docker jenkins jest nodejs puppeteer

Last synced: 23 Oct 2024

https://github.com/heronlabs/node-alpine-puppeteer

Image for Node Alpine with Puppeteer

docker docker-hub docker-image node nodejs puppeteer

Last synced: 13 Nov 2024

https://github.com/dkgee/tk_spa

nodejs案例 puppeteer

centos7 nodejs puppeteer windows-7

Last synced: 04 Nov 2024

https://github.com/luifean/dicio-api

API desenvolvida para obter o significado de palavras através de mineração de dados

express javascript nodejs puppeteer

Last synced: 08 Nov 2024

https://github.com/code-yeongyu/puppeteer-practice-melon-top100-crawler

My first puppeteer project using typescript. It prints melon top 100 chart with rank and song info!

melon puppeteer typescript

Last synced: 09 Nov 2024

https://github.com/euberdeveloper/tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

npm puppeteer scraper typescript video-scraper

Last synced: 09 Nov 2024

https://github.com/sepiropht/get-youtube-video-category

scraper for getting category from a youtube video

puppeteer scraper youtube youtube-api

Last synced: 05 Nov 2024

https://github.com/mdato/dolar2030

puppeteer + heroku + express

express heroku puppeteer

Last synced: 10 Nov 2024

https://github.com/mdato/aws-puppeteer

node express with puppeteer + aws-lambda

aws-lambda express node puppeteer

Last synced: 10 Nov 2024

https://github.com/kumarshivesh/aastey-newarrivals

Web Scraping data from E-Commerce Clothing Store Asstey

expressjs javascript nodejs puppeteer

Last synced: 12 Oct 2024

https://github.com/tronghieu60s/data-thptqg

Trình thu thập dữ liệu đIểm thi THPTQG năm 2021.

crawlers nodejs puppeteer

Last synced: 09 Nov 2024

https://github.com/cityssm/node-faster-report-exporter

On demand exports of selected reports from the FASTER Web Fleet Management System.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 11 Nov 2024

https://github.com/brightspace/d2l-beaker

A driver for Google Puppeteer to collect client-side performance metrics.

automation performance puppeteer

Last synced: 10 Nov 2024

https://github.com/horatiumarginean/mimirbot

Discord bot that contains various methods for retrieving and notifying me of the knowledge I find useful.

discord-js puppeteer

Last synced: 12 Oct 2024

https://github.com/matthewjselby/json-resume

Generate a resume in both HTML and PDF from a JSON file.

gulp handlebars html javascript json puppeteer resume sass

Last synced: 14 Nov 2024

https://github.com/ellache/adjust_your_algo

Run puppeteer core in the background to modify your digital profile by navigating repeatedly to a specified set of webpages.

nodejs puppeteer puppeteer-core

Last synced: 09 Nov 2024

https://github.com/anonymous961/scrapebooks

Just a repo to check puppeteer

neondb prisma puppeteer typescript

Last synced: 05 Nov 2024

https://github.com/rajeshberwal/simple-node-web-scraper

Simple web scraper template that you can use to scrape data from a website.

javascript nodejs puppeteer scraper

Last synced: 09 Nov 2024

https://github.com/megave/puppeteer-scripts

A few browser scripts made using puppeteer library in NodeJS

browser-automation nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Nov 2024

https://github.com/tomaszrewak/react-app-puppeteer-component-testing

Guide on how to to configure puppeteer with a default (non-ejected) react app in order to test individual react components.

puppeteer react regression-testing visual-testing

Last synced: 09 Nov 2024

https://github.com/damianravindupeiris/jobber-cli

A simple AI based Node-JS script to automate the job applying process.

ai nodejs open-ai puppeteer typescript web-scraping

Last synced: 09 Nov 2024

https://github.com/danvictorgithub/gpt-teer

A rework to my depricated project gpt-wright project using Puppeteer

express gpt4o puppeteer

Last synced: 11 Nov 2024

https://github.com/eltonsantos/gerador-de-pdf

Projeto desenvolvido - Vídeo: Vamos gerar PDF com NodeJS, Puppeteer, EJS e TailwindCSS - Instrutor: Mayk Brito - Link: https://www.youtube.com/watch?v=AoU7aEdTldE

ejs express html-pdf nodejs pdf puppeteer tailwindcss

Last synced: 12 Nov 2024

https://github.com/eltonsantos/calcular-horas-video-youtube

Simple Youtube Video Hour Calculator. - Vídeo: O último Code/Drops! Script que calcula horas de vídeo | Code/Drops #68 - Instrutor: Diego Fernandes & Mayk Brito - Link: https://www.youtube.com/watch?v=faekjlZuTFA

nodejs puppeteer

Last synced: 12 Nov 2024

https://github.com/f00b4r/2021-03-vercel-puppeteer-social-networks

🎁 How to use Puppeteer to generate images for social networks deployed to Vercel

f00b4r lambda network plugin puppeteer screenshot social vercel widget

Last synced: 14 Nov 2024

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 10 Nov 2024

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 11 Nov 2024

https://github.com/mobilerast/ssr-generator

SSR Generator is able to save your SPA as a rendered HTML. SSR For Angular, React.js, Vue.js.

angular-apps javascript nodejs puppeteer search-engines server-side-render server-side-rendering ssr ssr-generator

Last synced: 11 Nov 2024

https://github.com/kernix13/puppeteer-web-scraper

How to use Puppeteer for web scaping

puppeteer

Last synced: 09 Nov 2024

https://github.com/khoiuna/business-qrcode-flyers

Generate web pages with QR code and screenshot them for businesses to use at trade shows.

bootstrap javascript php puppeteer python script

Last synced: 15 Nov 2024