Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Puppeteer

Puppeteer is a Node.js library that provides an API to control Chrome/Chromium over the DevTools Protocol. Mainly used for tests, interaction automation in web applications, taking screenshots and scraping data of web pages.

https://github.com/baxsm/scrapway

Scrapway allows users to create powerful data scraping workflows and execute them either manually or via cron jobs. With an intuitive UI and support for various tasks such as user interactions, data extraction, storage, and result delivery – you can easily automate scraping operations with minimal effort.

cheerio nextjs openai puppeteer scraping shadcn-ui stripe tailwindcss

Last synced: 06 Dec 2024

https://github.com/lukmanrambe/sekawan-restaurant

Restaurant Catalogue Website. Submission for "Menjadi Front-End Web Developer Expert" (https://www.dicoding.com/academies/219) Dicoding Class

accessibility codeceptjs css html jasmine javascript karma karma-jasmine progressive-web-app puppeteer pwa semantic-html webpack workbox

Last synced: 18 Dec 2024

https://github.com/brightspace/d2l-beaker

A driver for Google Puppeteer to collect client-side performance metrics.

automation performance puppeteer

Last synced: 07 Jan 2025

https://github.com/hutsoninc/stihl-scraper

Used to scrape data on Stihl products.

puppeteer stihl

Last synced: 27 Dec 2024

https://github.com/b4dnewz/webpage-capture-cli

Capture the web in many ways from the command line

cli-tool cli-utility puppeteer puppeteer-screenshot screenshot webpage webshot website

Last synced: 12 Jan 2025

https://github.com/luifean/randomflix-api

API desenvolvida a fim de prover informações de filmes da sua lista da Netflix. Faz uso do conceito de web scraping como data source.

cors express javascript nodejs puppeteer

Last synced: 01 Jan 2025

https://github.com/luifean/dicio-api

API desenvolvida para obter o significado de palavras através de mineração de dados

express javascript nodejs puppeteer

Last synced: 01 Jan 2025

https://github.com/luifean/github-web-api

API criada a fim de copiar a API original do GitHub, porém utilizando o conceito de mineração de dados

express javascript nodejs puppeteer typescript webscraping

Last synced: 01 Jan 2025

https://github.com/pionl/docker-node-puppeteer-ready

🐳 Docker image based on official node with with GoogleChrome/puppeteer support

chrome docker docker-image nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/hougesen/twitchtracker-scraper

Used for scraping top channels on TwitchTracker sorted by langauge. The scraped data is then saved as a .csv file.

csv puppeteer scraper scraping twitch

Last synced: 14 Jan 2025

https://github.com/amoutonbrady/jobs-scraper

Simple scraper to fetch and centralized jobs in one place

jobs puppeteer scraper

Last synced: 24 Dec 2024

https://github.com/ekamid/goodreads-book-scrapper

Scrap Goodreads Book information using Puppeteer

javascript puppeteer scrapper scrapping typescript

Last synced: 08 Jan 2025

https://github.com/angrykoala/wendigo-plugin

Bootstraping of a wendigo plugin

automation browser chrome puppeteer template wendigo

Last synced: 18 Dec 2024

https://github.com/cityssm/node-faster-report-exporter

On demand exports of selected reports from the FASTER Web Fleet Management System.

asset-management faster-web fleet-management fmis puppeteer

Last synced: 11 Nov 2024

https://gitlab.com/hajnyon-projects/slichta/slichta-scraper

Scrapes various websites for daily meal menus. https://slichta.vercel.app/

apify menus puppeteer restaurants scraper

Last synced: 23 Oct 2024

https://github.com/yashkathe/download-wallpapers-cli

Search wallpapers from terminal directly and the script will download all the high resolution wallapers from the website

expressjs nodejs puppeteer script wallpaper web-scraping

Last synced: 25 Dec 2024

https://github.com/johan-perso/screenshothtml

Screenshot HTML code, from your NodeJS Code

puppeteer scrapping-nodejs

Last synced: 23 Jan 2025

https://github.com/t2bamboo/t2-puppeteer-plugin-block-resources

Blocks unnecessary resources like images, fonts, and stylesheets to optimize performance and speed up page loads.

automation performance puppeteer puppeteer-extra resource-optimization web-scraping

Last synced: 21 Jan 2025

https://github.com/mdato/dolar2030

puppeteer + heroku + express

express heroku puppeteer

Last synced: 07 Jan 2025

https://github.com/giansalex/puppeteer-sample

Puppeteer Headless Chrome (Sample)

node puppeteer

Last synced: 20 Dec 2024

https://github.com/aegis-dev/simple_mmo_simpler_bot

Simpler bot for SimpleMMO

bot js puppeteer

Last synced: 20 Jan 2025

https://github.com/t2bamboo/t2-puppeteer-plugin-random-ua

Helping to improve web scraping and automation by evading detection.

puppeteer puppeteer-plugin puppeteer-random-ua random-user-agent user-agent

Last synced: 21 Jan 2025

https://github.com/softonic/docker-puppeteer

Puppeteer docker image

docker-image puppeteer

Last synced: 21 Dec 2024

https://github.com/nubisub/tipsen

Males buka sipadung ? Titip Absen aja

automation puppeteer

Last synced: 24 Dec 2024

https://github.com/danvictorgithub/gpt-teer

A rework to my depricated project gpt-wright project using Puppeteer

express gpt4o puppeteer

Last synced: 10 Jan 2025

https://github.com/carelessinternet/schoolsoft-scraper

Unofficial SchoolSoft API made in Node.js

api node nodejs puppeteer puppeteer-core schoolsoft

Last synced: 23 Jan 2025

https://github.com/hawtim/collection

Code collection about demos, snippets, documents, etc...

es6 expressjs nodejs puppeteer pwa typescript vue

Last synced: 18 Dec 2024

https://github.com/shuklaritvik06/bms-type-api

A web scraper api built using puppeteer and typescript which scrapes live data from bms website

api puppeteer typescript

Last synced: 17 Jan 2025

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/pdehaan/puppeteer-a11y-cli

Puppeteer <3 Axe

a11y axe puppeteer

Last synced: 19 Dec 2024

https://github.com/pdehaan/send-puppeteer

Firefox Send v.Next screenshots.

firefox puppeteer send

Last synced: 19 Dec 2024

https://github.com/austenstone/puppeteer-github

Puppeteering GitHub

puppeteer

Last synced: 15 Dec 2024

https://github.com/evans-costa/screenshot-pipeline

Keep screenshots of your webpage up-to-date.

github-actions jest jest-snapshots puppeteer

Last synced: 18 Jan 2025

https://github.com/akirak/docker-chromium

Docker image containing a Chromium executable for Puppeteer

chromium docker-image puppeteer

Last synced: 19 Dec 2024

https://github.com/kavindu-mane/html-to-pdf

Simple API for convert HTML to PDF. This API use puppeteer npm package as convertor.

bun hono html-to-pdf puppeteer

Last synced: 19 Dec 2024

https://github.com/iamafnansk/personal-whatsapp-api

API to send message via Whatsapp Web

express nodejs puppeteer whatsapp-api

Last synced: 24 Dec 2024

https://github.com/bambooom/puppeteer-examples

just some snippets about how to use puppeteer

puppeteer

Last synced: 23 Jan 2025

https://github.com/florian-catalin-elisei/pdf-generator

This application combines React on the client side and Puppeteer with Express on the server side to generate PDF receipts. React, along with Axios, handles user input and HTTP requests, while Puppeteer on the server side creates PDFs using the submitted data.

axios cors css express file-saver html javascript puppeteer react

Last synced: 19 Dec 2024

https://github.com/minho42/og-image

Open Graph image generations

nodejs og-image opengraph-images puppeteer satori

Last synced: 19 Dec 2024

https://github.com/ainoya/cloudflare-dom-distiller

A Cloudflare Workers-based API for extracting and converting web page content to Markdown using DOM-Distiller and Turndown.

cloudflare cloudflare-workers puppeteer

Last synced: 10 Oct 2024

https://github.com/radzionc/twitter-outreach-cli

Half-automatically Reach Followers of a specific Profile

nodejs puppeteer twitter-api

Last synced: 24 Dec 2024

https://github.com/radzionc/music-alarm

Alarm with Yandex-music

nodejs puppeteer

Last synced: 24 Dec 2024

https://github.com/radzionc/linkedin-connector

Connect With Customers From Email List on LinkedIn With Automation

dynamodb nodejs puppeteer

Last synced: 24 Dec 2024

https://github.com/pro-oc/pro-oc-dzs-proxy

REST API CORS Proxy server pro DZS registr.

cors-proxy-server dzs proxy-server puppeteer rest-api

Last synced: 14 Jan 2025

https://github.com/arumie/recipe-scraper

Scraper for scraping recipes

deno puppeteer typescript

Last synced: 28 Nov 2024

https://github.com/thegreatbonnie/puppeteer-web-automation-javascript

Example code of end to end web automation testing using Puppeteer JavaScript

puppeteer test-automation testing testing-tools web-automation-testing

Last synced: 25 Dec 2024

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Oct 2024

https://github.com/daviteixeira-dev/saucedemo-automation-with-puppeteer

Using the Puppeteer library to perform automated testing on Swag Labs' soucedemo.com website.

jest jest-puppeteer nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/bernietv/workflows-app

Create AI Powered Workflows to scrape the Web

clerk cron nextjs14 prisma puppeteer reactflow stripe tailwindcss

Last synced: 25 Dec 2024

https://github.com/nimitbhargava/audio-video-url-extractor

Google Puppeteer for crawling SPA to fetch audio and video link

audio cheerio puppeteer video

Last synced: 21 Jan 2025

https://github.com/janumedia/puppeteer-ssr

Puppeteer SSR example

chromium node puppeteer ssr

Last synced: 29 Dec 2024

https://github.com/kunal00000/scrape-from-webpage

Scrape data from a particular webpage.

github-api puppeteer scraping-websites

Last synced: 12 Jan 2025

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automação que fornece informações dos elencos dos times da NBA. O sistema em questão é uma aplicação console que fornece opções de escolha, o usuário digita a opção que deseja e as informações são mostradas de acordo com essa opção.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Oct 2024

https://github.com/jayvirrathi/nodejs-puppeteer

NodeJS Instagram Post Liker using Puppeteer

instagram nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/shiv-source/slice-chrome-extension-automation

This project automates the viewing of advertisements through the Slice Chrome Extension. It is designed to view ads on your behalf, and credits for viewing these ads will be automatically added to your Slice account. You can monitor these credits through the Slice extension app.

automation puppeteer slice slice-extension

Last synced: 07 Jan 2025

https://github.com/pedroaurelli/buy-scrapper

Web scrapper to observe e-commerce items to shop, and throw an user notification when prices down

nodejs puppeteer scrapper

Last synced: 02 Jan 2025

https://github.com/nawodyaishan/webdev-js-unit-test-jest

Unit testing sample with Jest and Puppeteer

async jest puppeteer unit-testing

Last synced: 21 Jan 2025

https://github.com/joaopaulopmedeiros/playing-with-pptr

Using puppeteer for going to urls, accessing dom elements and taking screenshots

js puppeteer

Last synced: 03 Dec 2024

https://github.com/tamanobi/dokku-puppeteer-ss-server

Screenshot server using puppeteer on dokku

dokku puppeteer screenshot-server

Last synced: 21 Jan 2025

https://github.com/robertoachar/screenshot-puppeteer

A playground for take a screenshot with Puppeteer.

playground puppeteer screenshot

Last synced: 26 Dec 2024

https://github.com/horatiumarginean/mimirbot

Discord bot that contains various methods for retrieving and notifying me of the knowledge I find useful.

discord-js puppeteer

Last synced: 12 Oct 2024

https://github.com/zhoukekestar/puppeteer-scripts

puppeteer scripts

puppeteer

Last synced: 20 Jan 2025

https://github.com/vedovati-matteo/gpu-price-tracker

A sophisticated web scraper for tracking GPU prices across e-commerce platforms, featuring proxy rotation, CAPTCHA handling, and data visualization.

captcha-handling docker fullstack gpu-prices javascript mongodb next-js node-js proxy-rotation puppeteer telegram-bot web-scraping

Last synced: 21 Jan 2025

https://github.com/cityssm/puppeteer-launch

Launch Puppeteer, falling back to system browsers when the cached ones aren't working or aren't available.

puppeteer puppeteer-firefox

Last synced: 07 Dec 2024

https://github.com/khoiuna/business-qrcode-flyers

Generate web pages with QR code and screenshot them for businesses to use at trade shows.

bootstrap javascript php puppeteer python script

Last synced: 15 Jan 2025

https://github.com/ashutoshsce/nys-liquor-authority

Directly scrape records from https://www.tran.sla.ny.gov/JSP/query/PublicQueryAdvanceSearchPage.jsp and present it in datatable format

datatable expressjs mongodb node nys-liquor-authority puppeteer vuejs website-scraper

Last synced: 16 Dec 2024

https://github.com/tayyabmughal676/f1gpt_backend

Formula F1GPT Chat Unlock the power of AI-powered conversations! Built with Datastax, OpenAI, and more. Fork, explore, and enhance!

ai datastax genai genai-chatbot generative-ai gpt langchain langchain-js machine-learning ml open-source open-source-intelligence open-source-project openai openai-api puppeteer rag typescript

Last synced: 02 Jan 2025

https://github.com/juangm/webtest

Compare different web E2E frameworks against a simple application

cypress-example javascript playwright-typescript puppeteer python test-automation

Last synced: 08 Jan 2025

https://github.com/hamzahussyn/daraz-data-scrapper

Scrapes data from the site Daraz.pk and saves in a json file.

daraz darazpk data-science puppeteer scra scrapper

Last synced: 19 Jan 2025

https://github.com/k4u5h4l/automate-music-download

A headless chrome script to automate the process of downloading large amounts of FLAC (lossless) audio.

javascript nodejs puppeteer scraping

Last synced: 06 Jan 2025

https://github.com/zachltech/duckduckgoscraper-firebase

Fork of a previous project of mine with Firebase Cloud Functions/Firestore integration.

firebase firebase-database firebase-functions javascript puppeteer

Last synced: 30 Dec 2024

https://github.com/prixladi/urlik

Url shortener service with advanced statistics.

asp-net-core docker docker-compose mongodb nextjs puppeteer react redis

Last synced: 16 Jan 2025

https://github.com/ajit24/anakin-scrap

This repository contains the code in puppeteer and node.js to find the latitude and longitude of all locations in Singapore

expressjs nodejs puppeteer

Last synced: 02 Jan 2025

https://github.com/alxzu/imm-puppeteer

Search the IMM website for free places for the vehicle controller

nodejs puppeteer scraper

Last synced: 10 Jan 2025

https://github.com/rafinhadufluxo/losing

Buscador de cardápio do RU da UFFS, capturando em imagem em formato PNG 📸

javascript node-module nodejs puppet-module puppeteer puppeteer-screenshot

Last synced: 26 Dec 2024

https://github.com/michalsn/sls-chrome-puppeteer

Run puppeteer with Serverless on AWS Lambda.

aws-lambda puppeteer serverless

Last synced: 01 Oct 2024

https://github.com/igor-starostenko/book-worm

Google maps bookmark import tool

automation bookmarks google-maps puppeteer

Last synced: 07 Dec 2024

https://github.com/viniciusamelio/rift_crawler

Um scraper criado em TS e seguindo práticas de arquitetura limpa.

clean-architecture puppeteer scraping typescript

Last synced: 22 Dec 2024

https://github.com/maximemoreillon/ts3_scraper

Scraper designed to retrieve the list of transactions of a TS3 corporate credit card.

credit-card puppeteer ts3

Last synced: 22 Jan 2025