Puppeteer | Ecosyste.ms: Awesome

https://github.com/sidvishnoi/all-requests

Find all local and remote sub-resources and HTTP requests in a HTML document.

http-dependencies http-requests puppeteer scraper sub-resource subresource

Last synced: 17 Dec 2024

https://github.com/zombotron/reegex

- O projeto consiste em coletar dados de várias cidades do Tocantins usando web scraping.- Os dados coletados incluem o nome da cidade, população, gentílico e território.

javascript node nodejs puppeteer regex regex-pattern scraping scraping-websites scrapy

Last synced: 11 Jan 2025

https://github.com/antoniowd/nitto-tire-crawler

Web scraper del sitio nittotire para la obtención de las características de sus neumáticos y analizar que autos pueden usarlo

mongodb nodejs puppeteer webcrawler webscraping

Last synced: 12 Dec 2024

https://github.com/ghdwlsgur/node-crawling

# puppeteer 라이브러리를 사용하여 웹크롤링하기

crawling node puppeteer

Last synced: 27 Dec 2024

https://github.com/wlun001/html-image-headless

Example of convert HTML to image with Headless environment

docker headless-chrome nodejs puppeteer

Last synced: 17 Dec 2024

https://github.com/derrmru/scrape-the-news

Proof of concept - Scrape News Outlets with Express JS

expressjs javascript nlp puppeteer

Last synced: 23 Dec 2024

https://github.com/hutsoninc/stihl-scraper

Used to scrape data on Stihl products.

puppeteer stihl

Last synced: 27 Dec 2024

https://github.com/baxsm/scrapway

Scrapway allows users to create powerful data scraping workflows and execute them either manually or via cron jobs. With an intuitive UI and support for various tasks such as user interactions, data extraction, storage, and result delivery – you can easily automate scraping operations with minimal effort.

cheerio nextjs openai puppeteer scraping shadcn-ui stripe tailwindcss

Last synced: 06 Dec 2024

https://github.com/eric-philippe/crilstats-webscrapping

Web scraping for statistics and analytics.

api puppeteer resacril rest webscraping

Last synced: 12 Dec 2024

https://github.com/selfrefactor/services

angular commit-message lint puppeteer vscode

Last synced: 01 Jan 2025

https://github.com/eltonsantos/calcular-horas-video-youtube

Simple Youtube Video Hour Calculator. - Vídeo: O último Code/Drops! Script que calcula horas de vídeo | Code/Drops #68 - Instrutor: Diego Fernandes & Mayk Brito - Link: https://www.youtube.com/watch?v=faekjlZuTFA

nodejs puppeteer

Last synced: 11 Jan 2025

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-expect

Puppeteer end-to-end test automation boilerplate, using CommonJS, Cucumber, Chai and Expect.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/ervin-sungkono/mlbb-wiki-scraper

Scraping tool to extract data from MLBB Wiki and output as JSON file

fs javascript json nodejs p-limit puppeteer

Last synced: 16 Dec 2024

https://github.com/stopsopa/state-of-puppeteer

🎎Bunch of test of my own puppeteer extensions

extension extensions puppeteer

Last synced: 12 Dec 2024

https://github.com/stopsopa/docker-puppeteer-html-scraper

(Deprecated -> use better https://github.com/stopsopa/html-scraper-browserless) Microservice tool to scraping html from "any" page

docker html-scraper node nodejs puppeteer scraper

Last synced: 12 Dec 2024

https://github.com/iomerkoyuncu/website-to-file

Node.js library to capture image/pdf from url.

puppeteer url-to-image url-to-pdf

Last synced: 30 Oct 2024

https://github.com/dhairyash-1/url-content-summarizer

This project is a Web URL Summarizer, utilizing Puppeteer for web scraping and the ChatGPT API to deliver concise summaries of extracted content. Built with React, TypeScript, and ExpressJS.

browserless chatgpt-api epxressjs puppeteer reactjs typescript

Last synced: 04 Jan 2025

https://github.com/zachltech/duckduckgoscraper-firebase

Fork of a previous project of mine with Firebase Cloud Functions/Firestore integration.

firebase firebase-database firebase-functions javascript puppeteer

Last synced: 30 Dec 2024

https://github.com/sajdoko/larashot

Laravel web app to generate website screenshot.

browsershot laravel puppeteer screenshot

Last synced: 07 Jan 2025

https://github.com/enverarslan/eset-free-key-collector

Experimental Eset Free Trial Keys Collector

eset javascript keys mail nodejs puppeteer telegram telegram-bot-api vpn

Last synced: 28 Dec 2024

https://github.com/1j01/pangram-tester

Checks pangrams and assists in constructing them.

alphabet chatgpt grammar holoalphabetic linguistics pangram pangrams puppeteer sentence text web-application

Last synced: 08 Jan 2025

https://github.com/arnavk-09/clone-html-site

⛓️ Script to clone website elements...

browserless html-css-javascript html5 node pptr puppeteer

Last synced: 13 Dec 2024

https://github.com/kavindu-mane/html-to-pdf

Simple API for convert HTML to PDF. This API use puppeteer npm package as convertor.

bun hono html-to-pdf puppeteer

Last synced: 19 Dec 2024

https://github.com/iadtya/web-summarizer-client

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on Git

ec2-instance gpt-35-turbo jest nodejs puppeteer redis-cache redis-server

Last synced: 03 Jan 2025

https://github.com/jonathanlinat/simple-nodejs-amazon-web-scraper

A very simple and automated tool to scrape Amazon.com results

amazon cheerio nodejs puppeteer web-scraper

Last synced: 14 Jan 2025

https://github.com/yashkathe/download-wallpapers-cli

Search wallpapers from terminal directly and the script will download all the high resolution wallapers from the website

expressjs nodejs puppeteer script wallpaper web-scraping

Last synced: 25 Dec 2024

https://github.com/ainoya/cloudflare-dom-distiller

A Cloudflare Workers-based API for extracting and converting web page content to Markdown using DOM-Distiller and Turndown.

cloudflare cloudflare-workers puppeteer

Last synced: 10 Oct 2024

https://github.com/rorpage/puppeteer-screenshot

Puppeteer screenshot adapted from a Zeit Now function

puppeteer screenshot zeit zeit-now zeithq

Last synced: 08 Jan 2025

https://github.com/prixladi/site-capture-puppet

Worker service capturing sites using puppeteer. Part of Site Capture project - https://github.com/prixladi/site-capture

docker mongodb nodejs puppeteer redis

Last synced: 16 Nov 2024

https://github.com/chewbaccayeti/octo_games_metrics

This repo dedicated to data scrapping/parsing them into fronted side with Highchart.js statistics (SteamDB, RedditAPI)

ajax axios cheerio cors dotenv express hot-reload javascript momentjs nodejs nodemon parsing puppeteer react reddit scraping steam typescript webpack

Last synced: 10 Oct 2024

https://github.com/mairagalvao/automation-test-puppeteer

A test built with Puppeteer framework

automation javascript nodejs puppeteer qa test-automation

Last synced: 30 Dec 2024

https://github.com/nowaalex/masters-parsed

https://masterspl.com/ parser

docker docker-compose fastify headless-chrome nginx nodejs parser puppeteer react react-query tailwindcss typescript vitejs

Last synced: 18 Dec 2024

https://github.com/luifean/randomflix-api

API desenvolvida a fim de prover informações de filmes da sua lista da Netflix. Faz uso do conceito de web scraping como data source.

cors express javascript nodejs puppeteer

Last synced: 01 Jan 2025

https://github.com/luifean/dicio-api

API desenvolvida para obter o significado de palavras através de mineração de dados

express javascript nodejs puppeteer

Last synced: 01 Jan 2025

https://github.com/luifean/github-web-api

API criada a fim de copiar a API original do GitHub, porém utilizando o conceito de mineração de dados

express javascript nodejs puppeteer typescript webscraping

Last synced: 01 Jan 2025

https://github.com/daviteixeira-dev/saucedemo-automation-with-puppeteer

Using the Puppeteer library to perform automated testing on Swag Labs' soucedemo.com website.

jest jest-puppeteer nodejs puppeteer

Last synced: 10 Oct 2024

https://github.com/pionl/docker-node-puppeteer-ready

🐳 Docker image based on official node with with GoogleChrome/puppeteer support

chrome docker docker-image nodejs puppeteer

Last synced: 10 Jan 2025

https://github.com/jackdbd/regl-experiments

Regl experiments with React and Typescript

jest puppeteer react regl webgl webpack

Last synced: 07 Dec 2024

https://github.com/brunos3d/puppemask

A metamask bot.

automation blockchain bot chromium ethereum metamask nodejs puppeteer transaction typescript web3

Last synced: 07 Jan 2025

https://github.com/amoutonbrady/jobs-scraper

Simple scraper to fetch and centralized jobs in one place

jobs puppeteer scraper

Last synced: 24 Dec 2024

https://github.com/jprando/lotofacil

Buscar informacoes do ultimo sorteio da lotofacil

javascript lotofacil puppeteer

Last synced: 29 Nov 2024

https://github.com/d-sanderson/rick-and-morty-quote-scrapper

web scrapper for rick and morty quotes

chalk node nodejs puppeteer rick-and-morty web-scrapper

Last synced: 29 Nov 2024

https://github.com/gabrielczar/tests-for-api-interest-points

BDD tests for API Interest Points

bdd chai cucumber-js puppeteer tests

Last synced: 11 Jan 2025

https://github.com/iirving/pdf-dynamic-node-template

server side generated PDF's from static handlebar html templates with external dynamic data

handlebars hbs node nodejs pdf pdf-generation puppeteer

Last synced: 28 Nov 2024

https://github.com/adrianhdezm/spa-boilerplate

A boilerplate for building Single-Page Applications with React and TypeScript

jest json-server puppeteer react typescript webpack

Last synced: 16 Nov 2024

https://github.com/kos/react-ssr-genie

A simple tool for simple server-side rendering needs

pdf puppeteer

Last synced: 24 Nov 2024

https://github.com/kimromi/kshot

📷 Tools to take screenshots.

javascript koajs puppeteer

Last synced: 16 Nov 2024

https://github.com/sj22032003/scrapper-basic-flipkart

Minor web scrapper using puppeteer to scrap data from Flipkart listing

bun puppeteer typescript

Last synced: 06 Jan 2025

https://github.com/angrykoala/wendigo-plugin

Bootstraping of a wendigo plugin

automation browser chrome puppeteer template wendigo

Last synced: 18 Dec 2024

https://github.com/y2kforever/hltb-collector

Scrapes a selected public profile on HowLongToBeat.com

aws aws-lambda chromium cloudformation cloudformation-template hltb howlongtobeat lambda lambda-function node nodejs puppeteer puppeteer-core typescript web-scraper web-scraping

Last synced: 24 Dec 2024

https://github.com/matthewjselby/json-resume

Generate a resume in both HTML and PDF from a JSON file.

gulp handlebars html javascript json puppeteer resume sass

Last synced: 13 Jan 2025

https://github.com/code-with-amine/realpriceapi

cheerio express nodejs puppeteer webscraping

Last synced: 27 Sep 2024

https://github.com/gabrielweyer/ui-tests

Writing UI tests with Selenium Web Driver and Puppeteer

github-actions puppeteer selenium-webdriver ui-testing

Last synced: 14 Oct 2024

https://github.com/existenzial/puppeteer-testing

a sandbox for puppeteer

chromium headless-chrome javascript puppeteer ssr

Last synced: 16 Nov 2024

https://github.com/e2e-boilerplate/puppeteer-es-modules-esm-mocha-assert

Puppeteer end-to-end test automation boilerplate, using ES6 Modules, ESM, Mocha and Assert.

assert e2e-test e2e-testing e2e-tests es6 esm mocha puppeteer

Last synced: 11 Jan 2025

https://github.com/micalevisk/ecampus-ufam-crawler

🚧 Command Line Interface (CLI) tool that automates common tasks for https://ecampus.ufam.edu.br users.

nodejs-cli puppeteer ufam ufam-cli

Last synced: 28 Oct 2024

https://github.com/bambooom/puppeteer-examples

just some snippets about how to use puppeteer

puppeteer

Last synced: 23 Nov 2024

https://github.com/marcinrek/seed

Cutup boilerplate with support of: react, hyperapp and more ...

boilerplate-template boilerplates hyperapp mocha puppeteer react scaffold webpack

Last synced: 29 Nov 2024

https://github.com/deadcoder0904/puppeteer

A demo of things automating generating screenshot, creating pdf & signing into Facebook with Puppeteer ✨

pdf puppeteer screenshot sign-in

Last synced: 14 Jan 2025

https://github.com/dreamjet31/theinfautation-scraper

The Infautation scraper for me

axios cheerio infautation javascript mongodb nodejs puppeteer scraping

Last synced: 18 Dec 2024

https://github.com/bllsglm/scrape-with-puppeteer

Scrape with Puppeteer

node-js puppeteer scraper

Last synced: 19 Nov 2024

https://github.com/whosydd/cookie-format

format cookie for lib

cookie format puppeteer

Last synced: 19 Nov 2024

https://github.com/gonzalofh/travel-ban-updates

This script acts a web scraper for the Covid-19 travel restrictions page on the US Gov Travel website. It returns the last date that guidelines were updated.

covid covid-19 covid19 js nodejs puppeteer travel-ban travelban

Last synced: 19 Nov 2024

https://github.com/aymanabusura/formfillingbot

This project is a form-filling bot that automates form submissions on specified URLs using a server powered by Puppeteer.

axios cors expressjs nodejs puppeteer reactjs

Last synced: 19 Nov 2024

https://github.com/afeiship/pptr-html

Get html by puppeteer.

crawl html pptr puppeteer spider

Last synced: 14 Dec 2024

https://github.com/prixladi/urlik

Url shortener service with advanced statistics.

asp-net-core docker docker-compose mongodb nextjs puppeteer react redis

Last synced: 16 Nov 2024

https://github.com/louiscklaw/page-change-detect-tryout

page-change-detect-tryout

javascript puppeteer

Last synced: 20 Dec 2024

https://github.com/aikosiadotcom/automaton-cli

Command Line Interface (CLI) Of Automaton Framework

aikosia automation automaton bot chromium cli command-line-tool framework javascript playwright puppeteer

Last synced: 16 Nov 2024

https://github.com/aikosiadotcom/automaton-core

Core Libraries Of Automaton Framework

aikosia automation automaton bot chromium ecmascript framework javascript nodejs playwright puppeteer typescript

Last synced: 16 Nov 2024

https://github.com/sarukuku/dependency-checker

A command line tool that checks your web page's dependencies, what percentage of them are cross-origin or cross-domain and who's in control of them.

dependencies nodejs puppeteer whois

Last synced: 10 Dec 2024

https://github.com/t2leaf/t2-puppeteer-plugin-block-resources

Blocks unnecessary resources like images, fonts, and stylesheets to optimize performance and speed up page loads.

automation performance puppeteer puppeteer-extra resource-optimization web-scraping

Last synced: 11 Jan 2025

https://github.com/portrunban/node-vk-puppeteer-user

This app removes inactive users from the group Vkontakte. base on puppeteer

puppeteer vk vkontakte

Last synced: 02 Jan 2025

https://github.com/crud0626/howshare

cloudinary mongodb next-auth nextjs prisma puppeteer tailwindcss typescript zustand

Last synced: 07 Dec 2024

https://github.com/nubisub/tipsen2

Males buka sipadung ? Titip Absen aja

automation node-cron puppeteer

Last synced: 06 Nov 2024

https://github.com/e2e-boilerplate/puppeteer-commonjs-cucumber-chai-should

Puppeteer end-to-end test automation boilerplate, Using Commonjs, Cucumber, Chai and Should.

chai commonjs cucumber end-to-end-test-automation puppeteer

Last synced: 11 Jan 2025

https://github.com/zhoukekestar/puppeteer-scripts

puppeteer scripts

puppeteer

Last synced: 19 Nov 2024

https://github.com/afeiship/ushell-module-puppeteer

Unix config for puppeteer.

centos chrome headless mac module puppeteer ubuntu ushell

Last synced: 14 Dec 2024

https://github.com/shuklaritvik06/puppeteerprojects

Exploring Puppeteer

automation opensource puppeteer

Last synced: 16 Nov 2024

https://github.com/shuklaritvik06/bms-type-api

A web scraper api built using puppeteer and typescript which scrapes live data from bms website

api puppeteer typescript

Last synced: 16 Nov 2024

https://github.com/argshook/sitemap-to-html

CLI tool to generate HTML files for each link defined in sitemap.xml

crawlers html-snapshot puppeteer sitemap

Last synced: 14 Jan 2025

https://github.com/cityssm/puppeteer-launch

Launch Puppeteer, falling back to system browsers when the cached ones aren't working or aren't available.

puppeteer puppeteer-firefox

Last synced: 07 Dec 2024

https://github.com/khoiuna/business-qrcode-flyers

Generate web pages with QR code and screenshot them for businesses to use at trade shows.

bootstrap javascript php puppeteer python script

Last synced: 15 Jan 2025

https://github.com/austenstone/puppeteer-github

Puppeteering GitHub

puppeteer

Last synced: 15 Dec 2024

https://github.com/bastosmatheus/bot-nba

Esse projeto consiste em uma automação que fornece informações dos elencos dos times da NBA. O sistema em questão é uma aplicação console que fornece opções de escolha, o usuário digita a opção que deseja e as informações são mostradas de acordo com essa opção.

nodejs puppeteer readline-sync typescript webscrapping

Last synced: 10 Oct 2024