https://github.com/anasfik/user-repositories-scrapper

a puppeteer script to get repositories data from user using puppeteer
https://github.com/anasfik/user-repositories-scrapper

javascript puppeteer repositories scrapper web-scraper web-scraping

Last synced: 9 days ago
JSON representation

a puppeteer script to get repositories data from user using puppeteer

• Host: GitHub
• URL: https://github.com/anasfik/user-repositories-scrapper
• Owner: anasfik
• Created: 2022-08-26T03:50:12.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2022-08-26T16:44:31.000Z (over 2 years ago)
• Last Synced: 2025-01-07T15:38:27.799Z (15 days ago)
• Topics: javascript, puppeteer, repositories, scrapper, web-scraper, web-scraping
• Language: JavaScript
• Homepage:
• Size: 8.79 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# User Repositories Scrapper

A puppeteer script to scrap user repositories informations

## What it can scrap ?

 - Repository title

 - Repository description

 - Repository stars number

 - Repository forks number

 - Repository dominant language (most used in repository)

 - Repository last updateR

## Usage

First, you should have puppeteer installed fot your project




Get started with puppeteer





Or you can start with this : 

First, install puppeter in your folder project, or clone this repository

 ```

 npm i puppeteer --save

 ```

 Note: this will install a Chromium browser where puppeteer will run

 

Second, in the index.js you would be able to see my github repositories link, change it with the link you want

Third, run the script with

```

node index.js

```

And wait, a chromium browser will be opened to scrap the data of user repositories and log it in the console

# To-do

 - turn the result to json format

 - save the result into a json file, so it'll be useful as an API