Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/akashchouhan16/webscraping-cli

A command-line tool using node & puppeteer for web scraping.
https://github.com/akashchouhan16/webscraping-cli

chromium nodejs puppeteer

Last synced: 22 days ago
JSON representation

A command-line tool using node & puppeteer for web scraping.

Awesome Lists containing this project

README

        

# WebScraping CLI

[![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)](https://GitHub.com/Naereen/StrapDown.js/graphs/commit-activity "Repo Maintained")
[![Ask Me Anything !](https://img.shields.io/badge/Ask%20me-anything-1abc9c.svg)](https://GitHub.com/akashchouhan16/ "github.com/akashchouhan16")
[![made-for-VSCode](https://img.shields.io/badge/Made%20for-VSCode-1f425f.svg)](https://code.visualstudio.com/ "VSCODE")
[![GitHub issues](https://img.shields.io/github/issues/akashchouhan16/WebScraping-CLI.svg)](https://github.com/akashchouhan16/WebScraping-CLI/issues)
[![GitHub stars](https://img.shields.io/github/stars/akashchouhan16/WebScraping-CLI.svg?style=social)](https://github.com/akashchouhan16/WebScraping-CLI/stargazers) ![GitHub last commit](https://img.shields.io/github/last-commit/akashchouhan16/WebScraping-CLI.svg)

- This is a command line tool built using [Nodejs](https://nodejs.dev/learn) and the Google's Node library [Puppeteer](https://developers.google.com/web/tools/puppeteer).
- Provides a high-level API to control headless Chrome or Chromium over the DevTools Protocol.
- It can also be configured to use full (non-headless) Chrome or Chromium.

NOTE : **The cli takes **IMDb URI**, validates it and then scrapes contents to displays it in the output table.**

> **Checkout the previews [here](./previews).**

---

## How to run?

- **Install dependencies**
```bash
npm install
```
**OR**
```
npm i --save
```
- **Run the Script**
```bash
npm run start
```

---

## Preview

> ![web scraping](./previews/success2.gif)

---

## [Application Info](https://github.com/akashchouhan16/WebScraping-CLI "Web Scraping CLI")

[![forthebadge](https://forthebadge.com/images/badges/made-with-javascript.svg)](https://forthebadge.com)
[![forthebadge](https://forthebadge.com/images/badges/compatibility-betamax.svg)](https://forthebadge.com)

### Version

**[1.0.3](https://github.com/akashchouhan16/WebScraping-CLI#readme, "Web Scraping CLI v1.0.3")**

### Licence

**[MIT](https://github.com/akashchouhan16/WebScraping-CLI/blob/master/LICENSE.md, "View LICENSE")**