Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/akashchouhan16/webscraping-cli

A command-line tool using node & puppeteer for web scraping.
https://github.com/akashchouhan16/webscraping-cli

chromium nodejs puppeteer

Last synced: 12 days ago
JSON representation

A command-line tool using node & puppeteer for web scraping.

Host: GitHub
URL: https://github.com/akashchouhan16/webscraping-cli
Owner: akashchouhan16
License: mit
Created: 2021-03-16T18:53:05.000Z (almost 4 years ago)
Default Branch: master
Last Pushed: 2021-04-30T18:23:09.000Z (over 3 years ago)
Last Synced: 2024-10-24T21:59:22.101Z (about 2 months ago)
Topics: chromium, nodejs, puppeteer
Language: JavaScript
Homepage:
Size: 4.17 MB
Stars: 1
Watchers: 2
Forks: 0
Open Issues: 1
Metadata Files:
- Readme: README.md
- License: LICENSE.md

Awesome Lists containing this project

README

        # WebScraping CLI

[![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)](https://GitHub.com/Naereen/StrapDown.js/graphs/commit-activity "Repo Maintained")

[![Ask Me Anything !](https://img.shields.io/badge/Ask%20me-anything-1abc9c.svg)](https://GitHub.com/akashchouhan16/ "github.com/akashchouhan16")

[![made-for-VSCode](https://img.shields.io/badge/Made%20for-VSCode-1f425f.svg)](https://code.visualstudio.com/ "VSCODE")

[![GitHub issues](https://img.shields.io/github/issues/akashchouhan16/WebScraping-CLI.svg)](https://github.com/akashchouhan16/WebScraping-CLI/issues)

[![GitHub stars](https://img.shields.io/github/stars/akashchouhan16/WebScraping-CLI.svg?style=social)](https://github.com/akashchouhan16/WebScraping-CLI/stargazers) ![GitHub last commit](https://img.shields.io/github/last-commit/akashchouhan16/WebScraping-CLI.svg)

- This is a command line tool built using [Nodejs](https://nodejs.dev/learn) and the Google's Node library [Puppeteer](https://developers.google.com/web/tools/puppeteer).

- Provides a high-level API to control headless Chrome or Chromium over the DevTools Protocol.

- It can also be configured to use full (non-headless) Chrome or Chromium.

NOTE : **The cli takes **IMDb URI**, validates it and then scrapes contents to displays it in the output table.**

> **Checkout the previews [here](./previews).**

---

## How to run?

- **Install dependencies**

  ```bash

      npm install

  ```

  **OR**

  ```

      npm i --save

  ```

- **Run the Script**

  ```bash

   npm run start

  ```

---

## Preview

> ![web scraping](./previews/success2.gif)

---

## [Application Info](https://github.com/akashchouhan16/WebScraping-CLI "Web Scraping CLI")

[![forthebadge](https://forthebadge.com/images/badges/made-with-javascript.svg)](https://forthebadge.com)

[![forthebadge](https://forthebadge.com/images/badges/compatibility-betamax.svg)](https://forthebadge.com)

### Version

**[1.0.3](https://github.com/akashchouhan16/WebScraping-CLI#readme, "Web Scraping CLI v1.0.3")**

### Licence

**[MIT](https://github.com/akashchouhan16/WebScraping-CLI/blob/master/LICENSE.md, "View LICENSE")**