https://github.com/ondiekelijah/web-scraping-with-node.js-guide

Node.js Web Scraping Guide repository
https://github.com/ondiekelijah/web-scraping-with-node.js-guide

cheerio puppeteer

Last synced: about 1 month ago
JSON representation

Node.js Web Scraping Guide repository

• Host: GitHub
• URL: https://github.com/ondiekelijah/web-scraping-with-node.js-guide
• Owner: ondiekelijah
• Created: 2024-08-19T05:44:46.000Z (3 months ago)
• Default Branch: main
• Last Pushed: 2024-09-19T10:19:18.000Z (about 2 months ago)
• Last Synced: 2024-10-10T20:01:44.024Z (about 1 month ago)
• Topics: cheerio, puppeteer
• Language: JavaScript
• Homepage:
• Size: 69.3 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Node.js Web Scraping Guide

This project contains a complete solution for web scraping using Node.js.

## Installation

Clone the repository:

```bash

git clone https://github.com/ondiekelijah/Web-Scraping-with-Node.js-Guide.git

```

Navigate to the project directory:

```bash

cd Web-Scraping-with-Node.js-Guide

```

Install the necessary dependencies:

```bash

npm install

```

# Running Scraping Tasks

You can run the different scraping tasks using Node.js. Below are the commands for each script:

1. Make HTTP Request

`node src/makeHttpRequest.js`

2. Scrape Static HTML

`node src/scrapeStaticHtml.js`

3. Scrape Dynamic HTML

`node src/scrapeDynamicHtml.js`

4. Scrape with Proxy

`node src/scrapeWithProxy.js`