An open API service indexing awesome lists of open source software.

https://github.com/bchoubert/simple-nodejs-crawler


https://github.com/bchoubert/simple-nodejs-crawler

Last synced: 3 months ago
JSON representation

Awesome Lists containing this project

README

        

# simple-nodejs-crawler

## Uses

This simple web crawler project might be used in bigger projects or to get some HTML code from other websites.

## Installation

After running the command ``` npm install ``` , start the project with ``` npm start ``` (that redirects to ``` node index.js```).

You can navigate to ```http://localhost:3000/crawler?url=https://www.google.com``` to see the Google welcome page. Replace the ```url``` GET parameter to change the page.