https://github.com/yordadev/fenrisjs

A NodeJS application that scrapes any links from a given input and outputs the results nicely into one of two files, external or internal file for further analysis.
https://github.com/yordadev/fenrisjs

analysis crawler link-collection link-crawler nodejs nodejs-application

Last synced: 10 days ago
JSON representation

A NodeJS application that scrapes any links from a given input and outputs the results nicely into one of two files, external or internal file for further analysis.

• Host: GitHub
• URL: https://github.com/yordadev/fenrisjs
• Owner: yordadev
• Created: 2020-11-04T19:16:37.000Z (about 4 years ago)
• Default Branch: master
• Last Pushed: 2020-11-17T17:55:44.000Z (about 4 years ago)
• Last Synced: 2024-11-11T21:42:49.435Z (2 months ago)
• Topics: analysis, crawler, link-collection, link-crawler, nodejs, nodejs-application
• Language: JavaScript
• Homepage:
• Size: 8.79 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# FenrisS

FenrisJs is a simple NodeJS application that scrapes any links from a given domain and outputs the results nicely into one of two files, external or internal file for further analysis.

## Usage

```sh

node fenris.js https://example.com

```

## Notes

If you want to expand this project into a larger crawlere or spider, [This is where to look.](https://github.com/yordadev/FenrisJS/blob/38e352704c31033b2e59deb438392cdfd6e51dcd/fenris.js#L64)

## Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.