https://github.com/sebalp100/search-test

Simple NodeJs api to do web scraping
https://github.com/sebalp100/search-test

Last synced: about 1 month ago
JSON representation

Simple NodeJs api to do web scraping

• Host: GitHub
• URL: https://github.com/sebalp100/search-test
• Owner: sebalp100
• License: mit
• Created: 2024-05-13T16:07:35.000Z (6 months ago)
• Default Branch: dev
• Last Pushed: 2024-05-14T01:19:46.000Z (6 months ago)
• Last Synced: 2024-05-14T23:10:54.179Z (6 months ago)
• Language: JavaScript
• Homepage:
• Size: 39.1 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
This basic NodeJs API allows users to scrape data from websites and store it in MongoDB.

env variables used:

- `DATABASE_URL=` the mongoDb url for connection

- `JWT_SECRET_KEY=` the secret for the jwt creation

Endpoints:

- `http://localhost:5000/api/auth/register` to register

- `http://localhost:5000/api/auth/login` to login

- `http://localhost:5000/api/crawl` to extract data from a URL