Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/leandro-bertoluzzi/scrap-to-api

API to get the content of web pages via scraping
https://github.com/leandro-bertoluzzi/scrap-to-api

docker docker-compose nodejs puppeteer scraper

Last synced: 2 days ago
JSON representation

API to get the content of web pages via scraping

Awesome Lists containing this project

README

        

Scrap to API


Github top language

Github language count

Repository size

License


🚧 Scrap to API 🚀 Under construction... 🚧



About   |  
Features   |  
Technologies   |  
Requirements   |  
Starting   |  
License   |  
Author


## :dart: About ##

Proxy API to get info from MAL (My Anime List) website via web scraping.

## :sparkles: Features ##

:heavy_check_mark: REST API\
:heavy_check_mark: Scraping of websites via Puppeteer

## :rocket: Technologies ##

The following tools were used in this project:

- [Node.js](https://nodejs.org/en/)
- [Docker](https://www.docker.com/)
- [Puppeteer](https://github.com/puppeteer/puppeteer)

## :white_check_mark: Requirements ##

Before starting :checkered_flag:, you need to have [Node](https://nodejs.org/en/) installed. You would also need [Docker](https://www.docker.com/) if you want to run the containers.

## :checkered_flag: Starting ##

```bash
# Clone this project
$ git clone https://github.com/Leandro-Bertoluzzi/scrap-to-api

# Access
$ cd scrap-to-api

# Run the project (option 1: With Docker compose)
$ docker-compose up

# Run the project (option 2: With locally installed NPM)
$ cd api
$ npm run start:dev

# In any case, the API will initialize in
```

## :memo: License ##

This project is under license from MIT. For more details, see the [LICENSE](LICENSE.md) file.

Made with :heart: by Leandro Bertoluzzi

Back to top