Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/leandro-bertoluzzi/scrap-to-api
API to get the content of web pages via scraping
https://github.com/leandro-bertoluzzi/scrap-to-api
docker docker-compose nodejs puppeteer scraper
Last synced: 2 days ago
JSON representation
API to get the content of web pages via scraping
- Host: GitHub
- URL: https://github.com/leandro-bertoluzzi/scrap-to-api
- Owner: Leandro-Bertoluzzi
- License: mit
- Created: 2022-04-21T23:06:11.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2022-09-25T01:45:02.000Z (over 2 years ago)
- Last Synced: 2024-11-10T09:35:13.637Z (2 months ago)
- Topics: docker, docker-compose, nodejs, puppeteer, scraper
- Language: JavaScript
- Homepage:
- Size: 113 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
Scrap to API
🚧 Scrap to API 🚀 Under construction... 🚧
About  | Â
Features  | Â
Technologies  | Â
Requirements  | Â
Starting  | Â
License  | Â
Author
## :dart: About ##
Proxy API to get info from MAL (My Anime List) website via web scraping.
## :sparkles: Features ##
:heavy_check_mark: REST API\
:heavy_check_mark: Scraping of websites via Puppeteer## :rocket: Technologies ##
The following tools were used in this project:
- [Node.js](https://nodejs.org/en/)
- [Docker](https://www.docker.com/)
- [Puppeteer](https://github.com/puppeteer/puppeteer)## :white_check_mark: Requirements ##
Before starting :checkered_flag:, you need to have [Node](https://nodejs.org/en/) installed. You would also need [Docker](https://www.docker.com/) if you want to run the containers.
## :checkered_flag: Starting ##
```bash
# Clone this project
$ git clone https://github.com/Leandro-Bertoluzzi/scrap-to-api# Access
$ cd scrap-to-api# Run the project (option 1: With Docker compose)
$ docker-compose up# Run the project (option 2: With locally installed NPM)
$ cd api
$ npm run start:dev# In any case, the API will initialize in
```## :memo: License ##
This project is under license from MIT. For more details, see the [LICENSE](LICENSE.md) file.
Made with :heart: by Leandro Bertoluzzi