https://github.com/maltsev-dev/api_scraper_template
Spring-boot API data crawler
https://github.com/maltsev-dev/api_scraper_template
data-crawling mvc-architecture rest-api spring-boot
Last synced: 5 months ago
JSON representation
Spring-boot API data crawler
- Host: GitHub
- URL: https://github.com/maltsev-dev/api_scraper_template
- Owner: maltsev-dev
- Created: 2023-06-08T06:12:23.000Z (about 3 years ago)
- Default Branch: master
- Last Pushed: 2023-06-08T06:31:51.000Z (about 3 years ago)
- Last Synced: 2025-03-12T07:18:51.271Z (over 1 year ago)
- Topics: data-crawling, mvc-architecture, rest-api, spring-boot
- Language: Java
- Homepage:
- Size: 4.88 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
Awesome Lists containing this project
README
## api-response scraper ###
* SpringBoot
* Java 11
* Maven
* Apache POI
* Rest-Assured
* Lombok
* Log4j
### functionalities
* Scheduled
* Store URLs in application.properties
* ApiController sends prepared CRUD request to API
* Response schema validation
* DataStorageImpl convert Response to POJO
* Create XLSX or find existed file in project dir
* Add new row of POJO Data to the end of the file.
### how to run
* Create Maven project
* Add dependencies
* Configure project directories
* Start as SpringBoot Application
* Save as .jar file
* Create Docker Image
* Run as Docker Container