Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/tokenmill/crawling-framework-example
Demonstration on how to use the Crawling Framework to setup a simple science news crawler and store results in ElasticSearch. Use this configuration to set up your own crawler.
https://github.com/tokenmill/crawling-framework-example
crawler crawling-framework elasticsearch storm-crawler
Last synced: 4 days ago
JSON representation
Demonstration on how to use the Crawling Framework to setup a simple science news crawler and store results in ElasticSearch. Use this configuration to set up your own crawler.
- Host: GitHub
- URL: https://github.com/tokenmill/crawling-framework-example
- Owner: tokenmill
- License: other
- Created: 2017-10-26T08:31:49.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2019-09-04T10:48:45.000Z (about 5 years ago)
- Last Synced: 2024-05-07T18:28:17.864Z (6 months ago)
- Topics: crawler, crawling-framework, elasticsearch, storm-crawler
- Language: Java
- Homepage:
- Size: 179 KB
- Stars: 3
- Watchers: 4
- Forks: 0
- Open Issues: 0