https://github.com/yukihirai0505/streamcrawler
akka stream × crawler
https://github.com/yukihirai0505/streamcrawler
akka-streams crawler elasticsearch instagram sbt scala
Last synced: about 2 months ago
JSON representation
akka stream × crawler
- Host: GitHub
- URL: https://github.com/yukihirai0505/streamcrawler
- Owner: yukihirai0505
- Created: 2017-10-06T08:55:10.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2017-10-26T06:57:08.000Z (over 8 years ago)
- Last Synced: 2025-01-13T13:49:12.491Z (over 1 year ago)
- Topics: akka-streams, crawler, elasticsearch, instagram, sbt, scala
- Language: Scala
- Homepage:
- Size: 224 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Summary
Crawler service by akka stream.
## Elasticsearch
### How to setup
```
# 1. Install Elasticsearch
curl -L -O https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.6.1.tar.gz
tar -xvf elasticsearch-5.6.1.tar.gz
# 2. Intall plugins => Kuromoji & ICU And enable Script
cd elasticsearch-5.6.1
./bin/elasticsearch-plugin install analysis-kuromoji
./bin/elasticsearch-plugin install analysis-icu
echo "script.inline: true" >> config/elasticsearch.yml
```