https://github.com/elek/bigdata-docker-consul
https://github.com/elek/bigdata-docker-consul
Last synced: 12 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/elek/bigdata-docker-consul
- Owner: elek
- Created: 2017-05-04T21:23:54.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2017-05-16T06:21:54.000Z (about 9 years ago)
- Last Synced: 2025-02-12T10:55:18.053Z (over 1 year ago)
- Language: Shell
- Size: 50.8 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Consul configuration for HADOOP clusters
Quick start:
1. Install docker to all hosts. For Ubuntu I use https://github.com/angstwad/docker.ubuntu
2. Install consul to the hosts (see the consul.yaml from https://github.com/elek/bigdata-docker/tree/master/infra-playbooks )
3. Install ```consync``` from https://github.com/elek/consync (most probably with clone and ```pip install .```)
4. Upload the configuration to the consul: ```consync /yourworkingdir/bigdata-docker/consul conf --url http://consulhost:8500/v1/kv``` (You need to set GATEWAY_HOST and DATA_DIR environment variables. The first is to No1 node with the master components, the second is a data directory which will be a docker volume for the persistent data)
5. Start the agents with agent.yaml from https://github.com/elek/bigdata-docker/tree/master/infra-playbooks (The docker-compose files will be downloaded from consul and the containers will be started)
6. It's possible that some components needs additional initialization (eg. namenode format). Do It Yourself.