https://github.com/kambojankit/hadoop-docker-cluster
A Project to provide a complete docker based Hadoop Environment
https://github.com/kambojankit/hadoop-docker-cluster
cluster docker hadoop
Last synced: 4 months ago
JSON representation
A Project to provide a complete docker based Hadoop Environment
- Host: GitHub
- URL: https://github.com/kambojankit/hadoop-docker-cluster
- Owner: kambojankit
- Created: 2017-10-01T13:36:39.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2018-03-23T12:43:25.000Z (over 7 years ago)
- Last Synced: 2025-01-11T07:17:58.036Z (6 months ago)
- Topics: cluster, docker, hadoop
- Language: Java
- Homepage:
- Size: 116 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
The HA Mode setup of the hadoop cluster
The cluster name is: hdcluster
The namenode nn1 is: master
The namenode nn2 is: smaster
Journal, Zookeeper and Data nodes are: slave1, slave2 and slave3
### Building Hadoop Baseline [./base]
- ./base directory contains the baseline hadoop, with hadoop distribution setup and required ports exposed.
- The docker image using this docker file is build by the name 'hadoop-base' under user 'ankitkamboj' using below command ```docker build -t ankitkamboj/hadoop-base ./base```
### Setup (High Availability Mode) [./base_ha]
- ```docker build -t ankitkamboj/hadoop-base-ha ./base_ha```
### Setup (Federation Mode) [./base_fed]
- ```docker build -t ankitkamboj/hadoop-base ./base```
- ```docker build -t ankitkamboj/hadoop-base-fed ./base_fed```
### Starting the cluster (High Availability Mode) [./hadoop_ha]
- ```docker build -t ankitkamboj/hadoop-ha ./hadoop_ha```
- ```docker-compose build```
- ```docker-compose up```
### Login to master node
- ```docker exec -it master /bin/bash```