https://github.com/kambojankit/hadoop-docker-cluster

A Project to provide a complete docker based Hadoop Environment
https://github.com/kambojankit/hadoop-docker-cluster

cluster docker hadoop

Last synced: 9 days ago
JSON representation

A Project to provide a complete docker based Hadoop Environment

• Host: GitHub
• URL: https://github.com/kambojankit/hadoop-docker-cluster
• Owner: kambojankit
• Created: 2017-10-01T13:36:39.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2018-03-23T12:43:25.000Z (almost 7 years ago)
• Last Synced: 2024-11-12T09:46:53.966Z (2 months ago)
• Topics: cluster, docker, hadoop
• Language: Java
• Homepage:
• Size: 116 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
The HA Mode setup of the hadoop cluster

The cluster name is: hdcluster

The namenode nn1 is: master

The namenode nn2 is: smaster

Journal, Zookeeper and Data nodes are: slave1, slave2 and slave3

### Building Hadoop Baseline [./base]

- ./base directory contains the baseline hadoop, with hadoop distribution setup and required ports exposed. 

- The docker image using this docker file is build by the name 'hadoop-base' under user 'ankitkamboj' using below command ```docker build -t ankitkamboj/hadoop-base ./base```

### Setup (High Availability Mode) [./base_ha]

- ```docker build -t ankitkamboj/hadoop-base-ha ./base_ha```

### Setup (Federation Mode) [./base_fed]

- ```docker build -t ankitkamboj/hadoop-base ./base```

- ```docker build -t ankitkamboj/hadoop-base-fed ./base_fed```

### Starting the cluster (High Availability Mode) [./hadoop_ha]

- ```docker build -t ankitkamboj/hadoop-ha ./hadoop_ha```

- ```docker-compose build```

- ```docker-compose up```

### Login to master node 

- ```docker exec -it master /bin/bash```