https://github.com/0x3bfc/hadoop-utils

Apache Hadoop 2.6.0 Installation and configuration
https://github.com/0x3bfc/hadoop-utils

Last synced: 13 days ago
JSON representation

Apache Hadoop 2.6.0 Installation and configuration

• Host: GitHub
• URL: https://github.com/0x3bfc/hadoop-utils
• Owner: 0x3bfc
• Created: 2015-02-12T09:29:05.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2015-02-13T18:43:33.000Z (almost 10 years ago)
• Last Synced: 2023-08-03T19:35:36.091Z (over 1 year ago)
• Language: Python
• Size: 152 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# hutils

Python project to install and configure Apache Hadoop 2.6.0 on ubuntu cluster 

Pre-Installation

-----------------

1. You have to add new user called "hadoop" on all nodes, or any username but the name has to be the same on cluster's nodes.

2. Install a passwordless ssh among cluster's nodes.

3. Add Hosts to Hostsfile, Hosts file contains all hosts of your cluster as shown below 

        namenode

        slavenode1  

        slavenode2

        slavenode3

        .....

Installation:

-------------

First you have to install Apache Hadoop on slaves before master node, for each slave node run the following command line:  

    ./hadooputils.py --install=slave --hostname=slavenode1 --namenode=namenode

    

    INFO -- Start Apache Hadoop Pre-Installation ....

    INFO -- Install OpenJDK 7

    INFO -- Done

    INFO -- Download Apache Hadoop 2.6 ...

    INFO -- Done ...

    INFO -- Etract Apache Hadoop 2.6 ..

    INFO -- Done ...

    INFO -- Install and Configure Hadoop Env

    INFO -- Configure Hadoop Distributed File System...

    INFO -- Configure Hadoop core

    INFO -- Configur Hadoop MapReduce

The following lines 'll be shown during Hadoop installation Master node, run this command

    

    ./hadooputils.py --install=master --hosts=hostsfile.txt

    

    INFO -- setup hadoop core

    INFO -- Start Apache Hadoop Pre-Installation ....

    INFO -- Install OpenJDK 7

    INFO -- Done

    INFO -- Download Apache Hadoop 2.6 ...

    INFO -- Done ...

    INFO -- Etract Apache Hadoop 2.6 ..

    INFO -- Done ...

    INFO -- Install and Configure Hadoop Env

    INFO -- Configure Hadoop Distributed File System...

    INFO -- Configure Hadoop core

    INFO -- Configur Hadoop MapReduce

    INFO -- setup slaves list

    INFO -- Start all Apache Hadoop Services

Help:

-----

    

    	install Apache Hadoop on namenode "Master node"

    	-----------------------------------------------

    	./hadooputils.py 

    		--install=master 

    		--hosts=

    	

    	install hadoop on slave node

    	----------------------------

    	./hadooputils.py

    		--install=slave

    		--hostname=

    		--namenode=

    	

    	uninstall hadoop

    	----------------

    	./hadooputils.py

    		--clear