https://github.com/grycap/ansible-role-hadoop
Ansible Role to install a Hadoop Cluster
https://github.com/grycap/ansible-role-hadoop
Last synced: about 1 year ago
JSON representation
Ansible Role to install a Hadoop Cluster
- Host: GitHub
- URL: https://github.com/grycap/ansible-role-hadoop
- Owner: grycap
- License: apache-2.0
- Created: 2016-12-07T18:53:38.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2024-07-22T11:35:19.000Z (almost 2 years ago)
- Last Synced: 2025-03-27T15:49:14.363Z (about 1 year ago)
- Language: Shell
- Size: 53.7 KB
- Stars: 16
- Watchers: 7
- Forks: 14
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
[](https://www.apache.org/licenses/LICENSE-2.0)
[](https://github.com/grycap/ansible-role-hadoop/actions?query=workflow%3ACI)
Hadoop Cluster Role
===================
Installs and configure Hadoop system (version 2.X) in a cluster of nodes.
Role Variables
--------------
The variables that can be passed to this role and a brief description about them are as follows:
# The type of the node: slave or master or resourcemanager or nodemanager or datanode or namenode
hadoop_type_of_node: slave
# Hadoop base directory to install the software
hadoop_home: /opt/hadoop-2.X
# List of servers to download the hadoop code
hadoop_mirrors: [ "http://mirror.cc.columbia.edu/pub/software/apache/hadoop/core/stable/",
"http://ftp.osuosl.org/pub/apache/hadoop/core/stable/",
"http://apache.rediris.es/hadoop/core/stable/",
"http://apache.uvigo.es/hadoop/common/stable/" ]
# Hadoop version to install
hadoop_version: latest
# A dictionary with a set of properties to set in the core-site.xml
hdfs_props: {}
# A dictionary with a set of properties to set in the yarn-site.xml
yarn_props: {}
# List of slave nodes
hadoop_slave_nodes: "{{ groups['all']|map('extract', hostvars,'ansible_hostname')|list }}"
Example Playbook
----------------
This an example of how to install the Cluster:
In the "Worker Nodes"
```yml
roles:
- { role: 'grycap.hadoop', hadoop_master: 'MASTER_NODE_NAME_OR_IP' }
```
In the "Manager Node"
```yml
roles:
- { role: 'grycap.hadoop', hadoop_master: 'MASTER_NODE_NAME_OR_IP', hadoop_type_of_node: 'master'}
```
Contributing to the role
========================
In order to keep the code clean, pushing changes to the master branch has been disabled. If you want to contribute, you have to create a branch, upload your changes and then create a pull request.
Thanks