https://github.com/valtri/cesnet-hadoop_lib

Common Hadoop pupept module
https://github.com/valtri/cesnet-hadoop_lib

Last synced: 11 months ago
JSON representation

Common Hadoop pupept module

• Host: GitHub
• URL: https://github.com/valtri/cesnet-hadoop_lib
• Owner: valtri
• License: mit
• Created: 2015-10-04T19:24:35.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2015-10-04T20:02:20.000Z (over 10 years ago)
• Last Synced: 2025-04-01T10:47:31.029Z (about 1 year ago)
• Language: Ruby
• Size: 133 KB
• Stars: 0
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.markdown
  • Changelog: CHANGELOG
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

README

          
#### Table of Contents

1. [Module Description - What the module does and why it is useful](#module-description)

2. [Setup - The basics of getting started with hadoop\_lib](#setup)

    * [What hadoop\_lib affects](#what-hadoop_lib-affects)

3. [Usage - Beginning, configuration options, and additional functionality](#usage)

4. [Reference - An under-the-hood peek at what the module is doing and how](#reference)

    * [Classes](#classes)

     * [hadoop\_lib::env](#class-env)

    * [Resource Types](#resources)

     * [hadoop\_lib::postinstall](#resource-postinstall)

5. [Limitations - OS compatibility, etc.](#limitations)

6. [Development - Guide for contributing to the module](#development)



## Module Description

Common puppet library for Hadoop and its addons. It manages alternatives as used in Cloudera and provides necessary environment variables.



## Setup



### What hadoop\_lib affects

* Files created:

 * */etc/profile.d/hadoop.sh*

 * */etc/profile.d/hadoop.csh*

* Alternatives (*postinstall* resource type):

 * */etc/<NAME>/conf*: it can be switched to the new alternative, so original configuration is kept intact



## Usage

    include ::hadoop_lib

    Package['hive']

    ->

    ::hadoop_lib::postinstall { 'hive':

      alternatives => 'cluster',

    }

    ::hadoop_lib::env



## Reference



###Classes

* [**`hadoop_lib`**](#class-hadoop_lib): Common setup steps



###Resources

* [**`hadoop_lib::postinstall`**](#resource-postinstall): Post-installation steps



### hadoop\_lib

#### Parameters

(none)



### hadoop\_lib::postinstall

#### Parameters

#####`alternatives`

Switches the alternatives used for the configuration. Default: 'cluster' (Debian) or undef.

It can be used only when supported (for example with Cloudera distribution).



## Development



##Development

* Repository: [https://github.com/MetaCenterCloudPuppet/cesnet-hadoop\_lib](https://github.com/MetaCenterCloudPuppet/cesnet-hadoop_lib)

* Tests:

 * basic: see *.travis.yml*

 * vagrant: [https://github.com/MetaCenterCloudPuppet/hadoop-tests](https://github.com/MetaCenterCloudPuppet/hadoop-tests)

* Email: František Dvořák <valtri@civ.zcu.cz>