https://github.com/fog/fog-hadoop

Fog connector for Hadoop
https://github.com/fog/fog-hadoop

Last synced: about 1 year ago
JSON representation

Fog connector for Hadoop

• Host: GitHub
• URL: https://github.com/fog/fog-hadoop
• Owner: fog
• License: mit
• Created: 2017-03-01T18:32:24.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2023-01-27T14:35:48.000Z (over 3 years ago)
• Last Synced: 2025-06-06T23:04:08.262Z (about 1 year ago)
• Language: Ruby
• Size: 48.8 KB
• Stars: 2
• Watchers: 23
• Forks: 4
• Open Issues: 8
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# fog-hadoop

[![Gem Version](https://badge.fury.io/rb/fog-hadoop.svg)](https://badge.fury.io/rb/fog-hadoop)[![Build Status](https://travis-ci.org/fog/fog-hadoop.svg?branch=master)](https://travis-ci.org/fog/fog-hadoop) [![Code Climate](https://lima.codeclimate.com/github/fog/fog-hadoop/badges/gpa.svg)](https://lima.codeclimate.com/github/fog/fog-hadoop) [![Coverage Status](https://coveralls.io/repos/fog/fog-hadoop/badge.svg?branch=master&service=github)](https://coveralls.io/github/fog/fog-hadoop?branch=master)

## Fog connector for Hadoop

## Installation

Add this line to your application's Gemfile:

```ruby

gem 'fog-hadoop'

```

And then execute:

    $ bundle

Or install it yourself as:

    $ gem install fog-hadoop

## Usage

### Initial Setup

Require the gem:

```ruby

require "fog/hadoop"

```

Connection parameters:

```ruby

@connection_params = {

  hadoop_yarn_api_url:     "http://:8088/",

  hadoop_hdfs_api_url:     "http://:50070/"

}

```

* Use [Yarn](docs/yarn.md)    

* Use [HDFS](docs/hdfs.md)

 

# Support

Check in this [link](supported.md)

# Contribute

Read the [contribute](CONTRIBUTING.md) documentation

# Development

You can use this [Vagrant Hadoop](https://github.com/vangj/vagrant-hadoop-2.4.1-spark-1.0.1) repo to have a environment to dev.