https://github.com/juliaparallel/elly.jl

Hadoop HDFS and Yarn client
https://github.com/juliaparallel/elly.jl

Last synced: 10 months ago
JSON representation

Hadoop HDFS and Yarn client

• Host: GitHub
• URL: https://github.com/juliaparallel/elly.jl
• Owner: JuliaParallel
• License: other
• Created: 2015-02-03T08:41:41.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2023-03-14T12:47:15.000Z (about 3 years ago)
• Last Synced: 2025-07-28T00:18:06.000Z (11 months ago)
• Language: Julia
• Homepage:
• Size: 423 KB
• Stars: 46
• Watchers: 9
• Forks: 12
• Open Issues: 7
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.md

Awesome Lists containing this project

README

          
# Elly

[![Build Status](https://travis-ci.org/JuliaParallel/Elly.jl.png)](https://travis-ci.org/JuliaParallel/Elly.jl)

Elly is a [Hadoop](https://hadoop.apache.org/) HDFS and Yarn client. It provides:

- A familiar Julia `ClusterManager` interface, making it possible to

  use the familiar Julia parallel constructs on any Hadoop/Yarn

  cluster: `addprocs`, `@parallel`, `spawn`, `pmap`, etc.

- Lower level APIs to write native Yarn applications.

- A familiar Julia IO API for accessing HDFS files. It is a pure Julia

  implementation with no dependencies on `libhdfs`.

# Using Elly

- [HDFS using Elly](HDFS.md)

- [Yarn Applications using Elly](YARN.md)

- [Julia Cluster Manager for Yarn](YARNCM.md)

# Requirements

- Since Elly uses the newer Protobuf interface, it requires a Hadoop 2.2+ distribution.