https://github.com/perfectlysoft/perfect-hadoop
Perfect Hadoop: WebHDFS, MapReduce & Yarn.
https://github.com/perfectlysoft/perfect-hadoop
hadoop mapreduce perfect server-side-swift swift webhdfs yarn
Last synced: about 1 year ago
JSON representation
Perfect Hadoop: WebHDFS, MapReduce & Yarn.
- Host: GitHub
- URL: https://github.com/perfectlysoft/perfect-hadoop
- Owner: PerfectlySoft
- License: apache-2.0
- Created: 2016-11-18T20:07:11.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2018-02-09T18:02:54.000Z (over 8 years ago)
- Last Synced: 2025-04-08T18:51:16.309Z (about 1 year ago)
- Topics: hadoop, mapreduce, perfect, server-side-swift, swift, webhdfs, yarn
- Language: Swift
- Homepage: https://www.perfect.org
- Size: 217 KB
- Stars: 8
- Watchers: 4
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# PerfectHadoop [简体中文](README.zh_CN.md)
This project provides a set of Swift classes which enable access to Hadoop servers.
This package builds with Swift Package Manager and is part of the [Perfect](https://github.com/PerfectlySoft/Perfect) project. It was written to be stand-alone and so does not require PerfectLib or any other components.
Ensure you have installed and activated the latest Swift tool chain.
## Release Note
PerfectHadoop supports Hadoop 3.0.0 with a limitation on 2.7.3.
## Building
Add this project as a dependency in your Package.swift file.
``` swift
.Package(url:"https://github.com/PerfectlySoft/Perfect-Hadoop.git", majorVersion: 3)
```
Then please add the following line to the beginning part of swift sources:
``` swift
import PerfectHadoop
```
## Error Handle - `Exception`
In case of operation failure, an exception might be thrown out. In most cases of Perfect-Hadoop, the library would probably throw a `Exception` object. User can catch it and check a tuple `(url, header, body)` of the failure, as demo below:
``` swift
do {
// some Perfect Hadoop operations, including WebHDFS / MapReduce / YARN, all of them:
...
}
catch(Exception.unexpectedResponse(let (url, header, body))) {
print("Exception: \(url)\n\(header)\n\(body)")
}
catch (let err){
print("Other Error:\(err)")
}
```
## User Manual
- WebHDFS: [Perfect-HDFS](Doc/WebHDFS.md)
- MapReduce:
* [Perfect-MapReduce Application Master API](Doc/MapReduceMaster.md) ⚠️ Experimental ⚠️
* [Perfect-MapReduce History Server API](Doc/MapReduceHistory.md)
- YARN:
* [Perfect-YARN Node Manager](Doc/YARNNodeManager.md)
* [Perfect-YARN Resource Manager](Doc/YARNResourceManager.md)
## Further Information
For more information on the Perfect project, please visit [perfect.org](http://perfect.org).