https://github.com/damiencarol/jsr203-hadoop
A Java NIO file system provider for HDFS
https://github.com/damiencarol/jsr203-hadoop
hadoop hdfs java nio
Last synced: 6 months ago
JSON representation
A Java NIO file system provider for HDFS
- Host: GitHub
- URL: https://github.com/damiencarol/jsr203-hadoop
- Owner: damiencarol
- License: apache-2.0
- Created: 2014-03-19T14:31:47.000Z (over 11 years ago)
- Default Branch: master
- Last Pushed: 2024-09-25T14:32:19.000Z (about 1 year ago)
- Last Synced: 2025-03-31T17:15:49.881Z (6 months ago)
- Topics: hadoop, hdfs, java, nio
- Language: Java
- Homepage: https://github.com/damiencarol/jsr203-hadoop
- Size: 28.1 MB
- Stars: 57
- Watchers: 10
- Forks: 38
- Open Issues: 12
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
jsr203-hadoop
=============
JSR 203 Implementation for Hadoop Distributed File System
[](https://travis-ci.org/damiencarol/jsr203-hadoop)
[](https://coveralls.io/github/damiencarol/jsr203-hadoop?branch=master)
[](https://maven-badges.herokuapp.com/maven-central/com.github.jsr203hadoop/jsr203hadoop/)
[](https://www.versioneye.com/user/projects/56c2fdbc18b2710036c8d4af)
[](https://www.codacy.com/app/damien-carol/jsr203-hadoop)
[](https://jitpack.io/#damiencarol/jsr203-hadoop)
#### Maven artifact
```xml
com.github.jsr203hadoop
jsr203hadoop
1.0.3
```
#### Prerequisites
`jsr203-hadoop` requires:
* Git
* Maven 3.0.4 (or higher)
* JDK 1.7 (or higher)
#### Download and build
```bash
$ git clone git://github.com/damiencarol/jsr203-hadoop.git
$ cd jsr203-hadoop
$ mvn install
```
Use `mvn -DskipTests` if you do not want to execute the tests.
#### Example
`jsr203-hadoop` provide NIO 2 access to your HDFS cluster. For
example, you can build URI starts with `hdfs://:` and use standard NIO API :
```java
URI uri = new URI("hdfs://" + host + ":" + port + "/somefile");
Path file = Paths.get(uri);
System.out.println("File [" + file.toString() + "] exists = '" + Files.exists(file) + "'");
```
#### Status
This project is still a beta.
The following features are complete.
| Feature | Status | Description |
|---------|--------|-------------|
| Path support - build from string/URI | Done ||
| Path support - resolve, relativize, equals, ... | Done |
| Directory stream (provide ability to list files in directory, get status, ...) | Done ||
| Create/delete file/directory | Done ||
| Input/Output | Partial | Full support of SeekableByteChannel, FileChannel pending |
| Attribute view "basic" | Done | Full support (fileKey is implemented) |
| Attribute view "owner" | Done | Full support (Use Hadoop UGI) |
| Attribute view "posix" | Done ||
| Hadoop dedicated view "hadoop" for hadoop specific attributes (len, block size, replication factor) | Done | More attributes will come |
More features will come :
* Security and permissions
* complete list of hadoop specific attributes
For more details, see the Reference guide.
#### More information
* License: Apache License, Version 2.0.
* Author: Damien Carol
* Source code: http://github.com/damiencarol/jsr203-hadoop
#### Ressources