https://github.com/opensciencegrid/gridftp-hdfs

HDFS plugin for the Globus GridFTP server.
https://github.com/opensciencegrid/gridftp-hdfs

gridftp hdfs software

Last synced: 3 days ago
JSON representation

HDFS plugin for the Globus GridFTP server.

• Host: GitHub
• URL: https://github.com/opensciencegrid/gridftp-hdfs
• Owner: opensciencegrid
• License: apache-2.0
• Created: 2014-08-27T18:20:30.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2020-05-28T21:16:22.000Z (over 5 years ago)
• Last Synced: 2024-04-16T19:14:04.021Z (almost 2 years ago)
• Topics: gridftp, hdfs, software
• Language: C
• Size: 289 KB
• Stars: 1
• Watchers: 5
• Forks: 9
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# GridFTP/HDFS

This provides a HDFS plugin for the Globus GridFTP server, allowing the Globus GridFTP server to read and

write directly into HDFS using the default `libhdfs` client.

This uses Globus GridFTP's DSI interface to implement the plugin, and utilizes the default HDFS configuration on the host.

Note this package contains the plugin code as well as the configuration and packaging scripts, targeting RedHat Enterprise Linux

and variants.  Particularly, the plugin requires `$CLASSPATH` to be configured correctly for the Globus GridFTP process: each

OS and Hadoop packaging variant may need the bootstrap scripts to be customized to get HDFS working.