{"id":16835828,"url":"https://github.com/barakmich/go-hdfs","last_synced_at":"2026-03-08T11:32:00.093Z","repository":{"id":57514594,"uuid":"142786037","full_name":"barakmich/go-hdfs","owner":"barakmich","description":"Fast HDFS CLI ","archived":false,"fork":false,"pushed_at":"2018-09-07T04:41:54.000Z","size":527,"stargazers_count":6,"open_issues_count":0,"forks_count":2,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-11T05:05:56.689Z","etag":null,"topics":["cli","golang","hdfs"],"latest_commit_sha":null,"homepage":null,"language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/barakmich.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-07-29T18:33:22.000Z","updated_at":"2022-11-13T01:19:41.000Z","dependencies_parsed_at":"2022-09-06T03:02:05.196Z","dependency_job_id":null,"html_url":"https://github.com/barakmich/go-hdfs","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/barakmich%2Fgo-hdfs","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/barakmich%2Fgo-hdfs/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/barakmich%2Fgo-hdfs/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/barakmich%2Fgo-hdfs/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/barakmich","download_url":"https://codeload.github.com/barakmich/go-hdfs/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248345267,"owners_count":21088244,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cli","golang","hdfs"],"created_at":"2024-10-13T12:11:24.311Z","updated_at":"2026-03-08T11:32:00.086Z","avatar_url":"https://github.com/barakmich.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# go-hdfs\nA fast HDFS CLI \n\n## What is this?\nThis is Cobra CLI for [http://github.com/colinmarc/hdfs]. colinmarc/hdfs is a great library, but the CLI left a lot to be desired. In the spirit of Go, this package has no vendoring, and will use the master branch of the upstream HDFS library (and Cobra, incidentally), so it's functionally equivalent.\n\nThe advantage of this CLI is both its usability and that it'll be easy to drop in as a static client into a container; HDFS control with no need for Java.\n\n## What are the goals of this instead of upstream?\n\nThis package won't depend on an `hdfs-site.xml` for configuration -- while it will support one that exists by default (as does upstream), it will also be fully configured by environment variables and command line flags. This is super useful for containerized environments and Kubernetes.\n\nFlags defined in the Java client will have the same functionality, and may have long flag versions. Flags added to this CLI will follow GNU coreutils usage, as opposed to strict POSIX, which is what upstream prefers.\n\n##\nUsage:\n\n```\n$ hdfs\nGoHDFS is a very fast client for HDFS clusters\n\nUsage:\n  gohdfs [flags]\n  gohdfs [command]\n\nAvailable Commands:\n  cat         concatenate HDFS files and print on the standard output\n  checksum    calculate the checksum of the HDFS files\n  chmod       change HDFS file mode bits\n  chown       change HDFS file owner and group\n  df          concatenate HDFS files and print on the standard output\n  du          estimate HDFS space usage\n  get         get files from HDFS to the local filesystem\n  getmerge    get a directory from HDFS and merge the files into a single local file\n  head        output the first part of HDFS files\n  help        Help about any command\n  ls          list HDFS directory contents\n  mkdir       make HDFS directories\n  mv          move HDFS files\n  put         put files from local filesystem to HDFS\n  rm          remove HDFS files or directories\n  tail        output the last part of HDFS files\n  touch       create HDFS files and modify their timestamps\n\nFlags:\n  -h, --help      help for gohdfs\n      --version   version for gohdfs\n\nUse \"gohdfs [command] --help\" for more information about a command.\n```\n\nSubcommands and help:\n```\n$ hdfs mv --help\nmove HDFS files\n\nUsage:\n  gohdfs mv [-fT] SOURCE... DEST\n\nFlags:\n  -h, --help                  help for mv\n  -n, --no-clobber            do not overwrite an existing file\n  -T, --no-target-directory   treat DEST as a normal file\n```\n\n\nCompared to upstream:\n\n```\n$ hdfs mv --help\nunknown option: -\nUsage: ./hdfs COMMAND\nThe flags available are a subset of the POSIX ones, but should behave similarly.\n\nValid commands:\n  ls [-lah] [FILE]...\n  rm [-rf] FILE...\n  mv [-nT] SOURCE... DEST\n  mkdir [-p] FILE...\n  touch [-amc] FILE...\n  chmod [-R] OCTAL-MODE FILE...\n  chown [-R] OWNER[:GROUP] FILE...\n  cat SOURCE...\n  head [-n LINES | -c BYTES] SOURCE...\n  tail [-n LINES | -c BYTES] SOURCE...\n  du [-sh] FILE...\n  checksum FILE...\n  get SOURCE [DEST]\n  getmerge SOURCE DEST\n  put SOURCE DEST\n  df [-h]\n```\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbarakmich%2Fgo-hdfs","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbarakmich%2Fgo-hdfs","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbarakmich%2Fgo-hdfs/lists"}