https://github.com/guru107/hadoop-small-files-merger

A Spark application to merge small files on Hadoop
https://github.com/guru107/hadoop-small-files-merger

apache-hadoop apache-spark avro parquet scala text

Last synced: 2 months ago
JSON representation

A Spark application to merge small files on Hadoop

• Host: GitHub
• URL: https://github.com/guru107/hadoop-small-files-merger
• Owner: Guru107
• License: mit
• Created: 2019-09-24T03:50:08.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2020-09-07T12:02:13.000Z (over 4 years ago)
• Last Synced: 2023-08-12T22:04:55.507Z (over 1 year ago)
• Topics: apache-hadoop, apache-spark, avro, parquet, scala, text
• Language: Scala
• Homepage:
• Size: 101 KB
• Stars: 10
• Watchers: 2
• Forks: 2
• Open Issues: 1

Awesome Lists containing this project