https://github.com/confluentinc/kafka-connect-hdfs

Kafka Connect HDFS connector
https://github.com/confluentinc/kafka-connect-hdfs

apache-kafka big-data confluent hadoop hdfs kafka kafka-connect-hdfs kafka-connector streaming

Last synced: 4 months ago
JSON representation

Kafka Connect HDFS connector

• Host: GitHub
• URL: https://github.com/confluentinc/kafka-connect-hdfs
• Owner: confluentinc
• License: other
• Created: 2015-05-20T18:54:34.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2024-08-03T10:04:00.000Z (4 months ago)
• Last Synced: 2024-08-03T12:33:19.136Z (4 months ago)
• Topics: apache-kafka, big-data, confluent, hadoop, hdfs, kafka, kafka-connect-hdfs, kafka-connector, streaming
• Language: Java
• Homepage:
• Size: 2.26 MB
• Stars: 2
• Watchers: 163
• Forks: 395
• Open Issues: 158
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

• awesome-kafka - HDFS

README

        
# Kafka Connect HDFS Connector

kafka-connect-hdfs is a [Kafka Connector](http://kafka.apache.org/documentation.html#connect)

for copying data between Kafka and Hadoop HDFS.

Documentation for this connector can be found [here](http://docs.confluent.io/current/connect/connect-hdfs/docs/index.html).

# Development

To build a development version you'll need a recent version of Kafka as well as a set of upstream Confluent projects, which you'll have to build from their appropriate snapshot branch. See the [FAQ](https://github.com/confluentinc/kafka-connect-hdfs/wiki/FAQ) for guidance on this process.

You can build kafka-connect-hdfs with Maven using the standard lifecycle phases.

# FAQ

Refer frequently asked questions on Kafka Connect HDFS here -

https://github.com/confluentinc/kafka-connect-hdfs/wiki/FAQ

# Contribute

- Source Code: https://github.com/confluentinc/kafka-connect-hdfs

- Issue Tracker: https://github.com/confluentinc/kafka-connect-hdfs/issues

- Learn how to work with the connector's source code by reading our [Development and Contribution guidelines](CONTRIBUTING.md).

# License

This project is licensed under the [Confluent Community License](LICENSE).