https://github.com/confluentinc/kafka-connect-hdfs

Kafka Connect HDFS connector
https://github.com/confluentinc/kafka-connect-hdfs

apache-kafka big-data confluent hadoop hdfs kafka kafka-connect-hdfs kafka-connector streaming

Last synced: 3 months ago
JSON representation

Kafka Connect HDFS connector

• Host: GitHub
• URL: https://github.com/confluentinc/kafka-connect-hdfs
• Owner: confluentinc
• License: other
• Created: 2015-05-20T18:54:34.000Z (about 9 years ago)
• Default Branch: master
• Last Pushed: 2023-12-19T13:40:17.000Z (6 months ago)
• Last Synced: 2023-12-19T15:31:35.169Z (6 months ago)
• Topics: apache-kafka, big-data, confluent, hadoop, hdfs, kafka, kafka-connect-hdfs, kafka-connector, streaming
• Language: Java
• Homepage:
• Size: 2.07 MB
• Stars: 473
• Watchers: 315
• Forks: 399
• Open Issues: 154
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Codeowners: .github/CODEOWNERS

Lists

• awesome-kafka - HDFS
• awesome-stars - confluentinc/kafka-connect-hdfs - Kafka Connect HDFS connector (Java)
• awesome-repositories - confluentinc/kafka-connect-hdfs - Kafka Connect HDFS connector (Java)

README

        
# Kafka Connect HDFS Connector

kafka-connect-hdfs is a [Kafka Connector](http://kafka.apache.org/documentation.html#connect)

for copying data between Kafka and Hadoop HDFS.

Documentation for this connector can be found [here](http://docs.confluent.io/current/connect/connect-hdfs/docs/index.html).

# Development

To build a development version you'll need a recent version of Kafka as well as a set of upstream Confluent projects, which you'll have to build from their appropriate snapshot branch. See the [FAQ](https://github.com/confluentinc/kafka-connect-hdfs/wiki/FAQ) for guidance on this process.

You can build kafka-connect-hdfs with Maven using the standard lifecycle phases.

# FAQ

Refer frequently asked questions on Kafka Connect HDFS here -

https://github.com/confluentinc/kafka-connect-hdfs/wiki/FAQ

# Contribute

- Source Code: https://github.com/confluentinc/kafka-connect-hdfs

- Issue Tracker: https://github.com/confluentinc/kafka-connect-hdfs/issues

- Learn how to work with the connector's source code by reading our [Development and Contribution guidelines](CONTRIBUTING.md).

# License

This project is licensed under the [Confluent Community License](LICENSE).