https://github.com/mmolimar/kafka-connect-fs

Kafka Connect FileSystem Connector
https://github.com/mmolimar/kafka-connect-fs

apache-kafka azure-storage confluent files filesystem ftp gcp hadoop hadoop-filesystem hdfs kafka kafka-connect kafka-connect-fs kafka-connector s3

Last synced: 3 months ago
JSON representation

Kafka Connect FileSystem Connector

• Host: GitHub
• URL: https://github.com/mmolimar/kafka-connect-fs
• Owner: mmolimar
• License: apache-2.0
• Created: 2017-03-13T04:27:04.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2022-11-07T07:27:01.000Z (over 1 year ago)
• Last Synced: 2024-01-18T15:44:13.086Z (5 months ago)
• Topics: apache-kafka, azure-storage, confluent, files, filesystem, ftp, gcp, hadoop, hadoop-filesystem, hdfs, kafka, kafka-connect, kafka-connect-fs, kafka-connector, s3
• Language: Java
• Homepage:
• Size: 524 KB
• Stars: 111
• Watchers: 11
• Forks: 78
• Open Issues: 22
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Lists

• awesome-kafka - FileSystem

README

        
# Kafka Connect FileSystem Connector [![Build Status](https://travis-ci.org/mmolimar/kafka-connect-fs.svg?branch=master)](https://travis-ci.org/mmolimar/kafka-connect-fs)[![Coverage Status](https://coveralls.io/repos/github/mmolimar/kafka-connect-fs/badge.svg?branch=master)](https://coveralls.io/github/mmolimar/kafka-connect-fs?branch=master)

**kafka-connect-fs** is a [Kafka Connector](https://kafka.apache.org/documentation.html#connect)

for reading records from files in the file systems specified and load them into Kafka.

Documentation for this connector can be found [here](https://kafka-connect-fs.readthedocs.io/).

## Development

To build a development version you'll need a recent version of Kafka. You can build

kafka-connect-fs with Maven using the standard lifecycle phases.

## FAQ

Some frequently asked questions on Kafka Connect FileSystem Connector can be found here -

https://kafka-connect-fs.readthedocs.io/en/latest/faq.html

## Contribute

- Source Code: https://github.com/mmolimar/kafka-connect-fs

- Issue Tracker: https://github.com/mmolimar/kafka-connect-fs/issues

## License

Released under the Apache License, version 2.0.