https://github.com/MSurendra/kafka-connect-solr

Kafka connector for Solr Sink
https://github.com/MSurendra/kafka-connect-solr

Last synced: 2 months ago
JSON representation

Kafka connector for Solr Sink

• Host: GitHub
• URL: https://github.com/MSurendra/kafka-connect-solr
• Owner: MSurendra
• License: apache-2.0
• Created: 2016-04-22T04:21:38.000Z (over 8 years ago)
• Default Branch: master
• Last Pushed: 2016-06-17T04:46:57.000Z (over 8 years ago)
• Last Synced: 2024-08-03T03:04:33.085Z (6 months ago)
• Language: Java
• Size: 14.6 KB
• Stars: 16
• Watchers: 5
• Forks: 8
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-solr - Kafka Connector for Solr Sink - Kafka Connect Solr for writing data to Solr. (Projects)

README

        
# kafka-connect-solr

Kafka Connect Solr for writing data to Solr. The SolrSinkTask can be configured with the following configuration.




solr.cluster.url=http://localhost:8983/solr/kafka-solr/update/json?commit=true

solr.cluster.name=kafka-solr-sink-sample

bulk.size=500

action.type=insert

solr.doc.converter=com.apache.kafka.connect.solr.converter.SolrJsonDocConverter





`solr.doc.converter` is a `com.apache.kafka.connect.solr.converter.Converter` that needs to be configured. This will take a SinkRecord object and serialize it in to JSON bytes that can be written to Solr.

If the data in Kafka is already in JSON format then you can use the `com.apache.kafka.connect.solr.converter.SolrJsonDocConverter` that is available with this library.

If the data in Kafka is in Avro format then you can use the `com.apache.kafka.connect.solr.converter.SolrAvroJsonDocConverter` that is available with this library.