https://github.com/dbiir/jdbc-for-kafka

The java consumer API of kafka is tedious. This is an easy-to-use JDBC for kafka.
https://github.com/dbiir/jdbc-for-kafka

Last synced: about 1 month ago
JSON representation

The java consumer API of kafka is tedious. This is an easy-to-use JDBC for kafka.

• Host: GitHub
• URL: https://github.com/dbiir/jdbc-for-kafka
• Owner: dbiir
• License: apache-2.0
• Created: 2015-08-06T03:51:29.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2015-08-06T08:03:56.000Z (almost 10 years ago)
• Last Synced: 2025-03-27T15:04:30.389Z (about 2 months ago)
• Language: Java
• Size: 250 KB
• Stars: 4
• Watchers: 7
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# jdbc-for-kafka

The java consumer API of kafka is tedious. This is an easy-to-use JDBC for kafka. 

## Dependency

This jdbc relies on the SimpleConsumer in kafka.

So you have to use it with kafka_2.xx-0.x.x.x.jar, see https://www.apache.org/dyn/closer.cgi?path=/kafka/0.8.2.1/kafka_2.10-0.8.2.1.tgz

for downloading kafka, extract kafka, the jar-balls can be found in the libs sub directory.

## Usage

You can clone this repo, there is a jdbc-for-kafka-x.x.x.jar in the root directory. add this jar file and the kafka jar file into your java project.

Here is the example test code:

>       Class.forName("cn.edu.ruc.kafka.Driver");

        Properties info = new Properties();

        info.setProperty("role","consumer");

        info.setProperty("client.id", "12345");

        Connection conn = DriverManager.getConnection("kafka://log04:9092/test", info);

        Statement st = conn.createStatement();

        ResultSet rs = st.executeQuery(Query.GET_LEADER_PARTITIONS_METADATA);

        while (rs.next())

        {

                System.out.println(((Broker)rs.getObject("leader")).host() + ", " + rs.getInt("partitionId") + ", " + rs.getInt("sizeInBytes"));

        }

        st.close();

        conn.close();

        

A full example of using jdbc-for-kafka can be found in src/cn/edu/ruc/kafka/test/KafkaJDBCTest