https://github.com/sbcd90/siddhi-kafka-cep
This is a simple CEP Engine leveraging the Kafka Streams platform
https://github.com/sbcd90/siddhi-kafka-cep
cep kafka siddhi streams
Last synced: 9 months ago
JSON representation
This is a simple CEP Engine leveraging the Kafka Streams platform
- Host: GitHub
- URL: https://github.com/sbcd90/siddhi-kafka-cep
- Owner: sbcd90
- Created: 2017-04-25T23:45:50.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2017-04-25T23:57:19.000Z (about 9 years ago)
- Last Synced: 2025-08-30T22:23:36.238Z (11 months ago)
- Topics: cep, kafka, siddhi, streams
- Language: Java
- Size: 66.4 KB
- Stars: 16
- Watchers: 4
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
siddhi-kafka-cep
================
- This is a simple CEP Engine leveraging the [Kafka Streams](http://docs.confluent.io/3.2.0/streams/) platform.
Key Features
============
- This project integrates Kafka Streams with [WSO2 Siddhi CEP Engine](https://github.com/wso2/siddhi) and allows the
users to leverage the best features of both platforms.
- The complex CEP patterns supported by Siddhi ([link](https://docs.wso2.com/display/CEP310/Queries)) can be used for
processing events.
Getting started
===============
- Compile the cep engine with maven.
```
mvn clean install
```
- Start the cep engine with the scripts in the `scripts` directory.
- Create a siddhi rule using the command
```
java -cp example-1.0-SNAPSHOT-jar-with-dependencies.jar org.apache.kafka.SiddhiRuleGenerator
```
- Start the event receiver using the command
```
java -cp example-1.0-SNAPSHOT-jar-with-dependencies.jar org.apache.kafka.SiddhiStreamsDataReceiver
```
- Publish data to the Engine using the command
```
java -cp example-1.0-SNAPSHOT-jar-with-dependencies.jar org.apache.kafka.SiddhiStreamDataGenerator
```
Architecture
============
Api
===
- The Java api documentation to create a new Siddhi Rule can be found [here](siddhi-kafka-rule-manager/src/main/java/org/apache/kafka/interfaces/SiddhiRuleProducer.java).
- The Java api documentation to publish & receive data from the CEP Engine can be found [here](siddhi-kafka-streams-executor/src/main/java/org/apache/kafka/interfaces/SiddhiStreamsProducer.java)
& [here](siddhi-kafka-streams-executor/src/main/java/org/apache/kafka/interfaces/SiddhiStreamsConsumer.java).
Examples
========
- Examples for using the Java api s can be found the [example](example) directory.
Using Kafka Producers & Consumers
=================================
- The standard Kafka Producers & Consumers can also be used to publish & retrieve
data out of this engine.
Rest Api
========
- A simple REST server is included with this project.
## Getting started with the Rest server
- Run the maven jetty plugin to start the server.
```
mvn jetty:run
```
## Payloads
- To create a Siddhi Rule:
POST http://localhost:8080/cep/{streamId}/rule
Body:
```
{
"topic": "t1",
"bootstrapServers": "localhost:9092",
"definitions": ["define stream siddhiStream1 (symbol string, price double, volume long);"],
"rule": "@info(name = 'query1') from siddhiStream1[price < 20.0] select symbol, price, volume insert into outputStream"
}
```
- To post streams of data:
POST http://localhost:8085/cep/{streamId}/stream/data
Body:
```
{
"topic": "t1",
"bootstrapServers": "localhost:9092",
"data": [["Rectangle", 19.0, 19], ["Square", 21.0, 21]]
}
```