Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/druid-io/tranquility
Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover, seamlessly and without downtime.
https://github.com/druid-io/tranquility
Last synced: 3 months ago
JSON representation
Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover, seamlessly and without downtime.
- Host: GitHub
- URL: https://github.com/druid-io/tranquility
- Owner: druid-io
- License: apache-2.0
- Created: 2014-02-13T21:30:05.000Z (over 10 years ago)
- Default Branch: master
- Last Pushed: 2020-01-13T10:29:28.000Z (almost 5 years ago)
- Last Synced: 2024-04-14T23:59:06.267Z (7 months ago)
- Language: Scala
- Homepage:
- Size: 1 MB
- Stars: 515
- Watchers: 59
- Forks: 234
- Open Issues: 103
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
README
## Tranquility
> “Stay close, my friends, and I will heal your wounds.”
> —Mythen of the Wild
Tranquility helps you send event streams to Druid, the raddest data store ever (http://druid.io/), in real-time. It
handles partitioning, replication, service discovery, and schema rollover for you, seamlessly and without downtime.
Tranquility is written in Scala, and bundles idiomatic Java and Scala APIs that work nicely with Finagle, Samza, Spark,
Storm, and Trident.
This project is a friend of Druid. For discussion, feel free to use the normal Druid channels: http://druid.io/community/
### Documentation
General:
- [Overview](docs/overview.md) - Introduction to Tranquility concepts, including details about how it creates and
manages Druid tasks.
- [Configuration](docs/configuration.md) - The first step to using Tranquility is to configure it appropriately for your
Druid dataSource. This is generally done through a configuration file, with optional refinements in code.
- [Troubleshooting](docs/trouble.md) - Solutions to common problems.
Modules:
- [Core](docs/core.md) - The most basic data-sending API. You will likely use this one unless you are using
one of the higher-level modules.
- [Server](docs/server.md) - HTTP server that allows you to use Tranquility without developing a JVM app.
- [Samza](docs/samza.md) - Tranquility includes a Samza SystemProducer.
- [Spark](docs/spark.md) - Tranquility works with RDDs and DStreams.
- [Storm](docs/storm.md) - Tranquility includes a Storm Bolt and a Trident State.
- [Kafka](docs/kafka.md) - Application to push messages from Kafka into Druid through Tranquility.
- [Flink](docs/flink.md) - Tranquility includes a Flink Sink.
### Getting Tranquility with Maven
Tranquility [Core](docs/core.md), [Samza](docs/samza.md), [Spark](docs/spark.md), [Storm](docs/storm.md) and
[Flink](docs/flink.md) are meant to be included in an application that you write. Those modules are hosted on Maven
Central to make them easy to include. The current stable versions are:
```xml
io.druid
tranquility-core_2.11
0.8.2
io.druid
tranquility-samza_2.11
0.8.2
io.druid
tranquility-spark_2.11
0.8.2
io.druid
tranquility-storm_2.11
0.8.2
io.druid
tranquility-flink_2.11
0.8.2
```
You only need to include the modules you are actually using.
All Tranquility modules are built for Scala 2.11.
This version is built to work with Druid 0.7.x and 0.8.x. If you are using Druid 0.6.x, you may want to use Tranquility
v0.3.2, which is the most recent version built for use with Druid 0.6.x.
Tranquility is built with [SBT](http://www.scala-sbt.org/). If you want to build the jars yourself, you can
run `sbt +package`. To build a distribution tarball, run `sbt ++2.11.8 'project distribution' universal:packageZipTarball`.
### Downloadable Distribution
The Tranquility downloadable distribution includes the [Server](docs/server.md) and [Kafka](docs/kafka.md) programs,
which are standalone programs that can be used without writing any code. You can download the distribution and
run them directly. The distribution also includes the [Core API](docs/core.md) artifacts, if you prefer to download
them rather than get them through Maven.
The current distribution is:
[tranquility-distribution-0.8.2](http://static.druid.io/tranquility/releases/tranquility-distribution-0.8.2.tgz).
To use it, first download it and then unpack it into your directory of choice by running
`tar -xzf tranquility-distribution-0.8.2.tgz`.
### How to Contribute
See [CONTRIBUTING.md](CONTRIBUTING.md).