Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/streamnative/awesome-pulsar

A curated list of Pulsar tools, integrations and resources.
https://github.com/streamnative/awesome-pulsar

List: awesome-pulsar

apache-bookkeeper apache-flink apache-kafka apache-pulsar apache-spark apache-storm elastic-beats grafana-dashboard messaging prometheus pub-sub spark spark-sql spark-structured-streaming

Last synced: 3 months ago
JSON representation

A curated list of Pulsar tools, integrations and resources.

Lists

README

        

# Awesome Pulsar
[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fstreamnative%2Fawesome-pulsar.svg?type=shield)](https://app.fossa.io/projects/git%2Bgithub.com%2Fstreamnative%2Fawesome-pulsar?ref=badge_shield)

A curated list of Pulsar tools, integrations, and resources.

If you want to contribute, please read [this](CONTRIBUTING.md).

## Clients

The clients developed under ASF.

- [C++](http://pulsar.apache.org/docs/en/client-libraries-cpp/)
- [Go](http://pulsar.apache.org/docs/en/client-libraries-go/)
- [Java](http://pulsar.apache.org/docs/en/client-libraries-java/)
- [NodeJS](https://github.com/apache/pulsar-client-node)
- [Python](http://pulsar.apache.org/docs/en/client-libraries-python/)
- [Websocket](http://pulsar.apache.org/docs/en/client-libraries-websocket/)

Other clients:

- Go
- [pulsar-client-go](https://github.com/Comcast/pulsar-client-go)
- Ruby
- [ruby-pulsar-client](https://github.com/hiroakiwater/ruby-pulsar-client) ([@hiroakiwater](https://github.com/hiroakiwater))
- [pulsar_sdk](https://github.com/archfish/pulsar_sdk)
- Rust
- [pulsar-rs](https://github.com/wyyerd/pulsar-rs)
- Scala
- [pulsar4s](https://github.com/sksamuel/pulsar4s)
- .NET
- [pulsar-client-dotnet](https://github.com/fsharplang-ru/pulsar-client-dotnet)
- [dotpulsar](https://github.com/danske-commodities/dotpulsar)

## Data Processing

- Pulsar Flink Integration:
- [Flink 1.9+ Integration](https://github.com/streamnative/pulsar-flink): Streaming source and sink connector, streaming table support and catalog/schema integration.
- [Flink 1.6 Integration](https://github.com/apache/pulsar/tree/master/examples/flink/src/main/java/org/apache/flink/batch/connectors/pulsar/example): A collection of streaming and batch connectors for [Apache Flink](http://flink.apache.org) processing streams in Pulsar. [batch](https://github.com/apache/pulsar/tree/master/examples/flink/src/main/java/org/apache/flink/batch/connectors/pulsar/example) and
[streaming](https://github.com/apache/pulsar/tree/master/examples/flink/src/main/java/org/apache/flink/streaming/connectors/pulsar/example).
- Pulsar Spark Integration:
- [pulsar-spark](http://pulsar.apache.org/docs/en/adaptors-spark/): A [Spark Streaming](http://spark.apache.org) receiver to receive data from Pulsar.
- [streamnative/pulsar-spark](https://github.com/streamnative/pulsar-spark): Pulsar Spark Connector for [Spark SQL](https://spark.apache.org/sql/) and [Spark Structured Streaming](https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html).
- [pulsar-storm](http://pulsar.apache.org/docs/en/adaptors-storm): A Pulsar Spout and Bolt for integrating with [Apache Storm](http://storm.apache.org/) topologies.

## Interactive Query

- [pulsar-presto](http://pulsar.apache.org/docs/en/sql-overview/): A presto connector to query Pulsar topics using SQL

## Kafka

- [Kafka Compatibility wrapper](http://pulsar.apache.org/docs/en/adaptors-kafka/): A Java client wrapper that implement [Apache Kafka](http://kafka.apache.org) Java interface.
- [Kafka Pulsar Connector](http://pulsar.apache.org/docs/en/io-kafka/): Pulsar connectors that receive data from and send data to [Apache Kafka](http://kafka.apache.org)
- [Kafka Connect Adoptor](): A Pulsar Connector that adopts Kafka Connect api and run an existing Kafka connector as a Pulsar connector.

## Connectors

- [streamnative/pulsar-io-kafka](https://github.com/streamnative/pulsar-io-kafka): An enhanced version of pulsar-io-kafka connector to support copying data between Kafka and Pulsar with schema.
- [zwzch/fluent-plugin-pulsar](https://github.com/zwzch/fluent-plugin-pulsar): An enhanced version of fluent-plugin-pulsar connector to support copying data between Pulsar and Fluent.

## Logging

- [logstash-input-pulsar](https://github.com/se7enkings/logstash-input-pulsar): A logstash input that receives data from Pulsar.
- [pulsar-beat-output](https://github.com/streamnative/pulsar-beat-output): [Elastic Beats](https://github.com/elastic/beats) to Apache Pulsar.
- [pulsar-flume-ng-sink](https://github.com/streamnative/pulsar-flume-ng-sink): An [Apache Flume](https://github.com/apache/flume) Sink implementation to publish data to Pulsar.
- [pinterest/singer](https://github.com/pinterest/singer): A high-performance, reliable and extensible logging agent for uploading data to Kafka, Pulsar and other similar systems.

## Tools

### Dashboards

- [Pulsar Manager](https://github.com/streamnative/pulsar-manager): A web-based GUI management tool for managing and monitoring Pulsar.
- [Pulsar Express](https://github.com/bbonnin/pulsar-express): A simple web interface for Apache Pulsar, it is developed with [Nuxt.js](https://nuxtjs.org/) by [Bruno Bonnin](https://github.com/bbonnin).
- [Pulsar Dashboard](http://pulsar.apache.org/docs/en/administration-dashboard/): A web application that enables users to monitor the current stats of all topics in the tabular form.

### Monitoring

- [pulsar-grafana](http://pulsar.apache.org/docs/en/deploy-monitoring/#grafana): With the `pulsar-grafana` Docker image, you can create a dashboard driven by the data stored in Prometheus. It is enabled by default when deploying Pulsar on Kubernetes.
- [apache-pulsar-grafana-dashboard](https://github.com/streamnative/apache-pulsar-grafana-dashboard): Provides grafana dashboard templates for different Pulsar components running on both Kubernetes and on-premise machines.

## Source Code Analysis

- [Pulsar source code analysis / Pulsar 源码分析](https://github.com/kuangye098/Pulsar-analysis) by [@kuangye098](https://github.com/kuangye098)

## License
[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fstreamnative%2Fawesome-pulsar.svg?type=large)](https://app.fossa.io/projects/git%2Bgithub.com%2Fstreamnative%2Fawesome-pulsar?ref=badge_large)