Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/streamnative/awesome-pulsar

A curated list of Pulsar tools, integrations and resources.
https://github.com/streamnative/awesome-pulsar

List: awesome-pulsar

apache-bookkeeper apache-flink apache-kafka apache-pulsar apache-spark apache-storm elastic-beats grafana-dashboard messaging prometheus pub-sub spark spark-sql spark-structured-streaming

Last synced: 23 days ago
JSON representation

A curated list of Pulsar tools, integrations and resources.

Awesome Lists containing this project

README 

        
# Awesome Pulsar

[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fstreamnative%2Fawesome-pulsar.svg?type=shield)](https://app.fossa.io/projects/git%2Bgithub.com%2Fstreamnative%2Fawesome-pulsar?ref=badge_shield)



A curated list of Pulsar tools, integrations, and resources.



If you want to contribute, please read [this](CONTRIBUTING.md).



## Clients



The clients developed under ASF.



- [C++](http://pulsar.apache.org/docs/en/client-libraries-cpp/)

- [Go](http://pulsar.apache.org/docs/en/client-libraries-go/)

- [Java](http://pulsar.apache.org/docs/en/client-libraries-java/)

- [NodeJS](https://github.com/apache/pulsar-client-node)

- [Python](http://pulsar.apache.org/docs/en/client-libraries-python/)

- [Websocket](http://pulsar.apache.org/docs/en/client-libraries-websocket/)



Other clients:



- Go

  - [pulsar-client-go](https://github.com/Comcast/pulsar-client-go)

- Ruby

  - [ruby-pulsar-client](https://github.com/hiroakiwater/ruby-pulsar-client) ([@hiroakiwater](https://github.com/hiroakiwater))

  - [pulsar_sdk](https://github.com/archfish/pulsar_sdk)

- Rust

  - [pulsar-rs](https://github.com/wyyerd/pulsar-rs)

- Scala

  - [pulsar4s](https://github.com/sksamuel/pulsar4s)

- .NET

  - [pulsar-client-dotnet](https://github.com/fsharplang-ru/pulsar-client-dotnet)

  - [dotpulsar](https://github.com/danske-commodities/dotpulsar)



## Data Processing



- Pulsar Flink Integration:

  - [Flink 1.9+ Integration](https://github.com/streamnative/pulsar-flink): Streaming source and sink connector, streaming table support and catalog/schema integration.

  - [Flink 1.6 Integration](https://github.com/apache/pulsar/tree/master/examples/flink/src/main/java/org/apache/flink/batch/connectors/pulsar/example): A collection of streaming and batch connectors for [Apache Flink](http://flink.apache.org) processing streams in Pulsar. [batch](https://github.com/apache/pulsar/tree/master/examples/flink/src/main/java/org/apache/flink/batch/connectors/pulsar/example) and

  [streaming](https://github.com/apache/pulsar/tree/master/examples/flink/src/main/java/org/apache/flink/streaming/connectors/pulsar/example).

- Pulsar Spark Integration:

  - [pulsar-spark](http://pulsar.apache.org/docs/en/adaptors-spark/): A [Spark Streaming](http://spark.apache.org) receiver to receive data from Pulsar.

  - [streamnative/pulsar-spark](https://github.com/streamnative/pulsar-spark): Pulsar Spark Connector for [Spark SQL](https://spark.apache.org/sql/) and [Spark Structured Streaming](https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html).

- [pulsar-storm](http://pulsar.apache.org/docs/en/adaptors-storm): A Pulsar Spout and Bolt for integrating with [Apache Storm](http://storm.apache.org/) topologies.



## Interactive Query



- [pulsar-presto](http://pulsar.apache.org/docs/en/sql-overview/): A presto connector to query Pulsar topics using SQL



## Kafka



- [Kafka Compatibility wrapper](http://pulsar.apache.org/docs/en/adaptors-kafka/): A Java client wrapper that implement [Apache Kafka](http://kafka.apache.org) Java interface.

- [Kafka Pulsar Connector](http://pulsar.apache.org/docs/en/io-kafka/): Pulsar connectors that receive data from and send data to [Apache Kafka](http://kafka.apache.org)

- [Kafka Connect Adoptor](): A Pulsar Connector that adopts Kafka Connect api and run an existing Kafka connector as a Pulsar connector.



## Connectors



- [streamnative/pulsar-io-kafka](https://github.com/streamnative/pulsar-io-kafka): An enhanced version of pulsar-io-kafka connector to support copying data between Kafka and Pulsar with schema.

- [zwzch/fluent-plugin-pulsar](https://github.com/zwzch/fluent-plugin-pulsar): An enhanced version of fluent-plugin-pulsar connector to support copying data between Pulsar and Fluent.



## Logging



- [logstash-input-pulsar](https://github.com/se7enkings/logstash-input-pulsar): A logstash input that receives data from Pulsar.

- [pulsar-beat-output](https://github.com/streamnative/pulsar-beat-output): [Elastic Beats](https://github.com/elastic/beats) to Apache Pulsar.

- [pulsar-flume-ng-sink](https://github.com/streamnative/pulsar-flume-ng-sink): An [Apache Flume](https://github.com/apache/flume) Sink implementation to publish data to Pulsar.

- [pinterest/singer](https://github.com/pinterest/singer): A high-performance, reliable and extensible logging agent for uploading data to Kafka, Pulsar and other similar systems.



## Tools



### Dashboards



- [Pulsar Manager](https://github.com/streamnative/pulsar-manager): A web-based GUI management tool for managing and monitoring Pulsar.

- [Pulsar Express](https://github.com/bbonnin/pulsar-express): A simple web interface for Apache Pulsar, it is developed with [Nuxt.js](https://nuxtjs.org/) by [Bruno Bonnin](https://github.com/bbonnin).

- [Pulsar Dashboard](http://pulsar.apache.org/docs/en/administration-dashboard/): A web application that enables users to monitor the current stats of all topics in the tabular form.



### Monitoring



- [pulsar-grafana](http://pulsar.apache.org/docs/en/deploy-monitoring/#grafana): With the `pulsar-grafana` Docker image, you can create a dashboard driven by the data stored in Prometheus. It is enabled by default when deploying Pulsar on Kubernetes.

- [apache-pulsar-grafana-dashboard](https://github.com/streamnative/apache-pulsar-grafana-dashboard): Provides grafana dashboard templates for different Pulsar components running on both Kubernetes and on-premise machines.



## Source Code Analysis



- [Pulsar source code analysis / Pulsar 源码分析](https://github.com/kuangye098/Pulsar-analysis) by [@kuangye098](https://github.com/kuangye098)



## License

[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fstreamnative%2Fawesome-pulsar.svg?type=large)](https://app.fossa.io/projects/git%2Bgithub.com%2Fstreamnative%2Fawesome-pulsar?ref=badge_large)