Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/apache/incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://github.com/apache/incubator-streampark

apache development-framework easy-to-use etl-pipeline operation-platform streaming streampark

Last synced: 23 days ago
JSON representation

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.

Awesome Lists containing this project

README

        


StreamPark Logo


A magical framework that makes stream processing easier!

[![Stars](https://img.shields.io/github/stars/apache/streampark?style=for-the-badge&label=stars)](https://github.com/apache/incubator-streampark/stargazers)
[![Latest release](https://img.shields.io/github/v/release/apache/streampark.svg?style=for-the-badge&label=release)](https://github.com/apache/incubator-streampark/releases)
[![Total Downloads](https://img.shields.io/github/downloads/apache/streampark/total.svg?style=for-the-badge&label=downloads)](https://streampark.apache.org/download)
[![Twitter Follow](https://img.shields.io/twitter/follow/ASFStreamPark?label=follow&logo=x&style=for-the-badge)](https://twitter.com/ASFStreamPark)

**[Website](https://streampark.apache.org)**  |  
**[Official Documentation](https://streampark.apache.org/docs/get-started/intro)**  |  
**[FAQ](https://github.com/apache/incubator-streampark/issues/507)**

![](https://streampark.apache.org/image/dashboard-preview.png)

## 🚀 Abstract

----

Apache StreamPark™ is a stream processing development framework and application management platform.

> Apache StreamPark™ is a streaming application development framework. Aimed at ease building and managing streaming applications, StreamPark provides development framework for writing stream processing application with Apache Flink and Apache Spark, More other engines will be supported in the future. Also, StreamPark is a professional management platform for streaming application, including application development, debugging, interactive query, deployment, operation, maintenance, etc. It was initially known as StreamX and renamed to StreamPark in August 2022.

* Apache Flink & Apache Spark application development scaffold
* Support multiple versions of Apache Flink & Apache Spark
* Wide range of out-of-the-box connectors
* One-stop stream processing operation platform
* Support catalog、olap、streaming-warehouse etc.
* ...

## 🚀 QuickStart

- [Start with Docker](docker/README.md)
- [Start with Kubernetes](helm/README.md)

Click [Official Documentation](https://streampark.apache.org/docs/framework/quick-start) for more information

## 🔨 How to Build

```shell
git clone [email protected]:apache/incubator-streampark.git
cd incubator-streampark
./build.sh
```

🗄 Details:how to [Development](https://streampark.apache.org/docs/development/development)

## 🧑‍💻 Downloads

Download address for run-directly software package: https://streampark.apache.org/download

## 💋 Our users

Various companies and organizations use Apache StreamPark™ for research, production and commercial products. Are you using this project? [Welcome to add your company](https://github.com/apache/incubator-streampark/issues/163)!

![Our users](https://streampark.apache.org/image/users.png)

## 🤝 Contribution

[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg?style=flat-square)](https://github.com/apache/incubator-streampark/pulls)

### 🙋 Submit Pull Request and Issues

You can submit any ideas as [pull requests](https://github.com/apache/incubator-streampark/pulls) or as [issues](https://github.com/apache/incubator-streampark/issues/new/choose).

> If you're new to posting issues, we ask that you read [*How To Ask Questions The Smart Way*](http://www.catb.org/~esr/faqs/smart-questions.html) (**This guide does not provide actual support services for this project!**), [How to Report Bugs Effectively](http://www.chiark.greenend.org.uk/~sgtatham/bugs.html) prior to posting. Well written bug reports help us help you!

### 🍻 How to Contribute

We welcome your suggestions, comments (including criticisms), comments and contributions. See [How to Contribute](https://streampark.apache.org/community/submit_guide/submit_code) and [Code Submission Guide](https://streampark.apache.org/community/submit_guide/code_style_and_quality_guide)

### 📤 Subscribe Mailing Lists
Mail List is the most recognized form of communication in Apache community. See how to [Join the Mailing Lists](https://streampark.apache.org/community/contribution_guide/mailing_lists)

Thank you to all the people who already contributed to Apache StreamPark™!

[![contrib graph](https://contrib.rocks/image?repo=apache/streampark)](https://github.com/apache/incubator-streampark/graphs/contributors)

## License

Licensed under the [Apache License, Version 2.0](LICENSE)

## 💬 Social Media

- [X (Twitter)](https://twitter.com/ASFStreamPark)
- [Zhihu](https://www.zhihu.com/people/streampark) (in Chinese)
- [bilibili](https://space.bilibili.com/455330087) (in Chinese)
- WeChat Official Account (in Chinese, scan the QR code to follow)

Join the Group