https://github.com/apache/streampark
Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://github.com/apache/streampark
apache development-framework easy-to-use etl-pipeline operation-platform streaming streampark
Last synced: about 1 month ago
JSON representation
Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
- Host: GitHub
- URL: https://github.com/apache/streampark
- Owner: apache
- License: apache-2.0
- Created: 2019-05-27T05:56:03.000Z (about 6 years ago)
- Default Branch: dev
- Last Pushed: 2025-04-27T12:07:40.000Z (about 2 months ago)
- Last Synced: 2025-05-08T23:33:59.605Z (about 1 month ago)
- Topics: apache, development-framework, easy-to-use, etl-pipeline, operation-platform, streaming, streampark
- Language: Java
- Homepage: https://streampark.apache.org/
- Size: 59.3 MB
- Stars: 4,055
- Watchers: 76
- Forks: 1,029
- Open Issues: 263
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Apache StreamPark
==========
**StreamPark**: a streaming application development framework and cloud-native real-time computing platform.
[](https://github.com/apache/streampark/stargazers)
[](https://github.com/apache/streampark/releases)
[](https://x.com/ASFStreamPark)
## 📊 Overview
**StreamPark** is an open-source streaming application development framework and cloud-native real-time computing platform. Designed to simplify the development and management of streaming applications, StreamPark provides a development framework for developing stream processing applications using Apache Flink and Apache Spark, alongside a professional management platform. The platform covers the full lifecycle of streaming applications, including development, debugging, interactive querying, deployment, operations, and maintenance. Originally named StreamX, the project was renamed as StreamPark in August 2022 and graduated as an Apache Top-Level Project (TLP) in January 2025.
* **Streaming Application Development Framework**
* Provides a streaming-application framework to accelerate Apache Flink and Spark development, offering prebuilt plug-and-play APIs and connectors.
* **Real-Time Computing Platform**
* Provides a one-stop solution for real-time computing, including application development, deployment, management, monitoring, and more.
* **Supports Batch & Streaming**
* Supports Apache Flink and Apache Spark, enabling both stream processing and batch processing.
* **Supports Multi-engine/Multi-version**
* Enables cross-version development and management of Apache Flink and Apache Spark applications within a unified framework.
* **Multi-environment Compatibility**
* Compatible with various cluster environments, users can submit Flink and Spark applications to standalone clusters, YARN (Hadoop 2.x/3.x), and Kubernetes.
* **Rich Ecosystems**
* Compatible with big-data ecosystem tools (e.g., Apache Flink, Apache Spark, Apache Paimon, Apache Doris) and ML/AI ecosystems.
* **Easy to use**
* Only one service, deployment easy, allowing even beginners to get started within minutes.
## 🚀 QuickStart
#### 🐳 Play StreamPark in Docker
```shell
docker run -d -p 10000:10000 apache/streampark:latest
```
---
#### 🖥️ Local Quick Installation Experience
```shell
curl -L https://streampark.apache.org/quickstart.sh | sh
```
https://github.com/user-attachments/assets/dd7d5a89-bc28-4ccc-9ad5-258925fc4f34
## 🔨 How to Build
```shell
./build.sh
```
🗄 how to [Development](https://streampark.apache.org/docs/development/development)
## ⬇️ Downloads
Please head to the [releases page](https://streampark.apache.org/download) to download a release of Apache StreamPark.
## 📚 Docs
[Official Documentation](https://streampark.apache.org/docs/get-started)
## 💋 Our users
Various companies and organizations use Apache StreamPark for research, production and commercial products. Are you using this project? [Welcome to add your company](https://github.com/apache/streampark/issues/163)!
## 🤝 Contribution
[](https://github.com/apache/streampark/pulls)
### 🙋 Submit Pull Request and Issues
You can submit any ideas as [pull requests](https://github.com/apache/streampark/pulls) or as [issues](https://github.com/apache/streampark/issues/new/choose).
> If you're new to posting issues, we ask that you read [*How To Ask Questions The Smart Way*](http://www.catb.org/~esr/faqs/smart-questions.html) (**This guide does not provide actual support services for this project!**), [How to Report Bugs Effectively](http://www.chiark.greenend.org.uk/~sgtatham/bugs.html) prior to posting. Well written bug reports help us help you!
### 🍻 How to Contribute
We welcome your suggestions, comments (including criticisms), comments and contributions. See [How to Contribute](https://streampark.apache.org/community/submit_guide/submit_code) and [Code Submission Guide](https://streampark.apache.org/community/submit_guide/code_style_and_quality_guide)
Thank you to all the people who already contributed to Apache StreamPark!
## 💬 Contact Us
Contact us through the following mailing list.
| Name | Mailing list |
|:--------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| [[email protected]](mailto:[email protected]) | [Subscribe](mailto:[email protected])、[Unsubscribe](mailto:[email protected]) 、[Archives](http://mail-archives.apache.org/mod_mbox/streampark-dev/) |
## 💿 Social Media
- [X (Twitter)](https://twitter.com/ASFStreamPark)
- [Zhihu](https://www.zhihu.com/people/streampark) (in Chinese)
- [bilibili](https://space.bilibili.com/455330087) (in Chinese)
- WeChat Official Account (in Chinese, scan the QR code to follow)
## 📜 License
Licensed under the [Apache License, Version 2.0](LICENSE)