https://github.com/apache/streampark
Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://github.com/apache/streampark
apache development-framework easy-to-use etl-pipeline operation-platform streaming streampark
Last synced: about 1 month ago
JSON representation
Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
- Host: GitHub
- URL: https://github.com/apache/streampark
- Owner: apache
- License: apache-2.0
- Created: 2019-05-27T05:56:03.000Z (over 6 years ago)
- Default Branch: dev
- Last Pushed: 2025-04-27T12:07:40.000Z (10 months ago)
- Last Synced: 2025-05-08T23:33:59.605Z (10 months ago)
- Topics: apache, development-framework, easy-to-use, etl-pipeline, operation-platform, streaming, streampark
- Language: Java
- Homepage: https://streampark.apache.org/
- Size: 59.3 MB
- Stars: 4,055
- Watchers: 76
- Forks: 1,029
- Open Issues: 263
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Apache StreamPark
==========
**StreamPark**: a streaming application development framework and cloud-native real-time computing platform.
[](https://github.com/apache/streampark/stargazers)
[](https://github.com/apache/streampark/releases)
[](https://x.com/ASFStreamPark)
## 📊 Overview
**StreamPark** is an open-source framework for building and managing real-time streaming applications, designed to simplify the end-to-end lifecycle of stream processing. It provides a unified development framework for Apache Flink and Apache Spark, along with a powerful cloud-native platform for application management.
StreamPark enables users to develop, debug, deploy, and operate large-scale streaming applications efficiently and consistently.
Originally named StreamX, the project was renamed StreamPark in August 2022 and became an Apache Top-Level Project (TLP) in January 2025.
* **Streaming Application Development Framework**
* Simplifies Flink and Spark streaming development with prebuilt APIs, connectors, and templates.
* **Cloud-Native Real-Time Computing Platform**
* Offers a one-stop real-time computing platform for development, deployment, monitoring, and operations.
* **Unified Batch & Streaming Processing**
* Supports Apache Flink and Apache Spark, enabling both stream processing and batch processing.
* **Multi-Engine & Multi-Version Support**
* Run and manage multi-version Flink/Spark applications.
* **Multi-Environment Compatibility**
* Works on Standalone, YARN (Hadoop 2.x/3.x), and Kubernetes.
* **Rich Ecosystems**
* Compatible with big-data ecosystem tools (e.g., Apache Flink/Spark/Paimon/Doris) and ML/AI ecosystems.
* **Easy to use**
* Single-service deployment; go from zero to running jobs in minutes.
## 🚀 QuickStart
#### 🐳 Play StreamPark in Docker
```shell
docker run -d -p 10000:10000 apache/streampark:latest
```
---
#### 🖥️ Local Quick Installation Experience
```shell
curl -L https://streampark.apache.org/quickstart.sh | sh
```
https://github.com/user-attachments/assets/dd7d5a89-bc28-4ccc-9ad5-258925fc4f34
## 🔨 How to Build
```shell
./build.sh
```
🗄 how to [Development](https://streampark.apache.org/docs/development/development)
## ⬇️ Downloads
Please head to the [releases page](https://streampark.apache.org/download) to download a release of Apache StreamPark.
## 📚 Docs
[Official Documentation](https://streampark.apache.org/docs/get-started)
## 💋 Our users
Various companies and organizations use Apache StreamPark for research, production and commercial products. Are you using this project? [Welcome to add your company](https://github.com/apache/streampark/issues/163)!
## 🤝 Contribution
[](https://github.com/apache/streampark/pulls)
### 🙋 Submit Pull Request and Issues
You can submit any ideas as [pull requests](https://github.com/apache/streampark/pulls) or as [issues](https://github.com/apache/streampark/issues/new/choose).
> If you're new to posting issues, we ask that you read [*How To Ask Questions The Smart Way*](http://www.catb.org/~esr/faqs/smart-questions.html) (**This guide does not provide actual support services for this project!**), [How to Report Bugs Effectively](http://www.chiark.greenend.org.uk/~sgtatham/bugs.html) prior to posting. Well written bug reports help us help you!
### 🍻 How to Contribute
We welcome your suggestions, comments (including criticisms), comments and contributions. See [How to Contribute](https://streampark.apache.org/community/submit_guide/submit_code) and [Code Submission Guide](https://streampark.apache.org/community/submit_guide/code_style_and_quality_guide)
Thank you to all the people who already contributed to Apache StreamPark!
## 💬 Contact Us
Contact us through the following mailing list.
| Name | Mailing list |
|:--------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| [dev@streampark.apache.org](mailto:dev@streampark.apache.org) | [Subscribe](mailto:dev-subscribe@streampark.apache.org)、[Unsubscribe](mailto:dev-unsubscribe@streampark.apache.org) 、[Archives](http://mail-archives.apache.org/mod_mbox/streampark-dev/) |
## 💿 Social Media
- [X (Twitter)](https://twitter.com/ASFStreamPark)
- [Zhihu](https://www.zhihu.com/people/streampark) (in Chinese)
- [bilibili](https://space.bilibili.com/455330087) (in Chinese)
- WeChat Official Account (in Chinese, scan the QR code to follow)
## 📜 License
Licensed under the [Apache License, Version 2.0](LICENSE)