StreamPark: a streaming application development framework and cloud-native real-time computing platform.
StreamPark is an open-source streaming application development framework and cloud-native real-time computing platform. Designed to simplify the development and management of streaming applications, StreamPark provides a development framework for developing stream processing applications using Apache Flink and Apache Spark, alongside a professional management platform. The platform covers the full lifecycle of streaming applications, including development, debugging, interactive querying, deployment, operations, and maintenance. Originally named StreamX, the project was renamed as StreamPark in August 2022 and graduated as an Apache Top-Level Project (TLP) in January 2025.
- Streaming Application Development Framework
- Provides a streaming-application framework to accelerate Apache Flink and Spark development, offering prebuilt plug-and-play APIs and connectors.
- Real-Time Computing Platform
- Provides a one-stop solution for real-time computing, including application development, deployment, management, monitoring, and more.
- Supports Batch & Streaming
- Supports Apache Flink and Apache Spark, enabling both stream processing and batch processing.
- Supports Multi-engine/Multi-version
- Enables cross-version development and management of Apache Flink and Apache Spark applications within a unified framework.
- Multi-environment Compatibility
- Compatible with various cluster environments, users can submit Flink and Spark applications to standalone clusters, YARN (Hadoop 2.x/3.x), and Kubernetes.
- Rich Ecosystems
- Compatible with big-data ecosystem tools (e.g., Apache Flink, Apache Spark, Apache Paimon, Apache Doris) and ML/AI ecosystems.
- Easy to use
- Only one service, deployment easy, allowing even beginners to get started within minutes.
docker run -d -p 10000:10000 apache/streampark:latest
curl -L https://streampark.apache.org/quickstart.sh | sh
StreamPark.QuickStart.mp4
./build.sh
π how to Development
Please head to the releases page to download a release of Apache StreamPark.
Various companies and organizations use Apache StreamPark for research, production and commercial products. Are you using this project? Welcome to add your company!
You can submit any ideas as pull requests or as issues.
If you're new to posting issues, we ask that you read How To Ask Questions The Smart Way (This guide does not provide actual support services for this project!), How to Report Bugs Effectively prior to posting. Well written bug reports help us help you!
We welcome your suggestions, comments (including criticisms), comments and contributions. See How to Contribute and Code Submission Guide
Thank you to all the people who already contributed to Apache StreamPark!
Contact us through the following mailing list.
Name | Mailing list |
---|---|
[email protected] | SubscribeγUnsubscribe γArchives |
- X (Twitter)
- Zhihu (in Chinese)
- bilibili (in Chinese)
- WeChat Official Account (in Chinese, scan the QR code to follow)
Licensed under the Apache License, Version 2.0