https://github.com/queukat/real-time-data-platform
Reference real-time data platform with Kafka, Spark, and analytics dashboard components.
https://github.com/queukat/real-time-data-platform
analytics dashboard data-engineering kafka legacy python real-time reference spark streaming
Last synced: about 8 hours ago
JSON representation
Reference real-time data platform with Kafka, Spark, and analytics dashboard components.
- Host: GitHub
- URL: https://github.com/queukat/real-time-data-platform
- Owner: queukat
- License: other
- Created: 2024-10-12T09:33:24.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2026-05-11T18:10:25.000Z (about 1 month ago)
- Last Synced: 2026-05-11T19:33:27.127Z (about 1 month ago)
- Topics: analytics, dashboard, data-engineering, kafka, legacy, python, real-time, reference, spark, streaming
- Language: Python
- Size: 21.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Notice: NOTICE
Awesome Lists containing this project
README
# Real-Time Data Processing and Analytics Platform
> Status: Legacy/reference. This repository is kept public as an architecture and implementation example, but it is not actively supported. Issues and pull requests are disabled unless support is reopened.
## Project Overview
This project is a real-time data processing and analytics platform that ingests streaming data, processes it using Apache Spark and Kafka, and provides interactive visualizations through a web interface.
## Architecture
## Technologies Used
- **Programming Languages**: Python, JavaScript
- **Big Data Tools**: Apache Kafka, Apache Spark
- **Databases**: MongoDB
- **Web Frameworks**: Flask, React.js
- **Visualization Libraries**: Chart.js
- **Containerization**: Docker
- **Orchestration**: Docker Compose
- **Version Control**: Git
## Setup Instructions
### Prerequisites
- Docker and Docker Compose installed
- Git installed
### Clone the Repository
```bash
git clone https://github.com/yourusername/real-time-data-platform.git
cd real-time-data-platform
```
### Start the Services
```bash
docker-compose up
```
### Access the Application
Frontend: http://localhost:3000
Backend API: http://localhost:5000/api/data
### Usage
The application will start ingesting data automatically.
Real-time data will be visualized on the frontend.
### Contributing
Contributions are welcome! Please open an issue or submit a pull request.
## License
This project is licensed for non-commercial use under the [PolyForm Noncommercial License 1.0.0](https://polyformproject.org/licenses/noncommercial/1.0.0.txt).
Commercial use, resale, paid distribution, marketplace publication, SaaS hosting, or bundling into a paid product requires separate written permission from the author.
Project names, logos, package identifiers, store listings, screenshots, and other branding assets are not licensed for use in forks or redistributed builds.