https://github.com/amsh4/driftsiren
DriftSiren is a production-grade platform for real-time data drift and quality monitoring. Built with Next.js, FastAPI, and Docker, it tracks feature drift, provides live alerts, and visualizes metrics on a sleek dashboard. Includes agent, APIs, Celery workers, and Kubernetes-ready setup.
https://github.com/amsh4/driftsiren
celery cicd datadrift dataquality docker fastapi k8s machine-learning nextjs observability postgresql real-time redis tailwindcss typescript websocket
Last synced: 9 days ago
JSON representation
DriftSiren is a production-grade platform for real-time data drift and quality monitoring. Built with Next.js, FastAPI, and Docker, it tracks feature drift, provides live alerts, and visualizes metrics on a sleek dashboard. Includes agent, APIs, Celery workers, and Kubernetes-ready setup.
- Host: GitHub
- URL: https://github.com/amsh4/driftsiren
- Owner: AmSh4
- License: mit
- Created: 2025-08-26T09:52:56.000Z (about 1 month ago)
- Default Branch: main
- Last Pushed: 2025-08-26T10:05:04.000Z (about 1 month ago)
- Last Synced: 2025-08-26T12:13:00.762Z (about 1 month ago)
- Topics: celery, cicd, datadrift, dataquality, docker, fastapi, k8s, machine-learning, nextjs, observability, postgresql, real-time, redis, tailwindcss, typescript, websocket
- Language: Python
- Homepage:
- Size: 28.3 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# DriftSiren
### `Real‑Time Data Drift & Data Quality Monitoring Platform`
A production‑style, full‑stack platform to **detect data drift**, **monitor data quality**, and **alert in real time**.
## Key Features
- Agent SDK sends datasets/events to the backend securely.
- Real‑time drift metrics (PSI, KS, Chi‑Squared) computed in background jobs.
- Live alert stream via WebSocket; historical metrics stored in Postgres.
- Clean dashboard with charts (Recharts) and filters.
- Role‑based users (stub/JWT) and organizations (demo scope).
- Docker Compose one‑command startup. K8s manifests included for cluster deployments.
## Project Structure
- https://github.com/AmSh4/DriftSiren/tree/main/Structure
## Quick Start (Docker)
1. Clone the repo and create `.env` from `.env.example`.
2. Run: `docker compose up --build`.
3. Open **http://localhost:3000** (frontend) and **http://localhost:8000/docs** (backend API).
> Demo creds: any email works; click "Sign In (Demo)" to get a JWT.
## Sample Run (without Docker)
- Backend: `cd backend && uvicorn app.main:app --reload`
- Worker: `cd backend && celery -A app.celery_app.app worker --loglevel=INFO`
- Frontend: `cd frontend && npm i && npm run dev`
## Security Notes
Replace `SECRET_KEY`, add proper auth, HTTPS, and harden CORS before production.