https://github.com/dream-horizon-org/logwise
Open-source, cost-effective end-to-end logging system featuring full architecture, deployment automation, dashboards, and production-ready scaling guides
https://github.com/dream-horizon-org/logwise
log-centralization logging logwise open-source
Last synced: about 2 months ago
JSON representation
Open-source, cost-effective end-to-end logging system featuring full architecture, deployment automation, dashboards, and production-ready scaling guides
- Host: GitHub
- URL: https://github.com/dream-horizon-org/logwise
- Owner: dream-horizon-org
- License: lgpl-3.0
- Created: 2025-10-28T08:32:49.000Z (5 months ago)
- Default Branch: main
- Last Pushed: 2026-01-20T13:36:34.000Z (about 2 months ago)
- Last Synced: 2026-01-20T19:11:06.362Z (about 2 months ago)
- Topics: log-centralization, logging, logwise, open-source
- Language: Java
- Homepage: https://dream-horizon-org.github.io/logwise/
- Size: 2.49 MB
- Stars: 85
- Watchers: 1
- Forks: 9
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
- Roadmap: docs/roadmap.md
Awesome Lists containing this project
- awesome-java - LogWise
README
# LogWise
Open-source end-to-end logging system for high-volume log processing. Streams logs from Vector → Kafka → Spark → S3/Athena, with Grafana dashboards and automated orchestration.
## 📚 Documentation
Full documentation is available at: **[https://dream-horizon-org.github.io/logwise/](https://dream-horizon-org.github.io/logwise/)**
## 🚀 Quick Start
### Docker Setup (Recommended)
1. **Complete S3 & Athena Setup** (required first step):
- Follow the [S3 & Athena Setup Guide](https://dream-horizon-org.github.io/logwise/setup-guides/self-host/s3-athena-setup)
2. **Run the setup script**:
```bash
cd deploy
./setup.sh
```
3. **Access services**:
- Grafana: `http://localhost:3000` (admin/admin)
- Spark Master UI: `http://localhost:18080`
- Orchestrator: `http://localhost:8080`
For detailed instructions, see the [Docker Setup Guide](https://dream-horizon-org.github.io/logwise/setup-guides/docker/).
### Quick Links
- **[Docker Setup](https://dream-horizon-org.github.io/logwise/setup-guides/docker/)** - One-click Docker deployment
- **[Architecture Overview](https://dream-horizon-org.github.io/logwise/architecture-overview)** - System design and flow
- **[Component Guides](https://dream-horizon-org.github.io/logwise/components/vector)** - Detailed component documentation
- **[Self-Host Setup](https://dream-horizon-org.github.io/logwise/setup-guides/self-host/)** - Manual component setup
## 📁 Project Structure
```
logwise/
├── deploy/ # Docker deployment configuration
├── vector/ # Vector log collection config
├── spark/ # Spark streaming application
├── orchestrator/ # Spring Boot orchestrator service
└── docs/ # Documentation
```
## ✨ Features
- **High-throughput** log processing with Kafka streaming
- **Real-time dashboards** with Grafana integration
- **Scalable architecture** with Spark stream processing
- **Cost-efficient storage** using S3 and Athena
- **Production-ready** with automated orchestration
- **Docker support** for easy deployment
## 🤝 Contributing
We welcome contributions! Please see our [Contributing Guide](CONTRIBUTING.md) for details.
## 📄 License
This project is licensed under the LGPL-3 License. See the [LICENSE](LICENSE) file for details.
## 📧 Contact
For questions or support, please open an issue or contact the maintainers.