https://github.com/siimas/uptime

Distributed website uptime monitoring service built with Go, Kafka, Redis, and PostgreSQL. Event-driven, scalable, and optimized for performance.
https://github.com/siimas/uptime

go golang kafka monitoring-tool postgresql redis

Last synced: 1 day ago
JSON representation

Distributed website uptime monitoring service built with Go, Kafka, Redis, and PostgreSQL. Event-driven, scalable, and optimized for performance.

• Host: GitHub
• URL: https://github.com/siimas/uptime
• Owner: Siimas
• License: apache-2.0
• Created: 2025-05-14T16:58:23.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2025-05-29T20:50:42.000Z (about 1 year ago)
• Last Synced: 2025-07-19T11:44:24.522Z (12 months ago)
• Topics: go, golang, kafka, monitoring-tool, postgresql, redis
• Language: Go
• Homepage:
• Size: 240 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# 🖥️ Uptime - Distributed Website Monitoring Service

**Uptime** is a modular, event-driven website uptime monitoring service. It leverages Go's concurrency, Kafka for pub/sub event flow, Redis for fast cache access, and PostgreSQL for durable persistence. It is optimized for scale, performance, and modularity.

---

## 🚀 Features

- 🕒 **Scheduled Monitoring** – Periodic HTTP pings to user-defined URLs.

- 📬 **Event-Driven Architecture** – Kafka is used for distributing monitor results and scheduling tasks.

- 🧵 **Worker Pool** – Efficient concurrent message processing to handle thousands of events per minute.

- 🧠 **PostgreSQL Logging** – Durable persistence of monitor status over time.

- ⚡ **Redis Caching** – Real-time monitor status updates for quick reads.

- 🌐 **REST API** – Expose endpoints for CRUD operations on monitors.

- 🔐 **Environment-based Config** – Easy switching between local and cloud environments.

---

## 🛠️ Tech Stack

- **Language**: Go 1.24.3+

- **Message Queue**: Kafka (Confluent v2 client)

- **Database**: PostgreSQL

- **Cache**: Redis

- **API**: Standard Go `net/http`

- **Others**: Docker (for deployment), systemd/graceful shutdown support

---

## 📁 Project Structure

```bash

.

├── cmd/                  # Application entry point

├── internal/

│   ├── cache/            # Redis client and utilities

│   ├── config/           # Environment variable loading

│   ├── constants/        # Shared constant values

│   ├── events/           # Kafka consumer/producer wrapper

│   ├── http/             # HTTP server and handlers

│   ├── logger/           # Kafka consumer for log processing (with worker pool)

│   ├── models/           # Data models

│   ├── postgres/         # Postgres logic

│   ├── scheduler/        # Monitor scheduling engine

│   └── worker/           # Monitor runner and async job handler

├── .env.example          # Environment config template

├── go.mod / go.sum       # Go dependencies

└── README.md             # Project documentation

```

---

**Built with ❤️ by Siimas.**