An open API service indexing awesome lists of open source software.

https://github.com/fayleenpc/go_tasks_queue

A distributed task queue system built in Go with dashboard and observability support.
https://github.com/fayleenpc/go_tasks_queue

dashboard distributed-systems golang microservices observability task-queue

Last synced: 5 months ago
JSON representation

A distributed task queue system built in Go with dashboard and observability support.

Awesome Lists containing this project

README

          

# GTQ Ultra — Production Task Queue (Full Bundle)

This bundle ships a **complete production system**:
- Go **API** and **Worker** with Redis queue, metrics, tracing, job search (cursor), retry/backoff, visibility timeout
- **PostgreSQL sink** for job history/audit
- **Next.js dashboard** (NextAuth OAuth, filters, pagination, enqueue)
- **Docker Compose** (Redis, Postgres, Jaeger, Prometheus, Grafana, API, Worker, Dashboard)
- **Helm charts** (API + Worker + HPA) for staging/prod
- **OpenAPI spec**, **Prometheus rules**, **Grafana dashboards**
- **GitHub Actions CI**

## Quickstart (Local)

```bash
make dev
# Dashboard: http://localhost:3000
# API: http://localhost:8080/healthz
# Jaeger: http://localhost:16686
# Grafana: http://localhost:3001 (admin/admin)
# Prometheus: http://localhost:9090
```

Enqueue a sample job:
```bash
curl -X POST "http://localhost:8080/enqueue?queue=default&task=echo" -H "X-API-Key: devkey" -H "Content-Type: application/json" -d '{"hello":"world"}'
```

Search jobs:
```bash
curl -H "X-API-Key: devkey" "http://localhost:8080/jobs?status=success&limit=10"
```

## Kubernetes (Helm)

```bash
helm upgrade --install gtq charts/gtq -f charts/gtq/values-prod.yaml
```

---

## Deluxe Pack Additions
- Kind demo lab (`infra/kind`)
- CI/CD polish with SBOM & Trivy (`.github/workflows/ci.yml`)
- E2E tests (pytest + k6) (`tests/e2e`)
- MkDocs documentation site (`docs/` + `.github/workflows/docs.yml`)