https://github.com/yousabu/high-robust-monitoring-stack

Prometheus-stack
https://github.com/yousabu/high-robust-monitoring-stack

alertmanager grafana kafka loki prometheus pushgateway python slack

Last synced: 2 months ago
JSON representation

Prometheus-stack

• Host: GitHub
• URL: https://github.com/yousabu/high-robust-monitoring-stack
• Owner: yousabu
• Created: 2024-08-25T13:33:44.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-08-27T08:38:32.000Z (4 months ago)
• Last Synced: 2024-10-11T06:03:39.163Z (2 months ago)
• Topics: alertmanager, grafana, kafka, loki, prometheus, pushgateway, python, slack
• Language: HTML
• Homepage:
• Size: 30.2 MB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Monitoring Components:

- Prometheus

- Kafka

- Logstash

- Grafana

- Alert Manager

- Node Exporter

- Push Gateway

- Slack 

![Screenshot from 2024-08-27 11-02-09](https://github.com/user-attachments/assets/95bf0ac2-03f0-4a78-9bbb-5ecb3104a306)

# Logger

* Python Application Used To Create And Produce Logs To kafka

![loggger](https://github.com/user-attachments/assets/58365619-282e-4954-a1e7-b78a684a7624)

# Kafka

* Kafka Consumer will receive logs in 'logs' topic.

![cons](https://github.com/user-attachments/assets/78c372e3-290c-4f4b-92d0-c55c2626d586)

# LogStash

* It will receive logs from Kafka in plain text, reformat them, and send them to Loki.

# Loki

* It will start indexing the logs and ship them to Grafana.

# Grafana

* Finally, the logs are visualized in Grafana.

![Screenshot from 2024-08-27 11-24-44](https://github.com/user-attachments/assets/62bb6b06-7b72-4e01-b44b-0f3950d5809d)

# Push Gateway and Node Exporter

* To collect system metrics and cron jobs or small processes, and ship them to Prometheus.

![Screenshot from 2024-08-25 16-41-20](https://github.com/user-attachments/assets/e403cbda-0534-4c85-976a-f139920dbaec)

# Alert Manager

* Wait for a condition to occur, then send a notification to Slack or any other app.

![Screenshot from 2024-08-25 16-45-08](https://github.com/user-attachments/assets/7e4495d9-cacc-4c54-bb68-136aed2ac87b)