https://github.com/jeffvestal/ingest_pipeline_metrics

Collect Elasticsearch ingest pipeline metrics and index them for monitoring
https://github.com/jeffvestal/ingest_pipeline_metrics

Last synced: 5 days ago
JSON representation

Collect Elasticsearch ingest pipeline metrics and index them for monitoring

• Host: GitHub
• URL: https://github.com/jeffvestal/ingest_pipeline_metrics
• Owner: jeffvestal
• Created: 2022-08-29T19:15:10.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2022-08-31T21:02:09.000Z (over 2 years ago)
• Last Synced: 2024-10-29T23:43:29.377Z (about 2 months ago)
• Language: Python
• Size: 22.4 MB
• Stars: 3
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        

# Ingest Pipeline Monitoring

Collect Elasticsearch ingest pipeline metrics and index them for monitoring

### Info

Until we get ingest monitoring built-in to stack monitoring, this is a temporary workaround

## *WARNING*

Prior to 7.17.4 and 8.2, there is a slight, but real, potential a **hung node could take down a cluster**. 

This was addressed by this [GH Issue](https://github.com/elastic/elasticsearch/issues/82337)

You are **strongly encouraged** to only run this in the 7x on versions 7.17.4+ or 8x 8.2+

## Running

python ./main.py

### Environment Variables that must be set

Monitoring Cluster

 - "es_mon_cloud_id":

 - "es_mon_cloud_user":    

 - "es_mon_cloud_pass":    

  Source Cluster

 

 - "es_cloud_id":   

 - "es_cloud_user":    

 -  "es_cloud_pass":

### Example Dashboard