Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/chronosphereio/high-cardinality-analyzer

Last synced: 3 months ago
JSON representation

Host: GitHub
URL: https://github.com/chronosphereio/high-cardinality-analyzer
Owner: chronosphereio
License: mit
Created: 2020-10-19T11:15:37.000Z (over 3 years ago)
Default Branch: main
Last Pushed: 2021-04-07T20:17:14.000Z (about 3 years ago)
Last Synced: 2024-01-21T08:39:22.016Z (5 months ago)
Language: Go
Size: 35.2 KB
Stars: 46
Watchers: 8
Forks: 1
Open Issues: 1
Metadata Files:
- Readme: README.md
- License: LICENSE

Lists

awesome-open-source-monitoring-tools - High Cardinality Analyzer

README

# High Cardinality Analyzer

That is a simple tool to help you analyze your Prometheus Query Log and generate
recording rules according to total query time. It looks for aggregation functions
and generates a template for a recording rule.

For more information about recording rules, please follow: https://prometheus.io/docs/prometheus/latest/configuration/recording_rules/

For more information about how to enable query log: https://prometheus.io/docs/guides/query-log/

## Building
To build it simply call `go build .`

## Running
To analyze query log and show queries which in total (including all same queries) took longer than 50 seconds:

`./high-cardinality-analyzer --query-log query.log --min-query-time 50s`

To generate recording rules for queries which in total took longer than 50 seconds and where used at least 10 times:

`./high-cardinality-analyzer --query-log query.log --min-query-time 50s --min-query-count 10 --generate-recording-rules`

## Future development
- Support of M3 query log and rules
- Filter queries by a percent of aggregated records. For example, we would like to see long taking queries which
data points count were reduced 100 or more times (for example from 10k to 100). Such queries are potentially are good candidates for optimization using recording rules.