https://github.com/vkcom/statshouse
StatsHouse is a highly available, scalable, multitenant monitoring system
https://github.com/vkcom/statshouse
dashboard graphing metrics monitoring observability tsdb
Last synced: 7 days ago
JSON representation
StatsHouse is a highly available, scalable, multitenant monitoring system
- Host: GitHub
- URL: https://github.com/vkcom/statshouse
- Owner: VKCOM
- License: mpl-2.0
- Created: 2022-11-22T13:08:41.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2024-10-29T11:20:26.000Z (7 months ago)
- Last Synced: 2024-10-29T11:47:22.686Z (7 months ago)
- Topics: dashboard, graphing, metrics, monitoring, observability, tsdb
- Language: Go
- Homepage: https://vkcom.github.io/statshouse/
- Size: 62.6 MB
- Stars: 214
- Watchers: 17
- Forks: 22
- Open Issues: 96
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
README
# StatsHouse
StatsHouse is a highly available, scalable, multitenant monitoring system.
Visit the [StatsHouse documentation website](https://vkcom.github.io/statshouse/).
## Why should I use StatsHouse?
**StatsHouse is used in production at big scale**
StatsHouse is the main monitoring system of [vk.com](https://vk.com). As of
November 2023, main StatsHouse cluster is receiving 1.2 billion metrics
per second from 22000 servers and stores 5 years of data.
**StatsHouse provides high resolution, low latency data**
With default metric resolution of 1 second and latency of 5 seconds,
StatsHouse makes it easy to observe things happening in great detail
immediately as they are happening.
**StatsHouse provides long-term metrics storage**
StatsHouse automatically downsamples high-resolution data to 1 minute and 1
hour resolutions with automatic TTL. High-resolution data is stored for 2
days, minute-resolution data is stored for a month, and hour-resolution
data is stored indefinitely.
**StatsHouse is easy to operate**
StatsHouse automatically works around network unavailability and individual
machine failure. Most StatsHouse components are quasi-stateless. Main
stateful component is a ClickHouse cluster which StatsHouse uses
internally as a primary data store.
**StatsHouse is almost impossible to overload**
StatsHouse uses explicitly configured per-second budgets for network and
disk usage, and automatically samples metrics which use more than their
fair share of the budget.
**StatsHouse has a built-in UI**
Built-in UI allow to interactively dig into metrics without using any query
language. It also has a simple dashboard system. For more advanced use
cases, StatsHouse provides a Grafana data source plugin as well.
## UI screenshots
## Documentation
The [StatsHouse documentation website](https://vkcom.github.io/statshouse/) is currently in draft form,
so please check our earlier documents as well:
- [Quick start guide](./docs/quickstart.md)
- [Internals](./docs/internals.ru.md) (in Russian)
- [Protocol and data format](./docs/protocol.md)
- [PromQL implementation notes](./docs/promql.ru.md) (in Russian)
## Presentations
- HighLoad++ 2022 (in Russian):
[video](https://www.youtube.com/watch?v=gs2_PGgPVwU),
[slides](./docs/presentations/highload2022.ru.pdf)
- Linkmeup [sysadmins podcast №42](https://linkmeup.ru/podcasts/2333/) (in Russian)
## Clients
- [Go](https://github.com/VKCOM/statshouse-go)
- [PHP](https://github.com/VKCOM/statshouse-php)
- [C++](https://github.com/VKCOM/statshouse-cpp)
- [Java](https://github.com/VKCOM/statshouse-java)
- [Python](https://github.com/VKCOM/statshouse-py)
- [nginx](https://github.com/VKCOM/nginx-statshouse-module)
## License
StatsHouse is licensed under the [Mozilla Public License Version 2.0](./LICENSE).