https://github.com/altinity/demo-opentelemetry-cluster-logs
A demonstration using the OpenTelemetry Collector to send all cluster logs to a ClickHouse instance.
https://github.com/altinity/demo-opentelemetry-cluster-logs
Last synced: 4 months ago
JSON representation
A demonstration using the OpenTelemetry Collector to send all cluster logs to a ClickHouse instance.
- Host: GitHub
- URL: https://github.com/altinity/demo-opentelemetry-cluster-logs
- Owner: Altinity
- Created: 2024-08-06T17:17:26.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-08-07T18:35:41.000Z (almost 2 years ago)
- Last Synced: 2024-08-07T21:57:54.397Z (almost 2 years ago)
- Size: 7.81 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Cluster Logs Demo with OpenTelemetry & ClickHouse®
A demo to collect all cluster logs with the OpenTelemetry Collector and send them to a ClickHouse instance.
## Quickstart
This repository depends on an existing Kubernetes cluster with the [Altinity Operator](https://github.com/Altinity/clickhouse-operator) installed in the `kube-system` namespace.
Clone this repository and in the directory run (modifying the namespace as you see fit):
```
helm install cluster-logs-demo . --namespace=demo --create-namespace
```
## Connect
#### Grafana
Connect to Grafana:
```
kubectl port-forward -n demo services/monitoring-grafana 3000:80
```
You can then load Grafana in your browser at `http://localhost:3000` — there is no username or password.
## Architecture
### Components
- Altinity Operator (not included) - for creating and managing a ClickHouse Cluster
- ClickHouse - for storing log data
- OpenTelemetry Collector - deployed as a daemonset to collect node logs and metrics
- OpenTelemetry Exoprter for ClickHouse - to forward logs data to ClickHouse
- Grafana - for visualizing logs
- ClickHouse Plugin for Grafana - to connect ClickHouse as a Grafana datasource.
# Legal
Altinity®, Altinity.Cloud®, and Altinity Stable® are registered trademarks of Altinity, Inc. ClickHouse® is a registered trademark of ClickHouse, Inc.; Altinity is not affiliated with or associated with ClickHouse, Inc.