Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/tetafro/clickhouse-cluster
Simple clickhouse cluster with docker-compose
https://github.com/tetafro/clickhouse-cluster
clickhouse docker docker-compose
Last synced: 4 days ago
JSON representation
Simple clickhouse cluster with docker-compose
- Host: GitHub
- URL: https://github.com/tetafro/clickhouse-cluster
- Owner: tetafro
- Created: 2020-04-12T15:02:40.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2023-04-23T09:32:46.000Z (almost 2 years ago)
- Last Synced: 2025-01-28T15:07:03.544Z (6 days ago)
- Topics: clickhouse, docker, docker-compose
- Language: Makefile
- Size: 6.84 KB
- Stars: 214
- Watchers: 7
- Forks: 82
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-clickhouse - tetafro/clickhouse-cluster - A simple ClickHouse cluster setup using Docker Compose, featuring two shards and two replicas. (Integrations / Deployment and Management Tools)
README
# Clickhouse Cluster
Clickhouse cluster with 2 shards and 2 replicas built with docker-compose.
Not for production use.
## Run
Run single command, and it will copy configs for each node and
run clickhouse cluster `company_cluster` with docker-compose
```sh
make config up
```
Containers will be available in docker network `172.23.0.0/24`
| Container | Address
| ------------ | -------
| zookeeper | 172.23.0.10
| clickhouse01 | 172.23.0.11
| clickhouse02 | 172.23.0.12
| clickhouse03 | 172.23.0.13
| clickhouse04 | 172.23.0.14
## Profiles
- `default` - no password
- `admin` - password `123`
## Test it
Login to clickhouse01 console (first node's ports are mapped to localhost)
```sh
clickhouse-client -h localhost
```
Or open `clickhouse-client` inside any container
```sh
docker exec -it clickhouse01 clickhouse-client -h localhost
```
Create a test database and table (sharded and replicated)
```sql
CREATE DATABASE company_db ON CLUSTER 'company_cluster';
CREATE TABLE company_db.events ON CLUSTER 'company_cluster' (
time DateTime,
uid Int64,
type LowCardinality(String)
)
ENGINE = ReplicatedMergeTree('/clickhouse/tables/{cluster}/{shard}/events', '{replica}')
PARTITION BY toDate(time)
ORDER BY (uid);
CREATE TABLE company_db.events_distr ON CLUSTER 'company_cluster' AS company_db.events
ENGINE = Distributed('company_cluster', company_db, events, uid);
```
Load some data
```sql
INSERT INTO company_db.events_distr VALUES
('2020-01-01 10:00:00', 100, 'view'),
('2020-01-01 10:05:00', 101, 'view'),
('2020-01-01 11:00:00', 100, 'contact'),
('2020-01-01 12:10:00', 101, 'view'),
('2020-01-02 08:10:00', 100, 'view'),
('2020-01-03 13:00:00', 103, 'view');
```
Check data from the current shard
```sql
SELECT * FROM company_db.events;
```
Check data from all cluster
```sql
SELECT * FROM company_db.events_distr;
```
## Add more nodes
If you need more Clickhouse nodes, add them like this:
1. Add replicas/shards to `config.xml` to the block `company/remote_servers/company_cluster`.
1. Add nodes to `docker-compose.yml`.
1. Add nodes in `Makefile` in `config` target.
## Start, stop
Start/stop the cluster without removing containers
```sh
make start
make stop
```
## Teardown
Stop and remove containers
```sh
make down
```