{"id":31945672,"url":"https://github.com/bzed/carbon-schema-to-clickhouse","last_synced_at":"2026-02-24T09:06:38.589Z","repository":{"id":57598208,"uuid":"86082351","full_name":"bzed/carbon-schema-to-clickhouse","owner":"bzed","description":"Converts storage-schema.conf from graphite/carbon to clickhouse graphite_rollup XML","archived":false,"fork":false,"pushed_at":"2017-03-24T16:12:23.000Z","size":6,"stargazers_count":15,"open_issues_count":0,"forks_count":5,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-10-12T11:28:01.283Z","etag":null,"topics":["carbon-clickhouse","clickhouse","graphite","graphite-carbon"],"latest_commit_sha":null,"homepage":null,"language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bzed.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2017-03-24T15:22:23.000Z","updated_at":"2024-05-17T00:11:43.000Z","dependencies_parsed_at":"2022-08-28T10:21:53.524Z","dependency_job_id":null,"html_url":"https://github.com/bzed/carbon-schema-to-clickhouse","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/bzed/carbon-schema-to-clickhouse","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bzed%2Fcarbon-schema-to-clickhouse","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bzed%2Fcarbon-schema-to-clickhouse/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bzed%2Fcarbon-schema-to-clickhouse/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bzed%2Fcarbon-schema-to-clickhouse/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bzed","download_url":"https://codeload.github.com/bzed/carbon-schema-to-clickhouse/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bzed%2Fcarbon-schema-to-clickhouse/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29777684,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-24T04:54:30.205Z","status":"ssl_error","status_checked_at":"2026-02-24T04:53:58.628Z","response_time":75,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["carbon-clickhouse","clickhouse","graphite","graphite-carbon"],"created_at":"2025-10-14T10:57:52.533Z","updated_at":"2026-02-24T09:06:38.514Z","avatar_url":"https://github.com/bzed.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# carbon-schema-to-clickhouse [![Build Status](https://api.travis-ci.org/bzed/carbon-schema-to-clickhouse.svg?branch=master)](https://travis-ci.org/bzed/carbon-schema-to-clickhouse/)\n\nConverts storage-schema.conf from graphite/carbon to clickhouse graphite_rollup XML\n\nMigrating our `storage-schemas.conf` from an older graphite implementation to\nthe XML snippet needed for [ClickHouse](https://github.com/yandex/ClickHouse)\nwould have needed much more time than hacking this small piece of go code.\n\n## Usage:\n\n```\n% cat storage-schemas-example.conf                                                                                                          [carbon]\npattern = ^carbon\\.\nretentions = 60:90d,60m:120d,360m:400d,720m:2y,1d:3y,7d:10y\n\n[collectd]\npattern = ^collectd\\..*\nretentions = 10s:12h,1m:10d,15m:20d,30m:40d,60m:120d,360m:400d,720m:2y,1d:3y,7d:10y\n\n[netapp.capacity]\npattern = ^netapp\\.capacity\\.*\nretentions = 15m:100d, 1d:5y\n\n[default]\npattern = .*\nretentions = 1m:10d,15m:20d,30m:40d,60m:120d,360m:400d,720m:2y,1d:3y,7d:10y\n```\n\n```\n% ./carbon-schema-to-clickhouse -h\nUsage of ./carbon-schema-to-clickhouse:                                                                 \n  -rollupfunction string\n    \tclickhouse rollup function (default \"any\")\n  -schemafile string\n    \tstorage schema file to convert (default \"/etc/carbon/storage-schemas.conf\")\n```\n```\n% ./carbon-schema-to-clickhouse -schemafile storage-schemas-example.conf -rollupfunction avg\n\u003cgraphite_rollup\u003e\n\t\u003c!-- carbon --\u003e\n\t\u003cpattern\u003e\n\t\t\u003cregexp\u003e^carbon\\.\u003c/regexp\u003e\n\t\t\u003cfunction\u003eavg\u003c/function\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e0\u003c/age\u003e\n\t\t\t\u003cprecision\u003e60\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e7776000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e3600\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e10368000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e21600\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e34560000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e43200\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e63072000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e86400\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e94608000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e604800\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\u003c/pattern\u003e\n\t\u003c!-- collectd --\u003e\n\t\u003cpattern\u003e\n\t\t\u003cregexp\u003e^collectd\\..*\u003c/regexp\u003e\n\t\t\u003cfunction\u003eavg\u003c/function\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e0\u003c/age\u003e\n\t\t\t\u003cprecision\u003e10\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e43200\u003c/age\u003e\n\t\t\t\u003cprecision\u003e60\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e864000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e900\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e1728000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e1800\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e3456000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e3600\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e10368000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e21600\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e34560000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e43200\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e63072000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e86400\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e94608000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e604800\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\u003c/pattern\u003e\n\t\u003c!-- netapp.capacity --\u003e\n\t\u003cpattern\u003e\n\t\t\u003cregexp\u003e^netapp\\.capacity\\.*\u003c/regexp\u003e\n\t\t\u003cfunction\u003eavg\u003c/function\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e0\u003c/age\u003e\n\t\t\t\u003cprecision\u003e900\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e8640000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e86400\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\u003c/pattern\u003e\n\t\u003c!-- default --\u003e\n\t\u003cdefault\u003e\n\t\t\u003cfunction\u003eavg\u003c/function\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e0\u003c/age\u003e\n\t\t\t\u003cprecision\u003e60\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e864000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e900\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e1728000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e1800\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e3456000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e3600\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e10368000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e21600\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e34560000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e43200\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e63072000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e86400\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\t\u003cretention\u003e\n\t\t\t\u003cage\u003e94608000\u003c/age\u003e\n\t\t\t\u003cprecision\u003e604800\u003c/precision\u003e\n\t\t\u003c/retention\u003e\n\t\u003c/default\u003e\n\u003c/graphite_rollup\u003e\n\n```\n\n## Thanks\nThanks to Roman Lomonosov for his [go-carbon](https://github.com/lomik/go-carbon) code - I'm reusing the storage schema parser here.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbzed%2Fcarbon-schema-to-clickhouse","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbzed%2Fcarbon-schema-to-clickhouse","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbzed%2Fcarbon-schema-to-clickhouse/lists"}