{"id":20528234,"url":"https://github.com/manticoresoftware/columnar","last_synced_at":"2026-02-07T11:04:19.113Z","repository":{"id":38319091,"uuid":"343648351","full_name":"manticoresoftware/columnar","owner":"manticoresoftware","description":"Manticore Columnar Library","archived":false,"fork":false,"pushed_at":"2026-01-31T09:35:09.000Z","size":6906,"stargazers_count":99,"open_issues_count":18,"forks_count":18,"subscribers_count":13,"default_branch":"master","last_synced_at":"2026-01-31T11:12:29.194Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/manticoresoftware.png","metadata":{"files":{"readme":"README.md","changelog":"Changelog.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":"NOTICE","maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2021-03-02T04:45:26.000Z","updated_at":"2026-01-29T05:31:36.000Z","dependencies_parsed_at":"2023-02-12T00:30:32.378Z","dependency_job_id":"9c4f6e78-930a-470b-a794-3611fcaf5271","html_url":"https://github.com/manticoresoftware/columnar","commit_stats":null,"previous_names":[],"tags_count":73,"template":false,"template_full_name":null,"purl":"pkg:github/manticoresoftware/columnar","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/manticoresoftware%2Fcolumnar","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/manticoresoftware%2Fcolumnar/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/manticoresoftware%2Fcolumnar/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/manticoresoftware%2Fcolumnar/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/manticoresoftware","download_url":"https://codeload.github.com/manticoresoftware/columnar/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/manticoresoftware%2Fcolumnar/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29193089,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-07T07:37:03.739Z","status":"ssl_error","status_checked_at":"2026-02-07T07:37:03.029Z","response_time":63,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-15T23:24:07.456Z","updated_at":"2026-02-07T11:04:19.098Z","avatar_url":"https://github.com/manticoresoftware.png","language":"C++","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://manticoresearch.com\" target=\"_blank\" rel=\"noopener\"\u003e\n    \u003cimg src=\"https://manticoresearch.com/manticore-logo-central.svg\" width=\"15%\" alt=\"Manicore Search Logo\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n\u003ch1 align=\"center\"\u003e\n  Manticore Columnar Library\n\u003c/h1\u003e\n\nManticore Columnar Library is a column-oriented storage and secondary indexing library, aiming to provide **decent performance with low memory footprint at big data volume**.\nWhen used in combination with [Manticore Search](https://github.com/manticoresoftware/manticoresearch) can be beneficial for those looking for:\n1. log analytics including rich free text search capabities (which is missing in e.g. [Clickhouse](https://github.com/ClickHouse/ClickHouse) - great tool for metrics analytics)\n2. faster / low resource consumption log/metrics analytics. Since the library and Manticore Search are both written in C++ with low level optimizations in mind, in many cases the performance / RAM consumption is better than in Lucene / SOLR / Elasticsearch\n3. running log / metric analytics in docker / kubernetes. Manticore Search + the library can work with as little as 30 megabytes of RAM which Elasticsearch / Clickhouse can't. It also starts in less than a second or a few seconds in the worst case. Since the overhead is so little you can afford having more nodes of Manticore Search + the library than Elasticsearch. More nodes and quicker start means higher high availability and agility.\n4. powerful SQL for logs/metrics analytics and everything else [Manticore Search](https://github.com/manticoresoftware/manticoresearch) can give you\n\n## Getting started\n\n### Requirements\n\n1. CPU: with SSE \u003e= 4.2\n2. Architecture: arm64 or x86_64 \n3. OS: Debian-based OS (Debian, Ubuntu, Mint), RHEL-based (RHEL, Centos, Alma, Oracle Linux, Amazon Linux) OS, Windows, MacOS\n\n### Installation from yum/apt repositories\n#### Ubuntu, Debian:\n```bash\nwget https://repo.manticoresearch.com/manticore-repo.noarch.deb\nsudo dpkg -i manticore-repo.noarch.deb\nsudo apt update\nsudo apt install manticore-columnar-lib\n```\n\n#### Centos:\n```bash\nsudo yum install https://repo.manticoresearch.com/manticore-repo.noarch.rpm\nsudo yum install manticore-columnar-lib\n```\n\n`searchd -v` should include `columnar x.y.z`, e.g.:\n```bash\nroot@srv# searchd -v\nManticore 6.0.2 89c7a5139@230210 (columnar 2.0.0 a7c703d@230130) (secondary 2.0.0 a7c703d@230130)\n```\n\n### Basic usage:\n1. Read https://manual.manticoresearch.com/Creating_a_table/Data_types#Row-wise-and-columnar-attribute-storages\n2. Create plain or real-time table specifying that the columnar storage should be used\n\n## Benchmarks\n\n### Log analytics - 6x faster than Elasticsearch\n\nhttps://db-benchmarks.com/test-logs10m/#elasticsearch-tuned-vs-manticore-search-columnar-storage\n\n![logs_es_msc](https://db-benchmarks.com/test-logs10m/est_msc.png)\n\n### Log analytics - 1.4x faster than Clickhouse\n\nhttps://db-benchmarks.com/test-logs10m/#clickhouse-vs-manticore-search-columnar-storage\n\n![logs_es_ch](https://db-benchmarks.com/test-logs10m/ch_msc.png)\n\n### Medium data - 110M Hackernews comments - 5x faster than Elasticsearch\n\nhttps://db-benchmarks.com/test-hn/#manticore-search-columnar-storage-vs-elasticsearch\n\n![hn_es_msc](https://db-benchmarks.com/test-hn/msc_es.png)\n\n### Medium data - 110M Hackernews comments - 11x faster than Clickhouse\n\nhttps://db-benchmarks.com/test-hn/#manticore-search-columnar-storage-vs-clickhouse\n\n![hn_msc_ch](https://db-benchmarks.com/test-hn/msc_ch.png)\n\n### Big data - 1.7B NYC taxi rides - 4x faster than Elasticsearch\n\nhttps://db-benchmarks.com/test-taxi/#manticore-search-vs-elasticsearch\n\n![taxi_ms_es](https://db-benchmarks.com/test-taxi/ms_es.png)\n\n### Big data - 1.7B NYC taxi rides - 1.8x faster than Clickhouse\n\nhttps://db-benchmarks.com/test-taxi/#manticore-search-vs-clickhouse\n\n![taxi_ms_ch](https://db-benchmarks.com/test-taxi/ms_ch.png)\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmanticoresoftware%2Fcolumnar","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmanticoresoftware%2Fcolumnar","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmanticoresoftware%2Fcolumnar/lists"}