Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/logv/sybil
columnar storage + NoSQL OLAP engine | https://logv.org
https://github.com/logv/sybil
columnar-storage golang olap
Last synced: 25 days ago
JSON representation
columnar storage + NoSQL OLAP engine | https://logv.org
- Host: GitHub
- URL: https://github.com/logv/sybil
- Owner: logv
- License: other
- Created: 2016-01-27T03:50:27.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2021-03-24T04:48:16.000Z (over 3 years ago)
- Last Synced: 2024-02-26T03:39:24.874Z (4 months ago)
- Topics: columnar-storage, golang, olap
- Language: Go
- Homepage: https://logv.org
- Size: 1.32 MB
- Stars: 300
- Watchers: 15
- Forks: 25
- Open Issues: 30
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Lists
- awesome-stars - logv/sybil
README
Sybil is an append only analytics datastore with no up front table schema
requirements; just log JSON records to a table and run queries. Written in Go,
sybil is designed for fast full table scans of multi-dimensional data on one or
more machines.more documentation is available [on the wiki](http://github.com/logv/sybil/wiki)
and [in the repo](http://github.com/logv/sybil/blob/master/docs).if sybil by itself is uninteresting (who wants to run command line queries,
anyways?), sybil is a supported backend for
[snorkel](http://github.com/logv/snorkel)advantages
----------* Easy to setup and get data inside sybil - just pipe JSON on stdin to sybil
* Supports histograms (and percentiles), standard deviations and time series roll ups
* Runs fast full table queries ([performance notes](http://github.com/logv/sybil/wiki/Performance))
* Lower disk usage through per column compression schemes
* Serverless design with controlled memory usage
* Per table retention policies (specify max age and/or size of tables)
* Timestamp resistant query cache (optional) that avoids recomputationdisadvantages
-------------* JOINS not supported
* No UPDATE operation on data - only writesinstallation
------------go get github.com/logv/sybil
build status
------------[![CircleCI](https://circleci.com/gh/logv/sybil.svg?style=svg)](https://circleci.com/gh/logv/sybil)
additional information
----------------------* [command line tour](http://github.com/logv/sybil/wiki/Quick-Overview)
* [want to contribute?](http://github.com/logv/sybil/wiki/Contributing)
* [notes on performance](http://github.com/logv/sybil/wiki/Performance)
* [implementation notes](https://logv.org/sybil-implementation.html)
* [abadi survey of column stores](http://db.csail.mit.edu/pubs/abadi-column-stores.pdf)