https://github.com/facebookarchive/LogDevice

Distributed storage for sequential data
https://github.com/facebookarchive/LogDevice

Last synced: 15 days ago
JSON representation

Distributed storage for sequential data

• Host: GitHub
• URL: https://github.com/facebookarchive/LogDevice
• Owner: facebookarchive
• License: other
• Archived: true
• Created: 2018-09-12T15:13:48.000Z (about 6 years ago)
• Default Branch: main
• Last Pushed: 2021-10-12T21:28:41.000Z (about 3 years ago)
• Last Synced: 2024-10-15T12:02:59.490Z (29 days ago)
• Language: C++
• Homepage: https://logdevice.io
• Size: 32.6 MB
• Stars: 1,900
• Watchers: 86
• Forks: 215
• Open Issues: 11
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

        
# LogDevice

[![Build Status](https://circleci.com/gh/facebookincubator/LogDevice.svg?style=shield&circle-token=1a68ba9a5f81ea693f341726bc4039980490f16e)](https://circleci.com/gh/facebookincubator/LogDevice) [![Gitter](https://badges.gitter.im/facebookincubator/LogDevice.svg)](https://gitter.im/facebookincubator/LogDevice?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge)

> Note: This is an archived project and is no longer supported or updated by Facebook.

LogDevice is a scalable and fault tolerant distributed log system. While a

file-system stores and serves data organized as files, a log system stores and

delivers data organized as logs. The log can be viewed as a record-oriented,

append-only, and trimmable file.

LogDevice is designed from the ground up to serve many types of logs with high

reliability and efficiency at scale. It's also highly tunable, allowing each use

case to be optimized for the right set of trade-offs in the durability-efficiency

and consistency-availability space. Here are some examples of workloads supported

 by LogDevice:

* Write-ahead logging for durability

* Transaction logging in a distributed database

* Event logging

* Stream processing

* ML training pipelines

* Replicated state machines

* Journals of deferred work items

For full documentation, please visit [logdevice.io](https://logdevice.io/). 

## Requirements

LogDevice is only supported on Ubuntu 18.04 (Bionic Beaver). However, it should

be possible to build it on any other Linux distribution without significant

challenges. LogDevice relies on some c++17 features, so building LogDevice

requires a compiler that supports c++17.

## Quick Start

* [Run a local cluster in Docker](https://logdevice.io/docs/LocalCluster.html)

## Documentation

* [Overview](https://logdevice.io/docs/Overview.html)

* [Concepts and Architecture](https://logdevice.io/docs/Concepts.html)

## Build LogDevice

* [Build](https://logdevice.io/docs/Installation.html)

## Join the LogDevice community

* Facebook: [LogDevice Users Group](https://www.facebook.com/groups/logdevice.oss/)

* [GitHub Issues](https://github.com/facebookincubator/LogDevice/issues)

## Contributors

See the [CONTRIBUTING](CONTRIBUTING.md) file for how to help out.

## License

LogDevice is BSD licensed, as found in the [LICENSE](LICENSE) file.