Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/frugalos/frugalos
Frugal Object Storage
https://github.com/frugalos/frugalos
distributed-object-store object-storage rust
Last synced: 2 days ago
JSON representation
Frugal Object Storage
- Host: GitHub
- URL: https://github.com/frugalos/frugalos
- Owner: frugalos
- License: mit
- Created: 2018-10-25T06:21:38.000Z (about 6 years ago)
- Default Branch: develop
- Last Pushed: 2022-12-06T19:05:30.000Z (almost 2 years ago)
- Last Synced: 2024-03-14T23:47:12.325Z (8 months ago)
- Topics: distributed-object-store, object-storage, rust
- Language: Rust
- Size: 1.52 MB
- Stars: 392
- Watchers: 17
- Forks: 28
- Open Issues: 96
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
README
Frugalos
Frugal Object Storage
Frugalos is a distributed object storage written by Rust.
It is suitable for storing medium size BLOBs that become petabyte scale in total.
Documentation
-------------
- [Rustdoc](https://docs.rs/frugalos)
- [Wiki (Japanese version only)](https://github.com/frugalos/frugalos/wiki)
- [Real World Example in Niconico (used for recording live video streams)][niconico example]
[niconico example]: https://dwango.github.io/articles/frugalos/
Installation
------------
You can install `frugalos` by the following command:
```console
$ cargo install frugalos
```
**Note:** The current installation process requires `automake`, `autoconf`, and `libtool` to build [liberasurecode] internally. If you have not installed them, please install them. (See also [liberasurecode's prerequisites])
You can also use pre-build binaries from the [releases] page.
[liberasurecode]: https://github.com/frugalos/liberasurecode
[liberasurecode's prerequisites]: https://github.com/frugalos/liberasurecode#prerequisites-to-build
[releases]: https://github.com/frugalos/frugalos/releases
Simple Example
------------
```console
// Create a cluster.
$ frugalos create --id example --data-dir example/
Oct 26 13:42:06.244 INFO [START] create: local=Server { id: "example", seqno: 0, host: V4(127.0.0.1), port: 14278 }; data_dir.as_ref()="example/"; , server: [email protected]:14278, module: frugalos_config::cluster:121
Oct 26 13:42:06.245 INFO Creates data directry: "example/", server: [email protected]:14278, module: frugalos_config::cluster:113
Oct 26 13:42:06.256 INFO [START] LoadBallot: lump_id=LumpId("03000000000000000000000000000000"); , server: [email protected]:14278, module: frugalos_raft::storage::ballot:21
...
...
// Start a frugalos process in the background.
$ frugalos start --data-dir example/ &
Oct 26 13:46:16.046 INFO Local server info: Server { id: "example", seqno: 0, host: V4(127.0.0.1), port: 14278 }, module: frugalos_config::service:68
Oct 26 13:46:16.062 INFO [START] LoadBallot: lump_id=LumpId("03000000000000000000000000000000"); , module: frugalos_raft::storage::ballot:21
Oct 26 13:46:16.086 INFO Starts RPC server, server: 127.0.0.1:14278, module: fibers_rpc::rpc_server:221
...
...
// Add a device and a bucket to store objects.
$ DEVICE_JSON='{"file": {"id": "file0", "server": "example", "filepath": "example/file0.lusf"}}'
$ curl -XPUT -d "$DEVICE_JSON" http://localhost:3000/v1/devices/file0
{"file":{"id":"file0","seqno":0,"weight":"auto","server":"example","capacity":19556691462,"filepath":"example/file0.lusf"}}%
$ BUCKET_JSON='{"metadata": {"id": "bucket0", "device": "file0", "tolerable_faults": 1}}'
$ curl -XPUT -d "$BUCKET_JSON" http://localhost:3000/v1/buckets/bucket0
{"metadata":{"id":"bucket0","seqno":0,"device":"file0","segment_count":1,"tolerable_faults":1}}%
// PUT and GET an object.
$ curl -XPUT -d 'your_object_data' http://localhost:3000/v1/buckets/bucket0/objects/your_object_id
$ curl http://localhost:3000/v1/buckets/bucket0/objects/your_object_id
your_object_data
```
Please see [REST API] for details and other available APIs.
[REST API]: https://github.com/frugalos/frugalos/wiki/REST-API
For Frugalos Developers
-----------------------
Please see [Developer's Guide].
[Developer's Guide]: https://github.com/frugalos/frugalos/wiki/Developer%27s-Guide