https://github.com/codenoid/Fido

E2E Solution for Distributed Cold-Data Storage
https://github.com/codenoid/Fido

distributed-storage distributed-systems

Last synced: about 1 month ago
JSON representation

E2E Solution for Distributed Cold-Data Storage

• Host: GitHub
• URL: https://github.com/codenoid/Fido
• Owner: codenoid
• Created: 2019-11-04T05:05:40.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2020-03-19T13:21:18.000Z (over 4 years ago)
• Last Synced: 2024-11-01T17:51:40.734Z (about 1 month ago)
• Topics: distributed-storage, distributed-systems
• Language: Rust
• Homepage:
• Size: 36.1 KB
• Stars: 8
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-indo-projects - Fido - Distributed Storage, Easily distribute your data accross disk/node. (Rust)
• awesome-indonesia-repo - Fido - Distributed Storage, Easily distribute your data accross disk/node. (Rust)

README

        
# Fido [Active Development]

E2E Solution for your distributed file storage

## Real-World use case

1. you need to download a file, many files, a bunch of file from your scraper

2. one disk is not enough, you always need more

3. then you decide to use Fido with Systemd

4. Fido will automatically distribute your files into selected external disk

5. When your files getting bigger again, just add external disk again to your server

## Prerequisite

1. Make sure you have running mongodb server, if not, [install mongodb](https://docs.mongodb.com/manual/tutorial/install-mongodb-on-ubuntu/)

2. Setup mongodb url in [here](https://github.com/codenoid/Fido/blob/master/src/main.rs#L49)

## Installation

```

git clone 

cd Fido

cargo build --release

```

## Usage

```bash

# generate symbolic link for any data that already in brick/slave/disk

# --path are not used in --cmd 0

./target/release/Fido --cmd 0 --path / --bricks /mnt/disks/disk-1

# move temporary file to brick/slave/disk, then create ln from disk to temporary location

./target/release/Fido --cmd 1 --path /path/to/scrapped-data --bricks /mnt/disks/

```