https://github.com/crrow/kisekifs
Kiseki is a Rust implementation for Juicedata's juicefs (https://github.com/juicedata/juicefs), a distributed POSIX file system built on top of Redis and S3.
https://github.com/crrow/kisekifs
cloud-native filesystem fuse posix rust s3 storage
Last synced: 5 months ago
JSON representation
Kiseki is a Rust implementation for Juicedata's juicefs (https://github.com/juicedata/juicefs), a distributed POSIX file system built on top of Redis and S3.
- Host: GitHub
- URL: https://github.com/crrow/kisekifs
- Owner: crrow
- License: apache-2.0
- Created: 2024-01-14T07:44:28.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2025-09-03T17:08:50.000Z (10 months ago)
- Last Synced: 2025-09-03T19:21:31.004Z (10 months ago)
- Topics: cloud-native, filesystem, fuse, posix, rust, s3, storage
- Language: Rust
- Homepage: https://crrow.github.io/kisekifs/
- Size: 1.72 MB
- Stars: 32
- Watchers: 3
- Forks: 2
- Open Issues: 9
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
README
# Kiseki
Go check the [doc](https://crrow.github.io/kisekifs/).
Kiseki is my learning rust project, a simple 'distributed' fuse file system that is port
of [JuiceFS](https://github.com/juicedata/juicefs).
**It's just a rust learning project**
If you don't know juicefs very much, the following is the introduction of juicefs:
```
JuiceFS is an open-source, high-performance distributed file system designed for the cloud. By providing full POSIX
compatibility, it allows almost all kinds of object storage to be used as massive
local disks and to be mounted and accessed on different hosts across platforms and regions.
JuiceFS separates "data" and "metadata" storage. Files are split into chunks and stored in object storage like Amazon
S3. The corresponding metadata can be stored in various databases such as Redis, MySQL, TiKV, and SQLite, based on the
scenarios and requirements.
```
FUSE must be installed to build or run programs that use fuse-rs (i.e. kernel driver and libraries. Some platforms may
also require userland utils like `fusermount`). A default installation of FUSE is usually sufficient.
To build fuse-rs or any program that depends on it, `pkg-config` needs to be installed as well.
## Difference with juicefs
### 1. Write Buffer
JuiceFS uses a pre-allocated memory and growable bytes pool as write buffer,
but this pool is also used for make reading buffer.
Kiseki's write buffer pool is fixed-size, and it is consist of a in-memory bytes
pool and a mmap file.
### 2. Cache
JuiceFs use disk-eviction mechinism to manage the writeback cache,
in Kisekifs, it employs [moka](https://github.com/moka-rs/moka) to implement the
write back cache, much cleaner and efficient.
### 3. How to read slices
JuiceFs reorganize the slices into a linkedlist, kisekifs use [rangemap](https://github.com/jeffparsons/rangemap) to
handle the trick part.
# Posix Compliance
Totally not compliant with posix, go to the issue page check the details.
## Disclaimer
Kiseki is an independent learning project
and is not endorsed by or affiliated with the Juice company.
# License
Apache-2.0