Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with distributed-file-system
A curated list of projects in awesome lists tagged with distributed-file-system .
https://github.com/seaweedfs/seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
blob-storage cloud-drive distributed-file-system distributed-storage distributed-systems erasure-coding fuse hadoop-hdfs hdfs kubernetes object-storage posix replication s3 s3-storage seaweedfs tiered-file-system
Last synced: 16 Dec 2024
https://github.com/ceph/ceph
Ceph is a distributed object, block, and file storage platform
block-storage cloud-storage distributed-file-system distributed-storage erasure-coding fuse hdfs high-performance highly-available iscsi kubernetes nfs nvme-over-fabrics object-store posix replication s3 smb software-defined-storage storage
Last synced: 16 Dec 2024
https://github.com/happyfish100/fastdfs
FastDFS is an open source high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs
distributed-file-storage distributed-file-system storage-servers
Last synced: 16 Dec 2024
https://github.com/cubefs/cubefs
cloud-native distributed storage
ai-native-storage cloud-native-storage cloud-storage cncf data-orchestration distributed-file-system distributed-storage erasure-coding fuse hybrid-cloud kubernetes object-storage
Last synced: 16 Dec 2024
https://github.com/cubeFS/cubefs
cloud-native distributed storage
ai-native-storage cloud-native-storage cloud-storage cncf data-orchestration distributed-file-system distributed-storage erasure-coding fuse hybrid-cloud kubernetes object-storage
Last synced: 07 Nov 2024
https://github.com/sjqzhang/go-fastdfs
go-fastdfs 是一个简单的分布式文件系统(私有云存储),具有无中心、高性能,高可靠,免维护等优点,支持断点续传,分块上传,小文件合并,自动同步,自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic repair.(similar fastdfs).
breakpoint-resume cloud-storage cloudnative distributed-file-storage distributed-file-system fastdfs file-system fileserver filesystem go go-fastdfs godfs object-storage-service oss rsync small-file-merge storage storage-servers sync tus
Last synced: 19 Dec 2024
https://github.com/moosefs/moosefs
MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage
backup block-storage distributed-computing distributed-file-storage distributed-file-system distributed-storage ditributed-systems erasure-coding file-storage file-system filesystem fuse high-availability media posix posix-compliant snapshots software-defined-storage storage tiering
Last synced: 19 Dec 2024
https://github.com/leo-project/leofs
The LeoFS Storage System
datalake distributed-file-system distributed-storage erlang leofs nfs nfs-server s3 s3-storage
Last synced: 21 Dec 2024
https://github.com/wenweihu86/raft-java
Raft Java implementation which is simple and easy to understand.
distributed-file-system distributed-storage raft raft-algorithm raft-consensus raft-consensus-algorithm raft-java raft-protocol
Last synced: 31 Oct 2024
https://github.com/Hexilee/tifs
A distributed POSIX filesystem based on TiKV, with partition tolerance and strict consistency.
distributed-file-system distributed-systems filesystem fuse posix-compatible tifs tikv
Last synced: 09 Nov 2024
https://github.com/hexilee/tifs
A distributed POSIX filesystem based on TiKV, with partition tolerance and strict consistency.
distributed-file-system distributed-systems filesystem fuse posix-compatible tifs tikv
Last synced: 15 Dec 2024
https://github.com/freakmaxi/kertish-dfs
Kertish-dfs is a simple distributed storage platform, implements file storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dfs aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.
data-farm dfs distributed-file-storage distributed-file-system distributed-storage scalable
Last synced: 01 Nov 2024
https://github.com/richardschneider/net-ipfs-engine
IPFS Core API implementation in .Net
distributed-file-system ipfs peer-to-peer pubsub
Last synced: 21 Dec 2024
https://github.com/pitchpoint-solutions/sfs
The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)
distributed-file-system distributed-storage distributed-systems elasticsearch java object-storage openstack-swift rxjava vertx
Last synced: 09 Oct 2024
https://github.com/ibm/ipfsfb
InterPlanetary File System for Business (IPFSfB) is an enterprise blockchain storage network based on InterPlanetary File System.
blockchain cryptography distributed-file-system ipfs networking p2p protocol
Last synced: 30 Sep 2024
https://github.com/unixjunkie/daft
DAFT Allows File Transfers
cli cryptography distributed-file-system ocaml-program user-space
Last synced: 15 Oct 2024
https://github.com/foreverbell/yfs
Yet Another File System (yfs) based on Paxos algorithm.
Last synced: 15 Nov 2024
https://github.com/ks-amit/distributed-database
A travel agency app with a distributed database implemented from scratch!
bulma bulma-css distributed-database distributed-file-system distributed-storage distributed-systems django django-rest-framework fault-tolerance gfs heartbeat-service postgresql python travel-agency
Last synced: 14 Oct 2024
https://github.com/WilliamX1/cse-2021
A distributed file system similar to Google File System (GFS).
distributed-file-system gfs mapreduce raft rpc
Last synced: 08 Nov 2024
https://github.com/codenoid/sdfs
a Connector |> Distributed File System based on Symlinking (that fit author need)
distributed-file-system distributed-systems
Last synced: 19 Oct 2024
https://github.com/deric/puppet-beegfs
Manage BeeGFS parallel system installations.
beegfs distributed-file-system puppet storage
Last synced: 12 Oct 2024
https://github.com/tibold/docker-volume-sharedfs
A docker volume driver for shared filesystems.
distributed-file-system docker docker-plugin docker-volume-driver docker-volume-plugin volume
Last synced: 21 Nov 2024
https://github.com/arpan491/distributed-filesystem
An open-source, scalable, decentralized, robust, heterogeneous file storage solution which is fault tolerant, replicated, distributed and lets you upload, download, and see the catalog of other cluster with low latency and LRU cache capabilities.
distributed-file-system grpc-python heartbeat-service lru-cache multithreading poxy-server protobuf3 python3 raft-consensus-algorithm
Last synced: 18 Oct 2024
https://github.com/hasanimran96/project-distributed-file-system
Final Project for my distributed systems course
algorithm client-server-architecture distributed-file-system python3
Last synced: 16 Nov 2024
https://github.com/artemgr/rados.hi.rs
Opinionated high-level wrapper for librados (Ceph).
asynchronous ceph distributed-database distributed-file-system futures librados rados
Last synced: 17 Dec 2024
https://github.com/federicoponzi/mydfs
A simple distributed file system.
c distributed-file-system distributed-system
Last synced: 01 Dec 2024
https://github.com/roll-w/scake
A high available, scalable distributed file system.
distributed distributed-file-system distributed-storage distributed-system java java-8 spring spring-boot
Last synced: 19 Nov 2024
https://github.com/alpha74/contentbucket
Web application for sharing resources on a network where each user can contribute though uploads to Central Server.
content-management-system distributed-file-system filesharing filesystem lampp online-learning php server xampp
Last synced: 15 Nov 2024
https://github.com/drostlab/hitparsr
Distributed Databasing of Alignment Hit Data
distributed-database distributed-file-system distributed-storage
Last synced: 12 Nov 2024
https://github.com/anjaloh/fileshard
A minimal prototype of a Distributed File Management System (DFMS) implemented with 🧬 MoleculerJS.
distributed-file-system microservice moleculer mongodb redis traefik
Last synced: 14 Nov 2024
https://github.com/joao-conde/feup-sdis-backup-system
Repository to host the first Distributed Systems project, a third year course @FEUP
backup distributed-computing distributed-file-system distributed-systems
Last synced: 13 Nov 2024
https://github.com/igoraugust0/distsys
🌎 Arquivos e materiais utilizados na disciplina GSI028 - Sistemas Distribuídos da UFU.
architecture consistency dht distributed-file-system distributed-systems distributed-transactions dns middleware naming nfs ntp processes replication rpc scaling sockets stateful stateless transparency
Last synced: 19 Nov 2024
https://github.com/heracliteanflux/exercises-scala
Exercises in the Scala programming language with an emphasis on big data programming and applications in Apache Hadoop and Apache Spark.
apache-hadoop apache-maven apache-spark distributed-computing distributed-file-system distributed-systems hadoop map-reduce mrjob scala spark
Last synced: 18 Nov 2024
https://github.com/gabrielluizbh/sms-dfs
Script para migração de DFS com Storage Migration Service.
dfs distributed-file-system powershell windows-admin-center windows-server windows-server-2022
Last synced: 25 Nov 2024
https://github.com/gabrielluizbh/staging-area-dfsr-needs-for-a-replicated-folder
Script para encontrar os 32 maiores arquivos para determinar a área mínima de preparo exigida pelo DFSR para uma pasta replicada
dfs dfsr dfsreplication distributed-file-system distributed-file-system-replication windows-server windows-server-2022
Last synced: 25 Nov 2024
https://github.com/kierse/distributed-app
eece513 distributed-app
distributed-computing distributed-file-system distributed-systems kotlin
Last synced: 28 Nov 2024