{"id":18544773,"url":"https://github.com/131/libcloudfs","last_synced_at":"2026-02-07T22:03:17.934Z","repository":{"id":73455563,"uuid":"161061033","full_name":"131/libcloudfs","owner":"131","description":"A cloud based filesystem","archived":false,"fork":false,"pushed_at":"2022-05-10T14:54:32.000Z","size":85,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-07-31T12:29:28.054Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/131.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2018-12-09T16:54:24.000Z","updated_at":"2022-05-07T18:23:05.000Z","dependencies_parsed_at":"2023-02-28T13:01:57.854Z","dependency_job_id":null,"html_url":"https://github.com/131/libcloudfs","commit_stats":null,"previous_names":[],"tags_count":9,"template":false,"template_full_name":null,"purl":"pkg:github/131/libcloudfs","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/131%2Flibcloudfs","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/131%2Flibcloudfs/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/131%2Flibcloudfs/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/131%2Flibcloudfs/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/131","download_url":"https://codeload.github.com/131/libcloudfs/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/131%2Flibcloudfs/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29209856,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-07T21:35:21.898Z","status":"ssl_error","status_checked_at":"2026-02-07T21:35:20.106Z","response_time":63,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-06T20:17:34.608Z","updated_at":"2026-02-07T22:03:17.921Z","avatar_url":"https://github.com/131.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"libcloudfs.\n\n# Motivation\n// make it work, make it simple, make is fast, make it clean\n\nUnlimited drive.\n\n[libcloudfs](https://github.com/131/libcloudfs) is [cloudfs](https://github.com/131/cloudfs) main storage driver. \n[libcloudfs](https://github.com/131/libcloudfs) is  a **file system** that stores all its data in the cloud. it stores file contents in a [CAS designed](https://github.com/131/casfs) cloud object storage backend [openstack swift](https://developer.openstack.org/api-ref/object-store/) and files metadata (inode table) in an [SQLlite database](https://github.com/131/sqlfs).\n\n\n[![Build Status](https://github.com/131/libcloudfs/actions/workflows/test.yml/badge.svg?branch=master)](https://github.com/131/libcloudfs/actions/workflows/test.yml)\n[![Coverage Status](https://coveralls.io/repos/github/131/libcloudfs/badge.svg?branch=master)](https://coveralls.io/github/131/libcloudfs?branch=master)\n[![Version](https://img.shields.io/npm/v/libcloudfs.svg)](https://www.npmjs.com/package/libcloudfs)\n[![License](https://img.shields.io/badge/license-MIT-blue.svg)](http://opensource.org/licenses/MIT)\n[![Code style](https://img.shields.io/badge/code%2fstyle-ivs-green.svg)](https://www.npmjs.com/package/eslint-plugin-ivs)\n\n![Available platform](https://img.shields.io/badge/platform-win32-blue.svg)\n![Available platform](https://img.shields.io/badge/platform-linux-blue.svg)\n\n# Installation\nlibcloudfs is a storage driver, mostly, please refer to the [cloudfs](https://github.com/131/cloudfs) project for installation instructions.\n\n\n# Project structure\n* The [libcloudfs](https://github.com/131/libcloudfs) main driver\n* An isolated inode management API (see [sqlfs](https://github.com/131/sqlfs))\n* A [fuse bindings](https://github.com/mafintosh/fuse-bindings) interface\n* A battle tested [casfs](https://github.com/131/casfs) backend, to challenge implementation, confirm design and stress\n* An openstack/[swift](https://github.com/131/swift) driver\n\n\n# Roadmap\n- [X] Read Only POC using full openstack creds\n- [X] Full Read Only POC using tempUrl keys (no full creds ever required)\n- [X] Writable Inodes POC (rename, delete, mkdir)\n- [X] Minimal fs driver\n- [X] Initial test flow (through fs driver)\n- [X] Proper deployment flow\n- [X] Writable/editable files (fs mode)\n- [X] a bit better test suite (win/linux)\n- [X] (create dedicated project for writable big fs chunks) - see [casfs - dedicated project](https://github.com/131/casfs)\n- [X] Testable SeqWriteHTTP module\n- [X] Integrated writable files (with bigfile support)\n- [X] Publish read-only mode\n- [X] Temp write file consolidation\n\n\n## Upcoming roadmap\n- [ ] garbage collector\n\n\n# Features\n* Simple by design\n* Available on all platforms (linux \u0026 Windows)\n* Unlimited file size (cloudfs is mostly designed to store and manage 100k files of 10GB+ - aka HD BR rips)\n* Fast (sqlite is actually fastest than most file system)\n* large subset of POSIX including reading/writing files, directories, rename,  symlinks, mode, uid/gid, and extended attributes\n* renames do not invole any kind of server side copy\n* native file deduplication - through CAS\n* Compatible with existing CAS\n\n## Additional features\n* nice configuration GUI\n* Directroy tree snapshot / rollback / sealing (pure SQL)\n* Instant file deletion (pure SQL)\n* Server side TAR creation (so content duplication) - through static large object.\n\n\n# Related\n* [casfs](https://github.com/131/casfs/) main backend\n* [sqlfs](https://github.com/131/sqlfs/) inode backend\n* [s3ql](https://github.com/s3ql/) python based, non CAS (but fixed block)\n\n# Credits/thanks\n* [131 - author](https://github.com/131)\n* [fuse bindings](https://github.com/mafintosh/fuse-bindings)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F131%2Flibcloudfs","html_url":"https://awesome.ecosyste.ms/projects/github.com%2F131%2Flibcloudfs","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F131%2Flibcloudfs/lists"}