https://github.com/cubeFS/cubefs

cloud-native distributed storage
https://github.com/cubeFS/cubefs

ai-native-storage cloud-native-storage cloud-storage cncf data-orchestration distributed-file-system distributed-storage erasure-coding fuse hybrid-cloud kubernetes object-storage

Last synced: about 1 month ago
JSON representation

cloud-native distributed storage

• Host: GitHub
• URL: https://github.com/cubeFS/cubefs
• Owner: cubefs
• License: apache-2.0
• Created: 2019-02-19T03:15:04.000Z (almost 6 years ago)
• Default Branch: master
• Last Pushed: 2024-10-29T09:23:35.000Z (about 2 months ago)
• Last Synced: 2024-10-29T09:55:24.754Z (about 2 months ago)
• Topics: ai-native-storage, cloud-native-storage, cloud-storage, cncf, data-orchestration, distributed-file-system, distributed-storage, erasure-coding, fuse, hybrid-cloud, kubernetes, object-storage
• Language: Go
• Homepage: https://cubefs.io
• Size: 205 MB
• Stars: 4,636
• Watchers: 107
• Forks: 666
• Open Issues: 223
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Codeowners: .github/CODEOWNERS
  • Security: SECURITY.md
  • Governance: GOVERNANCE.md
  • Roadmap: ROADMAP.md

Awesome Lists containing this project

README

        
# CubeFS

[![CNCF Status](https://img.shields.io/badge/cncf%20status-incubating-blue.svg)](https://www.cncf.io/projects)

[![Build Status](https://github.com/cubefs/cubefs/actions/workflows/ci.yml/badge.svg)](https://github.com/cubefs/cubefs/actions/workflows/ci.yml)

[![LICENSE](https://img.shields.io/github/license/cubefs/cubefs.svg)](https://github.com/cubefs/cubefs/blob/master/LICENSE)

[![Language](https://img.shields.io/badge/Language-Go-blue.svg)](https://golang.org/)

[![Go Report Card](https://goreportcard.com/badge/github.com/cubefs/cubefs)](https://goreportcard.com/report/github.com/cubefs/cubefs)

[![Docs](https://img.shields.io/badge/docs-latest-green.svg)](https://cubefs.io/docs/master/overview/introduction.html)

[![CII Best Practices](https://bestpractices.coreinfrastructure.org/projects/2761/badge)](https://bestpractices.coreinfrastructure.org/projects/6232)

[![OpenSSF Scorecard](https://api.securityscorecards.dev/projects/github.com/cubefs/cubefs/badge)](https://securityscorecards.dev/viewer/?uri=github.com/cubefs/cubefs)

[![Codecov](https://img.shields.io/codecov/c/github/cubefs/cubefs?style=flat-square&logo=codecov)](https://codecov.io/gh/cubefs/cubefs)

[![Artifact HUB](https://img.shields.io/endpoint?url=https://artifacthub.io/badge/repository/cubefs)](https://artifacthub.io/packages/helm/cubefs/cubefs)

[![CLOMonitor](https://img.shields.io/endpoint?url=https://clomonitor.io/api/projects/cncf/chubao-fs/badge)](https://clomonitor.io/projects/cncf/chubao-fs)

[![FOSSA Status](https://app.fossa.com/api/projects/git%2Bgithub.com%2Fcubefs%2Fcubefs.svg?type=shield&issueType=security)](https://app.fossa.com/projects/git%2Bgithub.com%2Fcubefs%2Fcubefs?ref=badge_shield)

[![Release](https://img.shields.io/github/v/release/cubefs/cubefs.svg?color=161823&style=flat-square&logo=smartthings)](https://github.com/cubefs/cubefs/releases)

[![Tag](https://img.shields.io/github/v/tag/cubefs/cubefs.svg?color=ee8936&logo=fitbit&style=flat-square)](https://github.com/cubefs/cubefs/tags)

| Community Meeting|

|------------------|

| The CubeFS Project holds bi-weekly community online meeting. To join or watch previous meeting notes and recordings, please see [meeting schedule](https://github.com/cubefs/community/wiki/Meeting-Schedule) and [meeting minutes](https://github.com/cubefs/community/wiki/Meeting-Agenda-and-Notes). |



## Overview

CubeFS ("储宝" in Chinese) is an open-source cloud-native file storage system, hosted by the [Cloud Native Computing Foundation](https://cncf.io) (CNCF) as an [incubating](https://www.cncf.io/projects/) project.

## What can you build with CubeFS

As an open-source distributed storage, CubeFS can serve as your datacenter filesystem, data lake storage infra, and private or hybrid cloud storage. 

In particular, CubeFS enables the separation of storage/compute architecture for databases and AI/ML applications.

Some key features of CubeFS include:

- Multiple access protocols such as POSIX, HDFS, S3, and its own REST API

- Highly scalable metadata service with strong consistency  

- Performance optimization of large/small files and sequential/random writes

- Multi-tenancy support with better resource utilization and tenant isolation

- Hybrid cloud I/O acceleration through multi-level caching

- Flexible storage policies, high-performance replication or low-cost erasure coding



## Documents

- English version: https://cubefs.io/docs/master/overview/introduction.html

- Chinese version: https://cubefs.io/zh/docs/master/overview/introduction.html

## Community

- Homepage: [cubefs.io](https://cubefs.io/)

- Mailing list: [email protected]

- Slack: [cubefs.slack.com](https://cubefs.slack.com/)

- WeChat: detail see [here](https://github.com/cubefs/cubefs/issues/604)

- Twitter: [cubefs_storage](https://twitter.com/cubefs_storage)

## Partners and Users

There is the list of users and success stories [ADOPTERS.md](ADOPTERS.md).

## Reference

Haifeng Liu, et al., CFS: A Distributed File System for Large Scale Container Platforms. SIGMOD‘19, June 30-July 5, 2019, Amsterdam, Netherlands. 

For more information, please refer to https://dl.acm.org/citation.cfm?doid=3299869.3314046 and https://arxiv.org/abs/1911.03001

## License

CubeFS is licensed under the [Apache License, Version 2.0](http://www.apache.org/licenses/LICENSE-2.0).

For detail see [LICENSE](LICENSE) and [NOTICE](NOTICE).

## Note

The master branch may be in an unstable or even broken state during development. Please use releases instead of the master branch in order to get a stable set of binaries.

## Star History

[![Star History Chart](https://api.star-history.com/svg?repos=cubefs/cubefs&type=Date)](https://star-history.com/#cubefs/cubefs&Date)