https://github.com/GoogleCloudPlatform/gcsfuse
A user-space file system for interacting with Google Cloud Storage
https://github.com/GoogleCloudPlatform/gcsfuse
Last synced: 30 days ago
JSON representation
A user-space file system for interacting with Google Cloud Storage
- Host: GitHub
- URL: https://github.com/GoogleCloudPlatform/gcsfuse
- Owner: GoogleCloudPlatform
- License: apache-2.0
- Created: 2015-02-04T22:47:10.000Z (about 10 years ago)
- Default Branch: master
- Last Pushed: 2024-10-29T08:28:46.000Z (6 months ago)
- Last Synced: 2024-10-29T15:04:52.871Z (6 months ago)
- Language: Go
- Homepage: https://cloud.google.com/storage/docs/gcs-fuse
- Size: 163 MB
- Stars: 2,049
- Watchers: 69
- Forks: 428
- Open Issues: 104
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
- awesome-fuse-fs - gcsfuse - A user-space file (Built On)
- awesome-go-storage - gcsfuse - A user-space file system for interacting with Google Cloud Storage. (File System)
- awesome-starts - GoogleCloudPlatform/gcsfuse - A user-space file system for interacting with Google Cloud Storage (others)
- awesome-repositories - GoogleCloudPlatform/gcsfuse - A user-space file system for interacting with Google Cloud Storage (Go)
- awesome-go-storage - gcsfuse - A user-space file system for interacting with Google Cloud Storage. (File System)
README
[](https://codecov.io/gh/GoogleCloudPlatform/gcsfuse)
# Current status
Starting with V1.0, Cloud Storage FUSE is Generally Available and supported by Google, provided that it is used within its documented supported applications, platforms, and limits. Support requests, feature requests, and general questions should be submitted as a support request via Google Cloud support channels or via GitHub [here](https://github.com/GoogleCloudPlatform/gcsfuse/issues).
Cloud Storage FUSE is open source software, released under the
[Apache license](https://github.com/GoogleCloudPlatform/gcsfuse/blob/master/LICENSE).## _New_ Cloud Storage FUSE V2
Cloud Storage FUSE V2 provides important stability, functionality, and performance enhancements, including the introduction of a file cache that allows repeat file reads to be served from a local, faster cache storage of choice, such as a Local SSD, Persistent Disk, or even in-memory /tmpfs. The Cloud Storage FUSE file cache makes AI/ML training faster and more cost-effective by reducing the time spent waiting for data, with up to _**2.3x faster training time and 3.4x higher throughput**_ observed in training runs. This is especially valuable for multi epoch training and can serve small and random I/O operations significantly faster. The file cache feature is disabled by default and is enabled by passing a directory to 'cache-dir'. See [overview of caching](https://cloud.google.com/storage/docs/gcsfuse-cache) for more details.# ABOUT
## What is Cloud Storage FUSE?Cloud Storage FUSE is an open source FUSE adapter that lets you mount and access Cloud Storage buckets as local file systems. For a technical overview of Cloud Storage FUSE, see https://cloud.google.com/storage/docs/gcs-fuse.
## Cloud Storage FUSE for machine learning
To learn about the benefits of using Cloud Storage FUSE for machine learning projects, see https://cloud.google.com/storage/docs/gcsfuse-integrations#machine-learning.
## Limitations and key differences from POSIX file systems
To learn about limitations and differences between Cloud Storage FUSE and POSIX file systems, see https://cloud.google.com/storage/docs/gcs-fuse#differences-and-limitations.
## Pricing for Cloud Storage FUSE
For information about pricing for Cloud Storage FUSE, see https://cloud.google.com/storage/docs/gcs-fuse#charges.
# CSI Driver
Using the [Cloud Storage FUSE CSI driver](https://github.com/GoogleCloudPlatform/gcs-fuse-csi-driver), users get the declarative nature of Kubernetes
with all infrastructure fully managed by GKE in combination with Cloud Storage. This CSI
driver relies on Cloud Storage FUSE to mount Cloud storage buckets as file systems on the
GKE nodes, with the Cloud Storage FUSE deployment and management fully handled by GKE,
providing a turn-key experience.# Support
## Supported operating system and validated ML frameworks
To see supported operating system and ML frameworks that have been validated with Cloud Storage FUSE, see [here](https://cloud.google.com/storage/docs/gcs-fuse#supported-frameworks-os).
## Getting support
You can get support, submit general questions, and request new features by [filing issues in GitHub](https://github.com/GoogleCloudPlatform/gcsfuse/issues). You can also get support by using one of [Google Cloud's official support channels](https://cloud.google.com/support-hub).
See [Troubleshooting](https://github.com/GoogleCloudPlatform/gcsfuse/blob/master/docs/troubleshooting.md) for common issue handling.