Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with google-cloud-storage

A curated list of projects in awesome lists tagged with google-cloud-storage .

https://github.com/rclone/rclone

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

azure-blob azure-blob-storage azure-files backblaze-b2 cloud-storage dropbox encryption ftp fuse-filesystem go golang google-cloud-storage google-drive onedrive openstack-swift rclone s3 sftp sync webdav

Last synced: 12 May 2025

https://github.com/ncw/rclone

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

azure-blob azure-blob-storage azure-files backblaze-b2 cloud-storage dropbox encryption ftp fuse-filesystem go golang google-cloud-storage google-drive onedrive openstack-swift rclone s3 sftp sync webdav

Last synced: 15 Apr 2025

https://github.com/thanos-io/thanos

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

cncf go google-cloud-storage hacktoberfest high-availability metrics monitoring observability prometheus prometheus-ha-pairs prometheus-setup s3 storage thanos

Last synced: 12 May 2025

https://github.com/firebase/functions-samples

Collection of sample apps showcasing popular use cases using Cloud Functions for Firebase

faas faas-platform firebase google google-cloud-functions google-cloud-platform google-cloud-storage serverless

Last synced: 14 May 2025

https://github.com/drakkan/sftpgo

Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob

azure-blob cloud-storage data-at-rest-encryption docker ftp ftp-server git go google-cloud-storage multi-factor-authentication portable prometheus proxy-protocol s3 scp sftp sftp-server webdav webdav-server

Last synced: 12 May 2025

https://github.com/kopia/kopia

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

backup cloud deduplication encryption google-cloud-storage hacktoberfest

Last synced: 13 May 2025

https://github.com/gaul/s3proxy

Access other storage backends via the S3 API

atmos aws-s3 azure backblaze-b2 google-cloud-storage openstack-swift proxy s3

Last synced: 16 May 2025

https://github.com/fsouza/fake-gcs-server

Google Cloud Storage emulator & testing library.

emulator gcp gcs google-cloud-storage hacktoberfest storage

Last synced: 16 May 2025

https://github.com/tus/tus-node-server

Node.js tus server, standalone or integrable in any framework, with disk, S3, Azure, and GGC stores.

aws-s3 azure file-storage google-cloud-storage nodejs resumable-upload tus upload upload-server

Last synced: 13 May 2025

https://github.com/drivendataorg/cloudpathlib

Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

azure-blob cloud-storage google-cloud-storage pathlib python s3

Last synced: 14 May 2025

https://github.com/Slynova-Org/flydrive

☁️ Flexible and Fluent framework-agnostic driver based system to manage storage in Node.js

digital-ocean-spaces driver filesystem framework-agnostic google-cloud-storage nodejs s3 storage

Last synced: 08 Apr 2025

https://github.com/developmentseed/obstore

The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.

amazon-s3 azure azure-storage cloudflare-r2 google-cloud-storage object-store python rust s3

Last synced: 15 May 2025

https://github.com/hayorov/helm-gcs

Manage Helm 3 repositories on Google Cloud Storage 🔐 **privately**

bucket chart gcs google-cloud-storage helm helm-gcs helm-plugin kubernetes

Last synced: 02 Apr 2025

https://github.com/google-github-actions/upload-cloud-storage

A GitHub Action for uploading files to a Google Cloud Storage (GCS) bucket.

actions gcp gcs github-actions google-cloud google-cloud-platform google-cloud-storage

Last synced: 14 May 2025

https://github.com/renaudcerrato/appengine-maven-repository

Free Private Maven repositories hosted on Google App-Engine, backed by Google Cloud Storage and deployed in less than 5 minutes.

appengine appengine-java google-cloud-storage jersey2 maven

Last synced: 14 Apr 2025

https://github.com/gaul/are-we-consistent-yet

Compare eventual consistency of object stores

aws-s3 azure consistency google-cloud-storage openstack-swift s3

Last synced: 08 May 2025

https://github.com/bardisty/ytdlrc

:cloud: Downloads videos and metadata with youtube-dl and moves each file on completion to an rclone remote

amazon-drive amazon-s3 backblaze-b2 box ceph datahoarder digitalocean-spaces download-videos dropbox google-cloud-storage google-drive hubic mega metadata microsoft-onedrive ovh posix rclone wrapper youtube-dl

Last synced: 08 Apr 2025

https://github.com/ofek/csi-gcs

Kubernetes CSI driver for Google Cloud Storage

containers csi gcp golang google-cloud-storage kubernetes storage

Last synced: 19 Dec 2024

https://github.com/codebrewlab/nestjs-storage

Nestjs file system / file storage module wrapping flydrive

driver filesystem flydrive google-cloud-storage nestjs nodejs s3 storage typescript

Last synced: 09 Apr 2025

https://github.com/openbridge/ob_bulkstash

Bulk Stash is a docker rclone service to sync, or copy, files between different storage services. For example, you can copy files either to or from a remote storage services like Amazon S3 to Google Cloud Storage, or locally from your laptop to a remote storage.

amazon-web-services data-pipeline docker docker-image docker-rclone docker-service google-cloud google-cloud-storage oracle-cloud rclone s3 sftp-synchronisation storage-service sync

Last synced: 10 Apr 2025

https://github.com/line/jnotebook_reader

:black_joker: An awesome viewer to browse and render Jupyter Notebooks from local, Amazon S3, Google Cloud Storage or MinIO

amazon-s3 google-cloud-storage ipynb-viewer jnotebook-reader jupyter jupyter-notebook minio notebook-reader notebook-viewer

Last synced: 12 Apr 2025

https://github.com/managedcode/storage

Storage library provides a universal interface for accessing and manipulating data in different cloud blob storage providers

aws aws-s3 azure azure-storage blob blob-storage gcp google-cloud-storage s3 s3-bucket storage

Last synced: 16 May 2025

https://github.com/managedcode/Storage

Storage library provides a universal interface for accessing and manipulating data in different cloud blob storage providers

aws aws-s3 azure azure-storage blob blob-storage gcp google-cloud-storage s3 s3-bucket storage

Last synced: 13 May 2025

https://github.com/mikeghen/kubernetes-gcs-sftp

SFTP Server using Google Cloud Storage

docker google-cloud-storage kubernetes sftp

Last synced: 12 Apr 2025

https://github.com/bakdata/kafka-large-message-serde

A Kafka Serde that reads and writes records from and to Blob storage (S3, Azure, Google) transparently.

azure-blob-storage deserialization google-cloud-storage kafka kafka-streams large-data s3 serde serialization simple-storage-service

Last synced: 10 Apr 2025

https://github.com/abhi347/vid-to-speech-api-json

Generates google speech api response from any video using google cloud functions and google cloud storage

ffmpeg google-api google-cloud google-cloud-functions google-cloud-platform google-cloud-storage google-speech javascript nodejs

Last synced: 13 Apr 2025

https://github.com/sajari/storage

Go package for abstracting local, in-memory, and remote (Google Cloud Storage/S3) filesystems

cache filesystem go google-cloud-storage in-memory-fs s3

Last synced: 07 Apr 2025

https://github.com/src-d/jgscm

Jupyter support for Google Cloud Storage

gcs google-cloud-storage jupyter notebook

Last synced: 05 May 2025

https://github.com/artefactory/artefactory-connectors-kit

ACK is an E(T)L tool specialized in API data ingestion. It is accessible through a Command-Line Interface. The application allows you to easily extract, stream and load data (with minimum transformations), from the API source to the destination of your choice.

adobe-analytics amazon-s3 api confluence dcm dv360 facebook google-ads google-analytics google-cloud-storage google-sheets mysql mytarget radarly salesforce search-console the-trade-desk twitter yandex

Last synced: 22 Apr 2025

https://github.com/drpaulbrewer/zip-bucket

zips files in a Google Cloud Storage [tm] bucket

compression google-cloud-storage nodejs zip

Last synced: 01 Dec 2024

https://github.com/websightgmbh/l5-google-cloud-storage

Laravel 5 Flysystem Adapter for Google Cloud Storage

flysystem flysystem-adapter google-cloud-storage

Last synced: 14 Apr 2025

https://github.com/frodenas/gcs-resource

Concourse resource for interacting with Google Cloud Storage

concourse google-cloud-storage

Last synced: 14 Apr 2025

https://github.com/renchap/shrine-google_cloud_storage

Google Cloud Storage for Shrine

google-cloud-storage ruby shrine

Last synced: 09 Apr 2025

https://github.com/chees/datastore2bigquery

Export Google Datastore to BigQuery

backup bigquery datastore gcloud gcp google-cloud-storage

Last synced: 14 Apr 2025

https://github.com/rodydavis/pocketbase-cloudrun

Run PocketBase on CloudRun with mounted volumes via Google Cloud Storage

cloud-run cloud-storage google google-cloud google-cloud-run google-cloud-storage local-first pocketbase sqlite

Last synced: 23 Apr 2025

https://github.com/birotaio/mongodb-gcs-backup

Backup MongoDB using mongodump and upload the generated archive to GCS

backup-script google-cloud-storage kubernetes-deployment mongo-db mongo-oplog mongo-tools

Last synced: 09 Feb 2025

https://github.com/oscaro/clj-gcloud-storage

Clojure wrapper for google-cloud-storage Java client.

clojure google-cloud google-cloud-storage

Last synced: 06 Apr 2025

https://github.com/a-patel/litexstorage

LiteXStorage is simple yet powerful and very high-performance storage mechanism and incorporating both synchronous and asynchronous usage with some advanced usage of cloud storage which can help us to handle storage more easier!

amazon asp-net-core aspnet-core aspnetcore aws aws-s3 azure blob-container blob-storage blob-storage-services blob-store blob-utility cloud-storage csharp filesystem google-cloud-storage litex netcore nuget storage

Last synced: 11 Apr 2025

https://github.com/aginix/nestjs-gcloud-storage

Google Cloud Storage Module for Nest.js Framework

google-cloud-storage nest-framework nestjs typescript

Last synced: 16 Mar 2025

https://github.com/ofek/docker-volume-gcs

Docker Volume Plugin for Google Cloud Storage

docker fuse google-cloud-storage plugin

Last synced: 05 May 2025

https://github.com/hackersandslackers/googlecloud-storage-tutorial

:floppy_disk: :cloud: Tutorial for interacting with Google Cloud Storage via the Python SDK.

cloud google google-cloud-storage python python-sdk tutorial

Last synced: 28 Apr 2025

https://github.com/maorfr/kube-tasks

A tool to perform simple Kubernetes related actions

abs aws azure go golang google-cloud-storage kubernetes s3

Last synced: 14 Apr 2025

https://github.com/nownabe/go-bqloader

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

bigquery etl golang google-cloud google-cloud-functions google-cloud-storage

Last synced: 01 Dec 2024

https://github.com/migangqui/cloud-storage-spring-api

Manage files from AWS S3, Google Cloud Storag, Azure Blob Storage and Dropbox in Spring

amazon aws aws-s3 azure azure-storage-blob cloud-storage dropbox google-cloud google-cloud-storage java kotlin s3 s3-bucket spring

Last synced: 16 Dec 2024

https://github.com/foobarwidget/distributed-lock-google-cloud-storage-ruby

Ruby implementation of a distributed lock based on Google Cloud Storage

concurrency distributed-locking google-cloud-storage mutex

Last synced: 17 Mar 2025

https://github.com/FooBarWidget/distributed-lock-google-cloud-storage-ruby

Ruby implementation of a distributed lock based on Google Cloud Storage

concurrency distributed-locking google-cloud-storage mutex

Last synced: 24 Nov 2024

https://github.com/vitalibo/git-lfs

A set of modules for deploying custom Git LFS servers on different infrastructure providers

aws aws-s3 azure azure-blob-storage gcp git-lfs google-cloud-storage self-hosted terraform

Last synced: 12 Apr 2025

https://github.com/orsinium-labs/dimutex

asyncio Python library for distributed mutex with GCS as a backend

distributed-systems gcp gcs google-cloud google-cloud-platform google-cloud-storage mutex python

Last synced: 15 Apr 2025

https://github.com/transitive-bullshit/abstract-object-storage

Collection of useful utilities for working with Google Cloud Storage.

bucket gcp gcs google-cloud google-cloud-storage object-storage storage

Last synced: 06 May 2025

https://github.com/embulk/embulk-input-gcs

Embulk plugin that loads records from Google Cloud Storage

embulk embulk-input-plugin embulk-plugin gcp google-cloud-storage

Last synced: 09 Apr 2025

https://github.com/mansagroup/gcs-cache-action

A GitHub Action to cache your workload to a Google Cloud Storage bucket.

cache gcs github-action github-actions google-cloud google-cloud-platform google-cloud-storage

Last synced: 23 Jan 2025

https://github.com/sethvargo/go-gcslock

A Go library for acquiring a forward-looking lock in Google Cloud Storage.

google-cloud google-cloud-storage

Last synced: 06 May 2025

https://github.com/altescy/minato

⚓ Minato: A Unified File I/O Library for Python

cache cli filesystem google-cloud-storage http huggingface-hub python s3

Last synced: 14 Apr 2025

https://github.com/viur-framework/server

The ViUR application development framework - legacy version 2.x for Python 2.7

appengine appengine-python application-framework datastore google-cloud google-cloud-storage google-datastore jinja2 json python viur

Last synced: 11 Mar 2025

https://github.com/mansagroup/nx-gcs-remote-cache

A Google Cloud Storage distributed cache plugin for Nx.

cache distributed gcp gcs google-cloud-platform google-cloud-storage monorepo nrwl nx

Last synced: 22 Nov 2024