Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with object-storage

A curated list of projects in awesome lists tagged with object-storage .

https://github.com/seaweedfs/seaweedfs

SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

blob-storage cloud-drive distributed-file-system distributed-storage distributed-systems erasure-coding fuse hadoop-hdfs hdfs kubernetes object-storage posix replication s3 s3-storage seaweedfs tiered-file-system

Last synced: 15 Jun 2026

https://github.com/rustfs/rustfs

🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.

ai-native ai-storage amazon-s3 bigdata cloud-native filesystem minio multi-cloud object-storage objectstorage rust s3

Last synced: 27 May 2026

https://github.com/juicedata/juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

bigdata cloud-native distributed-systems filesystem go golang hdfs object-storage posix redis s3 storage

Last synced: 12 May 2025

https://github.com/paradedb/paradedb

ParadeDB is a modern Elasticsearch alternative built on Postgres. Built for real-time, update-heavy workloads.

aggregations analytics big-data bm25 database elasticsearch full-text-search htap hybrid-search mpp object-storage olap postgresql real-time-analytics similarity-search sparse-vector sql

Last synced: 23 Apr 2026

https://github.com/awslabs/mountpoint-s3

A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

aws filesystem fuse object-storage s3

Last synced: 22 Jan 2026

https://github.com/storj/storj

Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.

distributed distributed-storage distributed-systems golang object-storage open-source storage

Last synced: 16 Apr 2026

https://github.com/slatedb/slatedb

A cloud native embedded storage engine built on object storage.

database embedded-database lsm-tree object-storage rocksdb rust storage-engine

Last synced: 16 Apr 2026

https://github.com/scality/cloudserver

Zenko CloudServer, an open-source Node.js implementation of the Amazon S3 protocol on the front-end and backend storage capabilities to multiple clouds, including Azure and Google.

artesca aws-s3 cloud cloud-native cloud-storage docker javascript multiple-backends nodejs object-storage s3-storage storage zenko

Last synced: 05 Feb 2026

https://github.com/supabase/storage

S3 compatible object storage service that stores metadata in Postgres

gotrue iceberg object-storage postgres s3 tus vector

Last synced: 16 Apr 2026

https://github.com/open-io/oio-sds

High Performance Software-Defined Object Storage for Big Data and AI, that supports Amazon S3 and Openstack Swift

c flexible golang lightweight object-storage objectstorage open-source openstack-swift python s3-storage software-defined-storage storage

Last synced: 31 Jan 2026

https://github.com/scality/zenko

Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.

artesca aws-s3 azure-storage cloud-native docker-swarm google-cloud grafana helm hybrid-cloud kafka kubernetes mongodb multi-cloud object-storage prometheus redis scality zenko zookeeper

Last synced: 05 Apr 2026

https://github.com/scality/Zenko

Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.

artesca aws-s3 azure-storage cloud-native docker-swarm google-cloud grafana helm hybrid-cloud kafka kubernetes mongodb multi-cloud object-storage prometheus redis scality zenko zookeeper

Last synced: 30 Mar 2025

https://github.com/deuxfleurs-org/garage

(Mirror) S3-compatible object store for small self-hosted geo-distributed deployments. Main repo: https://git.deuxfleurs.fr/Deuxfleurs/garage

object-storage rust s3

Last synced: 18 Apr 2025

https://github.com/tidesdb/tidesdb

High-performance adaptive, durable, portable, transactional embeddable storage engine with optional tiered object storage for infinite scale. Designed for flash and RAM optimization.

acid btree c-library database embeddable linux lsm-tree lsmb macos multi-platform object-storage oltp portable storage-engine transactional ttl windows x86-64

Last synced: 24 May 2026

https://github.com/douban/gobeansdb

Distributed object storage server from Douban Inc.

distributed-storage kvstore memcached object-storage

Last synced: 04 Apr 2025

https://github.com/Just-Moh-it/Mockoops

Create 💎 beautiful animations from boring screen recordings within ⏳ seconds

animation browser canvas lambda mockup mockup-generator object-storage pwa react reactjs remotion render screen-recording

Last synced: 28 Mar 2025

https://github.com/ebogdum/callfs

CallFS is an ultra-lightweight, high-performance REST API filesystem that provides precise Linux filesystem semantics over various backends including local filesystem, Amazon S3, and distributed peer networks

filesystem go golang object-storage rest-api restapi restful restful-api s3 storage storage-api

Last synced: 21 Jan 2026

https://github.com/mosuka/phalanx

Phalanx is a cloud-native distributed search engine that provides endpoints through gRPC and traditional RESTful API.

cloud-native distributed engine go golang gossip-protocol grpc object-storage restful-api search

Last synced: 06 Apr 2025

https://github.com/lithops-cloud/lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

big-data big-data-analytics cloud-computing data-processing distributed kubernetes multicloud multiprocessing object-storage parallel python serverless serverless-computing serverless-functions

Last synced: 03 Jan 2026

https://github.com/qinguoyi/osproxy

对象存储分布式代理(object storage distrbuted proxy)，支持Docker一键部署

gin object-storage proxy s3

Last synced: 06 Apr 2025

https://github.com/uber-go/dosa

DOSA is a data object abstraction layer

abstraction cassandra dosa object-storage storage

Last synced: 24 Jul 2025

https://github.com/thanos-io/objstore

Go module providing unified interface and efficient clients to work with various object storage providers until like GCS, S3, Azure, SWIFT, COS and more.

azure-storage gcs minio object-storage s3 swift

Last synced: 14 May 2025

https://github.com/uroni/hs5

High-performance scale-up self-hosted simple storage service (hs5)

cplusplus object-storage s3 storage

Last synced: 12 Apr 2026

https://github.com/emcecs/ecs-communityedition

ECS Community Edition "Free & Frictionless"

ansible cloud dellemc ecs emc object object-storage storage

Last synced: 12 Apr 2025

https://github.com/EMCECS/ECS-CommunityEdition

ECS Community Edition "Free & Frictionless"

ansible cloud dellemc ecs emc object object-storage storage

Last synced: 09 May 2025

https://github.com/achtungsoftware/alarik

High performance S3 compatible object storage focused on speed and simplicity and designed to be an open alternative to MinIO and RustFS.

minio object object-storage rustfs s3-bucket s3-storage

Last synced: 13 Jan 2026

https://github.com/durner/anyblob

AnyBlob - A Universal Cloud Object Storage Download Manager Built For Cost-Throughput Optimal Analytics!

blob-storage cloud cloud-storage downloader object object-storage storage

Last synced: 13 Apr 2025

https://github.com/noobaa/noobaa-operator

Operator for NooBaa - object data service for hybrid and multi cloud environments :cloud: :wrench:

cli crd k8s kubernetes multi-cloud-environments noobaa object-storage ocs openshift operator

Last synced: 16 May 2025

https://github.com/freakmaxi/kertish-dos

Kertish-dos is a simple distributed object storage platform, implements object storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dos aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.

data-farm dfs distributed-file-storage distributed-file-system distributed-object-storage distributed-object-store distributed-storage dos object-storage s3-storage scalable

Last synced: 11 Dec 2025

https://github.com/namidb/namidb

Graph database native to the cloud. Embedded, multi-tenant, built on object storage.

agent-memory columnar cypher gql graph-database graphrag lsm-tree object-storage rust s3

Last synced: 13 Jun 2026

https://github.com/yongman/leto

A key value storage example powered by hashicorp raft and BadgerDB

hashicorp object-storage raft raft-consensus-algorithm raft-example raft-go raft-protocol redis redis-protocol

Last synced: 17 Mar 2025

https://github.com/golang-design/tgstore

An encrypted object storage system with unlimited space backed by Telegram.

encrypted-storage object-storage telegram unlimited-storage

Last synced: 03 Jul 2025

https://github.com/anthonybudd/S4

S4 is 100% S3 compatible storage, accessed through Tor and distributed using IPFS.

data docker ipfs object-storage s3 s4 storage

Last synced: 07 Apr 2025

https://github.com/iqiyi/auklet

Auklet is a high performance storage engine based on Openstack Swift

distributed-systems hummingbird object-storage openstack-swift storage-engine

Last synced: 29 Apr 2025

https://github.com/anthonybudd/s4

S4 is 100% S3 compatible storage, accessed through Tor and distributed using IPFS.

data docker ipfs object-storage s3 s4 storage

Last synced: 12 Apr 2025

https://github.com/allegro/akubra

Simple solution to keep a independent S3 storages in sync

amazon-s3 amazon-s3-storage ceph object-storage s3 storage sync

Last synced: 12 Jul 2025

https://github.com/pitchpoint-solutions/sfs

The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)

distributed-file-system distributed-storage distributed-systems elasticsearch java object-storage openstack-swift rxjava vertx

Last synced: 23 Oct 2025

https://github.com/slatedb/slatedb-go

A cloud native embedded storage engine built on object storage.

database embedded-database golang lsm-tree object-storage rocksdb storage-engine

Last synced: 09 Apr 2025

https://github.com/christianbaun/ossperf

A lightweight tool for analyzing the performance and data integrity of object-based storage services

aws-s3 cloud cloud-storage object-storage performance-testing shell storage-service

Last synced: 22 Feb 2026

https://github.com/xtyxtyx/minio-dart

Unofficial MinIO Dart Client SDK that provides simple APIs to access any Amazon S3 compatible object storage server.

dart minio object-storage s3

Last synced: 16 May 2025

https://github.com/xincao9/dkv

对象存储 - 日志结构哈希表

append-files bitcask hashtable key-value object-storage s3

Last synced: 11 Jul 2025

https://github.com/rgcsekaraa/brows3

Fast open-source S3 browser, S3 explorer, and desktop client for Amazon S3, MinIO, Cloudflare R2, Wasabi, and other S3-compatible storage.

amazon-s3 amazon-s3-bucket amazon-s3-storage aws-s3 cloudflare-r2 desktop-app minio nextjs object-storage rust s3 s3-browser s3-client tauri wasabi wasabi-s3

Last synced: 30 May 2026

https://github.com/gluster/gluster-swift

Object interface to GlusterFS (this is only a public mirror)

gluster glusterfs object-storage openstack-swift

Last synced: 19 Oct 2025

https://github.com/realdatadriven/etlx

ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.

data-engineering data-lake data-lakehouse data-quality data-quality-checks data-quality-monitoring data-science duckdb elt elt-pipeline etl etl-elt-pipelines etl-pipeline object-storage relational-databases report report-automation s3 s3-storage

Last synced: 30 Apr 2026

https://github.com/iamtugy/pyminio

Pyminio is a python client wrapped like the os module to control minio server

aws-s3 minio minio-client object-storage pyminio python3

Last synced: 12 Apr 2025

https://github.com/qingstor/qscamel

qscamel is a command line tool to migrate data between different endpoint efficiently.

migrate object-storage qingstor s3

Last synced: 15 Dec 2025

https://github.com/mojtaba-arvin/video-service

Python Video Streaming microervice | supports HLS, MPEG-DASH and HLS with fmp4 segments (CMAF), this project uses gRPC protocol for communication and S3-compatible object storage. The multi-stage dockerfile of project uses Python3.9.2 and FFmpeg4.1

cloud-video-processing docker-compose ffmpeg grpc grpc-video-service hls http-live-streaming mp4-to-hls-fmp4 mpeg-dash object-storage python python-ffmpeg python-ffmpeg-video-streaming python-hls-service python-video-streaming transcoding video video-processing-service video-streaming vod

Last synced: 22 Apr 2025

https://github.com/oracle/ansible-database-migration-tool

Ansible Database Migration Tool utility has been developed with an objective to provide a quick and easy way to move Oracle Cloud Infrastructure Classic (OCI-C) databases to Oracle Cloud Infrastructure (OCI) without setting up DataGuard.

ansible automation database migration object-storage oci oci-classic oracle rman

Last synced: 09 Apr 2025

https://github.com/boilingdata/boilstream

Diskless high-throughput data ingestion server with local DuckDB caching. Writes optimised Parquet files onto Object Storages.

analytics data-stream-processing data-stream-processing-framework data-streams duckdb ducklake object-storage rust sql

Last synced: 02 Sep 2025

https://github.com/br3ndonland/fastenv

⚙️ Unified environment variable and settings management for FastAPI and beyond 🚀

anyio asgi configuration-management dotenv environment-variables fastapi object-storage pydantic python s3 s3-bucket s3-client settings starlette uvicorn

Last synced: 06 Oct 2025

https://github.com/ucloud/ufile-sdk-java

UCloud 对象存储官方 SDK

java library object-storage ucloud-sdk

Last synced: 06 Apr 2025

https://github.com/xdev-software/spring-data-eclipse-store

Spring Data integration for EclipseStore with working copies

eclipse-store microstream object-storage spring-data spring-data-jpa

Last synced: 02 Mar 2026

https://github.com/orcastor/orcas

🗄️【开放开箱即用内容寻址对象存储】支持主流操作系统和廉价低功耗设备 [OrcaS] Open Ready-to-use Content Addressable Storage - for popular OS & cheap and low power devices.

ceph content-addressable-storage embedded fastdfs hacktoberfest minio nas object-file-system object-storage object-store osd oss s3 storage tikv

Last synced: 18 Jan 2026

https://github.com/angatar/s3cmd

A docker multi-arch image with a simple s3cmd S3 client purely installed on the latest Alpine linux

alpine backup backup-cron cronjob docker docker-image k8s kubernetes linux multi-arch object-storage s3 s3cmd

Last synced: 06 Mar 2026

https://github.com/dcoles/acme-linode-objectstorage

ACME ("Let's Encrypt") client for Linode Object Storage

acme-client lets-encrypt linode object-storage

Last synced: 17 Mar 2025

https://github.com/yandex-cloud-examples/yc-yandexgpt-qa-bot-for-docs

Пример реализации вопрос-ответного бота по документации на базе YandexGPT и других сервисов Yandex Cloud.

datasphere langchain object-storage opensearch yandex-cloud yandex-gpt yandexcloud yandexgpt

Last synced: 15 Mar 2026

https://github.com/benaubin/b2-js

Use Backblaze B2's native API from Javascript

backblaze-b2 javascript nodejs object-storage typescript

Last synced: 14 Mar 2026

https://github.com/oracle/ocifs

ocifs provides a POSIX-compatible API wrapping Oracle Cloud Infrastructure's (OCI) Object Storage. ocifs is a python library that relies on the fsspec framework.

cloud filesystem fsspec object-storage oci oracle python3

Last synced: 09 Apr 2025

https://github.com/supabase-community/storage-csharp

A C# implementation of Supabase's Object Storage API

object-storage storage supabase supabase-csharp supabase-storage

Last synced: 04 Sep 2025

https://github.com/f2face/cloudflare-r2

Node.js library for Cloudflare R2.

cloudflare object-storage r2

Last synced: 30 Dec 2025

https://github.com/tidesdb/tidesql

A space and write optimized pluggable MariaDB engine built on TidesDB

btree cloud-native lsmtree mariadb mvcc object-storage olap oltp optimistic pessimistic-concurrency sql storage-engine transactional

Last synced: 06 Jun 2026

https://github.com/emcecs/python-ecsclient

Python library for interacting with the Dell ECS Management API

dell-emc object-storage python sdk

Last synced: 28 Jul 2025

https://github.com/brutusin/flea-db

A java library for creating standalone, portable, schema-full object databases supporting pagination and faceted search, and offering strong-typed and generic APIs. Built on top of Apache Lucene.

faceted-search json json-schema lucene object-storage

Last synced: 10 Apr 2025

https://github.com/jkaninda/mysql-bkup

Docker container image to Backup, Restore and Migrate MySQL database to Local, AWS S3 or SSH remote Server Storage.

aws docker-mysql-backup kubernetes-mysql-backup minio mysql-backup mysql-backup-s3 mysql-database mysql-dump object-storage s3

Last synced: 26 Oct 2025

https://github.com/rhinouser0/riverpass

A handy local disk based cache for hot content from remote storage.

cache caching object-storage oss training-module

Last synced: 09 Jul 2025

https://github.com/leo-project/leo_object_storage

leo_object_storage is a log-structured object/BLOB storage.

erlang leofs library object-storage storage

Last synced: 14 Apr 2025

https://github.com/transitive-bullshit/abstract-object-storage

Collection of useful utilities for working with Google Cloud Storage.

bucket gcp gcs google-cloud google-cloud-storage object-storage storage

Last synced: 14 Oct 2025

https://github.com/yandex-cloud-examples/yc-practicum-serverless-telegram-bot

Практикум. Создание Telegram-бота с использованием Serverless в Yandex Cloud.

api-gateway lockbox object-storage s3 serverless terraform yandex-cloud yandexcloud ydb

Last synced: 29 Oct 2025

https://github.com/tnewman/dray

A cloud native SFTP server designed to support multiple data storage backends, starting with S3.

object-storage rust s3 sftp sftp-server

Last synced: 18 Jan 2026

https://github.com/ivopetkov/object-storage

A better way to work with files. Metadata available too.

atomic data-storage file-storage metadata object-storage storage

Last synced: 14 Apr 2025

https://github.com/andrewsomething/digitalocean-spaces-example-node

An example using DigitalOcean Spaces from Node.js on Glitch

digitalocean digitalocean-spaces glitch nodejs object-storage

Last synced: 07 May 2025

https://github.com/tsmotlp/knowtate

Knowtate is a sophisticated platform designed to elevate your academic research experience. Seamlessly blend reading, note-taking with markdown, and knowledge management into one intuitive interface, allowing you to effortlessly track your insights and ideas as you delve into scholarly literature.

chat-with-pdf excalidraw file-manager markdown-editor note-taking notion object-storage pdf-annotation pdf-viewer rag research-tool

Last synced: 10 Apr 2025

https://github.com/rosalexander/oci-object-storage-desktop

Desktop application for Oracle Cloud Infrastructure Object Storage

desktop gui macos object-storage oci oracle pyside2 python qt windows

Last synced: 04 Apr 2025

https://github.com/lancedb/ocra

OCRA: Object-store Cache in Rust for All

arrow caching object-storage rust

Last synced: 13 Jun 2025

https://github.com/linode/linode-cosi-driver

A Kubernetes Container Object Storage Interface (COSI) Driver for Linode

hacktoberfest kubernetes object-storage

Last synced: 07 Mar 2026

https://github.com/relaycorp/object-storage-js

Node.js client for object stores like AWS S3, GCP GCS or Minio

gcs minio object-storage object-store s3

Last synced: 08 Apr 2025

https://github.com/kuingsmile/vs-piclist

A powerful image uploading and managing plugin for VSCode based on PicList. Compatible with PicGo.

image image-upl object-storage oss picgo piclist s3 vscode vscode-extension

Last synced: 07 Mar 2026