Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with data-storage

A curated list of projects in awesome lists tagged with data-storage .

https://github.com/ammarahm-ed/react-native-mmkv-storage

An ultra fast (0.0002s read/write), small & encrypted mobile key-value storage framework for React Native written in C++ using JSI

android asyncstorage data-storage database encryption expo fast fast-storage ios java mmap mmkv mmkv-database native objective-c react react-native react-native-jsi storage

Last synced: 13 May 2025

https://github.com/fstpackage/fst

Lightning Fast Serialization of Data Frames for R

compression data-frame data-storage r

Last synced: 26 Apr 2025

https://github.com/datalad/datalad

Keep code, data, containers under control with git and git-annex

closember data-storage dataset git-annex python usable

Last synced: 21 Oct 2025

https://github.com/qsbase/qs

Quick serialization of R objects

compression data-storage encoding r serialization

Last synced: 12 Dec 2025

https://github.com/juliaio/hdf5.jl

Save and load data in the HDF5 file format from Julia

data-storage hacktoberfest hdf5 hdf5-binaries hdf5-files hdf5-library jld julia julia-language mat

Last synced: 17 Dec 2025

https://github.com/JuliaIO/HDF5.jl

Save and load data in the HDF5 file format from Julia

data-storage hacktoberfest hdf5 hdf5-binaries hdf5-files hdf5-library jld julia julia-language mat

Last synced: 10 May 2025

https://github.com/knoxite/knoxite

A data storage & backup system

backup data-storage hacktoberfest restore snapshot volumes

Last synced: 31 Mar 2025

https://github.com/juliaio/jld.jl

Saving and loading julia variables while preserving native types

data-storage hdf5-format jld-format julia serializer

Last synced: 12 Apr 2025

https://github.com/45Drives/autotier

A passthrough FUSE filesystem that intelligently moves files between storage tiers based on frequency of use, file age, and tier fullness.

data-storage passthrough-fuse-filesystem storage-tiers tiered tiered-file-system tiered-storage tiering

Last synced: 05 Apr 2025

https://github.com/karthik/rdrop2

Dropbox Interface from R

data-storage dropbox-interface r

Last synced: 16 May 2025

https://github.com/airscholar/e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

apache-airflow apache-kafka apache-spark apache-zookeeper big-data cassandra containerization data-engineering data-pipeline data-processing data-storage docker etl-pipeline postgresql real-time-analytics

Last synced: 16 May 2025

https://github.com/weedshaker/peerwebsite

Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

data-storage decentralized distributed encryption-decryption hosting indie-web indieweb ipfs js-ipfs old-internet p2p peer-to-peer peerweb small-internet smol-internet the-cyberfreedom-network web3 webrtc website-hosting webtorrent

Last synced: 08 May 2025

https://github.com/Weedshaker/PeerWebSite

Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

data-storage decentralized distributed encryption-decryption hosting indie-web indieweb ipfs js-ipfs old-internet p2p peer-to-peer peerweb small-internet smol-internet the-cyberfreedom-network web3 webrtc website-hosting webtorrent

Last synced: 03 Apr 2025

https://weedshaker.github.io/PeerWebSite/

Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

data-storage decentralized distributed encryption-decryption hosting indie-web indieweb ipfs js-ipfs old-internet p2p peer-to-peer peerweb small-internet smol-internet the-cyberfreedom-network web3 webrtc website-hosting webtorrent

Last synced: 01 Apr 2025

https://github.com/GridProtectionAlliance/openHistorian

The Open Source Time-Series Data Historian

data-mining data-storage data-stream historian time-series

Last synced: 08 Apr 2025

https://github.com/lf-edge/edge-home-orchestration-go

Home Edge Project in LF Edge - Edge Orchestration for home edge devices to enabling smart home use cases.

cluster-computing container containerization data-storage docker edgecomputing hikey960 home-iot homeedge iot lfedge node orchestration raspberry-pi rbac

Last synced: 16 May 2025

https://github.com/thesethrose/time-capsule

Time Capsule continuously captures and stores digital activities to create a comprehensive memory system. It features real-time audio recording, speech-to-text with Fast-Whisper, plugin support, database storage via Chroma, and a web interface for management. Ideal for documenting life or building digital memories.

ai audio-capture chroma data-storage digital-memory flask memory plugins python whisper

Last synced: 25 Feb 2025

https://github.com/TheSethRose/Time-Capsule

Time Capsule continuously captures and stores digital activities to create a comprehensive memory system. It features real-time audio recording, speech-to-text with Fast-Whisper, plugin support, database storage via Chroma, and a web interface for management. Ideal for documenting life or building digital memories.

ai audio-capture chroma data-storage digital-memory flask memory plugins python whisper

Last synced: 29 Jul 2025

https://github.com/bearframework/bearframework

An open-source PHP framework. Incredibly lightweight. Powerful enough.

data-storage framework php php-framework php7 routing web-application-framework

Last synced: 10 Apr 2025

https://github.com/gbeckers/darr

A Python library for numpy arrays that persist on disk in a format that is simple, self-documented and tool-independent, and maximizes universal readability.

array bsd-3-clause data-science data-sharing data-storage idl interoperability jagged-array julia-language maple mathematica matlab numeric octave python r ragged-array science scilab

Last synced: 21 Aug 2025

https://github.com/aureleoules/bitcandle

Store data on Bitcoin for 350 sats/KB up to 185 KB by using P2SH-P2WSH witness scripts

bitcoin data-storage p2sh-p2wsh segwit

Last synced: 14 Apr 2025

https://github.com/gerold-penz/bun-sqlite-key-value

A super fast key-value store with SQLite that uses bun:sqlite and v8 as a fast JSON replacement.

bun bun-js cache data-storage database db-storage key-value key-value-storage kv-store nosql nosql-database sqlite time-to-live ttl typescript

Last synced: 12 Apr 2025

https://github.com/ZorPastaman/Event-Based-Blackboard

Event Based Blackboard for Unity is a flexible data storage that can contain any count of properties of any type. The properties can be accessed with property names.

blackboard data-storage event-based flexible unity

Last synced: 08 May 2025

https://github.com/ivopetkov/object-storage

A better way to work with files. Metadata available too.

atomic data-storage file-storage metadata object-storage storage

Last synced: 14 Apr 2025

https://github.com/krassowski/data-vault

IPython magic for simple, organized, compressed and encrypted: storage & transfer of files between notebooks.

data-storage disk-cache ipython-magic jupyter-notebook persistent-storage

Last synced: 13 Apr 2025

https://github.com/dina-hosny/chaincare

ChainCare is a health information system that uses smart contracts to handle medical procedures and stores the medical history in Block Chains.

api-rest bigchain blockchain blockchain-technology data-science data-storage data-visualization ethereum golang health-informatics-systems healthcare insomnia metamask postgresql postman reactjs solidity truffle web3

Last synced: 24 Jul 2025

https://github.com/abeltavares/marketpipe

🛠 Containerized and configurable Airflow ETL pipeline for collecting and storing stock and cryptocurrency market data.

airflow aws ci-cd cryptocurrency data-analysis data-collection data-storage docker iac oop pgadmin pipeline postgresql python sql stocks unit-testing

Last synced: 22 Apr 2025

https://github.com/PFund-Software-Ltd/pfeed

Data pipeline for algo-trading, helping traders in getting real-time and historical data, and storing them in a local data lake for quantitative research.

algo-trading backtesting data-analysis data-pipeline data-storage historical-data pandas

Last synced: 27 Feb 2025

https://github.com/js2me/stonex

💡 Simple state container for JavaScript/TypeScript applications 💡

data-storage predictable predictable-state redux state state-container state-management stonex-store

Last synced: 07 May 2025

https://github.com/nuzulul/kv-storage

💾 Create data storage that uses a simple key-value method for Node, Browser, Deno, Bun, Cloudflare Workers

cloudflare-workers data-storage data-store database db file file-database file-storage indexeddb kv-storage node-js nodejs nosql nosql-database storage

Last synced: 01 May 2025

https://github.com/bocaletto-luca/phonebook

This is a Python application that implements a simple phone book with a graphical user interface (GUI) using PyQt5. The application allows users to add, view and delete phone contacts. Furthermore, it offers an "About" function to display information about the author of the application.

contact-management data-storage database gui open-source personal-organization phone-book pyqt5 python

Last synced: 09 Oct 2025

https://github.com/polyfrost/datastorage

Static data storage for Polyfrost projects.

data data-storage hypixel hypixel-api minecraft minecraft-mod

Last synced: 25 Feb 2025

https://github.com/dangerous-community/dangerous-net

The cloud storage / internet system for cypher punks, decentralized enthusiasts and bio-hackers. Built on a Proof of Storage mentality, You can pass all of your files, messages, and data through the private network. Secure them in a MFA and implant focused (AES) approach to data processing and encryption.

biohacking data-storage decentralized-applications encryption implant implants internet ipfs ipfs-web javacard keycard vivokey web3 webapplication

Last synced: 24 Oct 2025

https://github.com/ayaanhossain/sharedb

An on-disk pythonic embedded key-value store for compressed data storage and distributed data analysis

data-analysis data-storage distributed embedded-database key-value lmb msgpack multiprocessing parallel python python-3 python-library python-script python2 python3 store

Last synced: 13 Apr 2025

https://github.com/stillmatic/catcher

Catcher: Drop in caching for R functions

cache data-storage r

Last synced: 22 Jun 2025

https://github.com/anotherkamila/stalky

Self-hosted app to keep track of anything you want. Don't let others stalk you, stalk yourself!

csv data-analysis data-storage geeks privacy-by-design self-hosted timeseries tracking

Last synced: 12 Apr 2025

https://github.com/petrbouchal/purrrow

R package for iteratively collating Arrow datasets out of memory

arrow data-manipulation data-storage r rstats

Last synced: 14 Oct 2025

https://github.com/astrodynamic/key-value-storage-redis-in-cpp

The project is a key-value store. The project uses data structures such as hash tables, self-balancing binary search trees, and B+ trees. The code is written in C++ with CMake as a build tool. It supports sanitization, testing, coverage, formatting, and static analysis.

bd bplustree cmake comand-line console-application cpp cpp17 data-storage database hash-table interface key-value-store makefile memory-management redis storage

Last synced: 20 Sep 2025

https://github.com/nanosector/collections

Simple Collection class allowing storage of specific data.

array arrayobject collections data-storage php validation

Last synced: 24 Jun 2025

https://github.com/wtrocki/rhmap-storage-service

RHMAP file data storage service using express and mongodb for storage

data-storage mongodb storage-service storage-solution

Last synced: 11 Nov 2025

https://github.com/junzhengca/identity-atheneum

Identity federation and data storage platform for education tools. Powered by MongoDB, Redis and Node.js. Connect using simple REST API.

authentication data-storage node-js saml

Last synced: 11 Jun 2025

https://github.com/souvikns/jcontainer

Deployable REST API data storage service.

data-storage hacktoberfest2020 mongodb nextjs nodejs-server reactjs rest-api

Last synced: 12 Apr 2025

https://github.com/ultreon/ubo

NBT inspired data I/O. Made for games.

api binary-data data data-storage file-type game-data io library ubo

Last synced: 16 Jun 2025

https://github.com/seanox/xml-micro-exchange-js

XML and XPath based volatile NoSQL stateless micro datasource for data exchange for web applications and IoT (implementation for Node.js)

acme cloud data-storage exchange microservice node-js nosql web-api xlst xml xpath

Last synced: 27 Jul 2025

https://github.com/guoxicheng/tinycrud

基于 Issue API 的轻量级数据存储库 - Lightweight Data Repository Based on Git Issue API

crud data-storage issue lightweight typescript

Last synced: 11 Jun 2025

https://github.com/andrey-tech/data-storage-php

Простое хранилище данных в виде ключ-значение в JSON-файлах с разделяемой блокировкой на чтение и эксклюзивной блокировкой на запись.

data data-storage files json php php7 storage

Last synced: 11 Jun 2025

https://github.com/konh/analyticspipeline

The opinionated approach combines a client-side SDK, operative + historical data storage, and a data mart

analytics business-intelligence csharp data-driven data-storage dotnet unity

Last synced: 04 Sep 2025

https://github.com/aalkiyumi/senior-design-project

Web scraper for collecting product and review data from e-commerce sites using Scraping Bee, AWS, Selenium, and Pandas. Focuses on cost-effective solutions, user-friendly interfaces, and efficient data extraction and analysis.

aws cs5001 data-analysis data-extraction data-processing data-storage e-commerce-analytics e-commerce-data pandas product-reviews review-sentiment-analysis scraping-bee selenium senior-design-project uc uc2026 university-of-cincinnati web-crawlers web-scraping

Last synced: 13 Apr 2025

https://github.com/harismuneer/queue-and-stack

🎈 A C++ implementation of two datastructures: queue and stack

cplusplus data-storage data-structures datastructures free-to-use open-source-code queue stack

Last synced: 09 Apr 2025

https://github.com/harismuneer/Queue-and-Stack

🎈 A C++ implementation of two datastructures: queue and stack

cplusplus data-storage data-structures datastructures free-to-use open-source-code queue stack

Last synced: 16 Jul 2025

https://github.com/shahaf-f-s/data-place

A powerfull and flexible framework for designing async socket based data streaming and destribution systems, with automated parsing, dynamic data store and high-level control hooks.

data-storage data-store data-transmission socket-programming sockets websockets

Last synced: 25 Apr 2025

https://github.com/mr-ravin/bingenetic

This repository contains a simple python library to convert binary data to genetic codes and further genetic codes back to binary data.

bioinformatics data-storage dna dna-storage genetic-code genetic-storage genetics rna rna-storage

Last synced: 17 Mar 2025

https://github.com/mariodudjak/baas-datastorageapi

The API BaaS feature of my own Baas. Backed by NoSQL database, data is in JSON format. API has schemas and resources routes.

asp-net baas csharp data-storage microservice mongodb ninject onion-architecture rest-api

Last synced: 10 Oct 2025

https://github.com/manishkumar1601/gitdb

A simple Node.js library to read/write JSON files on GitHub and serve as a lightweight GitDB.

backend data-storage database esm git gitdb github github-api json json-storage nodejs npm-package octokit open-source typescript

Last synced: 21 Jun 2025

https://github.com/vulcalien/vulcdataformat

Simple data storage system for Java.

data data-storage java serialization

Last synced: 25 Feb 2025

https://github.com/serverfarmer/sf-storage-utils

Dependency extension, providing mass storage related logic for other extensions.

data-storage drive hdparm luks mount mounting rsync standby storage

Last synced: 19 Jun 2025

https://github.com/christian-2003/password-vault

Securely manage all your most sensitive account data locally on your Android device.

account-manager android data-storage password-manager userdata-manager

Last synced: 30 Mar 2025

https://github.com/gregorykogan/file-system

C++ virtual file system emulator with FAT structure, supporting directories, files, metadata, and cluster-based storage.

cli command-line-tool cpp data-storage educational fat file-allocation file-management filesystem filesystem-emulator learning-project storage-emulator

Last synced: 23 Jul 2025

https://github.com/davyjonescodes/jsondb-python

JsonDB is a minimal, Python-powered JSON database for easy data management. Ideal for small projects and prototyping, it supports simple CRUD operations, nested data structures, and basic searches. Streamline your data tasks with JsonDB's intuitive file-based system.

crud data-management data-storage database educational-tool file-based-database json jsondb lightweight-database no-sql pypi python simple-database

Last synced: 26 Mar 2025

https://github.com/asacxyz/flutter_aplicando_persistencia_de_dados

Para acompanhamento do curso Flutter: aplicando persistência de dados

dart data data-storage flutter persistence persistent-storage sqflite sql sqlite

Last synced: 28 Feb 2025

https://github.com/efebadir/todolist

ToDoList is a practical application that helps users manage their tasks. With an integrated database, you can securely store tasks, add new tasks, edit existing ones, and delete them. Additionally, you can easily navigate through tasks with the search feature.

android-app data-storage database-integration kotlin kotlin-android mobile-development productivity-tools search-functionality task-editing task-management user-interface

Last synced: 26 Dec 2025

https://github.com/1sumer/sql

This repository contains SQL scripts and data for various analytical and database management tasks. The project is designed to demonstrate SQL capabilities in handling complex queries, data analysis, and database design. It includes datasets related to e-commerce and streaming services, with a focus on real-world scenarios and use cases.

analytics data data-analysis data-storage sql vscode

Last synced: 05 Apr 2025

https://github.com/seanox/xml-micro-exchange-php

XML and XPath based volatile NoSQL stateless micro datasource for data exchange for web applications and IoT (implementation for PHP)

cloud data-storage microservice nosql web-api xml xpath xslt

Last synced: 20 Feb 2025

https://github.com/kockarevicivan/sequential-file-processing

Implementation of sequential file storage.

c data-storage sequential-file

Last synced: 27 Mar 2025

https://github.com/maxakuru/git-backup

Sync files/folders to git repositories, schedule with Docker image

automation backup data-storage docker git github raspberry-pi sync

Last synced: 11 Mar 2025

https://github.com/akshayjith4/billmates

BillMates is a user-friendly app designed to simplify managing shared expenses among flatmates. Easily track bills, automatically split costs, and ensure everyone knows what they owe. Features include bill tracking, expense splitting, payment reminders, and expense history. Contributions are welcome!

cost-splitting data-storage expense-tracking user-interface web-hosting

Last synced: 28 Feb 2025

https://github.com/fei-sheng-wu/numencoding

NumEncoding is a data encoding and decoding library implemented under .Net 8.0. It is designed to support all one-dimensional data structures and can directly translate C# classes into the described format. Aimed to be scalable and customizable, the library exposes necessary functionalities for one to easily personalize for their own demand.

compression compressor data data-storage database decode decoder decoding encode encoder encoding storage

Last synced: 06 Jul 2025

https://github.com/silent0wings/ta-record-management-system

The TA Record Management System is a C++ program designed to manage records of Teaching Assistants (TAs) in a department. The system allows for the filtering of invalid records, adding new TA records, and sorting the existing records based on various criteria.

course-management cplusplus data-storage database-management datafiltering datasorting errorhandling projectoverview record-management recordmanagement student-records ta-records tarecords teaching-assistant-management university-tool

Last synced: 01 Mar 2025

https://github.com/opdev1004/crumbdbjs

JSON files based database Javascript

data data-storage data-store database database-management nodejs

Last synced: 11 Apr 2025

https://github.com/mateolafalce/datastore

This program running in Solana has the purpose of saving the respective data of each web page for Decenwser . The program is deactivated to date since this data architecture was no longer used

blockchain blockchain-service browser data-storage decentralized decenwser solana

Last synced: 13 Oct 2025

https://github.com/jakephelan1/jfit

A user responsive program UI made using the JavaFX framework.

apis data-storage javafx-application object-oriented-programming

Last synced: 29 Dec 2025

https://github.com/serverfarmer/sf-samba-server

sf-samba-server extension provides managed Samba solution for small and medium companies.

data-storage debian php samba samba-server security security-tools server-configuration storage ubuntu

Last synced: 03 Nov 2025

https://github.com/serverfarmer/sm-backup-collector

sf-backup-collector extension provides central backup functionality for small and medium server farms.

backup backup-manager backup-process backup-script backup-solution backup-tool data-storage debian devops devops-tools storage ubuntu

Last synced: 16 Mar 2025

https://github.com/dedhawk/arangodb-ern

🚀 Connect ArangoDB with your Node.js applications seamlessly using this efficient integration tool for managing data and enhancing performance.

api arangodb backend-development cloud-database clustering data-storage database distributed-systems erlang graph-database nosql open-source performance remote-procedure-call schema-design

Last synced: 24 Oct 2025

https://github.com/brunortech/register-login-system-project

A simple, Python-based register and login system created using a guide by Coddy.tech. Allows users to securely register and authenticate accounts with stored credentials. Demonstrates core concepts like user authentication, data storage, and basic account management.

account-management authentication beginner-project command-line-application data-storage login-system python registration-system secure-programming user-authentication

Last synced: 29 Jun 2025

https://github.com/aiden-fe/compass-locker

数据存储管理工具,适用于Browser,Node,等多环境

browser data-management data-manager data-storage node storage storage-manager typescript

Last synced: 25 Feb 2025

https://github.com/mdouchement/lss

Light Storage Service, a simple lightweight web storage API.

data-storage golang storage-engine

Last synced: 24 Feb 2025

https://github.com/lakshitnagar/webcrawler

Web crawling using node.js and cheerio with mongodb as data storage

cheerio data-storage mongodb nodejs web-crawler

Last synced: 23 Mar 2025

https://github.com/lpogic/brackettree

Język znaczników Brackettree

data-storage java markup-language

Last synced: 29 Mar 2025

https://github.com/fhdsl/nih_data_sharing

Learn about the new NIH data sharing policy, places where you might want to share your particular kind of data, and how to deal with possible challenges associated with the policy.

audience-leaders budgeting category-best-practices data-management data-sharing data-storage dms-plan grant-proposals grant-submission hutch-course itn-course nih policy

Last synced: 05 Mar 2025

https://github.com/thaitechtales/snowflake

This repository houses projects that demonstrate proficiency in Snowflake, focusing on cloud-based data warehousing, analytics, and integrations.

analytics big-data cloud-database data-management data-storage data-warehousing scalable-solutions snowflake

Last synced: 22 Jul 2025

https://github.com/angeldollface/angelmarkup

Simple data storage with no drama. :performing_arts: :guitar: :ribbon:

data-storage data-store rust rust-application rust-lang rust-library

Last synced: 02 Sep 2025

https://github.com/simonp0420/citifile.jl

Read microwave network scattering parameters from CITIfile-formatted files

citi data-storage electrical-engineering engineering microwave microwave-engineering scattering-parameters

Last synced: 31 Mar 2025

https://github.com/nathadriele/cnpj-data-pipeline

The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.

amazon-s3 cloud-computing cnpj-data data-engineering data-pipeline data-processing data-storage etl-pipeline mage-ai public-data script-automation

Last synced: 24 Mar 2025