Projects in Awesome Lists tagged with data-storage

https://github.com/ammarahm-ed/react-native-mmkv-storage

An ultra fast (0.0002s read/write), small & encrypted mobile key-value storage framework for React Native written in C++ using JSI

android asyncstorage data-storage database encryption expo fast fast-storage ios java mmap mmkv mmkv-database native objective-c react react-native react-native-jsi storage

Last synced: 17 Dec 2024

https://github.com/fstpackage/fst

Lightning Fast Serialization of Data Frames for R

compression data-frame data-storage r

Last synced: 11 Nov 2024

https://github.com/datalad/datalad

Keep code, data, containers under control with git and git-annex

closember data-storage dataset git-annex python usable

Last synced: 06 Nov 2024

https://github.com/qsbase/qs

Quick serialization of R objects

compression data-storage encoding r serialization

Last synced: 19 Dec 2024

https://github.com/juliaio/hdf5.jl

Save and load data in the HDF5 file format from Julia

data-storage hacktoberfest hdf5 hdf5-binaries hdf5-files hdf5-library jld julia julia-language mat

Last synced: 19 Dec 2024

https://github.com/JuliaIO/HDF5.jl

Save and load data in the HDF5 file format from Julia

data-storage hacktoberfest hdf5 hdf5-binaries hdf5-files hdf5-library jld julia julia-language mat

Last synced: 17 Nov 2024

https://github.com/knoxite/knoxite

A data storage & backup system

backup data-storage hacktoberfest restore snapshot volumes

Last synced: 02 Nov 2024

https://github.com/juliaio/jld.jl

Saving and loading julia variables while preserving native types

data-storage hdf5-format jld-format julia serializer

Last synced: 18 Dec 2024

https://github.com/karthik/rdrop2

Dropbox Interface from R

data-storage dropbox-interface r

Last synced: 15 Dec 2024

https://github.com/45Drives/autotier

A passthrough FUSE filesystem that intelligently moves files between storage tiers based on frequency of use, file age, and tier fullness.

data-storage passthrough-fuse-filesystem storage-tiers tiered tiered-file-system tiered-storage tiering

Last synced: 05 Nov 2024

https://github.com/airscholar/e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

apache-airflow apache-kafka apache-spark apache-zookeeper big-data cassandra containerization data-engineering data-pipeline data-processing data-storage docker etl-pipeline postgresql real-time-analytics

Last synced: 17 Dec 2024

https://github.com/weedshaker/peerwebsite

Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

data-storage decentralized distributed encryption-decryption hosting indie-web indieweb ipfs js-ipfs old-internet p2p peer-to-peer peerweb small-internet smol-internet the-cyberfreedom-network web3 webrtc website-hosting webtorrent

Last synced: 21 Dec 2024

https://github.com/Weedshaker/PeerWebSite

Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

data-storage decentralized distributed encryption-decryption hosting indie-web indieweb ipfs js-ipfs old-internet p2p peer-to-peer peerweb small-internet smol-internet the-cyberfreedom-network web3 webrtc website-hosting webtorrent

Last synced: 04 Nov 2024

https://weedshaker.github.io/PeerWebSite/

Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

data-storage decentralized distributed encryption-decryption hosting indie-web indieweb ipfs js-ipfs old-internet p2p peer-to-peer peerweb small-internet smol-internet the-cyberfreedom-network web3 webrtc website-hosting webtorrent

Last synced: 02 Nov 2024

https://github.com/GridProtectionAlliance/openHistorian

The Open Source Time-Series Data Historian

data-mining data-storage data-stream historian time-series

Last synced: 06 Nov 2024

https://github.com/marceloboeira/bojack

🐴 The unreliable key-value store

bojack cache crystal data-storage data-store database distributed nosql redis ruby storage store

Last synced: 30 Oct 2024

https://github.com/lf-edge/edge-home-orchestration-go

Home Edge Project in LF Edge - Edge Orchestration for home edge devices to enabling smart home use cases.

cluster-computing container containerization data-storage docker edgecomputing hikey960 home-iot homeedge iot lfedge node orchestration raspberry-pi rbac

Last synced: 18 Dec 2024

https://github.com/artiomn/nas

Scripts and config files for the secure Linux-based multiservice server on ZFS

data-storage data-store debian dnsrobocert docker docker-compose home-server ldap letsencrypt linux nas nextcloud organizr personal-server secure-server security server torrents

Last synced: 28 Oct 2024

https://github.com/TheSethRose/Time-Capsule

Time Capsule continuously captures and stores digital activities to create a comprehensive memory system. It features real-time audio recording, speech-to-text with Fast-Whisper, plugin support, database storage via Chroma, and a web interface for management. Ideal for documenting life or building digital memories.

ai audio-capture chroma data-storage digital-memory flask memory plugins python whisper

Last synced: 04 Dec 2024

https://github.com/thesethrose/time-capsule

Time Capsule continuously captures and stores digital activities to create a comprehensive memory system. It features real-time audio recording, speech-to-text with Fast-Whisper, plugin support, database storage via Chroma, and a web interface for management. Ideal for documenting life or building digital memories.

ai audio-capture chroma data-storage digital-memory flask memory plugins python whisper

Last synced: 19 Dec 2024

https://github.com/bearframework/bearframework

An open-source PHP framework. Incredibly lightweight. Powerful enough.

data-storage framework php php-framework php7 routing web-application-framework

Last synced: 13 Oct 2024

https://github.com/msdeep14/deepdatabase

A relational database engine using B+ tree indexing

algorithms b-plus-tree bplus-tree bplustree btree-indexes cpp data-storage database development indexing mysql-database relational-databases search-algorithm

Last synced: 11 Oct 2024

https://github.com/gbeckers/darr

A Python library for numpy arrays that persist on disk in a format that is simple, self-documented and tool-independent, and maximizes universal readability.

array bsd-3-clause data-science data-sharing data-storage idl interoperability jagged-array julia-language maple mathematica matlab numeric octave python r ragged-array science scilab

Last synced: 19 Dec 2024

https://github.com/ZorPastaman/Event-Based-Blackboard

Event Based Blackboard for Unity is a flexible data storage that can contain any count of properties of any type. The properties can be accessed with property names.

blackboard data-storage event-based flexible unity

Last synced: 14 Nov 2024

https://github.com/aureleoules/bitcandle

Store data on Bitcoin for 350 sats/KB up to 185 KB by using P2SH-P2WSH witness scripts

bitcoin data-storage p2sh-p2wsh segwit

Last synced: 16 Nov 2024

https://github.com/qsbase/qs2

compression data-storage r serialization

Last synced: 11 Nov 2024

https://github.com/krassowski/data-vault

IPython magic for simple, organized, compressed and encrypted: storage & transfer of files between notebooks.

data-storage disk-cache ipython-magic jupyter-notebook persistent-storage

Last synced: 15 Nov 2024

https://github.com/ivopetkov/object-storage

A better way to work with files. Metadata available too.

atomic data-storage file-storage metadata object-storage storage

Last synced: 16 Nov 2024

https://github.com/PFund-Software-Ltd/pfeed

Data pipeline for algo-trading, helping traders in getting real-time and historical data, and storing them in a local data lake for quantitative research.

algo-trading backtesting data-analysis data-pipeline data-storage historical-data pandas

Last synced: 16 Oct 2024

https://github.com/js2me/stonex

💡 Simple state container for JavaScript/TypeScript applications 💡

data-storage predictable predictable-state redux state state-container state-management stonex-store

Last synced: 23 Oct 2024

https://github.com/polyfrost/datastorage

Static data storage for Polyfrost projects.

data data-storage hypixel hypixel-api minecraft minecraft-mod

Last synced: 10 Nov 2024

https://github.com/dina-hosny/chaincare

ChainCare is a health information system that uses smart contracts to handle medical procedures and stores the medical history in Block Chains.

api-rest bigchain blockchain blockchain-technology data-science data-storage data-visualization ethereum golang health-informatics-systems healthcare insomnia metamask postgresql postman reactjs solidity truffle web3

Last synced: 14 Nov 2024

https://github.com/dangerous-community/dangerous-net

The cloud storage / internet system for cypher punks, decentralized enthusiasts and bio-hackers. Built on a Proof of Storage mentality, You can pass all of your files, messages, and data through the private network. Secure them in a MFA and implant focused (AES) approach to data processing and encryption.

biohacking data-storage decentralized-applications encryption implant implants internet ipfs ipfs-web javacard keycard vivokey web3 webapplication

Last synced: 10 Oct 2024

https://github.com/ayaanhossain/sharedb

An on-disk pythonic embedded key-value store based on LMDB for compressed data storage and distributed data analysis

data-analysis data-storage distributed embedded-database key-value lmb msgpack multiprocessing parallel python python-3 python-library python-script python2 python3 store

Last synced: 15 Oct 2024

https://github.com/anotherkamila/stalky

Self-hosted app to keep track of anything you want. Don't let others stalk you, stalk yourself!

csv data-analysis data-storage geeks privacy-by-design self-hosted timeseries tracking

Last synced: 25 Nov 2024

https://github.com/wtrocki/rhmap-storage-service

RHMAP file data storage service using express and mongodb for storage

data-storage mongodb storage-service storage-solution

Last synced: 20 Oct 2024

https://github.com/souvikns/jcontainer

Deployable REST API data storage service.

data-storage hacktoberfest2020 mongodb nextjs nodejs-server reactjs rest-api

Last synced: 14 Oct 2024

https://github.com/nuzulul/kv-storage

💾 Create data storage that uses a simple key-value method for Node, Browser, Deno, Bun, Cloudflare Workers

cloudflare-workers data-storage data-store database db file file-database file-storage indexeddb kv-storage node-js nodejs nosql nosql-database storage

Last synced: 12 Nov 2024

https://github.com/nanosector/collections

Simple Collection class allowing storage of specific data.

array arrayobject collections data-storage php validation

Last synced: 28 Oct 2024

https://github.com/hurence/historian

big data timeseries historian

bigdata compression data-storage data-stream grafana historian sampling spark-streaming time-series

Last synced: 09 Nov 2024

https://github.com/junzhengca/identity-atheneum

Identity federation and data storage platform for education tools. Powered by MongoDB, Redis and Node.js. Connect using simple REST API.

authentication data-storage node-js saml

Last synced: 25 Oct 2024

https://github.com/ultreon/ubo

NBT inspired data I/O. Made for games.

api binary-data data data-storage file-type game-data io library ubo

Last synced: 06 Nov 2024

https://github.com/guoxicheng/tinycrud

基于 Issue API 的轻量级数据存储库 - Lightweight Data Repository Based on Git Issue API

crud data-storage issue lightweight typescript

Last synced: 07 Nov 2024

https://github.com/gerold-penz/bun-sqlite-key-value

A super fast key-value store with SQLite that uses bun:sqlite and v8 as a fast JSON replacement.

bun bun-js cache data-storage database db-storage key-value key-value-storage kv-store nosql nosql-database sqlite time-to-live ttl typescript

Last synced: 07 Sep 2024

https://github.com/vulcalien/vulcdataformat-specification

Specification for Binary and Textual VDF file formats.

data data-storage serialization

Last synced: 05 Dec 2024

https://github.com/seanox/xml-micro-exchange-js

XML and XPath based volatile NoSQL stateless micro datasource for data exchange for web applications and IoT (implementation for Node.js)

acme cloud data-storage exchange microservice node-js nosql web-api xlst xml xpath

Last synced: 08 Nov 2024

https://github.com/andrey-tech/data-storage-php

Простое хранилище данных в виде ключ-значение в JSON-файлах с разделяемой блокировкой на чтение и эксклюзивной блокировкой на запись.

data data-storage files json php php7 storage

Last synced: 09 Dec 2024

https://github.com/konh/analyticspipeline

The opinionated approach combines a client-side SDK, operative + historical data storage, and a data mart

analytics business-intelligence csharp data-driven data-storage dotnet unity

Last synced: 06 Dec 2024

https://github.com/ocramz/hdf5-lite

Haskell bindings to HDF5-lite

big-data data-frames data-storage data-tables hdf5 hdf5-library scientific-filesystem

Last synced: 19 Dec 2024

https://github.com/jelastic-jps/owncloud

ownCloud represents an open source and free file cloud storage

cloud-storage cloud-storage-application cloudstorage data-sharing data-storage jelastic jelastic-jps jps owncloud php sync-data sync-files

Last synced: 10 Nov 2024

https://github.com/vulcalien/vulcdataformat

Simple data storage system for Java.

data data-storage java serialization

Last synced: 15 Oct 2024

https://github.com/seanox/xml-micro-exchange-php

XML and XPath based volatile NoSQL stateless micro datasource for data exchange for web applications and IoT (implementation for PHP)

cloud data-storage microservice nosql web-api xml xpath xslt

Last synced: 08 Nov 2024

https://github.com/shahaf-f-s/data-place

A powerfull and flexible framework for designing async socket based data streaming and destribution systems, with automated parsing, dynamic data store and high-level control hooks.

data-storage data-store data-transmission socket-programming sockets websockets

Last synced: 10 Nov 2024

https://github.com/osspk/queue-and-stack

🎈 A C++ implementation of two datastructures: queue and stack

cplusplus data-storage data-structures datastructures free-to-use open-source-code queue stack

Last synced: 24 Nov 2024

https://github.com/mariodudjak/baas-datastorageapi

The API BaaS feature of my own Baas. Backed by NoSQL database, data is in JSON format. API has schemas and resources routes.

asp-net baas csharp data-storage microservice mongodb ninject onion-architecture rest-api

Last synced: 15 Nov 2024

https://github.com/cundd/document_storage

data-storage documentdb typo3 typo3-cms-extension

Last synced: 20 Nov 2024

https://github.com/serverfarmer/sf-storage-utils

Dependency extension, providing mass storage related logic for other extensions.

data-storage drive hdparm luks mount mounting rsync standby storage

Last synced: 22 Nov 2024

https://github.com/andre-alck/flutter_aplicando_persistencia_de_dados

Para acompanhamento do curso Flutter: aplicando persistência de dados

dart data data-storage flutter persistence persistent-storage sqflite sql sqlite

Last synced: 03 Dec 2024

https://github.com/maxakuru/git-backup

Sync files/folders to git repositories, schedule with Docker image

automation backup data-storage docker git github raspberry-pi sync

Last synced: 16 Nov 2024

https://github.com/sheroz/poncu

Distributed Storage System in Rust

caching data-storage distributed-storage file-storage in-memory key-value-store

Last synced: 15 Nov 2024

https://github.com/akshayjith4/billmates

BillMates is a user-friendly app designed to simplify managing shared expenses among flatmates. Easily track bills, automatically split costs, and ensure everyone knows what they owe. Features include bill tracking, expense splitting, payment reminders, and expense history. Contributions are welcome!

cost-splitting data-storage expense-tracking user-interface web-hosting

Last synced: 12 Nov 2024

https://github.com/mdouchement/lss

Light Storage Service, a simple lightweight web storage API.

data-storage golang storage-engine

Last synced: 10 Nov 2024

https://github.com/coslynx/fitness-tracker-mvp-social-community-web-app

Track fitness goals, log workouts, and share progress with friends... Created at https://coslynx.com

activity-tracking api-integration back-end code-generation data-storage developer-tools devops fitness-tracker front-end goal-setting javascript machine-learning mvp mvp-development nextjs postgresql progress-visualization social-features software-development user-authentication

Last synced: 17 Dec 2024

https://github.com/efebadir/todolist

ToDoList is a practical application that helps users manage their tasks. With an integrated database, you can securely store tasks, add new tasks, edit existing ones, and delete them. Additionally, you can easily navigate through tasks with the search feature.

android-app data-storage database-integration kotlin kotlin-android mobile-development productivity-tools search-functionality task-editing task-management user-interface

Last synced: 18 Nov 2024

https://github.com/sowrensen/butler

Take mysql or mariadb database backup for your Laravel apps altogether.

cronjob data-rescue data-storage database database-backups laravel laravel-framework mariadb mysql sql

Last synced: 05 Nov 2024

https://github.com/fiftin/mydataspace.github.io

Source code of fastlix.com

baas cloud-database cloud-datastore data-management data-storage firebase

Last synced: 21 Dec 2024

https://github.com/simplyprogrammer/java-serialx

Store Java objects into JSON or any format you want! SerialX is a powerful lightweight utility library to serialize Java objects programmatically via tweakable recursive descent parser for custom domain-specific languages!

base64-decoding base64-encoding data-storage domain-specific-language fast java java-serialization-alternative javautils json json-alternative objecttostring readfile reading recursive-descent-parser serialization serialization-library serialize-objects unserialize writefile writing

Last synced: 06 Dec 2024

https://github.com/serverfarmer/sm-backup-collector

sf-backup-collector extension provides central backup functionality for small and medium server farms.

backup backup-manager backup-process backup-script backup-solution backup-tool data-storage debian devops devops-tools storage ubuntu

Last synced: 22 Nov 2024

https://github.com/jakephelan1/jfit

A user responsive program UI made using the JavaFX framework.

apis data-storage javafx-application object-oriented-programming

Last synced: 19 Nov 2024

https://github.com/serverfarmer/sf-samba-server

sf-samba-server extension provides managed Samba solution for small and medium companies.

data-storage debian php samba samba-server security security-tools server-configuration storage ubuntu

Last synced: 22 Nov 2024

https://github.com/nathadriele/cnpj-data-pipeline

The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.

amazon-s3 cloud-computing cnpj-data data-engineering data-pipeline data-processing data-storage etl-pipeline mage-ai public-data script-automation

Last synced: 02 Dec 2024

https://github.com/simonp0420/citifile.jl

Read microwave network scattering parameters from CITIfile-formatted files

citi data-storage electrical-engineering engineering microwave microwave-engineering scattering-parameters

Last synced: 13 Dec 2024

https://github.com/vishalbansal28/end-to-end-realtime-data-streaming

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

apache-airflow apache-kafka apache-spark apache-zookeeper big-data cassandra containerization data-engineering data-pipeline data-processing data-storage docker etl-pipeline postgresql real-time-analytics

Last synced: 12 Oct 2024

https://github.com/kockarevicivan/sequential-file-processing

Implementation of sequential file storage.

c data-storage sequential-file

Last synced: 06 Dec 2024

https://github.com/davyjonescodes/jsondb-python

JsonDB is a minimal, Python-powered JSON database for easy data management. Ideal for small projects and prototyping, it supports simple CRUD operations, nested data structures, and basic searches. Streamline your data tasks with JsonDB's intuitive file-based system.

crud data-management data-storage database educational-tool file-based-database json jsondb lightweight-database no-sql pypi python simple-database

Last synced: 04 Dec 2024

https://github.com/mateolafalce/datastore

This program running in Solana has the purpose of saving the respective data of each web page for Decenwser . The program is deactivated to date since this data architecture was no longer used

blockchain blockchain-service browser data-storage decentralized decenwser solana