{"id":19448552,"url":"https://github.com/neurodata/ndstore","last_synced_at":"2025-04-25T02:31:25.253Z","repository":{"id":90462901,"uuid":"1606074","full_name":"neurodata/ndstore","owner":"neurodata","description":"code for storing neurodata images and image annotations","archived":false,"fork":false,"pushed_at":"2017-10-01T19:25:16.000Z","size":52123,"stargazers_count":38,"open_issues_count":99,"forks_count":12,"subscribers_count":18,"default_branch":"master","last_synced_at":"2025-04-03T15:05:04.729Z","etag":null,"topics":["aws","data-store","neuroscience","redis","s3"],"latest_commit_sha":null,"homepage":"http://neurodata.io","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/neurodata.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2011-04-12T20:21:22.000Z","updated_at":"2023-09-28T02:44:16.000Z","dependencies_parsed_at":null,"dependency_job_id":"07b38cf3-dd38-4957-a0d8-e196367d52e6","html_url":"https://github.com/neurodata/ndstore","commit_stats":null,"previous_names":[],"tags_count":13,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/neurodata%2Fndstore","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/neurodata%2Fndstore/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/neurodata%2Fndstore/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/neurodata%2Fndstore/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/neurodata","download_url":"https://codeload.github.com/neurodata/ndstore/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250741940,"owners_count":21479703,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","data-store","neuroscience","redis","s3"],"created_at":"2024-11-10T16:27:34.713Z","updated_at":"2025-04-25T02:31:24.067Z","avatar_url":"https://github.com/neurodata.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"Scalable database cluster for the spatial analysis and annotation of high-throughput brain imaging data called Neurodata Web Services(formerly called the Open Connectome Project).\n\n[![Neurodata.io](https://img.shields.io/badge/Visit-neurodata.io-ff69b4.svg)](http://neurodata.io/)\n[![DOI](https://zenodo.org/badge/doi/10.5281/zenodo.19972.svg)](http://dx.doi.org/10.5281/zenodo.19972)\n[![Hex.pm](https://img.shields.io/hexpm/l/plug.svg)](http://www.apache.org/licenses/LICENSE-2.0.html)\n[![Docs](https://img.shields.io/badge/Docs-latest-brightgreen.svg)](http://docs.neurodata.io/ndstore/)\n[![Build Status](https://travis-ci.org/neurodata/ndstore.svg?branch=microns)](https://travis-ci.org/neurodata/ndstore.svg?branch=master)\n[![Service Status](https://img.shields.io/badge/service-status-lightgrey.svg)](http://neurodata.statuspage.io/)\n\n\n#### Major directories include:\n\n  * spdb -- [Spatial Database submodule](https://github.com/neurodata/spdb)\n  * ndingest -- [AWS Wrappers for Parallel Ingest submodule](https://github.com/neurodata/ndingest)\n  * ndlib -- [Common library and Ctype accelerations submodule](https://github.com/neurodata/ndlib)\n  * ingest-client -- [Ingest client and related services submodule](https://github.com/neurodata/ingest-client)\n  * webservices -- Webservices module\n  * ndproj -- Project Module\n  * ramon -- RAMON and Annotation metadata module\n  * django -- Django module\n  * setup -- Install script, setup instructions and configurations\n  * test -- Test module\n  * examples -- How to use the service\n  * admin -- Scripts to manage the databases\n  * docs -- Sphinx documentation for the project\n  * scripts -- Useful general purpose scripts\n\nNOTE: git submodule init and git submodule update for all submodules\n\n#### Architecture\n\n![](./docs/images/neurodata_cluster.png)\n\n#### Installation\n\n* Use a fresh Ubuntu14.04 instance with sudo access.\n```console\nwget https://raw.githubusercontent.com/neurodata/ndstore/master/setup/ndstore_install.sh\nsudo chmod 7000 ndstore_install.sh\nsudo ./ndstore_install.sh\n```\n**Note:** *ndstore does not support Docker images because running custom systemd services needs some relaxation of security on the Docker engine leading to issues. We recommend using the install script used above*\n\n#### Benchmarks\n\nThe benchmarks were performed on AWS EC2 instance type i2.8xlarge with a MySQL backend.\n\n##### Read Throughput\n\n![](./docs/images/neurodata_read_throughput.png)\n\n##### Write Throughput\n\n![](./docs/images/neurodata_write_throughput.png)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fneurodata%2Fndstore","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fneurodata%2Fndstore","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fneurodata%2Fndstore/lists"}