{"id":19382591,"url":"https://github.com/neuro-ml/connectome","last_synced_at":"2025-04-23T20:32:24.145Z","repository":{"id":41567832,"uuid":"275780914","full_name":"neuro-ml/connectome","owner":"neuro-ml","description":"A library for datasets containing heterogeneous data","archived":false,"fork":false,"pushed_at":"2024-10-03T20:35:08.000Z","size":2884,"stargazers_count":12,"open_issues_count":15,"forks_count":1,"subscribers_count":6,"default_branch":"master","last_synced_at":"2025-04-02T20:11:15.167Z","etag":null,"topics":["data-processing","pipelines","python"],"latest_commit_sha":null,"homepage":"https://neuro-ml.github.io/connectome/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/neuro-ml.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-06-29T08:57:53.000Z","updated_at":"2024-10-03T20:34:11.000Z","dependencies_parsed_at":"2024-01-18T00:30:31.453Z","dependency_job_id":"3cc79df4-cba7-41db-b900-a7b8668b7875","html_url":"https://github.com/neuro-ml/connectome","commit_stats":{"total_commits":480,"total_committers":11,"mean_commits":43.63636363636363,"dds":"0.19999999999999996","last_synced_commit":"b35750567439394c7e7ba5371090e930aa431885"},"previous_names":[],"tags_count":35,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/neuro-ml%2Fconnectome","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/neuro-ml%2Fconnectome/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/neuro-ml%2Fconnectome/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/neuro-ml%2Fconnectome/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/neuro-ml","download_url":"https://codeload.github.com/neuro-ml/connectome/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250509826,"owners_count":21442507,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-processing","pipelines","python"],"created_at":"2024-11-10T09:22:20.250Z","updated_at":"2025-04-23T20:32:21.852Z","avatar_url":"https://github.com/neuro-ml.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![docs](https://img.shields.io/badge/-docs-success)](https://neuro-ml.github.io/connectome/)\n[![codecov](https://codecov.io/gh/neuro-ml/connectome/branch/master/graph/badge.svg)](https://codecov.io/gh/neuro-ml/connectome)\n[![pypi](https://img.shields.io/pypi/v/connectome?logo=pypi\u0026label=PyPi)](https://pypi.org/project/connectome/)\n![License](https://img.shields.io/github/license/neuro-ml/connectome)\n[![PyPI - Downloads](https://img.shields.io/pypi/dm/connectome)](https://pypi.org/project/connectome/)\n\nConnectome is a framework for datasets management with strong emphasis on simplicity, composability and reusability.\n\n# Features\n\n* Self-consistency: connectome encourages data transformations that keep entries' fields consistent\n* Caching: transformations' caching works out of the box and supports both caching to RAM and to Disk\n* Automatic cache invalidation: connectome tracks all the changes made to a dataset and automatically invalidates the\n  cache when something changes, making sure that your cache is always consistent with the data\n* Invertible transformations: write consistent pre- and post- processing to build production-ready pipelines\n\n# Install\n\nThe simplest way is to get it from PyPi:\n\n```shell\npip install connectome\n```\n\nOr if you want to try the latest version from GitHub:\n\n```shell\ngit clone https://github.com/neuro-ml/connectome.git\ncd connectome\npip install -e .\n\n# or let pip handle the cloning:\npip install git+https://github.com/neuro-ml/connectome.git\n```\n\n# Getting started\n\nThe docs are located [here](https://neuro-ml.github.io/connectome)\n\nAlso, you can check out our `Intro to connectome` series of\ntutorials [here](https://neuro-ml.github.io/connectome/tutorials/00%20-%20Intro/)\n\n# Acknowledgements\n\nSome parts of our automatic cache invalidation machinery vere heavily inspired by\nthe [cloudpickle](https://github.com/cloudpipe/cloudpickle) project.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fneuro-ml%2Fconnectome","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fneuro-ml%2Fconnectome","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fneuro-ml%2Fconnectome/lists"}