{"id":22632184,"url":"https://github.com/alleninstitute/micronsbinder","last_synced_at":"2025-04-11T20:10:57.418Z","repository":{"id":46804415,"uuid":"258812291","full_name":"AllenInstitute/MicronsBinder","owner":"AllenInstitute","description":"A collection of notebooks to provide examples of using Microns-explorer.org datasets","archived":false,"fork":false,"pushed_at":"2023-10-16T14:02:22.000Z","size":131905,"stargazers_count":21,"open_issues_count":2,"forks_count":13,"subscribers_count":13,"default_branch":"master","last_synced_at":"2023-10-17T05:12:06.298Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AllenInstitute.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-04-25T15:41:36.000Z","updated_at":"2024-05-30T02:47:31.994Z","dependencies_parsed_at":"2024-05-30T02:47:21.999Z","dependency_job_id":"de65ed32-2766-4732-938a-69c9df8cc871","html_url":"https://github.com/AllenInstitute/MicronsBinder","commit_stats":null,"previous_names":[],"tags_count":0,"template":null,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AllenInstitute%2FMicronsBinder","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AllenInstitute%2FMicronsBinder/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AllenInstitute%2FMicronsBinder/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AllenInstitute%2FMicronsBinder/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AllenInstitute","download_url":"https://codeload.github.com/AllenInstitute/MicronsBinder/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248473127,"owners_count":21109628,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-09T02:16:44.170Z","updated_at":"2025-04-11T20:10:57.393Z","avatar_url":"https://github.com/AllenInstitute.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/AllenInstitute/MicronsBinder/master?urlpath=lab) [![](https://img.shields.io/badge/python-3.7+-blue.svg)](https://www.python.org/download/releases/3.7.0/)\n\n# MicronsBinder\nA collection of notebooks to provide examples of using data from [microns-explorer.org](https://microns-explorer.org).  The repository is designed to work with [mybinder.org](https://mybinder.org)\n\n\n# Contents\n### Phase 3 cubic mm Introductory Notebooks\nIn July 2021, we released the data from [Phase 3 of the project](https://) that includes functional and anatomical data from large scale EM reconstructions covering approximately a mm^3 .  We have created some [introductory notebooks](notebooks/mm3_intro) to help users begin to analyze the anatomical data. There is a companion set of repositories for how to access the functional data located here ()\n\n* [CAVESetup](notebooks/mm3_intro/CAVEsetup.ipynb)\nThis notebook walks users through how to setup their environment to connect to the Connectome Annotation Versioning Engine services that are needed to access the data.  When using mybinder you will need to follow this notebook each time you launch the docker image.  When setting up your own machine it will only need to be followed once.  All other notebooks assume you have setup an account and credentials before continuing. \n\n* [SynapseAndAnnotationQuery](notebooks/mm3_intro/SynapseAndAnnotationQuery.ipynb)\nThis notebook shows how to query the inputs and outputs of a neuron, and then goes on to show you how to query any of the data annotation tables, including automated detection of where the neurons are, what neurons have been proofread, and so on. \n\n* [MeshAccess](notebooks/mm3_intro/MeshAccess.ipynb)\nDemonstrates how to download meshes of neurons from the flat and dynamic segmentation using cloud-volume and MeshParty, explaining their differences.  Note the visualization components of this require \n\n\n### Phase 1 Introductory Notebooks\nAn earlier releases of the [Phase 1 data  from layer 2/3](https://microns-explorer.org/phase1) used alternative data formats, and so we have alternative notebooks for accessing this data. \n\nWe've created some [introductory notebooks](notebooks/intro) to demonstrate some potential uses of the data. See:\n\n* [MostSynapsesInAndOut](notebooks/intro/MostSynapsesInAndOut.ipynb)  \nThis notebook introduces you to reading synapses and the soma valence table.  It creates neuroglancer links that let you explore the inputs and outputs of individual neurons.\n* [DashSynapseExplorer](notebooks/intro/DashSynapseExplorer.ipynb)  \nThis notebook shows you how to create dynamic scatterplots that recreate some of the results about layer 2/3 to layer 2/3 connections that were reported in Dorkenwald et al. 2019.\n* [ImageAndSegmentationDownload](notebooks/ImageAndSegmentationDownload.ipynb)  \nThis notebook shows you how to create figures with overlaid EM and segmentation figures.\n\nThe introductory notebooks below are not intended to be run on mybinder for reasons specified below. To run them you should set up a local python environment (see [these instructions](#localenv)).\n\n* [MeshExample](notebooks/intro/MeshExample.ipynb)\nThis demonstrates basic 3D visualization of meshes and skeletons using vtk, as well as calculating shortest paths along a mesh. This example uses more memory than allocated to most binder instances, and may be killed during processing while using those resources.\n* [Render3DScaleBar](notebooks/intro/Render3DScaleBar.ipynb)\nThis demonstrates two techinques to create 3D scale bars on 3D visualization plots. It requires access to an X windows system to view these plots.\n\n### Vignette manuscript analyses\nThese notebooks walk through some newer analyses studying the [Phase 1 data  from layer 2/3](https://microns-explorer.org/phase1).  \n\nThese include:\n* [Motif analysis](notebooks/vignette_analysis/motifs) of a proofread synaptic connectivity graph between pyramidal cells.\n* [Functional analysis](notebooks/vignette_analysis/function) of a subset of the same pyramidal cells based on two-photon calcium imaging. The analysis relates local connectivity to function.\n* [Mitochondria analysis](notebooks/vignette_analysis/mitochondria) comparing mitochondria across neuronal compartments (axon, dendrite, soma), as well as a relation between mitochondrial density and synapse density.\n* [Resource statistics](notebooks/vignette_analysis/resource_statistics) that summarize neurite branch length and the expected completeness of the dendritic arbors in the volume.\n\nSee each [directory](notebooks/vignette_analysis) and our [biorxiv manuscript](https://www.biorxiv.org/content/10.1101/2020.10.14.338681v3) for more details.\n\n\n# \u003ca name=\"localenv\"\u003e\u003c/a\u003e Local environment\n### Python packages\nA local environment for running the intermediate code generation scripts can be installed using the Anaconda environment installed within the binder and the `postBuild` script. We highly recommend using [mamba](https://mamba.readthedocs.io/en/latest/index.html) to at least resolve the initial set of dependencies.\n```\nconda install mamba -n base -c conda-forge\nmamba env create -f environment.yml\nconda activate micronsbinder\n```\nThis installs the required python packages for running the contained code.\n\nIf you'd like to use these notebooks as part of your general jupyter environment. You'll likely need to install this environment into your ipython kernels.\n```\nconda activate micronsbinder\npython -m ipykernel install --user --name=micronsbinder\n```\nYou can then select this python environment when opening the relevant notebooks.\n\n### Analysis data\n\nIf you'd like to download the data or jupyter plugins for a specific analysis, you can use the `Makefile` targets to download the data for a specific notebook directory. For example, the command for the [motif analysis](notebooks/vignette_analysis/motifs) is:\n```bash\nmake vignette_analysis/motifs\n```\n\nYou can also install all data using `make all` and remove all data using `make clean`. See the `Makefile` for more options.\n\n# Related projects\nThe notebooks contained here make heavy use of standard python tools, but also tools built as part of the collaboration between the Connectomics group at Allen Institute, the Seung Lab at Princeton, and the Tolias lab at Baylor, along with neuroglancer (developed by Jeremy Maitin-Shepard from the Connectomics group at Google).\n\n* [neuroglancer](https://www.github.com/google/neuroglancer)  \nThis is the main neuroglancer repository developed by Jeremy Maitin-Shepard. \n* [neuroglancer Seung-lab](https://www.github.com/seung-lab/neuroglancer)  \nThis is the Seung lab's fork of neuroglancer that has some alternative features added by many different Seung lab members. \n* [NeuroglancerAnnotationUI (nglui)](https://www.github.com/seung-lab/NeuroglancerAnnotationUI)  \nThis is a package principally developed by Casey Schneider-Mizell from the Allen Institute.  The package helps to create a pipeline that connects [pandas](https://pandas.pydata.org/) dataframes to neuroglancer links that visualize the contained data.\n* [CloudVolume](https://www.github.com/seung-lab/cloud-volume)  \nThis is a python library developed principally by Will Silversmith from the Seung Lab for reading and writing volumetric data (e.g. EM images, segmentation), meshes, and skeletons to a variety of storage locations (e.g. cloud buckets, chunked files).\n* [MeshParty](https://www.github.com/sdorkenw/MeshParty)  \nThis is a package developed by Sven Dorkenwald (Princeton), Forrest Collman (Allen), and Casey Schneider-Mizell (Allen) to make downloading meshes (via [CloudVolume](https://www.github.com/seung-lab/cloud-volume)), performing analysis (with tools like [trimesh](https://github.com/mikedh/trimesh), and [scipy](https://www.scipy.org/)) and visualization (via [vtk](https://pypi.org/project/vtk/)) of neuronal meshes easier.  There are also some tools for helping make dynamic movies of these data.\n* [DashDataFrame](https://www.github.com/AllenInstitute/DashDataFrame)  \nThis is a package developed by Leila Elabaddy, Melissa Hendershott, and Forrest Collman at the Allen Institute.  It simplifies constructing dynamic visualization from pandas dataframes using [Dash](https://www.github.com/plotly/dash), including making dynamic links out to external services.  In this case, we use this to make dynamic scatterplots that allow you to select variables to plot, select and filter data points, and construct neuroglancer views of the specific locations in the dataset of those data points.\n\n\n# Level of Support\nWe are releasing this repository as-is, and plan to update it without a fixed schedule.\nIt is intended to be a teaching tool to start interacting with the data. Community involvement is encouraged through both issues and pull requests.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Falleninstitute%2Fmicronsbinder","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Falleninstitute%2Fmicronsbinder","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Falleninstitute%2Fmicronsbinder/lists"}