Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/arcadelab/FastSAM3D_slicer

A 3D Slicer extension for FastSAM3D
https://github.com/arcadelab/FastSAM3D_slicer

Last synced: about 1 month ago
JSON representation

A 3D Slicer extension for FastSAM3D

Awesome Lists containing this project

README

        

# FastSAM-3DSlicer: A 3D-Slicer Extension for 3D Volumetric Segment Anything Model with Uncertainty Quantification

[paper](https://arxiv.org/abs/2403.09827)
\
[FastSAM3D code](https://github.com/arcadelab/FastSAM3D)
\
[video](https://youtu.be/oJ9ZhnPWqSs)
\
[ARCADE lab](https://arcade.cs.jhu.edu/), [Johns Hopkins University](https://www.jhu.edu/)
\
![Results](utils/results.PNG)

# Table of contents
- [Fast Segment-anything model in 3D medical image (FastSAM3D): A 3D Slicer extension to FastSAM3D](#fast-segment-anything-model-in-3d-medical-image-fastsam3d-a-3d-slicer-extension-for-fastsam3d)
- [Table of contents](#table-of-contents)
- [Introduction ](#introduction-)
- [Before You Try ](#before-you-try-)
- [How to Use ](#how-to-use-)
- [Features ](#features-)
- [Citation ](#citation-)

## Introduction
What are SAM, SAMMed3D, FastSAM3D and FastSAM3D_slicer?
* SAM is the vision foundation model developed by Meta, [Segment Anything](https://segment-anything.com).
* SAMMed3D is the 3D version of SAM based on medical image.
* FastSAM3D is the faster version of SAMMed3D.
* FastSAM3D_slicer is the 3D slicer extension based on FastSAM3D and SAMMed3D.
\
Why FastSAM3D and FastSAM3D_slicer?
* FastSAM3D is about 10 times faster compare with SAMMed3D, with small accuracy lose.
* FastSAM3D_slicer provide an interface for user to do segmentation based on FastSAM3D for medical image intutively.
* And it's really fast!
## Before You Try
Make sure you have more than 3GB storage to download model weights and install pytorch.
Don't forget to use the provided resample.py file to do resample for medical image.
## How to Use
step 1: Download the file and compress it.

step 2: open the 3D slicer and open the extension manager, download the pytorch extension, and restart the slicer.
![step21](utils/step21.PNG)
![step22](utils/step22.PNG)
step 3: open the extension wizard in the 3D slicer.
![step3](utils/step3.PNG)
step 4: click the select extension and choose the compressed file in step 1.
![step4](utils/step4.PNG)
step 5: the extension will now be available here
![step5](utils/step5.PNG)
### Features
- 3 View Inference
- Data type
- NIFTI file
- volume
- models
- FastSAM3D
- SAMMed3D
- interactions
- include and exclude points
## Citation
If you use FastSAM3D_slicer in your research, please consider use the following BibTeX entry.

```bibtex
@misc{shen2024fastsam3d,
title={FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Images},
author={Yiqing Shen and Jingxing Li and Xinyuan Shao and Blanca Inigo Romillo and Ankush Jindal and David Dreizin and Mathias Unberath},
year={2024},
eprint={2403.09827},
archivePrefix={arXiv},
primaryClass={eess.IV}
}

@article{shen2024fastsam,
title={FastSAM-3DSlicer: A 3D-Slicer Extension for 3D Volumetric Segment Anything Model with Uncertainty Quantification},
author={Shen, Yiqing and Shao, Xinyuan and Romillo, Blanca Inigo and Dreizin, David and Unberath, Mathias},
journal={arXiv preprint arXiv:2407.12658},
year={2024}
}
```