https://github.com/wangsssky/SonarSAM

Segment Anything Model, SAM, Sonar images
https://github.com/wangsssky/SonarSAM

Last synced: about 1 month ago
JSON representation

Segment Anything Model, SAM, Sonar images

• Host: GitHub
• URL: https://github.com/wangsssky/SonarSAM
• Owner: wangsssky
• License: apache-2.0
• Created: 2023-06-23T12:26:07.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-07-27T07:42:11.000Z (6 months ago)
• Last Synced: 2024-07-27T08:45:05.819Z (6 months ago)
• Language: Python
• Homepage:
• Size: 152 KB
• Stars: 48
• Watchers: 1
• Forks: 5
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

• Awesome-Segment-Anything - [code

README

        
# SonarSAM

This study presents the introduction of the Segment-Anything-Model (SAM) to sonar images. We conduct a comprehensive investigation into fine-tuning methods for SAM, including LoRA and visual prompt tuning. To facilitate comparison, we provide a framework that integrates these fine-tuning methods for SAM. If this project is helpful to your research, please consider citing our paper [PDF](https://arxiv.org/pdf/2306.14109.pdf).

```

@article{wang2023sonarsam,

  title={When SAM Meets Sonar Images},

  author={Wang, Lin and Ye, Xiufen and Zhu, Liqiang and Wu, Weijie and Zhang, Jianguo and Xing, Huiming and Hu, Chao},

  journal={arXiv preprint arXiv:2306.14109},

  year={2023}

}

```

# Update

- **2023-06-30** Support fine-tuning with LoRA on [Mobile SAM](https://github.com/ChaoningZhang/MobileSAM) backbone.

- **2023-06-29** Support fully fine-tuning on [Mobile SAM](https://github.com/ChaoningZhang/MobileSAM) backbone.

# Dataset

The Marine Debris dataset is used in this work, which is available at [Forward-Looking Sonar Marine Debris Datasets](https://github.com/mvaldenegro/marine-debris-fls-datasets).

# Training

- Using box prompts

```

python train_SAM_box.py --config ./configs/sam_box.yaml

```

- Semantic segmentation

```

python train_SAM.py --config ./configs/sam.yaml

```

# License

The model is licensed under the [Apache 2.0 license](./LICENSE.txt).

# Acknowledgment

This project was developed based on the following awesome codes.

- Segment Anything Model: [SAM](https://github.com/facebookresearch/segment-anything)

- Prompt layer & Custom segmentation head: [LearnablePromptSAM](https://github.com/Qsingle/LearnablePromptSAM/)

- LoRA: [SAMed](https://github.com/hitachinsk/SAMed/)