https://github.com/cvhub520/sam-hq

This project showcases the deployment of the encoder and decoder model using ONNXRUNTIME in Python.
https://github.com/cvhub520/sam-hq

Last synced: 10 months ago
JSON representation

This project showcases the deployment of the encoder and decoder model using ONNXRUNTIME in Python.

• Host: GitHub
• URL: https://github.com/cvhub520/sam-hq
• Owner: CVHub520
• License: apache-2.0
• Created: 2023-11-12T15:04:13.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2023-11-13T02:01:31.000Z (over 2 years ago)
• Last Synced: 2024-11-08T20:47:46.771Z (over 1 year ago)
• Language: Python
• Size: 47.5 MB
• Stars: 6
• Watchers: 2
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Segment Anything in High Quality

[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/segment-anything-in-high-quality/zero-shot-segmentation-on-segmentation-in-the)](https://paperswithcode.com/sota/zero-shot-segmentation-on-segmentation-in-the?p=segment-anything-in-high-quality)



[![Huggingfaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-blue)](https://huggingface.co/spaces/sam-hq-team/sam-hq)

[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/keleiwhu/sam-hq)

> [**Segment Anything in High Quality**](https://arxiv.org/abs/2306.01567)           

> NeurIPS 2023  

> ETH Zurich & HKUST

## **ONNX export**

The HQ-SAM's heavy encoder and lightweight mask decoder can be exported to ONNX format so that it can be run in any environment that supports ONNX runtime. Export the model with `run.sh`

[Option-1]

You can see the [example notebook](https://colab.research.google.com/drive/11U2La49c2IxahzJkAV-EzPqEH3cz_5hq?usp=sharing) for details on how to combine image preprocessing via HQ-SAM's backbone with mask prediction using the ONNX model. It is recommended to use the latest stable version of PyTorch for ONNX export.

[Option-2]

If you are targeting a deployment scenario, it's recommended refer to the example in `scripts/main.py`. Similarly, you can find the execution command in the `run.sh` script.



  

  

  





  
OnnxRuntime Demo Results



Citation

---------------

If you find HQ-SAM useful in your research or refer to the provided baseline results, please star :star: this repository and consider citing :pencil::

```

@article{sam_hq,

    title={Segment Anything in High Quality},

    author={Ke, Lei and Ye, Mingqiao and Danelljan, Martin and Liu, Yifan and Tai, Yu-Wing and Tang, Chi-Keung and Yu, Fisher},

    journal = {arXiv:2306.01567},

    year = {2023}

}  

```