Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/lartpang/ZoomNet

Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detection, CVPR 2022
https://github.com/lartpang/ZoomNet

camouflaged-object-detection cod codeforpaper cvpr cvpr2022 paper papercode python pytorch rgbcod rgbsod saliency-detection salient-object-detection sod

Last synced: 3 months ago
JSON representation

Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detection, CVPR 2022

Awesome Lists containing this project

README

        

# (CVPR 2022) Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detection

[![license: mit](https://img.shields.io/badge/License-MIT-green.svg)](https://opensource.org/licenses/MIT)
![LAST COMMIT](https://img.shields.io/github/last-commit/lartpang/ZoomNet?style=flat-square)
![ISSUES](https://img.shields.io/github/issues/lartpang/ZoomNet?style=flat-square)
![STARS](https://img.shields.io/github/stars/lartpang/ZoomNet?style=flat-square)
[![ARXIV PAPER](https://img.shields.io/badge/Arxiv-Paper-red?style=flat-square)](https://arxiv.org/abs/2203.02688)
[![ARXIV PAPER](https://img.shields.io/badge/Github-Paper-red?style=flat-square)](https://github.com/lartpang/ZoomNet/releases/download/v0.0.1/zoomnet-arxiv.pdf)

```
@inproceedings{ZoomNet-CVPR2022,
title = {Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detection},
author = {Pang, Youwei and Zhao, Xiaoqi and Xiang, Tian-Zhu and Zhang, Lihe and Lu, Huchuan},
booktitle = CVPR,
year = {2022}
}
```

**Extensions to the conference version can be found: .**

## Changelog

* 2022-3-16
- Add the link of the method prediction maps of Table 1 in our paper.
* 2022-03-08
- Add the link of arxiv version.
* 2022-03-07
- Add the link of paper.
* 2022-03-05:
- Update weights and results links.
- Fixed some bugs.
- Update dataset links.
- Update bibtex info.
* 2022-03-04:
- Initialize the repository.
- Add the model and configuration file for SOD.

## Usage

### Dependencies

Some core dependencies:

- timm == 0.4.12
- torch == 1.8.1
- [pysodmetrics](https://github.com/lartpang/PySODMetrics) == 1.2.4 # for evaluating results

More details can be found in <./requirements.txt>

### Datasets

More details can be found at:
- COD Datasets:
- SOD Datasets:

### Training

You can use our default configuration, like this:

```shell
$ python main.py --model-name=ZoomNet --config=configs/zoomnet/zoomnet.py --datasets-info ./configs/_base_/dataset/dataset_configs.json --info demo
```

or use our launcher script to start the one command in `commands.txt` on GPU 1:

```shell
$ python tools/run_it.py --interpreter 'abs_path' --cmd-pool tools/commands.txt --gpu-pool 1 --verbose --max-workers 1
```

If you want to launch multiple commands, you can use it like this:

1. Add your commands into the `tools/commands.txt`.
2. `python tools/run_it.py --interpreter 'abs_path' --cmd-pool tools/commands.txt --gpu-pool --verbose --max-workers max_workers`

**NOTE**:

- `abs_path`: the absolute path of your python interpreter
- `max_workers`: the maximum number of tasks to start simultaneously.

### Testing

| Task | Weights | Results |
| ---- | --------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------- |
| COD | [GitHub Release Link](https://github.com/lartpang/ZoomNet/releases/download/v0.0.1/cod_zoomnet_r50_bs8_e40_2022-03-04.pth) | [GitHub Release Link](https://github.com/lartpang/ZoomNet/releases/download/v0.0.1/CVPR-2022-ZoomNet-COD.zip) |
| SOD | [GitHub Release Link](https://github.com/lartpang/ZoomNet/releases/download/v0.0.1/sod_zoomnet_r50_bs22_e50_2022-03-04_fixed.pth) | [GitHub Release Link](https://github.com/lartpang/ZoomNet/releases/download/v0.0.1/CVPR-2022-ZoomNet-SOD.zip) |

For ease of use, we create a `test.py` script and a use case in the form of a shell script `test.sh`.

```shell
$ sudo chmod +x ./test.sh
$ ./test.sh 0 # on gpu 0
```

### Method Comparisons

- The prediction maps corresponding to the methods in Table 1 of our paper:
- Baidu Pan: Code: yxy9
- PySODEvalToolkit: A Python-based Evaluation Toolbox for Salient Object Detection and Camouflaged Object Detection
-

## Paper Details

### Method Detials

![](./assets/feat.png)

![](./assets/net.png)

### Comparison

#### Camouflaged Object Detection

![](./assets/cod_vis.png)

![](./assets/cod_cmp.png)

![](./assets/cod_fmpr.png)

#### Salient Object Detection

![](./assets/sod_cmp.png)

![](./assets/sod_fmpr.png)