https://github.com/megvii-research/ML-GCN

PyTorch implementation of Multi-Label Image Recognition with Graph Convolutional Networks, CVPR 2019.
https://github.com/megvii-research/ML-GCN

Last synced: 11 days ago
JSON representation

PyTorch implementation of Multi-Label Image Recognition with Graph Convolutional Networks, CVPR 2019.

• Host: GitHub
• URL: https://github.com/megvii-research/ML-GCN
• Owner: megvii-research
• Created: 2019-03-06T09:03:17.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2021-12-31T11:51:53.000Z (almost 3 years ago)
• Last Synced: 2024-08-11T17:08:21.956Z (3 months ago)
• Language: Python
• Homepage:
• Size: 137 KB
• Stars: 1,399
• Watchers: 28
• Forks: 344
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-gcn - chenzhaomin123/ML_GCN - Label Image Recognition with Graph Convolutional Networks, CVPR 2019, (Image Classification:)

README

        
# ML-GCN.pytorch

PyTorch implementation of [Multi-Label Image Recognition with Graph Convolutional Networks](https://arxiv.org/abs/1904.03582), CVPR 2019.

## Update

1. In our original conference paper, we report the baseline classification results using GAP for comparison, because GAP is the default choice for feature aggregation in ResNet series. In our experiments, we found that replacing GAP with GMP leads to improved performance, and thus adopt GMP with our GCN method -- we regard GMP as one part of our method. For clarification, we re-run the baselines and here report the corresponding results in the following table.

| Method    | COCO    | NUS-WIDE |VOC2007  |

|:---------:|:-------:|:-------:|:--------:|

| Res-101 GAP  | 77.3    |   56.9   |  91.7|

| Res-101 GMP |  81.9  | 59.7   |  93.0 |

| Ours        |  83.0  | 62.5   |  94.0 |

2. We correct the typos in Eq. (8) as follows.

![](data/svg.svg)

### Requirements

Please, install the following packages

- numpy

- torch-0.3.1

- torchnet

- torchvision-0.2.0

- tqdm

### Download pretrain models

checkpoint/coco ([GoogleDrive](https://drive.google.com/open?id=1ivLi1Rc-dCUmN1ProcMk76zxF1DSvlIk))

checkpoint/voc ([GoogleDrive](https://drive.google.com/open?id=1lhbmW5g-Mo9KgI07nmc1kwSbEnb6t-YA))

or

[Baidu](https://pan.baidu.com/s/17j3lTjMRmXvWHT86zhaaVA)

### Options

- `lr`: learning rate

- `lrp`: factor for learning rate of pretrained layers. The learning rate of the pretrained layers is `lr * lrp`

- `batch-size`: number of images per batch

- `image-size`: size of the image

- `epochs`: number of training epochs

- `evaluate`: evaluate model on validation set

- `resume`: path to checkpoint

### Demo VOC 2007

```sh

python3 demo_voc2007_gcn.py data/voc --image-size 448 --batch-size 32 -e --resume checkpoint/voc/voc_checkpoint.pth.tar

```

### Demo COCO 2014

```sh

python3 demo_coco_gcn.py data/coco --image-size 448 --batch-size 32 -e --resume checkpoint/coco/coco_checkpoint.pth.tar

```

## Citing this repository

If you find this code useful in your research, please consider citing us:

```

@inproceedings{ML-GCN_CVPR_2019,

author = {Zhao-Min Chen and Xiu-Shen Wei and Peng Wang and Yanwen Guo},

title = {{Multi-Label Image Recognition with Graph Convolutional Networks}},

booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},

year = {2019}

}

```

## Reference

This project is based on https://github.com/durandtibo/wildcat.pytorch

## Tips

If you have any questions about our work, please do not hesitate to contact us by emails.