https://github.com/torrvision/siamfc-tf

SiamFC tracking in TensorFlow.
https://github.com/torrvision/siamfc-tf

computer-vision deep-learning object-tracking siamese-network tensorflow tracking

Last synced: 4 days ago
JSON representation

SiamFC tracking in TensorFlow.

• Host: GitHub
• URL: https://github.com/torrvision/siamfc-tf
• Owner: torrvision
• Created: 2017-02-16T12:15:25.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2023-08-16T14:13:50.000Z (over 1 year ago)
• Last Synced: 2024-12-30T07:06:38.634Z (11 days ago)
• Topics: computer-vision, deep-learning, object-tracking, siamese-network, tensorflow, tracking
• Language: Python
• Homepage:
• Size: 434 KB
• Stars: 570
• Watchers: 31
• Forks: 189
• Open Issues: 34
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# SiamFC - TensorFlow

TensorFlow port of the tracking method described in the paper [*Fully-Convolutional Siamese nets for object tracking*](https://www.robots.ox.ac.uk/~luca/siamese-fc.html).

In particular, it is the improved version presented as baseline in [*End-to-end representation learning for Correlation Filter based tracking*](https://www.robots.ox.ac.uk/~luca/cfnet.html), which achieves state-of-the-art performance at high framerate. The other methods presented in the paper (similar performance, shallower network) haven't been ported yet.

**Note1**: results should be similar (i.e. slightly better or worse) than our MatConvNet implementation. However, for direct comparison please refer to the precomputed results available in the project pages or to the original code, which you can find pinned in [my GitHub](https://github.com/bertinetto).

**Note2**: at the moment this code only allows to use a pretrained net in forward mode.

## Settings things up with virtualenv

1) Get virtualenv if you don't have it already

`pip install virtualenv`

1) Create new virtualenv with Python 2.7

`virtualenv --python=/usr/bin/python2.7 ve-tracking`

1) Activate the virtualenv

`source ~/tracking-ve/bin/activate`

1) Clone the repository

`git clone https://github.com/torrvision/siamfc-tf.git`

1) `cd siamfc-tf`

1) Install the required packages

`sudo pip install -r requirements.txt`

1) `mkdir pretrained data`

1) Download the [pretrained networks](https://bit.ly/cfnet_networks) in `pretrained` and unzip the archive (we will only use `baseline-conv5_e55.mat`)

1) Download [video sequences](https://drive.google.com/file/d/0B7Awq_aAemXQSnhBVW5LNmNvUU0/view) in `data` and unzip the archive.

## Running the tracker

1) Set `video` from `parameters.evaluation` to `"all"` or to a specific sequence (e.g. `"vot2016_ball1"`)

1) See if you are happy with the default parameters in `parameters/hyperparameters.json`

1) Optionally enable visualization in `parameters/run.json`

1) Call the main script (within an active virtualenv session)

`python run_tracker_evaluation.py`

## Authors

* [**Luca Bertinetto**](https://www.robots.ox.ac.uk/~luca)

* [**Jack Valmadre**](http://jack.valmadre.net)

## References

If you find our work useful, please consider citing

↓ [Original method] ↓

```

@inproceedings{bertinetto2016fully,

  title={Fully-Convolutional Siamese Networks for Object Tracking},

  author={Bertinetto, Luca and Valmadre, Jack and Henriques, Jo{\~a}o F and Vedaldi, Andrea and Torr, Philip H S},

  booktitle={ECCV 2016 Workshops},

  pages={850--865},

  year={2016}

}

```

↓ [Improved method and evaluation] ↓

```

@article{valmadre2017end,

  title={End-to-end representation learning for Correlation Filter based tracking},

  author={Valmadre, Jack and Bertinetto, Luca and Henriques, Jo{\~a}o F and Vedaldi, Andrea and Torr, Philip HS},

  journal={arXiv preprint arXiv:1704.06036},

  year={2017}

}

```

## License

This code can be freely used for personal, academic, or educational purposes.

Please contact us for commercial use.