Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/LPXTT/SimTrack
https://github.com/LPXTT/SimTrack
Last synced: 6 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/LPXTT/SimTrack
- Owner: LPXTT
- License: mit
- Created: 2022-07-05T12:24:18.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2022-12-23T00:07:43.000Z (almost 2 years ago)
- Last Synced: 2024-08-02T06:12:39.552Z (3 months ago)
- Language: Python
- Size: 6.96 MB
- Stars: 46
- Watchers: 1
- Forks: 4
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- Awesome-Visual-Object-Tracking - [code
README
SimTrack
=========================================
Official Code for [Backbone is All Your Need: A Simplified Architecture for Visual Object Tracking](https://arxiv.org/abs/2107.02960) accepted by ECCV 2022.## Requirements
- python==3.8.15
- torch==1.8.1
- torchvision==0.9.0
- timm==0.5.4## Results (AUC)
|method| FLOPs | LaSOT | TNL2K | TrackingNet | GOT-10k_Test | UAV123 | model-clip| model-mae|
|:------:|:-----:|:-----:|:-----:|:------:|:------:|:------:|:------:|:------:|
|SimTrack| 25.0G | 69.3 | 54.8 | 82.3 | 70.6 | 69.8| [Sim-B/16](https://drive.google.com/file/d/19iSJi14yfJsi_XN5bfKdkBPUHgFzagg9/view?usp=sharing)| [MAE-B/16](https://drive.google.com/file/d/1TPir2JSrWuV7ZEA92oV1vvjjXn0KCRrx/view?usp=share_link)|
|Raw Results| - | [LaSOT](https://drive.google.com/file/d/1bVohxZGlpdTmEwIm0IRB9vbM6hIZOKpy/view?usp=sharing) | [TNL2K](https://drive.google.com/file/d/1B9Y3QDBWL16ku5BpavharMdfqVQvofhF/view?usp=sharing) | [TrackingNet](https://drive.google.com/file/d/1nnQqXN4BkUd6CORieHmGuTKSvo0rAZAZ/view?usp=sharing) | [GOT-10k_Test](https://drive.google.com/file/d/1G5HgEUUkx8EWglvTFpZrJ5plKDqHCF9X/view?usp=sharing) | [UAV123](https://drive.google.com/file/d/1U6SnBZLMqgPqFv-Gg0TvP6dtserjo5RA/view?usp=sharing) | - | -|It should be noted that the above pretrained model is trained under [PYSOT codebase](https://github.com/STVIR/pysot). If you want to load the model in current pipeline, you may need to change the parameter name. Or you can train a new model with the current pipeline.
## Evaluation
Download the model [Sim-B/16](https://drive.google.com/file/d/19iSJi14yfJsi_XN5bfKdkBPUHgFzagg9/view?usp=sharing). Add the model path to https://github.com/LPXTT/SimTrack/blob/a238932fd0cba9aa4a6fcdb590470d5882e5b0b4/lib/test/tracker/simtrack.py#L19
```
python tracking/test.py simtrack baseline --dataset got10k_test --threads 32
```Before evaluation, please make sure the data path in [***local.py***](./lib/test/evaluation/local.py) is correct.
## Training
```
python tracking/train.py --script simtrack --config baseline_got10k_only --save_dir . --mode multiple --nproc_per_node 8
```Before training, please make sure the data path in [***local.py***](./lib/train/admin/local.py) is correct.
Also, please make sure there is "ViT-B/16": "https://openaipublic.azureedge.net/clip/models/5806e77cd80f8b59890b7e101eabd078d9fb84e6937f9e85e4ecb61988df416f/ViT-B-16.pt" in '**/anaconda3/envs/stark/lib/python3.8/site-packages/clip/clip.py'. If not, please add it manually.## Thanks
This implementation is based on [STARK](https://github.com/researchmm/Stark). Please ref to their reposity for more details.## Citation
If you find that this project helps your research, please consider citing our paper:
```
@article{chen2022backbone,
title={Backbone is All Your Need: A Simplified Architecture for Visual Object Tracking},
author={Chen, Boyu and Li, Peixia and Bai, Lei and Qiao, Lei and Shen, Qiuhong and Li, Bo and Gan, Weihao and Wu, Wei and Ouyang, Wanli},
journal={arXiv preprint arXiv:2203.05328},
year={2022}
}