{"id":13545804,"url":"https://github.com/Siyu-C/ACAR-Net","last_synced_at":"2025-04-02T17:31:46.917Z","repository":{"id":44465031,"uuid":"271764149","full_name":"Siyu-C/ACAR-Net","owner":"Siyu-C","description":"[CVPR 2021] Actor-Context-Actor Relation Network for Spatio-temporal Action Localization","archived":false,"fork":false,"pushed_at":"2021-10-08T09:20:24.000Z","size":2298,"stargazers_count":204,"open_issues_count":20,"forks_count":39,"subscribers_count":13,"default_branch":"master","last_synced_at":"2024-11-03T13:35:26.301Z","etag":null,"topics":["acar-net","action-detection","activitynet","activitynet-challenge","arxiv","ava","ava-dataset","ava-kinetics","model-zoo","pytorch","spatio-temporal-action-localization","torch"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Siyu-C.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-06-12T09:48:51.000Z","updated_at":"2024-10-27T12:01:17.000Z","dependencies_parsed_at":"2022-09-07T12:30:07.934Z","dependency_job_id":null,"html_url":"https://github.com/Siyu-C/ACAR-Net","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Siyu-C%2FACAR-Net","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Siyu-C%2FACAR-Net/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Siyu-C%2FACAR-Net/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Siyu-C%2FACAR-Net/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Siyu-C","download_url":"https://codeload.github.com/Siyu-C/ACAR-Net/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246860093,"owners_count":20845598,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["acar-net","action-detection","activitynet","activitynet-challenge","arxiv","ava","ava-dataset","ava-kinetics","model-zoo","pytorch","spatio-temporal-action-localization","torch"],"created_at":"2024-08-01T12:00:19.371Z","updated_at":"2025-04-02T17:31:46.535Z","avatar_url":"https://github.com/Siyu-C.png","language":"Python","funding_links":[],"categories":["Table of contents"],"sub_categories":["Supervised"],"readme":"# [CVPR 2021] Actor-Context-Actor Relation Network for Spatio-temporal Action Localization\nThis repository gives the official PyTorch implementation of [Actor-Context-Actor Relation Network for Spatio-temporal Action Localization](https://arxiv.org/pdf/2006.07976.pdf) (CVPR 2021) - 1st place solution of [AVA-Kinetics Crossover Challenge 2020](https://research.google.com/ava/challenge.html).\nThis codebase also provides a general pipeline for training and evaluation on AVA-style datasets, as well as state-of-the-art action detection models.\n\n| ![Junting Pan][JuntingPan-photo]  | ![Siyu Chen][SiyuChen-photo]  |  ![Zheng Shou][ZhengShou-photo] | ![Jing Shao][JingShao-photo] | ![Hongsheng Li][HongshengLi-photo]  |\n|:-:|:-:|:-:|:-:|:-:|\n| [Junting Pan][JuntingPan-web]  | [Siyu Chen][SiyuChen-web] | [Zheng Shou][ZhengShou-web] | [Jing Shao][JingShao-web] |  [Hongsheng Li][HongshengLi-web] \n\n[JuntingPan-web]: https://junting.github.io/\n[SiyuChen-web]: https://siyu-c.github.io/\n[ZhengShou-web]: http://www.columbia.edu/~zs2262/\n[JingShao-web]: https://amandajshao.github.io/\n[HongshengLi-web]: https://www.ee.cuhk.edu.hk/~hsli/\n\n[JuntingPan-photo]: https://github.com/Siyu-C/ACAR-Net/blob/master/figs/authors/juntingpan.png \"Junting Pan\"\n[SiyuChen-photo]: https://github.com/Siyu-C/ACAR-Net/blob/master/figs/authors/siyuchen.png \"Siyu Chen\"\n[ZhengShou-photo]: https://github.com/Siyu-C/ACAR-Net/blob/master/figs/authors/zhengshou.png \"Zheng Shou\"\n[JingShao-photo]: https://github.com/Siyu-C/ACAR-Net/blob/master/figs/authors/jingshao.png \"JingShao\"\n[HongshengLi-photo]: https://github.com/Siyu-C/ACAR-Net/blob/master/figs/authors/hongshengli.png \"Hongsheng Li\"\n\n## Requirements\nSome key dependencies are listed below, while others are given in [`requirements.txt`](https://github.com/Siyu-C/ACAR-Net/blob/master/requirements.txt).\n- Python \u003e= 3.6\n- PyTorch \u003e= 1.3, and a corresponding version of torchvision\n- ffmpeg (used in data preparation)\n- Download pre-trained models, which are listed in [`pretrained/README.md`](https://github.com/Siyu-C/ACAR-Net/blob/master/pretrained/README.md), to the `pretrained` folder.\n- Prepare data. Please refer to [`DATA.md`](https://github.com/Siyu-C/ACAR-Net/blob/master/DATA.md).\n- Download annotations files to the `annotations` folder. See [`annotations/README.md`](https://github.com/Siyu-C/ACAR-Net/blob/master/annotations/README.md) for detailed information.\n\n## Usage\nDefault values for arguments `nproc_per_node`, `backend` and `master_port` are `8`, `nccl` and `31114` respectively.\n\n```\npython main.py --config CONFIG_FILE [--nproc_per_node N_PROCESSES] [--backend BACKEND] [--master_addr MASTER_ADDR] [--master_port MASTER_PORT]\n```\n\n### Running with Multiple Machines\nIn this case, the `master_addr` argument must be provided. Moreover, arguments `nnodes` and `node_rank` can be additionally specified (similar to `torch.distributed.launch`), otherwise the program will try to obtain their values from environment variables. See [`distributed_utils.py`](https://github.com/Siyu-C/ACAR-Net/blob/master/distributed_utils.py) for details.\n\n## Model Zoo\nTrained models are provided in [`model_zoo/README.md`](https://github.com/Siyu-C/ACAR-Net/blob/master/model_zoo/README.md).\n\n## To-Do List\n- Our detections for AVA\n- Data preparation for Kinetics dataset, and training on AVA-Kinetics\n- Implementation for ACFB\n\n## License\nACAR-Net is released under the [Apache 2.0 license](https://github.com/Siyu-C/ACAR-Net/blob/master/LICENSE).\n\n## CVPR 2020 AVA-Kinetics Challenge  \nFind slides and video presentation of our winning solution on [[Google Slides]](https://docs.google.com/presentation/d/1JrZLddujC2LVl3etUKkbj40o486fnQMzlAHHbc8F9q4/edit?usp=sharing) [[Youtube Video]](https://youtu.be/zJPEmG3LCH4?list=PLw6H4u-XW8siSxqdRVcD5aBn3OTuA7M7x\u0026t=1105) [[Bilibili Video]](https://www.bilibili.com/video/BV1nT4y1J716) (Starting from 18:20).\n\n## About Our Paper\nFind our work on [arXiv](https://arxiv.org/pdf/2006.07976.pdf).\n![architecture-fig]\n\n[architecture-fig]: https://github.com/Siyu-C/ACAR-Net/blob/master/figs/architecture.png \"acar-net architecture\"\n\nPlease cite with the following Bibtex code:\n\n```\n@inproceedings{pan2021actor,\n  title={Actor-context-actor relation network for spatio-temporal action localization},\n  author={Pan, Junting and Chen, Siyu and Shou, Mike Zheng and Liu, Yu and Shao, Jing and Li, Hongsheng},\n  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},\n  pages={464--474},\n  year={2021}\n}\n```\n\nYou may also want to refer to our publication with the more human-friendly Chicago style:\n\n*Pan, Junting, Siyu Chen, Mike Zheng Shou, Yu Liu, Jing Shao, and Hongsheng Li. \"Actor-context-actor relation network for spatio-temporal action localization.\" In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 464-474. 2021.*\n\n## Contact\nIf you have any general question about our work or code which may be of interest to other researchers, please use the [public issues section](https://github.com/Siyu-C/ACAR-Net/issues) of this repository. Alternatively, drop us an e-mail at siyuchen@pku.edu.cn and junting.pa@gmail.com .\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSiyu-C%2FACAR-Net","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FSiyu-C%2FACAR-Net","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSiyu-C%2FACAR-Net/lists"}