{"id":18972488,"url":"https://github.com/junweiliang/vera_shooter_localization","last_synced_at":"2025-04-19T16:13:26.166Z","repository":{"id":110285130,"uuid":"188706769","full_name":"JunweiLiang/VERA_Shooter_Localization","owner":"JunweiLiang","description":"Code and model for the Video Event Reconstruction and Analysis (VERA) system. ACM Multimedia. ","archived":false,"fork":false,"pushed_at":"2019-10-26T16:39:12.000Z","size":20499,"stargazers_count":31,"open_issues_count":1,"forks_count":9,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-04-16T11:03:08.199Z","etag":null,"topics":["gunshot-detection","machine-learning","shooter-localization","video-synchronization"],"latest_commit_sha":null,"homepage":"https://vera.cs.cmu.edu","language":"PHP","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/JunweiLiang.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2019-05-26T16:28:40.000Z","updated_at":"2024-12-03T12:08:48.000Z","dependencies_parsed_at":"2023-03-16T04:01:10.134Z","dependency_job_id":null,"html_url":"https://github.com/JunweiLiang/VERA_Shooter_Localization","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JunweiLiang%2FVERA_Shooter_Localization","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JunweiLiang%2FVERA_Shooter_Localization/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JunweiLiang%2FVERA_Shooter_Localization/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JunweiLiang%2FVERA_Shooter_Localization/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/JunweiLiang","download_url":"https://codeload.github.com/JunweiLiang/VERA_Shooter_Localization/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":249734852,"owners_count":21317910,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["gunshot-detection","machine-learning","shooter-localization","video-synchronization"],"created_at":"2024-11-08T15:08:57.975Z","updated_at":"2025-04-19T16:13:26.161Z","avatar_url":"https://github.com/JunweiLiang.png","language":"PHP","funding_links":[],"categories":[],"sub_categories":[],"readme":"# VERA - The Shooter Localization System\n\nThis repository contains the code and models for the following paper:\n\n\n**[Technical Report of the Video Event Reconstruction and Analysis (VERA) System - Shooter Localization, Models, Interface, and Beyond](https://arxiv.org/abs/1905.13313)** \\\n[Junwei Liang](https://www.cs.cmu.edu/~junweil/),\n[Jay D. Aronson](https://www.cmu.edu/dietrich/history/people/faculty/aronson.html),\n[Alexander Hauptmann](https://www.cs.cmu.edu/~alex/)\n\n*Our work received **Best Demo Award** at [CBMI 2019](http://cbmi2019.org/).*\n\nYou can find more information/try out the shooter localization system at our [Project Page](https://vera.cs.cmu.edu/). Also, check out our 3D Reconstruction demo [here](https://vera.cs.cmu.edu/VERA_3D_Reconstruction).\n\n## Introduction\n\u003cdiv align=\"center\"\u003e\n  \u003cdiv style=\"\"\u003e\n      \u003cimg src=\"images/VERA_Shooter_Localization.gif\" height=\"400px\" /\u003e\n  \u003c/div\u003e\n\u003c/div\u003e\n\nWe introduce the Video Event Reconstruction and Analysis (VERA) system, enabled by established machine learning techniques and physics models, that can localize the shooter location only based on a couple of user-generated videos that capture the gunshot sound.\n\n\n\u003cdiv align=\"center\"\u003e\n  \u003cdiv style=\"\"\u003e\n      \u003cimg src=\"images/method1.png\" height=\"200px\" /\u003e\n      \u003cimg src=\"images/method2.png\" height=\"200px\" /\u003e\n  \u003c/div\u003e\n  \u003cp style=\"font-weight:bold;font-size:1.2em;\"\u003e\n  \t\u003ca href=\"http://www.youtube.com/watch?feature=player_embedded\u0026v=z0KFTXg5sqI\" target=\"_blank\"\u003eDemo Video\u003c/a\u003e \u0026nbsp; \u0026nbsp;\n    \u003ca href=\"http://www.youtube.com/watch?feature=player_embedded\u0026v=6q7LqqzrY2I\" target=\"_blank\"\u003eExplanatory Video\u003c/a\u003e\n  \u003c/p\u003e\n\u003c/div\u003e\n\nIf you find this system/code useful in your research/report then please cite\n\n```\n@inproceedings{liang2019shooter,\n  title={Shooter Localization Using Social Media Videos},\n  author={Liang, Junwei and Aronson, Jay D and Hauptmann, Alexander},\n  booktitle={Proceedings of the 27th ACM International Conference on Multimedia},\n  pages={2280--2283},\n  year={2019},\n  organization={ACM}\n}\n@inproceedings{liang2017synchronization,\n  title={Synchronization for multi-perspective videos in the wild},\n  author={Liang, Junwei and Huang, Poyao and Chen, Jia and Hauptmann, Alexander},\n  booktitle={2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},\n  pages={1592--1596},\n  year={2017},\n  organization={IEEE}\n}\n@inproceedings{liang2017temporal,\n  title={Temporal localization of audio events for conflict monitoring in social media},\n  author={Liang, Junwei and Jiang, Lu and Hauptmann, Alexander},\n  booktitle={2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},\n  pages={1597--1601},\n  year={2017},\n  organization={IEEE}\n}\n```\n\n\n## Purpose of This Repository\nThis repository includes all the necessary code and models to host our [VERA](https://vera.cs.cmu.edu/) system on your local machine.\nPlease report issues including:\n- Bugs/security concerns\n- Instsallation problems\n- Explanation of the code\n- Additional details needed to be explained in the technical report (or even typos)\n- Feature requests\n\n\n## Code Overview\n- `web_interface` includes all the code needed for the web interface. It is written in PHP with Yii framework (v1.3). There are some Chinese comments in the code since the code is from my earlier days as a website designer in China. File an issue if you have a question. To find the code for a URL, for example, for \"..index.php/application/cGunshot?videoname=firstshots_36_mXwckuEw.mp4\", the code is in web_interface/protected/controllers/ApplicationController.php and in function \"actionCGunshot\". The view code is in web_interface/themes/basic/views/application/cGunshot.php\n- `python_server` is the backend server we designed for PHP to communicate with machine learning code, which is usually written in PYTHON with Tensorflow. Currently we use shell calls within the python server so that we could change the machine learning code on the fly without restarting the backend server.\n- `ml_code` includes the inferencing code for gunshot detection, gun type classification and audio synchronization.\n\nTo install the system on your machine you need to know about basic Linux Shell command, Apache server and MySQL database. To modify the web interface code, you will need to know PHP, Javascript with JQuery, html/css, and some knowledge of the Model/View/Controller (MVC) framework (Yii v1). To modify the machine learning code, you will need to know PYTHON and read our paper on [Video Synchronization](https://ieeexplore.ieee.org/abstract/document/7952425) and [Audio Event Temporal Localization](https://ieeexplore.ieee.org/abstract/document/7952426). I have tested the code on a CPU machine with Ubuntu 16.04.\n\n## Installation\nInstructions for installing the system on your local machine can be [found here](INSTALL.md).\n\n## Future Directions\n1. Automatic visual synchronization of videos;\n2. Automatic detection of muzzle blast sound and shockwave sound in videos;\n3. Better gun type/bullet type classification to get estimation of the bullet speed range;\n4. Automatic video localization - putting camera on the map.\n\n## Other Notes\n1. Method 1 code is in python_server/run.py \"gunshotLocalizationMethod1\".\n2. Method 2 code is in web_interface/themes/basic/views/application/cMainPage.php javascript function \"declare_canvas_class_method2\"\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjunweiliang%2Fvera_shooter_localization","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjunweiliang%2Fvera_shooter_localization","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjunweiliang%2Fvera_shooter_localization/lists"}