{"id":13441669,"url":"https://github.com/tobiasfshr/MOTSFusion","last_synced_at":"2025-03-20T12:32:19.319Z","repository":{"id":132542695,"uuid":"192729643","full_name":"tobiasfshr/MOTSFusion","owner":"tobiasfshr","description":"MOTSFusion: Track to Reconstruct and Reconstruct to Track","archived":false,"fork":false,"pushed_at":"2023-08-22T14:39:44.000Z","size":43822,"stargazers_count":178,"open_issues_count":3,"forks_count":25,"subscribers_count":13,"default_branch":"master","last_synced_at":"2024-08-01T03:36:56.634Z","etag":null,"topics":["motsfusion","multi-object-tracking","reconstruction","segmentation"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tobiasfshr.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2019-06-19T12:39:40.000Z","updated_at":"2024-07-31T07:27:42.000Z","dependencies_parsed_at":"2024-01-13T21:45:22.349Z","dependency_job_id":null,"html_url":"https://github.com/tobiasfshr/MOTSFusion","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tobiasfshr%2FMOTSFusion","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tobiasfshr%2FMOTSFusion/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tobiasfshr%2FMOTSFusion/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tobiasfshr%2FMOTSFusion/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tobiasfshr","download_url":"https://codeload.github.com/tobiasfshr/MOTSFusion/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":221760105,"owners_count":16876354,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["motsfusion","multi-object-tracking","reconstruction","segmentation"],"created_at":"2024-07-31T03:01:36.708Z","updated_at":"2025-03-20T12:32:19.311Z","avatar_url":"https://github.com/tobiasfshr.png","language":"Python","funding_links":[],"categories":["Python","Related research papers","Uncategorized"],"sub_categories":["Uncategorized"],"readme":"## MOTSFusion: Track to Reconstruct and Reconstruct to Track\n![Method Overview](https://github.com/tobiasfshr/MOTSFusion/blob/master/imgs/overview.png)\n\n### Introduction\n\nThis repository contains the corresponding source code for the paper \"Track to Reconstruct and Reconstruct to Track\" [arXiv PrePrint](http://arxiv.org/abs/1910.00130).\n\n### News\nThis paper has been accepted as both a conference paper at ICRA 2020, as well as being accepted as a journal paper in Robotics and Automation Letters (RA-L)!!!\n\n### Requirements\nThe code was tested on:\n- CUDA 9, cuDNN 7\n- Tensorflow 1.13\n- Python 3.6\n\n*Note: For some external code that is required to run in the precompute script, you need different requirements (see references). Please refer to the corresponding repositories to obtain the requirements for these.*\n\n### Instructions\n\nAt first, download the datasets in section References (Stereo image pairs) as well as the detections and adapt the config files in ./configs according to your desired setup. The file \"config_default\" will run 2D as well as 3D tracking on the KITTI MOTS validation set. Next, download our [pretrained segmentation network](https://drive.google.com/open?id=1Jj3VpAo7WJ-8Tvr7M3XLTA2WrUivvvNA) and extract it into './external/BB2SegNet'. Before running the main script, run:\n```\npython precompute.py -config ./configs/config_default\n```\n\nAfter this, all necessary information such as segmentations, optical flow, disparity and the corresponding pointcloud should be computed. Now you can run the tracker using:\n\n```\npython main.py -config ./configs/config_default\n```\nAfter the tracker has completed all sequences, results will be evaluated automatically.\n\n### Results\nWe release our results on the MOTS test set [cars](https://drive.google.com/open?id=1v6AIJ2qRkHKLTnR7Sma3QA3Be6VcQJ2U)\n[pedestrians](https://drive.google.com/file/d/1yqkjqt-0t8zVU7jxwbon2TWyhXXmbMAt/view?usp=sharing)\n\nAs well as the detections  and segmentations ([test-RRC](https://drive.google.com/open?id=1QmArTCHaxS2a9jciGBqA6LAQQ4bcPeKE), [test-TRCNN](https://drive.google.com/open?id=14YLMwTDi2gpUVOSgDiNxMLrTgvX_Nb6Q), [train/val-RRC](https://drive.google.com/open?id=194Yj_L9_cc5Yio-Khk6DGFOUQ6RS7PvV), [train/val-TRCNN](https://drive.google.com/open?id=1Rb63G4j6lap2Zk4zKOlYX_YJozAdduPD)).\n\n### References\n- RRC Detections: https://github.com/JunaidCS032/MOTBeyondPixels - can be downloaded along with other features in section 'Running the demo script'\n- Optical flow/disparity: https://github.com/lmb-freiburg/netdef_models\n- Camera pose: https://github.com/raulmur/ORB_SLAM2\n- MOTS dataset and TrackRCNN detections \u0026 segmentations: https://www.vision.rwth-aachen.de/page/mots\n- MOT dataset: http://www.cvlibs.net/datasets/kitti/eval_tracking.php\n\n### Citation\n```\n@article{luiten2020track,\n  title={Track to reconstruct and reconstruct to track},\n  author={Luiten, Jonathon and Fischer, Tobias and Leibe, Bastian},\n  journal={IEEE Robotics and Automation Letters},\n  volume={5},\n  number={2},\n  pages={1803--1810},\n  year={2020},\n  publisher={IEEE}\n}\n```\n### License\nMIT License\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftobiasfshr%2FMOTSFusion","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftobiasfshr%2FMOTSFusion","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftobiasfshr%2FMOTSFusion/lists"}