{"id":21622406,"url":"https://github.com/zafarrehan/deepsortmask","last_synced_at":"2025-04-11T11:12:01.738Z","repository":{"id":231157063,"uuid":"545282683","full_name":"zafarRehan/DeepSortMask","owner":"zafarRehan","description":"Track your Instance Segmentation model predictions with DeepSortMask. This repository explains how to use deep_sort to track masked objects from MaskRCNN.","archived":false,"fork":false,"pushed_at":"2022-11-03T17:32:44.000Z","size":24856,"stargazers_count":9,"open_issues_count":1,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-25T07:36:12.230Z","etag":null,"topics":["coco","deepsort","detectron2","instance-segmentation","kalman-filter","mask-rcnn","mask-rcnn-models","semantic-segmentation","tracking"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/zafarRehan.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2022-10-04T05:00:09.000Z","updated_at":"2024-11-04T23:23:05.000Z","dependencies_parsed_at":"2024-04-02T19:10:04.010Z","dependency_job_id":null,"html_url":"https://github.com/zafarRehan/DeepSortMask","commit_stats":null,"previous_names":["zafarrehan/deepsortmask"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zafarRehan%2FDeepSortMask","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zafarRehan%2FDeepSortMask/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zafarRehan%2FDeepSortMask/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zafarRehan%2FDeepSortMask/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/zafarRehan","download_url":"https://codeload.github.com/zafarRehan/DeepSortMask/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248381791,"owners_count":21094528,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["coco","deepsort","detectron2","instance-segmentation","kalman-filter","mask-rcnn","mask-rcnn-models","semantic-segmentation","tracking"],"created_at":"2024-11-25T00:08:41.464Z","updated_at":"2025-04-11T11:12:01.717Z","avatar_url":"https://github.com/zafarRehan.png","language":"Jupyter Notebook","readme":"# DeepSort MaskRCNN - Track instance segmentation outputs\n\nRecently I had a task which required tracking detections along with it's mask. I searched the internet for days to find anything that solves my problem but found no tutorial, articles, repository that solved my problem. \u003cbr/\u003e\n\nThen I found this repository: https://github.com/theAIGuysCode/yolov4-deepsort\nActually for object detecion there were many resources for tracking, so I chose the above one and decided to change it to tracking objects along with masks.\n\n\n\n## What exactly it will do?\n\nThis repository will guide you through tracking objects with masks produced by default MaskRCNN in Detectron2 framework.\nYou can train your custom MaskRCNN using Detectron2 easily following this tutorial:\n\nVideo 1: https://www.youtube.com/watch?v=ffTURA0JM1Q \u003cbr/\u003e\nVideo2: https://www.youtube.com/watch?v=GoItxr16ae8\u0026t=357s\n\nAlso here is another helpful repo: https://github.com/joheras/CLoDSA which will help with augmenting images with masks, in case you have limited training data, thats what I used too.\n\n\n## Usage\n\nOpen the \u003ca href=\"maskRCNN_tracking.ipynb\"\u003eNotebook\u003c/a\u003e given in this repo in Google Colab and run it following the instructions there, it's preety straightforward.\nThe file \u003ca href=\"mask_tracker.py\"\u003emask_tracker.py\u003c/a\u003e is the one that takes care of everything and the details of the codes are properly documented in the code, please follow it for clarification.\n\n\n## Performance \n\n### Input\nInput videos are there in \u003ca href=\"/data/video/\"\u003e/data/video/\u003c/a\u003e\n\n\n### Output\n\u003ca href=\"https://drive.google.com/file/d/1Gf8NUKqZJ2PN4hhAEPdQ-oQ2PPK8lN0v/view?usp=share_link\"\u003e\u003cimg src=\"/cars.png\" width=800\u003e\u003c/a\u003e\n\u003cbr/\u003e\u003cbr/\u003e\u003cbr/\u003e\n\u003ca href=\"https://drive.google.com/file/d/1fP_wjmwxBWg1R6Ij7QHbaL4aHFvn83es/view?usp=share_link\"\u003e\u003cimg src=\"/public.png\" width=800\u003e\u003c/a\u003e\n\n\n\n## Conclusion\n\nThis repo guides you with tracking masked objects using Detectron2 MaskRCNN in detail. This same method can be used to track other Object Detection or Segmentation models built in different frameworks too, some tweaks would be needed, try to figure it out and if some help is needed can raise an Issue or connect with me on linkedIn https://www.linkedin.com/in/rehan-zafar-48797b193/\n\nIf this repository helped you in anyway please give it a star.\n\nThanks,\u003c/br\u003e\nREHAN ZAFAR\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzafarrehan%2Fdeepsortmask","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fzafarrehan%2Fdeepsortmask","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzafarrehan%2Fdeepsortmask/lists"}