An open API service indexing awesome lists of open source software.

https://github.com/karenwky/computer_vision_closetai

fashion segmentation & classification project with Mask R-CNN
https://github.com/karenwky/computer_vision_closetai

deep-learning deepfashion2 image-segmentation mask-rcnn

Last synced: 6 months ago
JSON representation

fashion segmentation & classification project with Mask R-CNN

Awesome Lists containing this project

README

          

# Computer Vision: ClosetAI
Combining the techniques of Object Detection and Instance Segmentation, using deep learning model Mask R-CNN in clothes retrieval. Various medias such as clothing image and street fashion video can be analyzed by the model. Also, ClosetAI can generate business intelligence analysis in giving you a popular fashion items report.

## Data Source
[DeepFashion2 Dataset](https://github.com/switchablenorms/DeepFashion2/) which contains including 191,961 training images and 32,153 validation images. Json files of image information such as annotations and category names are also provided.

## Demo Video
![Demo](/img/demo.gif)


https://www.youtube.com/watch?v=JSrxAmX793k

## Skills Acquired
* Deep Learning: Computer Vision, Keras
* Flask: deploy the machine learning model as a web application, classifying clothes in the uploaded image
* Git LFS: upload large file greater than 100MB to GitHub using terminal command, self-written tutorial can be found [here](./Git_LFS.md)

## Citations
```
@article{DeepFashion2,
author = {Yuying Ge and Ruimao Zhang and Lingyun Wu and Xiaogang Wang and Xiaoou Tang and Ping Luo},
title={A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Images},
journal={CVPR},
year={2019}
}
```
```
@misc{matterport_maskrcnn_2017,
title={Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow},
author={Waleed Abdulla},
year={2017},
publisher={Github},
journal={GitHub repository},
howpublished={\url{https://github.com/matterport/Mask_RCNN}},
}
```

## Acknowledgements
This project cannnot be accomplished without references from below repositories and blog post. Thank you coders for sharing your experience! =]
* [switchablenorms/DeepFashion2](https://github.com/switchablenorms/DeepFashion2/)
* [matterport/Mask_RCNN](https://github.com/matterport/Mask_RCNN)
* [akTwelve/tutorials](https://github.com/akTwelve/tutorials/blob/master/mask_rcnn/MaskRCNN_TrainAndInference.ipynb)
* [Tony607/colab-mask-rcnn](https://github.com/Tony607/colab-mask-rcnn)
* [chohaku84/np_detect](https://github.com/chohaku84/np_detect/blob/master/api/flask_app.py)
* [technovechno@home:~$](https://technovechno.com/creating-graphs-in-python-using-matplotlib-flask-framework-pythonanywhere/)