Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/nikhilroxtomar/multiclass-image-segmentation-using-unetr-in-tensorflow

Multiclass Image Segmentation on Human Face Segmentation in TensorFlow
https://github.com/nikhilroxtomar/multiclass-image-segmentation-using-unetr-in-tensorflow

multiclass-segmentation tensorflow unet unet-transformer unetr unetr-segmentation

Last synced: about 2 months ago
JSON representation

Multiclass Image Segmentation on Human Face Segmentation in TensorFlow

Awesome Lists containing this project

README

        

# Multiclass-Image-Segmentation-using-UNETR-in-TensorFlow
This GitHub repository demonstrates the utilization of UNETR for multiclass image segmentation on the Landmark Guided Face Parsing dataset (LaPa) dataset.
.

## Architecture

| ![The block diagram of the Original UNETR model.](figures/unetr_architecture.png) |
| :--: |
| *The block diagram of the Original UNETR model.* |

## Dataset
LaPa stands for Landmark guided face Parsing dataset (LaPa). It is a large-scale dataset for human face parsing. It consists of more than 22,000 facial images with abundant variations in expression, pose and occlusion, and each image of LaPa is provided with a 11-category pixel-level label map and 106-point landmarks.



Download the dataset: [Landmark guided face Parsing dataset (LaPa)](https://drive.google.com/file/d/1XOBoRGSraP50_pS1YPB8_i8Wmw_5L-NG/view?usp=sharing)



For more: [LaPa-Dataset for face parsing](https://github.com/jd-opensource/lapa-dataset)

## Results
The sequence in the images below is `Input Image`, `Ground Truth` and `Prediction`.


| ![](results/115769026_1.png) |
| :--: |
| ![](results/101972691_1.png) |
| ![](results/141022532_0.png) |
| ![](results/218281108_2.png) |
| ![](results/1048174932_2.png) |

## How to improve
- Train on more epochs.
- Increase the input image resolution.
- Apply data augmentation.

## Contact
For more follow me on:

- YouTube
- Facebook
- Twitter
- Instagram
- Telegram