Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/reshalfahsi/point-cloud-segmentation

Point Cloud Segmentation Using PointNet
https://github.com/reshalfahsi/point-cloud-segmentation

point-cloud point-cloud-segmentation pointnet pytorch-lightning shapenet shapenet-dataset shapenetcore

Last synced: about 6 hours ago
JSON representation

Point Cloud Segmentation Using PointNet

Awesome Lists containing this project

README

        

# Point Cloud Segmentation Using PointNet


colab


In this project, PointNet is leveraged for the segmentation of parts of a certain shape in the form of point cloud data. The data points are obtained from the ShapeNet dataset, i.e., ShapeNetCore. This project chooses the shape of a motorbike. PointNet is utilized due to its nature, which is invariant to permutation. Keep in mind that point cloud data has zero care for the spatial relationship between points in the point cloud, even though it stores information regarding the object's location in the space. In other words, the order of points must be negligible and not influence the result.

## Experiment

Proceed to the following [link](https://colab.research.google.com/github/reshalfahsi/point-cloud-segmentation/blob/master/Point_Cloud_Segmentation_Using_PointNet.ipynb) to unveil the implementation shrouded in the **cloud** of secrets.

## Result

## Quantitative Result

The numeric values below bespeak the performance of the model.

Test Metric | Score
------------ | -------------
Loss | 0.169
IoU | 0.885

## Loss and IoU Curve

loss_curve
The loss curve on the training set and the validation set of PointNet.

iou_curve
The IoU curve on the training set and the validation set of PointNet.

## Qualitative Result

Click the following image to see the interactive result of the model.



qualitative_result

The segmentation result for the motorbike subcategory of the ShapeNet dataset with the labels: wheel, seat, gas_tank, light, and handle.

## Credit

- [Point Cloud Segmentation with PointNet](https://keras.io/examples/vision/pointnet_segmentation/)
- [PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation](https://arxiv.org/pdf/1612.00593.pdf)
- [ShapeNet](https://shapenet.org/)
- [PointNet.pytorch](https://github.com/fxia22/pointnet.pytorch)
- [PyTorch Lightning](https://lightning.ai/docs/pytorch/latest/)