Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kghandour/dd3d
Dataset Distillation on 3D Point Clouds using Gradient Matching
https://github.com/kghandour/dd3d
dataset-distillation gradient-matching
Last synced: 29 days ago
JSON representation
Dataset Distillation on 3D Point Clouds using Gradient Matching
- Host: GitHub
- URL: https://github.com/kghandour/dd3d
- Owner: kghandour
- Created: 2023-04-26T08:45:15.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-09-12T20:49:38.000Z (over 1 year ago)
- Last Synced: 2024-11-10T15:40:36.498Z (about 2 months ago)
- Topics: dataset-distillation, gradient-matching
- Language: Python
- Homepage:
- Size: 17 MB
- Stars: 6
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Dataset Distillation on 3D Point Clouds using Gradient Matching
Figure 1: Overview of the main pipeline
Figure 2: Pipeline of the Distillation Block
Figure 3: Distillation results of MNIST pointclouds after projecting to image space. Top: Pytorch implementation. Bottom: MinkowskiEngine implementation.
[Report](assets/Report.pdf)
## Abstract
As the demand for better deep learning model increases, the need for larger datasets is on the rise. This increase in size is requiring more resources to be able to store such datasets and use them in training. Dataset distillation is a relatively new research focus that attempts to condense a large dataset by learning a smaller synthetic dataset which when used to train a neural network reaches a similar performance as using the original dataset. Several approaches attempt distilling dense data representations such as images whether by using a bi-level optimization method, feature matching, or gradient matching. However, the objective of this paper is to use dataset distillation using gradient matching on a sparse data representation, specifically 3D point clouds with a variable number of input points. Instead of turning on or off voxels in a dense grid, the objective is updating the point coordinates directly starting from points scattered randomly in 3D space to eventually converge to capture the geometric features of the classes. Even though the results do not reach other state of the art approaches, they show a proof of concept that updating coordinates directly is a possible method for distilling data.
## Getting Started
### 1. Installing MinkowskiEngine
This implementation focuses on sparse tensors. MinkowskiEngine is heavily used in the process.
Follow the steps found [here](https://github.com/NVIDIA/MinkowskiEngine) to install MinkowskiEngine
### 2. Installing the dependancies
- Install Conda on your system
- Install the environment
```
conda env create -f environment.yml
```
### 3. Update configuration
Update `configs/default.ini` important fields:
- `logging_parent` stands for the destination of your logging files
- `distillation_checkpoint_dir` stands for the destination of your checkpoint saves
### 4. Running the Distillation
```
python mnist_distill.py
```
Useful parameters:
- `--no-log` when debugging this prevents creating tensorboard logs
- `--exp ` quickly set the experiment name for each run
- `--pytorch` uses pytorch architecture instead of Minkowski Engine. (DEFAULT: FALSE)
## Important Files
- `mnist_distill.py`
Covers the main pipeline of the distillation and evaluation
- `distillation_loss.py`
Includes the list of distance measurements implemented
- `models/MEConv.py`
Includes the different network architectures.
`MEPytorch` covers the architecture used for using pure Pytorch.
`MEConvExp` covers the arhictecture for using ME.
- `models/MNIST.py`
Includes the classifier network
- `configs/settings.py`
Parses the config file and the CLI arguments and sets the default values for multiple global variables.
- `configs/default.ini`
Is the default configuration file. Includes the directory paths, naming and some network parameters.
## Irrelevant files
- `run_distill.py`
Includes initial experiments for distilling ShapeNet using PointNet++
- `train_classification.py` and `test_classification.py` and `models/pointnet2_ssg_wo_normals/`
Include training pipeline for baseline classifier on ShapeNet that uses PointNet++ as base. These files are heavily based on https://github.com/yanx27/Pointnet_Pointnet2_pytorch
- Additional files in other branches worked to convert ShapeNet to PCD as well as run some analysis on ShapeNet during initial experiments.
## Citations
- Zhao et al. Dataset Condensation using Gradient Matching (2020) [Github Link](https://github.com/VICO-UoE/DatasetCondensation)
- MNIST dataset
- Choy et al. 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks [Github Link](https://github.com/NVIDIA/MinkowskiEngine)
- Xu Yan: PointNet/Pointnet++ Pytorch [Github Link](https://github.com/yanx27/Pointnet_Pointnet2_pytorch) (This implementation is no longer mainly used but is kept in the repository for potential future use.)