https://ku-cvlab.github.io/SE-NeRF/

Official implementation of "SE-NeRF : Self-Evolving Neural Radiance Fields"
https://ku-cvlab.github.io/SE-NeRF/

Last synced: 3 months ago
JSON representation

Official implementation of "SE-NeRF : Self-Evolving Neural Radiance Fields"

• Host: GitHub
• URL: https://ku-cvlab.github.io/SE-NeRF/
• Owner: cvlab-kaist
• License: mit
• Created: 2023-05-31T08:42:05.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-04-25T09:42:30.000Z (9 months ago)
• Last Synced: 2024-10-28T16:39:48.463Z (3 months ago)
• Homepage: https://ku-cvlab.github.io/SE-NeRF/
• Size: 360 MB
• Stars: 38
• Watchers: 3
• Forks: 3
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-scene-representation - Self-Evolving Neural Radiance Fields - CVLAB/SE-NeRF) | [bibtex](./citations/jung2023selfevolving.txt) (Uncategorized / Uncategorized)

README

        
# SE-NeRF : Self-Evolving Neural Radiance Fields








This is our official implementation of Self-Evolving Neural Radiance Fields!

by [Jaewoo Jung](https://github.com/crepejung00)\*, [Jisang Han](https://github.com/ONground-Korea)\*, [Jiwon Kang](https://github.com/loggerJK)\*, [Seongchan Kim](https://github.com/deep-overflow), [Min-seop Kwak](https://mskwak01.github.io/), [Seungryong Kim](https://cvlab.korea.ac.kr)†

## Updates

### ⚠ Please notice that the code is currently being refactored, so minor bugs or mismatches with the metrics in the original paper might exist. Please feel free to raise any issues and we will fix it as soon as possible!

2024 : We released our codes for SE-NeRF(K-Planes) on the NeRF Synthetic & NeRF Synthetic Extreme dataset!

## Introduction

![](assets/main_architecture.png)

We introduce a self-training framework applicable to existing Neural Radiance Fields!  

We show that the self-training strategy successfully mitigates the overfitting problem when training NeRFs with only sparse inputs.

For further details and visualization results, please check out our [paper](https://arxiv.org/abs/2312.01003) and our [project page](https://ku-cvlab.github.io/SE-NeRF/).

## Installation

Please follow [installation](INSTALL.md). 

## Datasets

Training and evaluation data can be downloaded from the respective websites.

NeRF Synthetic Dataset(blender) : [Data](https://www.matthewtancik.com/nerf).

## Training

Currently only [K-Planes](https://github.com/sarafridov/K-Planes) is the supported backbone model!

To train the model with our framework, all you need to do is:

```

python train.py --backbone kplanes

```

## Acknowledgement

As we show that our framework succesfully applies self-training to existing NeRF models, we utilized the public codes for the baseline networks in this repository.

We would like to acknowledge the contributions of [K-Planes](https://github.com/sarafridov/K-Planes) for open-sourcing the official codes for K-Planes! 

## Citation

```

@misc{jung2023selfevolving,

      title={Self-Evolving Neural Radiance Fields}, 

      author={Jaewoo Jung and Jisang Han and Jiwon Kang and Seongchan Kim and Min-Seop Kwak and Seungryong Kim},

      year={2023},

      eprint={2312.01003},

      archivePrefix={arXiv},

      primaryClass={cs.CV}

}

```