https://github.com/matheussoranco/volumetric-rendering-using-nerf
3D volumetric rendering with NeRF
https://github.com/matheussoranco/volumetric-rendering-using-nerf
3d artificial-intelligence deep-learning volume-rendering
Last synced: about 2 months ago
JSON representation
3D volumetric rendering with NeRF
- Host: GitHub
- URL: https://github.com/matheussoranco/volumetric-rendering-using-nerf
- Owner: Matheussoranco
- Created: 2024-12-11T13:16:00.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-12-16T11:53:59.000Z (over 1 year ago)
- Last Synced: 2025-01-30T00:33:53.406Z (over 1 year ago)
- Topics: 3d, artificial-intelligence, deep-learning, volume-rendering
- Language: Jupyter Notebook
- Homepage:
- Size: 2.51 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Volumetric-Rendering-Using-NeRF
This is minimal implementation of the research paper NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis by Ben Mildenhall et. al. The authors have proposed an ingenious way to synthesize novel views of a scene by modelling the volumetric scene function through a neural network.
The quetion is: would it be possible to give to a neural network the position of a pixel in an image, and ask the network to predict the color at that position?
The neural network would hypothetically memorize (overfit on) the image. This means that our neural network would have encoded the entire image in its weights. We could query the neural network with each position, and it would eventually reconstruct the entire image.
The authors of the paper propose a minimal and elegant way to learn a 3D scene using a few images of the scene. They discard the use of voxels for training. The network learns to model the volumetric scene, thus generating novel views (images) of the 3D scene that the model was not shown at training time.
## Sources and References
- [Keras: NeRF Example](https://keras.io/examples/vision/nerf/)
- [Official NeRF GitHub Repository](https://github.com/bmild/nerf)
- [MathWorks: Camera Calibration](https://www.mathworks.com/help/vision/ug/camera-calibration.html)
- [Original Paper on ArXiv](https://arxiv.org/abs/2003.08934)