https://github.com/julienkay/merf-unity-viewer

An unofficial Unity port of the MERF viewer
https://github.com/julienkay/merf-unity-viewer

merf nerf neural-radiance-fields raymarching texture3d unity view-synthesis volume-rendering

Last synced: 2 months ago
JSON representation

An unofficial Unity port of the MERF viewer

• Host: GitHub
• URL: https://github.com/julienkay/merf-unity-viewer
• Owner: julienkay
• License: apache-2.0
• Created: 2023-02-26T14:10:32.000Z (almost 2 years ago)
• Default Branch: master
• Last Pushed: 2023-09-19T15:14:30.000Z (over 1 year ago)
• Last Synced: 2024-05-02T01:52:30.542Z (9 months ago)
• Topics: merf, nerf, neural-radiance-fields, raymarching, texture3d, unity, view-synthesis, volume-rendering
• Language: C#
• Homepage:
• Size: 187 KB
• Stars: 39
• Watchers: 9
• Forks: 2
• Open Issues: 2
• Metadata Files:
  • Readme: readme.md
  • Changelog: CHANGELOG.md
  • License: License.txt

Awesome Lists containing this project

README

        
> **Warning**

> **!!! Work in progress !!!**  

> Does not work, but could be fun to fix.

# MERF Unity Viewer

This repository contains the source code for a Unity port of the web viewer for [MERF - Memory-Efficient Radiance Fields for

Real-time View Synthesis in Unbounded Scenes](https://creiser.github.io/merf/)[^1]

*Please note, that this is an unofficial port. I am not affiliated with the original authors or their institution.*

## Known Issues

- Everything mostly works up to calculating the diffuse term of the volume. But the *'evaluateNetwork()'* function in the shader seems to return unreasonably high values, probably due to some coordinate space or other platform-specific differences between the original Three.js viewer and Unity. Contributions welcome.

## References

Other projects exploring NeRFs and related techniques in Unity:

- [MobileNeRF (Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architectures)](https://github.com/julienkay/MobileNeRF-Unity-Viewer)

- [SNeRG (Sparse Neural Radiance Grids)](https://github.com/julienkay/SNeRG-Unity-Viewer)

[^1]: [Christian Reiser and Richard Szeliski and Dor Verbin and Pratul P. Srinivasan and Ben Mildenhall and Andreas Geiger and Jonathan T. Barron and Peter Hedman. MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes. SIGGRAPH, 2023](https://creiser.github.io/merf/)