{"id":19514231,"url":"https://github.com/weihaox/gen3d","last_synced_at":"2026-01-26T12:36:00.526Z","repository":{"id":109200246,"uuid":"558977212","full_name":"weihaox/Gen3D","owner":"weihaox","description":"[CSUR 2023] A Survey on Deep Generative 3D-aware Image Synthesis","archived":false,"fork":false,"pushed_at":"2025-02-06T15:28:54.000Z","size":208,"stargazers_count":160,"open_issues_count":0,"forks_count":11,"subscribers_count":12,"default_branch":"main","last_synced_at":"2025-02-06T16:35:55.767Z","etag":null,"topics":["3d-aware-image-synthesis","computer-graphics","computer-vision"],"latest_commit_sha":null,"homepage":"https://weihaox.github.io/3D-aware-Gen/","language":"HTML","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/weihaox.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-10-28T18:22:17.000Z","updated_at":"2025-02-06T15:28:58.000Z","dependencies_parsed_at":"2024-11-10T23:39:28.651Z","dependency_job_id":"d0fbf9a3-82d5-42c1-b720-befd2e9e275f","html_url":"https://github.com/weihaox/Gen3D","commit_stats":null,"previous_names":["weihaox/3d-aware-gen","weihaox/gen3d"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/weihaox%2FGen3D","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/weihaox%2FGen3D/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/weihaox%2FGen3D/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/weihaox%2FGen3D/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/weihaox","download_url":"https://codeload.github.com/weihaox/Gen3D/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240762529,"owners_count":19853498,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["3d-aware-image-synthesis","computer-graphics","computer-vision"],"created_at":"2024-11-10T23:35:35.614Z","updated_at":"2026-01-26T12:36:00.442Z","avatar_url":"https://github.com/weihaox.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003chtml xmlns=\"http://www.w3.org/1999/xhtml\" xml:lang=\"en\"\u003e\n\u003chead\u003e\n\u003cmeta name=\"generator\" content=\"jemdoc, see http://jemdoc.jaboc.net/\" /\u003e\n\u003cmeta http-equiv=\"Content-Type\" content=\"text/html;charset=utf-8\" /\u003e\n\u003clink rel=\"stylesheet\" href=\"jemdoc.css\" type=\"text/css\" /\u003e\n\u003c/head\u003e\n\n\u003c!-- \u003cdiv id=\"layout-content\"\u003e\n\u003cdiv id=\"toptitle\"\u003e\n  \u003ch1 align=\"center\"\u003e3D-aware Image Synthesis \u0026ndash; Papers, Codes and Datasets\u003c/h1\u003e\n\u003c/div\u003e --\u003e\n\n\u003cdiv id=\"layout-content\"\u003e\n\u003c!-- \u003cdiv id=\"toptitle\"\u003e --\u003e\n\u003cp align=\"center\"\u003e\n  \u003ch1 align=\"center\"\u003eA Survey on Deep Generative 3D-aware Image Synthesis\u003c/h1\u003e \n  \u003cp align=\"center\"\u003e\n    ACM Computing Surveys, 2023\n    \u003cbr /\u003e\n    \u003ca href=\"https://weihaox.github.io/\"\u003e\u003cstrong\u003eWeihao Xia\u003c/strong\u003e\u003c/a\u003e\n    ·\n    \u003ca href=\"http://www.homepages.ucl.ac.uk/~ucakjxu/\"\u003e\u003cstrong\u003eJing-Hao Xue\u003c/strong\u003e\u003c/a\u003e\n  \u003c/p\u003e\n\n  \u003cp align=\"center\"\u003e\n    \u003ca href='https://arxiv.org/abs/2210.14267'\u003e\n      \u003cimg src='https://img.shields.io/badge/Paper-Paper-green?style=flat\u0026logo=arxiv\u0026logoColor=green' alt='arxiv Paper'\u003e\n    \u003c/a\u003e\n    \u003ca href='https://weihaox.github.io/Gen3D/' style='padding-left: 0.5rem;'\u003e\n      \u003cimg src='https://img.shields.io/badge/Project-Page-blue?style=flat\u0026logo=Google%20chrome\u0026logoColor=blue' alt='Project Page'\u003e\n    \u003c/a\u003e\n    \u003ca href='https://dl.acm.org/doi/10.1145/3626193' style='padding-left: 0.5rem;'\u003e\n      \u003cimg src='https://img.shields.io/badge/CSUR-Paper-red?style=flat\u0026logoColor=red' alt='CSUR Paper'\u003e\n    \u003c/a\u003e\n  \u003c/p\u003e\n\u003c/p\u003e\n\u003c!-- \u003c/div\u003e --\u003e\n\nIntroduction\n------------\n\nThis project lists representative papers/codes/datasets about deep **[3D-aware image synthesis](https://weihaox.github.io/3D-aware-Gen)**. Besides **3D-aware Generative Models** (GANs and Diffusion Models) discussed in this [survey](https://arxiv.org/abs/2210.14267), this project additionally covers novel view synthesis studies, especially those based on [implicit neural representations](https://github.com/weihaox/awesome-neural-rendering#implicit-neural-representation-and-rendering) such as NeRF. \n\nWe aim to constantly update the latest relevant papers and help the community track this topic. Please feel free to join us and [contribute](https://github.com/weihaox/3D-aware-Gen/blob/main/CONTRIBUTING.md) to the project. Please do not hesitate to reach out if you have any questions or suggestions.\n\nSurvey paper\n------------\n\n*   [A Survey on Deep Generative 3D-aware Image Synthesis](https://arxiv.org/abs/2210.14267)  \n    Weihao Xia and Jing-Hao Xue. _ACM Computing Surveys_, 2023. \n\n## 3D Control of 2D GANs\n\n### 3D Control Latent Directions\n\nFor 3D control over diffusion models simiar to [GAN](https://github.com/weihaox/GAN-Inversion#gan-latent-space-editing), please refer to [diffusion latent editing](https://github.com/weihaox/GAN-Inversion#semantic-editing-in-diffusion-latent-spaces).\n\n* **SeFa: Closed-Form Factorization of Latent Semantics in GANs.**\u003cbr\u003e\n*Yujun Shen, Bolei Zhou.*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2007.06600)] [[Project](https://genforce.github.io/sefa/)] [[Code](https://github.com/genforce/sefa)] \n\n* **GANSpace: Discovering Interpretable GAN Controls.**\u003cbr\u003e\n*Erik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain Paris.*\u003cbr\u003e\nNeurIPS 2020. [[Paper](https://arxiv.org/abs/2004.02546)] [[Code](https://github.com/harskish/ganspace)]\n\n* **Interpreting the Latent Space of GANs for Semantic Face Editing.**\u003cbr\u003e\n*[Yujun Shen](http://shenyujun.github.io/), [Jinjin Gu](http://www.jasongt.com/), [Xiaoou Tang](http://www.ie.cuhk.edu.hk/people/xotang.shtml), [Bolei Zhou](http://bzhou.ie.cuhk.edu.hk/).*\u003cbr\u003e\nCVPR 2020. [[Paper](https://arxiv.org/abs/1907.10786)] [[Project](https://genforce.github.io/interfacegan/)] [[Code](https://github.com/genforce/interfacegan)]\n\n* **Unsupervised Discovery of Interpretable Directions in the GAN Latent Space.**\u003cbr\u003e\n*Andrey Voynov, Artem Babenko.*\u003cbr\u003e\nICML 2020. [[Paper](https://arxiv.org/abs/2002.03754)] [[Code](https://github.com/anvoynov/GANLatentDiscovery)]\n\n* **On the \"steerability\" of generative adversarial networks.**\u003cbr\u003e\n*Ali Jahanian, Lucy Chai, Phillip Isola.*\u003cbr\u003e\nICLR 2020. [[Paper](https://arxiv.org/abs/1907.07171)] [[Project](https://ali-design.github.io/gan_steerability/)] [[Code](https://github.com/ali-design/gan_steerability)]\n\n### 3D Parameters as Controls\n\n* **3D-FM GAN: Towards 3D-Controllable Face Manipulation.**\u003cbr\u003e\n*[Yuchen Liu](https://lychenyoko.github.io/), Zhixin Shu, Yijun Li, Zhe Lin, Richard Zhang, and Sun-Yuan Kung.*\u003cbr\u003e\nECCV 2022. [[Paper](https://arxiv.org/abs/2208.11257)] [[Project](https://lychenyoko.github.io/3D-FM-GAN-Webpage/)]\n\n* **GAN-Control: Explicitly Controllable GANs.**\u003cbr\u003e\n*Alon Shoshan, Nadav Bhonker, Igor Kviatkovsky, Gerard Medioni.*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2101.02477)] [[Project](https://alonshoshan10.github.io/gan_control/)] [[Code](https://github.com/amazon-science/gan-control)]\n\n* **CONFIG: Controllable Neural Face Image Generation.**\u003cbr\u003e\n*Marek Kowalski, Stephan J. Garbin, Virginia Estellers, Tadas Baltrušaitis, Matthew Johnson, Jamie Shotton.*\u003cbr\u003e\nECCV 2020. [[Paper](https://arxiv.org/abs/2005.02671)] [[Code](https://github.com/microsoft/ConfigNet)]\n\n* **DiscoFaceGAN: Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning.**\u003cbr\u003e\n*Yu Deng, Jiaolong Yang, Dong Chen, Fang Wen, Xin Tong.*\u003cbr\u003e\nCVPR 2020. [[Paper](https://arxiv.org/Paper/2004.11660.Paper)] [[Code](https://github.com/microsoft/DiscoFaceGAN)] \n\n* **StyleRig: Rigging StyleGAN for 3D Control over Portrait Images.**\u003cbr\u003e\n*Ayush Tewari, Mohamed Elgharib, Gaurav Bharaj, Florian Bernard, Hans-Peter Seidel, Patrick Pérez, Michael Zollhöfer, Christian Theobalt.*\u003cbr\u003e\nCVPR 2020 (oral). [[Paper](https://arxiv.org/abs/2004.00121)] [[Project](https://gvv.mpi-inf.mpg.de/projects/StyleRig/)]\n\n* **PIE: Portrait Image Embedding for Semantic Control.**\u003cbr\u003e \n*[Ayush Tewari](http://people.mpi-inf.mpg.de/~atewari/), Mohamed Elgharib, Mallikarjun B R., Florian Bernard, Hans-Peter Seidel, Patrick Pérez, Michael Zollhöfer, Christian Theobalt.*\u003cbr\u003e \nTOG (SIGGRAPH Asia) 2020. [[Paper](http://gvv.mpi-inf.mpg.de/projects/PIE/data/paper.Paper)] [[Project](http://gvv.mpi-inf.mpg.de/projects/PIE/)]\n\n### 3D Prior Knowledge as Constraints\n\n* **3D-Aware Indoor Scene Synthesis with Depth Priors.**\u003cbr\u003e\n*Zifan Shi, Yujun Shen, Jiapeng Zhu, Dit-Yan Yeung, Qifeng Chen.*\u003cbr\u003e\nECCV 2022 (oral). [[Paper](https://arxiv.org/abs/2202.08553)] [[Project](https://vivianszf.github.io/depthgan/)] [[Code](https://github.com/vivianszf/depthgan)]\n\n* **NGP: Towards a Neural Graphics Pipeline for Controllable Image Generation.**\u003cbr\u003e\n*Xuelin Chen, Daniel Cohen-Or, Baoquan Chen, Niloy J. Mitra.*\u003cbr\u003e\nEurographics 2021. [[Paper](https://arxiv.org/abs/2006.10569)] [[Code](http://geometry.cs.ucl.ac.uk/projects/2021/ngp)]\n\n* **Lifting 2D StyleGAN for 3D-Aware Face Generation.**\u003cbr\u003e\n*[Yichun Shi](https://seasonsh.github.io/), Divyansh Aggarwal, [Anil K. Jain](http://www.cse.msu.edu/~jain/).*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2011.13126)] [[Code](https://github.com/seasonSH/LiftedGAN)]\n\n* **RGBD-GAN: Unsupervised 3D Representation Learning From Natural Image Datasets via RGBD Image Synthesis.**\u003cbr\u003e\n*Atsuhiro Noguchi, Tatsuya Harada.*\u003cbr\u003e\nICLR 2020. [[Paper](https://arxiv.org/abs/1909.12573)] [[Code](https://github.com/nogu-atsu/RGBD-GAN)]\n\n* **Visual Object Networks: Image Generation with Disentangled 3D Representation.**\u003cbr\u003e\n*Jun-Yan Zhu, Zhoutong Zhang, Chengkai Zhang, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum, William T. Freeman.*\u003cbr\u003e\nNeurIPS 2018. [[Paper](https://arxiv.org/abs/1812.02725)] [[Project](http://von.csail.mit.edu/)] [[Code](https://github.com/junyanz/VON)]\n\n* **3D Shape Induction from 2D Views of Multiple Objects.**\u003cbr\u003e\n*Matheus Gadelha, Subhransu Maji, Rui Wang.*\u003cbr\u003e\n3DV 2017. [[Paper](https://arxiv.org/abs/1612.05872)] [[Project](http://mgadelha.me/prgan/index.html)] [[Code](https://github.com/matheusgadelha/PrGAN)]\n\n* **Generative Image Modeling using Style and Structure Adversarial Networks.**\u003cbr\u003e\n*Xiaolong Wang, Abhinav Gupta.*\u003cbr\u003e\nECCV 2016. [[Paper](https://arxiv.org/abs/1603.05631)] [[Project](https://github.com/facebook/eyescream)] [[Code](https://github.com/xiaolonw/ss-gan)]\n\n## 3D-aware GANs for a Single Image Category\n\n### Unconditional 3D Generative Models\n\n* **BallGAN: 3D-aware Image Synthesis with a Spherical Background.**\u003cbr\u003e\n*Minjung Shin, Yunji Seo, Jeongmin Bae, Young Sun Choi, Hyunsu Kim, Hyeran Byun, Youngjung Uh.*\u003cbr\u003e\nICCV 2023. [[Paper](https://arxiv.org/abs/2301.09091)] [[Project](https://minjung-s.github.io/ballgan/)] [[Code](https://github.com/minjung-s/BallGAN)]\n\n* **Mimic3D: Thriving 3D-Aware GANs via 3D-to-2D Imitation.**\u003cbr\u003e\n*Xingyu Chen, Yu Deng, Baoyuan Wang.*\u003cbr\u003e\nICCV 2023. [[Paper](https://arxiv.org/abs/2303.09036)] [[Project](https://seanchenxy.github.io/Mimic3DWeb/)]\n\n* **GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifolds.**\u003cbr\u003e\n*Jianfeng Xiang, Jiaolong Yang, Yu Deng, Xin Tong.*\u003cbr\u003e\nICCV 2023. [[Paper](https://arxiv.org/abs/2206.07255)] [[Project](https://jeffreyxiang.github.io/GRAM-HD/)]\n\n* **Live 3D Portrait: Real-Time Radiance Fields for Single-Image Portrait View Synthesis.**\u003cbr\u003e\n*Alex Trevithick, Matthew Chan, Michael Stengel, Eric R. Chan, Chao Liu, Zhiding Yu, Sameh Khamis, Manmohan Chandraker, Ravi Ramamoorthi, Koki Nagano.*\u003cbr\u003e\nTOG (SIGGRAPH) 2023. [[Paper](https://research.nvidia.com/labs/nxp/lp3d//media/paper.Paper)] [[Project](https://research.nvidia.com/labs/nxp/lp3d//)]\n\n* **VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids.**\u003cbr\u003e\n*Katja Schwarz, Axel Sauer, Michael Niemeyer, Yiyi Liao, Andreas Geiger.*\u003cbr\u003e\nNeurIPS 2022. [[Paper](https://arxiv.org/Paper/2206.07695.Paper)] [[Code](https://github.com/autonomousvision/voxgraf)]\n\n* **GeoD: Improving 3D-aware Image Synthesis with A Geometry-aware Discriminator.**\u003cbr\u003e\n*Zifan Shi, Yinghao Xu, Yujun Shen, Deli Zhao, Qifeng Chen, Dit-Yan Yeung.*\u003cbr\u003e\nNeurIPS 2022. [[Paper](https://arxiv.org/abs/2209.15637)] [[Project](https://vivianszf.github.io/geod)]\n\n* **EpiGRAF: Rethinking training of 3D GANs.**\u003cbr\u003e\n*[Ivan Skorokhodov](https://universome.github.io/), [Sergey Tulyakov](http://www.stulyakov.com/), [Yiqun Wang](https://sites.google.com/view/yiqun-wang/home), [Peter Wonka](https://peterwonka.net/).*\u003cbr\u003e\nNeurIPS 2022. [[Paper](https://arxiv.org/abs/2206.10535)] [[Project](https://universome.github.io/epigraf)] [[Code](https://github.com/universome/epigraf)]\n\n* **VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids.**\u003cbr\u003e\n*Schwarz, Katja, Sauer, Axel, Niemeyer, Michael, Liao, Yiyi, and Geiger, Andreas.*\u003cbr\u003e\nNeurIPS 2022. [[Paper](https://arxiv.org/Paper/2206.07695.Paper)] [[Project](https://katjaschwarz.github.io/voxgraf)]\n\n* **Injecting 3D Perception of Controllable NeRF-GAN into StyleGAN for Editable Portrait Image Synthesis.**\u003cbr\u003e\n*Jeong-gi Kwak, Yuanming Li, Dongsik Yoon, Donghyeon Kim, David Han, Hanseok Ko.*\u003cbr\u003e\nECCV 2022. [[Paper](https://arxiv.org/abs/2207.10257)] [[Project](https://jgkwak95.github.io/surfgan/)] [[Code](https://github.com/jgkwak95/SURF-GAN)]\n\n* **Generative Multiplane Images: Making a 2D GAN 3D-Aware.**\u003cbr\u003e\n*[Xiaoming Zhao](https://xiaoming-zhao.com/), [Fangchang Ma](https://fangchangma.github.io/), [David Güera](https://scholar.google.com/citations?user=bckYvFkAAAAJ\u0026hl=en), [Zhile Ren](https://jrenzhile.com/), [Alexander G. Schwing](https://www.alexander-schwing.de/), [Alex Colburn](https://www.colburn.org/).*\u003cbr\u003e\nECCV 2022. [[Paper](https://arxiv.org/abs/2207.10642)] [[Project](https://xiaoming-zhao.github.io/projects/gmpi/)] [[Code](https://github.com/apple/ml-gmpi)]\n\n* **3D-FM GAN: Towards 3D-Controllable Face Manipulation.**\u003cbr\u003e\n*[Yuchen Liu](https://lychenyoko.github.io/), Zhixin Shu, Yijun Li, Zhe Lin, Richard Zhang, and Sun-Yuan Kung.*\u003cbr\u003e\nECCV 2022. [[Paper](https://arxiv.org/abs/2208.11257)] [[Project](https://lychenyoko.github.io/3D-FM-GAN-Webpage/)]\n\n* **EG3D: Efficient Geometry-aware 3D Generative Adversarial Networks.**\u003cbr\u003e\n*[Eric R. Chan](https://ericryanchan.github.io/), [Connor Z. Lin](https://connorzlin.com/), [Matthew A. Chan](https://matthew-a-chan.github.io/), [Koki Nagano](https://luminohope.org/), [Boxiao Pan](https://cs.stanford.edu/~bxpan/), [Shalini De Mello](https://research.nvidia.com/person/shalini-gupta), [Orazio Gallo](https://oraziogallo.github.io/), [Leonidas Guibas](https://geometry.stanford.edu/member/guibas/), [Jonathan Tremblay](https://research.nvidia.com/person/jonathan-tremblay), [Sameh Khamis](https://www.samehkhamis.com/), [Tero Karras](https://research.nvidia.com/person/tero-karras), [Gordon Wetzstein](https://stanford.edu/~gordonwz/).*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2112.07945)] [[Project](https://matthew-a-chan.github.io/EG3D)] [[Code](https://github.com/NVlabs/eg3d)]\n\n* **StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning.**\u003cbr\u003e\n*Yi-Hua Huang, Yue He, Yu-Jie Yuan, Yu-Kun Lai, Lin Gao.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2205.12183)]\n\n* **Multi-View Consistent Generative Adversarial Networks for 3D-aware Image Synthesis.**\u003cbr\u003e\n*Xuanmeng Zhang, Zhedong Zheng, Daiheng Gao, Bang Zhang, Pan Pan, Yi Yang.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2204.06307)] [[Code](https://github.com/Xuanmeng-Zhang/MVCGAN)]\n\n* **Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images.**\u003cbr\u003e\n*[Ayush Tewari](https://ayushtewari.com/), Mallikarjun B R, Xingang Pan, Ohad Fried, Maneesh Agrawala, Christian Theobalt.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://people.mpi-inf.mpg.de/~atewari/projects/D3D/data/paper.Paper)] [[Project](https://people.mpi-inf.mpg.de/~atewari/projects/D3D/)]\n\n* **GIRAFFE HD: A High-Resolution 3D-aware Generative Model.**\u003cbr\u003e\n*Yang Xue, Yuheng Li, Krishna Kumar Singh, Yong Jae Lee.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2203.14954)] [[Code](https://github.com/AustinXY/GIRAFFEHD)]\n\n* **StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generation.**\u003cbr\u003e\n*[Roy Or-El](https://homes.cs.washington.edu/~royorel/), [Xuan Luo](https://roxanneluo.github.io/), Mengyi Shan, Eli Shechtman, Jeong Joon Park, Ira Kemelmacher-Shlizerman.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2112.11427)] [[Project](https://stylesdf.github.io/)] [[Code](https://github.com/royorel/StyleSDF)]\n\n* **FENeRF: Face Editing in Neural Radiance Fields.**\u003cbr\u003e\n*Jingxiang Sun, Xuan Wang, Yong Zhang, Xiaoyu Li, Qi Zhang, Yebin Liu, Jue Wang.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2111.15490)] [[Code](https://github.com/MrTornado24/FENeRF)]\n\n* **LOLNeRF: Learn from One Look.**\u003cbr\u003e\n*[Daniel Rebain](https://vision.cs.ubc.ca/team/), Mark Matthews, Kwang Moo Yi, Dmitry Lagun, Andrea Tagliasacchi.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2111.09996)] [[Project](https://ubc-vision.github.io/lolnerf/)]\n\n* **GRAM: Generative Radiance Manifolds for 3D-Aware Image Generation.**\u003cbr\u003e\n*[Yu Deng](https://yudeng.github.io/), [Jiaolong Yang](https://jlyang.org/), [Jianfeng Xiang](http://www.xtong.info/), [Xin Tong]().*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2112.08867)] [[Project](https://yudeng.github.io/GRAM/)] [[Code](https://yudeng.github.io/GRAM/)]\n\n* **VolumeGAN: 3D-aware Image Synthesis via Learning Structural and Textural Representations.**\u003cbr\u003e\n*Yinghao Xu, Sida Peng, Ceyuan Yang, Yujun Shen, Bolei Zhou.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2112.10759)] [[Project](https://genforce.github.io/volumegan/)] [[Code](https://github.com/genforce/VolumeGAN)]\n\n* **Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks.**\u003cbr\u003e\n*Sihyun Yu, Jihoon Tack, Sangwoo Mo, Hyunsu Kim, Junho Kim, Jung-Woo Ha, Jinwoo Shin.*\u003cbr\u003e\nICLR 2022. [[Paper](https://openreview.net/forum?id=Czsdv-S4-w9)] [[Project](https://sihyun-yu.github.io/digan/)] [[Code](https://github.com/sihyun-yu/digan)]\n\n* **StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis.**\u003cbr\u003e\n*[Jiatao Gu](http://jiataogu.me/), [Lingjie Liu](https://lingjie0206.github.io/), [Peng Wang](https://totoro97.github.io/about.html), [Christian Theobalt](http://people.mpi-inf.mpg.de/~theobalt/).*\u003cbr\u003e\nICLR 2022. [[Paper](https://arxiv.org/abs/2110.08985)] [[Project](http://jiataogu.me/style_nerf/)]\n\n* **MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation.**\u003cbr\u003e\n*Safa C. Medin, Bernhard Egger, Anoop Cherian, Ye Wang, Joshua B. Tenenbaum, Xiaoming Liu, Tim K. Marks.*\u003cbr\u003e\nAAAI 2022. [[Paper](https://arxiv.org/abs/2111.01048)]\n\n* **A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis.**\u003cbr\u003e\n*Xingang Pan, Xudong Xu, Chen Change Loy, Christian Theobalt, Bo Dai.*\u003cbr\u003e\nNeurIPS 2021. [[Paper](https://arxiv.org/abs/2110.15678)]\n\n* **pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis.**\u003cbr\u003e\n*[Eric R. Chan](https://ericryanchan.github.io/), [Marco Monteiro](https://marcoamonteiro.github.io/pi-GAN-website/), [Petr Kellnhofer](https://kellnhofer.xyz/), [Jiajun Wu](https://jiajunwu.com/), [Gordon Wetzstein](https://stanford.edu/~gordonwz/).*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2012.00926)] [[Project](https://marcoamonteiro.github.io/pi-GAN-website/)] [[Code](https://github.com/lucidrains/pi-GAN-pytorch)]\n\n* **GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields.**\u003cbr\u003e\n*Michael Niemeyer, Andreas Geiger.*\u003cbr\u003e\nCVPR 2021 (Best Paper). [[Paper](https://arxiv.org/abs/2011.12100)] [[Project](https://m-niemeyer.github.io/project-pages/giraffe/index.html)] [[Code](https://github.com/autonomousvision/giraffe)]\n\n* **BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images.**\u003cbr\u003e\n*Thu Nguyen-Phuoc, Christian Richardt, Long Mai, Yong-Liang Yang, Niloy Mitra.*\u003cbr\u003e\nNeurIPS 2020. [[Paper](https://arxiv.org/abs/2002.08988)] [[Project](https://www.monkeyoverflow.com/#/blockgan/)] [[Code](https://github.com/thunguyenphuoc/BlockGAN)]\n\n* **GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis.**\u003cbr\u003e\n*[Katja Schwarz](https://katjaschwarz.github.io/), [Yiyi Liao](https://yiyiliao.github.io/), [Michael Niemeyer](https://m-niemeyer.github.io/), [Andreas Geiger](http://www.cvlibs.net/).*\u003cbr\u003e\nNeurIPS 2020. [[Paper](https://arxiv.org/abs/2007.02442)] [[Project](https://avg.is.tuebingen.mpg.de/publications/schwarz2020neurips)] [[Code](https://github.com/autonomousvision/graf)]\n\n* **HoloGAN: Unsupervised learning of 3D representations from natural images.**\u003cbr\u003e\n*[Thu Nguyen-Phuoc](https://monkeyoverflow.com/about/),  [Chuan Li](https://lambdalabs.com/blog/author/chuan/), Lucas Theis, [Christian Richardt]( https://richardt.name/), [Yong-liang Yang](http://yongliangyang.net/).*\u003cbr\u003e\nICCV 2019. [[Paper](https://arxiv.org/abs/1904.01326)] [[Project](https://www.monkeyoverflow.com/hologan-unsupervised-learning-of-3d-representations-from-natural-images/)] [[Code](https://github.com/thunguyenphuoc/HoloGAN)]\n\n### Conditional 3D Generative Models\n\n* **3D-aware Conditional Image Synthesis.**\u003cbr\u003e\n*[Kangle Deng](https://dunbar12138.github.io/), [Gengshan Yang](https://gengshan-y.github.io/), [Deva Ramanan](https://www.cs.cmu.edu/~deva/), [Jun-Yan Zhu](https://www.cs.cmu.edu/~junyanz/).*\u003cbr\u003e\nCVPR 2023. [[Paper](https://arxiv.org/abs/2302.08509)] [[Project](https://www.cs.cmu.edu/~pix2pix3D/)] [[Code](https://github.com/dunbar12138/pix2pix3D)]\n\n* **Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields.**\u003cbr\u003e\n*[Yuedong Chen](https://donydchen.github.io/), [Qianyi Wu](https://wuqianyi.top/), [Chuanxia Zheng](https://www.chuanxiaz.com/), [Tat-Jen Cham](https://personal.ntu.edu.sg/astjcham/), [Jianfei Cai](https://jianfei-cai.github.io/).*\u003cbr\u003e\nECCV 2022. [[Paper](https://arxiv.org/abs/2203.10821)] [[Project](https://donydchen.github.io/sem2nerf)] [[Code](https://github.com/donydchen/sem2nerf)]\n\n* **IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis.**\u003cbr\u003e\n*[Jingxiang Sun](https://github.com/MrTornado24), [Xuan Wang](https://mrtornado24.github.io/IDE-3D/), [Yichun Shi](https://seasonsh.github.io/), [Lizhen Wang](https://lizhenwangt.github.io/), [Jue Wang](https://juewang725.github.io/), [Yebin Liu](https://liuyebin.com/).*\u003cbr\u003e\nSIGGRAPH Asia 2022. [[Paper](https://arxiv.org/abs/2205.15517)] [[Project](https://mrtornado24.github.io/IDE-3D/)] [[Code](https://github.com/MrTornado24/IDE-3D)]\n\n* **NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fields.**\u003cbr\u003e\n*Kaiwen Jiang, [Shu-Yu Chen](http://people.geometrylearning.com/csy/), [Feng-Lin Liu](http://people.geometrylearning.com/lfl/), [Hongbo Fu](http://sweb.cityu.edu.hk/hongbofu/), [Lin Gao](http://www.geometrylearning.com/cn/).*\u003cbr\u003e\nSIGGRAPH Asia 2022. [[Paper](https://arxiv.org/abs/2211.07968)] [[Project](http://geometrylearning.com/NeRFFaceEditing/)] \n\n* **GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worlds.**\u003cbr\u003e\n*Zekun Hao, Arun Mallya, Serge Belongie, Ming-Yu Liu.*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2104.07659)] [[Project](https://nvlabs.github.io/GANcraft/)] [[Code](https://github.com/NVlabs/imaginaire)]\n\n## 3D-aware Diffusion Models for a Single Image Category\n\n* **Generating Images with 3D Annotations Using Diffusion Models.**\u003cbr\u003e\n*[Wufei Ma](https://wufeim.github.io/), [Qihao Liu](https://qihao067.github.io/), [Jiahao Wang](https://jiahaoplus.github.io/), Angtian Wang, Xiaoding Yuan, Yi Zhang, Zihao Xiao, Guofeng Zhang, Beijia Lu, Ruxiao Duan, Yongrui Qi, [Adam Kortylewski](https://adamkortylewski.com/), [Yaoyao Liu](https://www.cs.jhu.edu/~yyliu/), [Alan Yuille](https://www.cs.jhu.edu/~ayuille/).*\u003cbr\u003e\nICLR 2024. [[Paper](https://arxiv.org/abs/2306.08103)] [[Project](https://ccvl.jhu.edu/3D-DST/)] [[Code](https://github.com/wufeim/DST3D)]\n\n* **GeNVS: Generative Novel View Synthesis with 3D-Aware Diffusion Models.**\u003cbr\u003e\n*Eric R. Chan, Koki Nagano, Matthew A. Chan, Alexander W. Bergman, Jeong Joon Park, Axel Levy, Miika Aittala, Shalini De Mello, Tero Karras, Gordon Wetzstein.*\u003cbr\u003e \nICCV 2023. [[Paper](https://arxiv.org/abs/2304.02602)] [[Project](https://nvlabs.github.io/genvs/)] [[Code](https://github.com/NVlabs/genvs)]\n\n* **Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction.**\u003cbr\u003e\n*Hansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian, Zhuowen Tu, Lingjie Liu, Hao Su.*\u003cbr\u003e \nICCV 2023. [[PDF](http://arxiv.org/abs/2304.06714)] [[Project](https://lakonik.github.io/ssdnerf)] [[Code](https://github.com/Lakonik/SSDNeRF)]\n\n* **3D-aware Image Generation using 2D Diffusion Models.**\u003cbr\u003e\n*[Jianfeng Xiang](https://jeffreyxiang.github.io/), Jiaolong Yang, Binbin Huang, Xin Tong.*\u003cbr\u003e \nICCV 2023. [[Paper](https://arxiv.org/abs/2303.17905)] [[Project](https://jeffreyxiang.github.io/ivid/)] [[Code](https://github.com/JeffreyXiang/ivid)]\n\n* **HoloFusion: Towards Photo-realistic 3D Generative Modeling.**\u003cbr\u003e\n*Animesh Karnewar, Niloy J. Mitra, Andrea Vedaldi, David Novotny.*\u003cbr\u003e \nICCV 2023. [[Paper](http://arxiv.org/abs/2308.14244)] [[Project](https://holodiffusion.github.io/holofusion)]\n\n* **HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion.**\u003cbr\u003e\n*[Ziya Erkoç](https://ziyaerkoc.com/), [Fangchang Ma](https://fangchangma.github.io/), [Qi Shan](http://shanqi.github.io/), [Matthias Nießner](https://niessnerlab.org/members/matthias_niessner/profile.html), [Angela Dai](https://www.3dunderstanding.org/team.html).*\u003cbr\u003e\nICCV 2023. [[Paper](https://arxiv.org/abs/2303.17015)] [[Project](https://ziyaerkoc.com/hyperdiffusion/)] \n\n* **LatentSwap3D: Semantic Edits on 3D Image GANs.**\u003cbr\u003e\n*Enis Simsar, Alessio Tonioni, Evin Pınar Örnek, Federico Tombari.*\u003cbr\u003e \nICCV 2023 Workshop on AI3DCC. [[Paper](https://arxiv.org/abs/2212.01381)]\n\n* **DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Models.**\u003cbr\u003e\n*[Jamie Wynn](https://scholar.google.com/citations?user=ASP-uu4AAAAJ\u0026hl=en\u0026oi=ao) and [Daniyar Turmukhambetov](https://scholar.google.com/citations?user=ELFm0CgAAAAJ\u0026hl=en\u0026oi=ao).*\u003cbr\u003e\nCVPR 2023. [[Paper](https://arxiv.org/abs/2302.12231)] [[Supplementary material](https://storage.googleapis.com/niantic-lon-static/research/diffusionerf/diffusionerf_supplemental.Paper)] [[COde](https://github.com/nianticlabs/diffusionerf)]\n\n* **NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models.**\u003cbr\u003e\n*Seung Wook Kim, Bradley Brown, Kangxue Yin, Karsten Kreis, Katja Schwarz, Daiqing Li, Robin Rombach, Antonio Torralba, Sanja Fidler.*\u003cbr\u003e\nCVPR 2023. [[Paper](https://arxiv.org/abs/2304.09787)] [[Project](https://research.nvidia.com/labs/toronto-ai/NFLDM/)]\n\n* **Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion.**\u003cbr\u003e\n*Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, Baining Guo.*\u003cbr\u003e\nCVPR 2023. [[Paper](https://arxiv.org/abs/2212.06135)] [[Project](https://3d-avatar-diffusion.microsoft.com/)]\n\n* **DiffRF: Rendering-guided 3D Radiance Field Diffusion.**\u003cbr\u003e\n*[Norman Müller](https://niessnerlab.org/members/norman_mueller/profile.html), [Yawar Siddiqui](https://niessnerlab.org/members/yawar_siddiqui/profile.html), [Lorenzo Porzi](https://scholar.google.com/citations?user=vW1gaVEAAAAJ), [Samuel Rota Bulò](https://scholar.google.com/citations?hl=de\u0026user=484sccEAAAAJ), [Peter Kontschieder](https://scholar.google.com/citations?user=CxbDDRMAAAAJ\u0026hl=en), [Matthias Nießner](https://niessnerlab.org/members/matthias_niessner/profile.html).*\u003cbr\u003e \nCVPR 2023 (Highlight). [[Paper](https://arxiv.org/abs/2212.01206)] [[Project](https://sirwyver.github.io/DiffRF/)]\n\n* **RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation.**\u003cbr\u003e\n*Titas Anciukevičius, Zexiang Xu, Matthew Fisher, Paul Henderson, Hakan Bilen, Niloy J. Mitra, Paul Guerrero.*\u003cbr\u003e \nCVPR 2023. [[Paper](https://arxiv.org/abs/2211.09869)] [[Project](https://holodiffusion.github.io/)] [[Code](https://github.com/Anciukevicius/RenderDiffusion)]\n\n* **SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction.**\u003cbr\u003e\n*[Zhizhuo Zhou](https://www.zhiz.dev/), [Shubham Tulsiani](https://shubhtuls.github.io/).*\u003cbr\u003e \nCVPR 2023. [[Paper](https://arxiv.org/abs/2212.00792)] [[Project](https://sparsefusion.github.io/)] [[Code](https://github.com/zhizdev/sparsefusion)]\n\n* **HoloDiffusion: Training a 3D Diffusion Model using 2D Images.**\u003cbr\u003e\n*Animesh Karnewar, Andrea Vedaldi, David Novotny, Niloy Mitra.*\u003cbr\u003e \nCVPR 2023. [[Paper](https://arxiv.org/abs/2303.16509)] [[Project](https://3d-diffusion.github.io/)]\n\n* **3DiM: Novel View Synthesis with Diffusion Models.**\u003cbr\u003e\n*Daniel Watson, William Chan, Ricardo Martin-Brualla, Jonathan Ho, Andrea Tagliasacchi, Mohammad Norouzi.*\u003cbr\u003e \nICLR 2023. [[Paper](https://arxiv.org/abs/2210.04628)] [[Project](https://3d-diffusion.github.io/)]\n\n* **3DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models.**\u003cbr\u003e\n*[Biao Zhang](https://1zb.github.io/), [Jiapeng Tang](https://tangjiapeng.github.io/), [Matthias Niessner](https://www.niessnerlab.org/), [Peter Wonka](http://peterwonka.net/).*\u003cbr\u003e\nSIGGRAPH 2023. [[Paper](https://arxiv.org/abs/2301.11445)] [[Project](https://1zb.github.io/3DShape2VecSet/)] [[Code](https://github.com/1zb/3DShape2VecSet)]\n\n* **GAUDI: A Neural Architect for Immersive 3D Scene Generation.**\u003cbr\u003e\n*Miguel Angel Bautista, Pengsheng Guo, Samira Abnar, Walter Talbott, Alexander Toshev, Zhuoyuan Chen, Laurent Dinh, Shuangfei Zhai, Hanlin Goh, Daniel Ulbricht, Afshin Dehghan, Josh Susskind.*\u003cbr\u003e \nNeurIPS 2022. [[Paper](https://arxiv.org/abs/2212.01381)] [[Project](https://github.com/apple/ml-gaudi)]\n\n* **Learning a Diffusion Prior for NeRFs.**\u003cbr\u003e\n*Guandao Yang, Abhijit Kundu, Leonidas J. Guibas, Jonathan T. Barron, Ben Poole.*\u003cbr\u003e \narxiv 2023. [[Paper](https://arxiv.org/abs/2304.14473)] \n\n* **3D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Models.**\u003cbr\u003e\n*Gimin Nam, Mariem Khlifi, Andrew Rodriguez, Alberto Tono, Linqi Zhou, Paul Guerrero.*\u003cbr\u003e \narxiv 2022. [[Paper](https://arxiv.org/abs/2212.00842)]\n\n## 3D-Aware Generative Models on ImageNet\n\n* **VQ3D: Learning a 3D-Aware Generative Model on ImageNet.**\u003cbr\u003e\n*Kyle Sargent, Jing Yu Koh, Han Zhang, Huiwen Chang, Charles Herrmann, Pratul Srinivasan, Jiajun Wu, Deqing Sun.*\u003cbr\u003e\nICCV 2023 (Oral). [[Paper](https://arxiv.org/abs/2302.06833)] [[Project](http://kylesargent.github.io/vq3d)]\n\n* **3D Generation on ImageNet.**\u003cbr\u003e\n*Ivan Skorokhodov, Aliaksandr Siarohin, Yinghao Xu, Jian Ren, Hsin-Ying Lee, Peter Wonka, Sergey Tulyakov.*\u003cbr\u003e\nICLR 2023 (Oral). [[Paper](https://openreview.net/forum?id=U2WjB9xxZ9q)] [[Project](https://u2wjb9xxz9q.github.io/)] [[Code](https://justimyhxu.github.io/pub.html)]\n\n## 3D-aware Video Synthesis\n\n* **3D-Aware Video Generation.**\u003cbr\u003e\n*[Sherwin Bahmani](https://sherwinbahmani.github.io/), [Jeong Joon Park](https://jjparkcv.github.io/), [Despoina Paschalidou](https://paschalidoud.github.io/), [Hao Tang](https://scholar.google.com/citations?user=9zJkeEMAAAAJ\u0026hl=en/), [Gordon Wetzstein](https://stanford.edu/~gordonwz/), [Leonidas Guibas](https://geometry.stanford.edu/member/guibas/), [Luc Van Gool](https://ee.ethz.ch/the-department/faculty/professors/person-detail.OTAyMzM=.TGlzdC80MTEsMTA1ODA0MjU5.html/), [Radu Timofte](https://ee.ethz.ch/the-department/people-a-z/person-detail.MjAxNjc4.TGlzdC8zMjc5LC0xNjUwNTg5ODIw.html/).*\u003cbr\u003e\nTMLR 2023. [[Paper](https://arxiv.org/abs/2206.14797)] [[Project](https://sherwinbahmani.github.io/3dvidgen/)] [[Code](https://github.com/sherwinbahmani/3dvideogeneration/)]\n\n* **Streaming Radiance Fields for 3D Video Synthesis.**\u003cbr\u003e\n*Lingzhi Li, Zhen Shen, Zhongshu Wang, Li Shen, Ping Tan.*\u003cbr\u003e\nNeurIPS 2022. [[Paper](https://arxiv.org/abs/2210.14831)] [[Code](https://github.com/AlgoHunt/StreamRF)]\n\n## INR-based 3D Novel View Synthesis\n\n### Neural Scene Representations\n\n* **Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations.**\u003cbr\u003e\n*Mehdi S. M. Sajjadi, Henning Meyer, Etienne Pot, Urs Bergmann, Klaus Greff, Noha Radwan, Suhani Vora, Mario Lucic, Daniel Duckworth, Alexey Dosovitskiy, Jakob Uszkoreit, Thomas Funkhouser, Andrea Tagliasacchi.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2111.13152)] [[Project](https://srt-paper.github.io/)] [[Code](https://github.com/stelzner/srt)]\n\n* **Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering.**\u003cbr\u003e\n*Vincent Sitzmann, Semon Rezchikov, William T. Freeman, Joshua B. Tenenbaum, Fredo Durand.*\u003cbr\u003e\nNeurIPS 2021 (Spotlight). [[Paper](https://arxiv.org/abs/2106.02634)] [[Project](https://vsitzmann.github.io/lfns/)] [[Code](https://github.com/vsitzmann/light-field-networks)]\n\n* **Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields.**\u003cbr\u003e\n*[Jonathan T. Barron](https://jonbarron.info/), [Ben Mildenhall](https://bmild.github.io/), [Matthew Tancik](https://www.matthewtancik.com/), [Peter Hedman](https://phogzone.com/cv.html), [Ricardo Martin-Brualla](http://ricardomartinbrualla.com/), [Pratul P. Srinivasan](https://pratulsrinivasan.github.io/).*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2103.13415)] [[Project](http://jonbarron.info/mipnerf)] [[Github](https://github.com/google/mipnerf)]\n\n* **NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.**\u003cbr\u003e\n*[Ben Mildenhall](http://people.eecs.berkeley.edu/~bmild/), [Pratul P. Srinivasan](https://people.eecs.berkeley.edu/~pratul/), [Matthew Tancik](http://www.matthewtancik.com/), [Jonathan T. Barron](https://jonbarron.info/), [Ravi Ramamoorthi](http://cseweb.ucsd.edu/~ravir/), [Ren Ng](https://www2.eecs.berkeley.edu/Faculty/Homepages/yirenng.html).*\u003cbr\u003e\nECCV 2020. [[Paper](https://arxiv.org/abs/2003.08934)] [[Project](http://tancik.com/nerf)] [[Gtihub-Tensorflow](https://github.com/bmild/nerf)] [[krrish94-PyTorch](https://github.com/krrish94/nerf-pytorch)] [[yenchenlin-PyTorch](https://github.com/yenchenlin/nerf-pytorch)]\n\n* **Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision.**\u003cbr\u003e\n*Michael Niemeyer, Lars Mescheder, Michael Oechsle, Andreas Geiger.*\u003cbr\u003e\nCVPR 2020. [[Paper](http://www.cvlibs.net/publications/Niemeyer2020CVPR.Paper)] [[Code](https://github.com/autonomousvision/differentiable_volumetric_rendering)]\n\n* **Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations.**\u003cbr\u003e\n*[Vincent Sitzmann](https://vsitzmann.github.io/), Michael Zollhöfer, Gordon Wetzstein.*\u003cbr\u003e\nNeurIPS 2019 (Oral, Honorable Mention \"Outstanding New Directions\").\n[[Paper](http://arxiv.org/abs/1906.01618)] [[Project](https://github.com/vsitzmann/scene-representation-networks)] [[Code](https://github.com/vsitzmann/scene-representation-networks)] [[Dataset](https://drive.google.com/drive/folders/1OkYgeRcIcLOFu1ft5mRODWNQaPJ0ps90?usp=sharing)]\n\n* **LLFF: Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines.**\u003cbr\u003e\n*[Ben Mildenhall](http://people.eecs.berkeley.edu/~bmild/), Pratul Srinivasan, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, Abhishek Kar.*\u003cbr\u003e\nSIGGRAPH 2019. [[Paper](https://arxiv.org/abs/1905.00889)] [[Project](https://people.eecs.berkeley.edu/~bmild/llff/)] [[Code](https://github.com/Fyusion/LLFF)]\n\n* **DeepVoxels: Learning Persistent 3D Feature Embeddings.**\u003cbr\u003e\n*Vincent Sitzmann, Justus Thies, Felix Heide, Matthias Nießner, Gordon Wetzstein, Michael Zollhöfer.*\u003cbr\u003e\nCVPR 2019 (Oral). [[Paper](https://arxiv.org/abs/1812.01024)] [[Project](http://vsitzmann.github.io/deepvoxels/)] [[Code](https://github.com/vsitzmann/deepvoxels)]\n\n### Acceleration\n\n* **Instant Neural Graphics Primitives with a Multiresolution Hash Encoding.**\u003cbr\u003e\n*[Thomas Müller](https://tom94.net/), [Alex Evans](https://research.nvidia.com/person/alex-evans), [Christoph Schied](https://research.nvidia.com/person/christoph-schied), [Alexander Keller](https://research.nvidia.com/person/alex-keller).*\u003cbr\u003e\nSIGGRAPH (TOG) 2022. [[Paper](https://nvlabs.github.io/instant-ngp/assets/mueller2022instant.Paper)] [[Project](https://nvlabs.github.io/instant-ngp)] [[Code](https://github.com/NVlabs/instant-ngp)]\n\n* **DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering.**\u003cbr\u003e\n*[Liwen Wu](https://lwwu2.github.io/), [Jae Yong Lee](https://jyl.kr/), [Anand Bhattad](https://anandbhattad.github.io/), [Yuxiong Wang](https://yxw.web.illinois.edu/), [David A. Forsyth](http://luthuli.cs.uiuc.edu/~daf/).*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2111.10427)] [[Project](https://lwwu2.github.io/diver/)] [[Code](https://github.com/lwwu2/diver)]\n\n* **KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs.**\u003cbr\u003e\n*Christian Reiser, Songyou Peng, Yiyi Liao, Andreas Geiger.*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2103.13744)] [[Code](https://github.com/creiser/kilonerf)]\n\n* **FastNeRF: High-Fidelity Neural Rendering at 200FPS.**\u003cbr\u003e\n*Stephan J. Garbin, Marek Kowalski, Matthew Johnson, Jamie Shotton, Julien Valentin.*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2103.10380)]\n\n* **PlenOctrees for Real-time Rendering of Neural Radiance Fields.**\u003cbr\u003e\n*[Alex Yu](https://alexyu.net/), [Ruilong Li](https://www.liruilong.cn/), [Matthew Tancik](https://www.matthewtancik.com/), [Hao Li](https://www.hao-li.com/), [Ren Ng](https://www2.eecs.berkeley.edu/Faculty/Homepages/yirenng.html), [Angjoo Kanazawa](https://people.eecs.berkeley.edu/~kanazawa/).*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2103.14024)] [[Project](https://alexyu.net/plenoctrees/)] [[Code](https://github.com/sxyu/plenoctree)]\n\n* **Baking Neural Radiance Fields for Real-Time View Synthesis.**\u003cbr\u003e\n*[Peter Hedman](https://phogzone.com/), [Pratul P. Srinivasan](https://pratulsrinivasan.github.io/), [Ben Mildenhall](https://bmild.github.io/), [Jonathan T. Barron](https://jonbarron.info/), [Paul Debevec](https://www.pauldebevec.com/).*\u003cbr\u003e\nICCV 2021 (oral). [[Paper](https://arxiv.org/abs/2103.14645)] [[Project](https://nerf.live/)] [[Code](https://github.com/google-research/google-research/tree/master/snerg)]\n\n* **AutoInt: Automatic Integration for Fast Neural Volume Rendering.**\u003cbr\u003e\n*David B. Lindell, Julien N. P. Martel, Gordon Wetzstein.*\u003cbr\u003e\nCVPR 2021 (oral). [[Paper](https://arxiv.org/abs/2012.01714)] [[Project](http://www.computationalimaging.org/publications/automatic-integration/)] [[Code](https://github.com/computational-imaging/automatic-integration)]\n\n* **NSVF: Neural Sparse Voxel Fields.**\u003cbr\u003e\n*[Lingjie Liu](https://lingjie0206.github.io/), Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua, Christian Theobalt.*\u003cbr\u003e\nNeurIPS 2020. [[Paper](https://arxiv.org/abs/2007.11571)] [[Project](https://lingjie0206.github.io/papers/NSVF/)] [[Code](https://github.com/facebookresearch/NSVF)]\n\n### From Constrained to In-the-wild Conditions\n\n#### Few Images\n\n* **GRF: Learning a General Radiance Field for 3D Representation and Rendering.**\u003cbr\u003e\n*Alex Trevithick, Bo Yang.*\u003cbr\u003e\nICCV 2021. [[Paper](https://openaccess.thecvf.com/content/ICCV2021/html/Trevithick_GRF_Learning_a_General_Radiance_Field_for_3D_Representation_and_ICCV_2021_paper.html)] [[Code](https://github.com/alextrevithick/GRF)]\n\n* **MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo.**\u003cbr\u003e\n*[Anpei Chen](https://apchenstu.github.io/), [Zexiang Xu](http://cseweb.ucsd.edu/~zex014/), Fuqiang Zhao, Xiaoshuai Zhang, [Fanbo Xiang](https://www.fbxiang.com/), [Jingyi Yu](http://vic.shanghaitech.edu.cn/vrvc/en/people/), [Hao Su](https://cseweb.ucsd.edu/~haosu/).*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2103.15595)] [[Project](https://apchenstu.github.io/mvsnerf/)] [[Code](https://github.com/apchenstu/mvsnerf)]\n\n* **CodeNeRF: Disentangled Neural Radiance Fields for Object Categories.**\u003cbr\u003e\n*Wonbong Jang, Lourdes Agapito.*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2109.01750)] [[Project](https://sites.google.com/view/wbjang/home/codenerf)] [[Code](https://github.com/wayne1123/code-nerf)]\n\n* **pixelNeRF: Neural Radiance Fields from One or Few Images.**\u003cbr\u003e\n*[Alex Yu](https://alexyu.net/), Vickie Ye, Matthew Tancik, Angjoo Kanazawa.*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2012.02190)] [[Project](https://alexyu.net/pixelnerf)] [[Code](https://github.com/sxyu/pixel-nerf)]\n\n* **IBRNet: Learning Multi-View Image-Based Rendering.**\u003cbr\u003e\n*Qianqian Wang, Zhicheng Wang, Kyle Genova, Pratul Srinivasan, Howard Zhou, Jonathan T. Barron, Ricardo Martin-Brualla, Noah Snavely, Thomas Funkhouser.*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2102.13090)] [[Project](https://ibrnet.github.io/)] [[Code](https://github.com/googleinterns/IBRNet)]\n\n* **NeRF-VAE: A Geometry Aware 3D Scene Generative Model.**\u003cbr\u003e\n*Adam R. Kosiorek, Heiko Strathmann, Daniel Zoran, Pol Moreno, Rosalia Schneider, Soňa Mokrá, Danilo J. Rezende.*\u003cbr\u003e\nICML 2021. [[Paper](https://arxiv.org/abs/2104.00587)]\n\n#### Pose-free\n\n* **Self-Calibrating Neural Radiance Fields.**\u003cbr\u003e\n*Yoonwoo Jeong, Seokjun Ahn, Christopher Choy, Animashree Anandkumar, Minsu Cho, Jaesik Park.*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2108.13826)] [[Project](https://postech-cvlab.github.io/SCNeRF/)] [[Code](https://github.com/POSTECH-CVLab/SCNeRF)]\n\n* **BARF: Bundle-Adjusting Neural Radiance Fields.**\u003cbr\u003e\n*[Chen-Hsuan Lin](https://chenhsuanlin.bitbucket.io/), [Wei-Chiu Ma](http://people.csail.mit.edu/weichium/), Antonio Torralba, Simon Lucey.*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2104.06405)] [[Code](https://github.com/chenhsuanlin/bundle-adjusting-NeRF)]\n\n* **NeRF--: Neural Radiance Fields Without Known Camera Parameters.**\u003cbr\u003e\n*[Zirui Wang](https://scholar.google.com/citations?user=zCBKqa8AAAAJ\u0026hl=en), [Shangzhe Wu](http://elliottwu.com), [Weidi Xie](https://weidixie.github.io/weidi-personal-webpage/), [Min Chen](https://sites.google.com/site/drminchen/home), [Victor Adrian Prisacariu](https://eng.ox.ac.uk/people/victor-prisacariu/).*\u003cbr\u003e\narxiv 2021. [[Paper](https://arxiv.org/abs/2102.07064)] [[Project](http://nerfmm.active.vision/)] [[Code](https://github.com/ActiveVisionLab/nerfmm)]\n\n#### Varying Appearance\n\n* **NeRFReN: Neural Radiance Fields with Reflections.**\u003cbr\u003e\n*Yuan-Chen Guo, Di Kang, Linchao Bao, Yu He, Song-Hai Zhang.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2111.15234)] [[Project](https://bennyguo.github.io/nerfren/]\n\n* **NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections.**\u003cbr\u003e\n*[Ricardo Martin-Brualla](http://www.ricardomartinbrualla.com/), [Noha Radwan](https://scholar.google.com/citations?user=g98QcZUAAAAJ\u0026hl=en), [Mehdi S. M. Sajjadi](https://research.google/people/105804/), [Jonathan T. Barron](https://jonbarron.info/), [Alexey Dosovitskiy](https://scholar.google.com/citations?user=FXNJRDoAAAAJ\u0026hl=en), [Daniel Duckworth](http://www.stronglyconvex.com/about.html).*\u003cbr\u003e\nCVPR 2021 (oral). [[Paper](https://arxiv.org/abs/2008.02268)] [[Code](https://nerf-w.github.io/)]\n\n#### Large-scale Scene\n\n* **Grid-guided Neural Radiance Fields for Large Urban Scenes.**\u003cbr\u003e\n*Linning Xu, Yuanbo Xiangli, Sida Peng, Xingang Pan, Nanxuan Zhao, Christian Theobalt, Bo Dai, Dahua Lin.*\u003cbr\u003e \nCVPR 2023. [[Paper](https://arxiv.org/abs/2303.14001)] [[Project](https://city-super.github.io/gridnerf/)]\n\n* **S3-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpoint.**\u003cbr\u003e\n*[Wenqi Yang](https://ywq.github.io/), [Guanying Chen](https://guanyingc.github.io/), [Chaofeng Chen](http://chaofengc.github.io/), [Zhenfang Chen](https://zfchenunique.github.io/), [Kwan-Yee K. Wong](http://i.cs.hku.hk/~kykwong/).*\u003cbr\u003e\nNeurIPS 2022. [[Paper](https://arxiv.org/abs/2210.08936)] [[Project](https://ywq.github.io/s3nerf)]\n\n* **BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Rendering.**\u003cbr\u003e\n*Yuanbo Xiangli, Linning Xu, Xingang Pan, Nanxuan Zhao, Anyi Rao, Christian Theobalt, Bo Dai, Dahua Lin.*\u003cbr\u003e\nECCV 2022. [[Paper](https://arxiv.org/abs/2112.05504)] [[Project](https://city-super.github.io/citynerf)]\n\n* **Block-NeRF: Scalable Large Scene Neural View Synthesis.**\u003cbr\u003e\n*Matthew Tancik, Vincent Casser, Xinchen Yan, Sabeek Pradhan, Ben Mildenhall, Pratul P. Srinivasan, Jonathan T. Barron, Henrik Kretzschmar.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2202.05263)] [[Project](https://waymo.com/research/block-nerf/)]\n\n* **Urban Radiance Fields.**\u003cbr\u003e\n*[Konstantinos Rematas](http://www.krematas.com/), Andrew Liu, Pratul P. Srinivasan, Jonathan T. Barron, Andrea Tagliasacchi, Thomas Funkhouser, Vittorio Ferrari.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2111.14643)] [[Project](https://urban-radiance-fields.github.io/)]\n\n* **Mega-NERF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs.**\u003cbr\u003e\n*Haithem Turki, Deva Ramanan, Mahadev Satyanarayanan.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://openaccess.thecvf.com/content/CVPR2022/html/Turki_Mega-NERF_Scalable_Construction_of_Large-Scale_NeRFs_for_Virtual_Fly-Throughs_CVPR_2022_paper.html)] [[Code](https://github.com/cmusatyalab/mega-nerf)]\n\n* **Shadow Neural Radiance Fields for Multi-view Satellite Photogrammetry.**\u003cbr\u003e\n*Dawa Derksen, Dario Izzo.*\u003cbr\u003e \nCVPR 2021. [[Paper](https://arxiv.org/abs/2104.09877)] [[Code](https://github.com/esa/snerf)]\n\n#### Dynamic Scene\n\n* **NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields.**\u003cbr\u003e\n*Liangchen Song, Anpei Chen, Zhong Li, Zhang Chen, Lele Chen, Junsong Yuan, Yi Xu, Andreas Geiger.*\u003cbr\u003e\nTVCG 2023. [[Paper](https://arxiv.org/abs/2210.15947)] [[Project](https://lsongx.github.io/projects/nerfplayer.html)]\n\n* **Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objects.**\u003cbr\u003e\n*Ziyu Wang, Yu Deng, Jiaolong Yang, Jingyi Yu, Xin Tong.*\u003cbr\u003e\nPacific Graphics 2022. [[Paper](https://arxiv.org/abs/2209.04183)] [[Code](https://ziyuwang98.github.io/GDRF/)]\n\n* **Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Camera.**\u003cbr\u003e\n*[Hongrui Cai](https://rainbowrui.github.io/), [Wanquan Feng](https://github.com/WanquanF), [Xuetao Feng](https://scholar.google.com/citations?hl=en\u0026user=5G-2EFcAAAAJ), [Yan Wang](), [Juyong Zhang](http://staff.ustc.edu.cn/~juyong/).*\u003cbr\u003e\nNeurIPS 2022. [[Paper](https://arxiv.org/abs/2206.15258)] [[Project](https://ustc3dv.github.io/ndr/)] [[Code](https://github.com/USTC3DV/NDR-code)]\n\n* **LoRD: Local 4D Implicit Representation for High-Fidelity Dynamic Human Modeling.**\u003cbr\u003e\n*Boyan Jiang, Xinlin Ren, Mingsong Dou, Xiangyang Xue, Yanwei Fu, Yinda Zhang.*\u003cbr\u003e\nECCV 2022. [[Paper](https://arxiv.org/abs/2208.08622)] [[Code](https://boyanjiang.github.io/LoRD/)]\n\n* **Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-time.**\u003cbr\u003e\n*[Liao Wang](https://aoliao12138.github.io/), [Jiakai Zhang](https://jiakai-zhang.github.io/), Xinhang Liu, Fuqiang Zhao, Yanshun Zhang, Yingliang Zhang, Minye Wu, Lan Xu, Jingyi Yu.*\u003cbr\u003e\nCVPR 2022 (Oral). [[Paper](https://arxiv.org/abs/2202.08614)] [[Project](https://aoliao12138.github.io/FPO/)]\n\n* **CoNeRF: Controllable Neural Radiance Fields.**\u003cbr\u003e\n*Kacper Kania, Kwang Moo Yi, Marek Kowalski, Tomasz Trzciński, Andrea Taliasacchi.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2112.01983)] [[Project](https://conerf.github.io/)]\n\n* **Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video.**\u003cbr\u003e\n*Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhöfer, Christoph Lassner, Christian Theobalt.*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2012.12247)] [[Project](https://gvv.mpi-inf.mpg.de/projects/nonrigid_nerf/)] [[Code](https://github.com/facebookresearch/nonrigid_nerf)]\n\n* **NeRFlow: Neural Radiance Flow for 4D View Synthesis and Video Processing.**\u003cbr\u003e\n*Yilun Du, Yinan Zhang, Hong-Xing Yu, Joshua B. Tenenbaum, Jiajun Wu.*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2012.09790)] [[Project](https://yilundu.github.io/nerflow/)]\n\n* **Nerfies: Deformable Neural Radiance Fields.**\u003cbr\u003e\n*[Keunhong Park](https://keunhong.com/), [Utkarsh Sinha](https://utkarshsinha.com/), [Jonathan T. Barron](https://jonbarron.info/), [Sofien Bouaziz](http://sofienbouaziz.com/), [Dan B Goldman](https://www.danbgoldman.com/), [Steven M. Seitz](https://homes.cs.washington.edu/~seitz/), [Ricardo-Martin Brualla](http://www.ricardomartinbrualla.com/).*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2011.12948)] [[Project](https://nerfies.github.io/)] [[Code](https://github.com/google/nerfies)]\n\n* **D-NeRF: Neural Radiance Fields for Dynamic Scenes.**\u003cbr\u003e\n*[Albert Pumarola](https://www.albertpumarola.com/), [Enric Corona](https://www.iri.upc.edu/people/ecorona/), [Gerard Pons-Moll](http://virtualhumans.mpi-inf.mpg.de/), [Francesc Moreno-Noguer](http://www.iri.upc.edu/people/fmoreno/).*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2011.13961)] [[Project](https://www.albertpumarola.com/research/D-NeRF/index.html)] [[Code](https://github.com/albertpumarola/D-NeRF)] [[Data](https://www.dropbox.com/s/0bf6fl0ye2vz3vr/data.zip?dl=0)]\n\n* **Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction.**\u003cbr\u003e\n*Guy Gafni, Justus Thies, Michael Zollhöfer, Matthias Nießner.*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2012.03065)] [[Project](https://gafniguy.github.io/4D-Facial-Avatars/)] [[Video](https://youtu.be/m7oROLdQnjk)]\n\n* **NSFF: Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes.**\u003cbr\u003e\n*[Zhengqi Li](https://www.cs.cornell.edu/~zl548/), [Simon Niklaus](https://sniklaus.com/welcome), [Noah Snavely](https://www.cs.cornell.edu/~snavely/), [Oliver Wang](https://research.adobe.com/person/oliver-wang/).*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2011.13084)] [[Project](http://www.cs.cornell.edu/~zl548/NSFF)] [[Code](https://github.com/zhengqili/Neural-Scene-Flow-Fields)]\n\n* **Space-time Neural Irradiance Fields for Free-Viewpoint Video.**\u003cbr\u003e\n*[Wenqi Xian](https://www.cs.cornell.edu/~wenqixian/), [Jia-Bin Huang](https://filebox.ece.vt.edu/~jbhuang/), [Johannes Kopf](https://johanneskopf.de/), [Changil Kim](https://changilkim.com/).*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2011.12950)] [[Project](https://video-nerf.github.io/)]\n\nThe following papers are not directly related to 3D-aware image synthesis. But it would be beneficial to pay attention to those works. For example, in our survey, inverse rendering are not classified as 3D-aware image synthesis as they are not deliberately designed for this purpose. But with the inferred intrinsic components, photorealistic images can be rendered. 3D reconstruction models geometry only with no appearance information, meaning them not able to render images with photorealistic textures. But these representations have been introduced as the geometric representation along with a textural representation (e.g., Texture Field) for 3D-aware image synthesis.\n\n## 3D Representations\n\n* **K-Planes: Explicit Radiance Fields in Space, Time, and Appearance.**\u003cbr\u003e\n*[Sara Fridovich-Keil](https://people.eecs.berkeley.edu/~sfk/), [Giacomo Meanti](https://www.iit.it/web/iit-mit-usa/people-details/-/people/giacomo-meanti), [Frederik Warburg](https://frederikwarburg.github.io/), [Benjamin Recht](https://people.eecs.berkeley.edu/~brecht/), [Angjoo Kanazawa](https://people.eecs.berkeley.edu/~kanazawa/).*\u003cbr\u003e\nCVPR 2023. [[Paper](https://arxiv.org/abs/2301.10241)] [[Project](https://sarafridov.github.io/K-Planes/)] [[Code](https://github.com/sarafridov/K-Planes)]\n\n* **HexPlane: A Fast Representation for Dynamic Scenes.**\u003cbr\u003e\n*[Ang Cao](https://caoang327.github.io/), [Justin Johnson](https://web.eecs.umich.edu/~justincj).*\u003cbr\u003e\nCVPR 2023. [[Paper](https://arxiv.org/abs/2301.09632)] [[Project](https://caoang327.github.io/HexPlane/)] [[Code](https://caoang327.github.io/HexPlane/)]\n\n* **GIFS: Neural Implicit Function for General Shape Representation.**\u003cbr\u003e\n*Jianglong Ye, Yuntao Chen, Naiyan Wang, Xiaolong Wang.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2204.07126)] [[Project](https://jianglongye.com/gifs)] [[Code](https://github.com/jianglongye/gifs)]\n\n* **Geometry-Consistent Neural Shape Representation with Implicit Displacement Fields.**\u003cbr\u003e\n*[Wang Yifan](https://yifita.github.io/), Lukas Rahmann, [Olga Sorkine-Hornung](https://igl.ethz.ch/people/sorkine/).*\u003cbr\u003e\nICLR 2022. [[Paper](https://arxiv.org/abs/2106.05187)] [[Project](https://yifita.github.io/publication/idf/)] [[Code](https://github.com/yifita/idf)]\n\n* **Neural Volumes: Learning Dynamic Renderable Volumes from Images.**\u003cbr\u003e\n*Stephen Lombardi, Tomas Simon, Jason Saragih, Gabriel Schwartz, Andreas Lehrmann, Yaser Sheikh.*\u003cbr\u003e\nTOG 2019. [[Paper](https://arxiv.org/abs/1906.07751)] [[Code](https://github.com/facebookresearch/neuralvolumes)]\n\n* **DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation.**\u003cbr\u003e\n*eong Joon Park, Peter Florence, Julian Straub, Richard Newcombe, Steven Lovegrove.*\u003cbr\u003e\nCVPR 2019. [[Paper](http://openaccess.thecvf.com/content_CVPR_2019/html/Park_DeepSDF_Learning_Continuous_Signed_Distance_Functions_for_Shape_Representation_CVPR_2019_paper.html)] [[Code](https://github.com/facebookresearch/DeepSDF)] \n\n* **Occupancy Networks: Learning 3D Reconstruction in Function Space.**\u003cbr\u003e\n*Lars Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, Andreas Geiger.*\u003cbr\u003e\nCVPR 2019. [[Paper](https://arxiv.org/abs/1812.03828)] [[Project](https://avg.is.mpg.de/publications/occupancy-networks)] [[Code](http://avg.is.tuebingen.mpg.de/publications/occupancy-networks)]\n\n## Neural Inverse Rendering (Neural De-rendering)\n\n[Inverse rendering](https://github.com/weihaox/awesome-neural-rendering/blob/master/docs/NEURAL-INVERSE-RENDERING.md) is to infer underlying intrinsic components of a scene from rendered 2D images. These properties include shape (surface, depth, normal), material (albedo, reflectivity, shininess), and lighting (direction, intensity), which can be further used to render photorealistic images. \n\n* **NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination.**\u003cbr\u003e\n*[Xiuming Zhang](http://people.csail.mit.edu/xiuming/), [Pratul P. Srinivasan](https://pratulsrinivasan.github.io/), [Boyang Deng](https://boyangdeng.com/), [Paul Debevec](http://www.pauldebevec.com/), [William T. Freeman](http://billf.mit.edu/), [Jonathan T. Barron](https://jonbarron.info/).*\u003cbr\u003e\nSIGGRAPH Asia 2021. [[Paper](https://arxiv.org/abs/2106.01970)] [[Project](http://people.csail.mit.edu/xiuming/projects/nerfactor/)] [[Code](https://github.com/google/nerfactor)]\n\n* **Extracting Triangular 3D Models, Materials, and Lighting From Images.**\u003cbr\u003e\n*[Jacob Munkberg](https://research.nvidia.com/person/jacob-munkberg), [Jon Hasselgren](https://research.nvidia.com/person/jon-hasselgren), [Tianchang Shen](http://www.cs.toronto.edu/~shenti11/), [Jun Gao](http://www.cs.toronto.edu/~jungao/), [Wenzheng Chen](http://www.cs.toronto.edu/~wenzheng/), [Alex Evans](https://research.nvidia.com/person/alex-evans), [Thomas Müller](https://research.nvidia.com/person/thomas-mueller), [Sanja Fidler](https://www.cs.toronto.edu/~fidler/).*\u003cbr\u003e\nCVPR 2022. [[Paper](http://arxiv.org/abs/2111.12503)] [[Code](https://github.com/NVlabs/nvdiffrec)] [[Project](https://nvlabs.github.io/nvdiffrec/)]\n\n* **Modeling Indirect Illumination for Inverse Rendering.**\u003cbr\u003e\n*Yuanqing Zhang, Jiaming Sun, Xingyi He, Huan Fu, Rongfei Jia, Xiaowei Zhou.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2204.06837)]\n\n* **IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenes.**\u003cbr\u003e\n*Rui Zhu, Zhengqin Li, Janarbek Matai, Fatih Porikli, Manmohan Chandraker.*\u003cbr\u003e\nCVPR 2022. [[Paper](https://openaccess.thecvf.com/content/CVPR2022/html/Zhu_IRISformer_Dense_Vision_Transformers_for_Single-Image_Inverse_Rendering_in_Indoor_CVPR_2022_paper.html)]\n\n* **De-rendering 3D Objects in the Wild.**\u003cbr\u003e\n*[Felix Wimbauer](https://www.linkedin.com/in/felixwimbauer/), [Shangzhe Wu](https://elliottwu.com/), [Christian Rupprecht](https://chrirupp.github.io/).*\u003cbr\u003e\nCVPR 2022. [[Paper](https://arxiv.org/abs/2201.02279)] [[Project](https://www.robots.ox.ac.uk/~vgg/research/derender3d/)] [[Code](https://github.com/Brummi/derender3d)]\n\n* **GAN2X: Non-Lambertian Inverse Rendering of Image GANs.**\u003cbr\u003e\n*[Xingang Pan](https://xingangpan.github.io/), [Ayush Tewari](https://ayushtewari.com/), [Lingjie Liu](https://lingjie0206.github.io/), [Christian Theobalt](http://www.mpi-inf.mpg.de/~theobalt/).*\u003cbr\u003e\n3DV 2022. [[Paper](https://arxiv.org/abs/2206.09244)] [[Project](https://people.mpi-inf.mpg.de/~xpan/GAN2X/)]\n\n* **PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting.**\u003cbr\u003e\n*Kai Zhang, Fujun Luan, Qianqian Wang, Kavita Bala, Noah Snavely.*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2104.00674)] [[Project](https://kai-46.github.io/PhySG-website/)]\n\n* **Unified Shape and SVBRDF Recovery using Differentiable Monte Carlo Rendering.**\u003cbr\u003e\n*[Fujun Luan](https://www.cs.cornell.edu/~fujun/), [Shuang Zhao](https://www.shuangz.com/), [Kavita Bala](https://www.cs.cornell.edu/~kb/), [Zhao Dong](http://flycooler.com/).*\u003cbr\u003e\nEGSR 2021. [[Paper](https://www.cs.cornell.edu/~fujun/files/egsr2021/paper.Paper)] [[Project](https://luanfujun.github.io/InverseMeshSVBRDF/)] [[Video](https://youtu.be/u9HqKGqvJhQ?t=8404)]\n\n* **Invertible Neural BRDF for Object Inverse Rendering.**\u003cbr\u003e\n*Zhe Chen, Shohei Nobuhara, Ko Nishino.*\u003cbr\u003e\nECCV 2020. [[Paper](https://arxiv.org/abs/2008.04030)] [[Code](https://github.com/chenzhekl/iBRDF)]\n\n* **Polarimetric Multi-View Inverse Rendering.**\u003cbr\u003e\n*Jinyu Zhao, Yusuke Monno, Masatoshi Okutomi.*\u003cbr\u003e\nECCV 2020. [[Paper](https://arxiv.org/abs/2007.08830)]\n\n* **Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF From a Single Image.**\u003cbr\u003e\n*[Zhengqin Li](http://sites.google.com/a/eng.ucsd.edu/zhengqinli/), [Mohammad Shafiei](https://www.linkedin.com/in/mohammadshafiei/), [Ravi Ramamoorthi](http://cseweb.ucsd.edu/~ravir/), [Kalyan Sunkavalli](http://www.kalyans.org/), [Manmohan Chandraker](http://cseweb.ucsd.edu/~mkchandraker/).*\u003cbr\u003e\nCVPR 2020.[[Paper](https://drive.google.com/file/d/18zG1kzVpL9XsEVBK95hbpnB-FMlChRXP/view?usp=sharing)] [[Project](http://cseweb.ucsd.edu/~viscomp/projects/CVPR20InverseIndoor/)] [[Code](https://github.com/lzqsd/InverseRenderingOfIndoorScene)]\n\n* **DRWR: A Differentiable Renderer without Rendering for Unsupervised 3D Structure Learning from Silhouette Images.**\u003cbr\u003e\n*Zhizhong Han, Chao Chen, Yu-Shen Liu, Matthias Zwicker.*\u003cbr\u003e\nICML 2020. [[Paper](https://arxiv.org/abs/2007.06127)]\n\n* **Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer.**\u003cbr\u003e\n*Wenzheng Chen, Jun Gao, Huan Ling, Edward J. Smith, Jaakko Lehtinen, Alec Jacobson, Sanja Fidler.*\u003cbr\u003e\nNeurIPS 2019. [[Paper](https://arxiv.org/abs/1908.01210)] [[Code](https://github.com/nv-tlabs/DIB-R)]\n\n* **InverseRenderNet: Learning Single Image Inverse Rendering.**\u003cbr\u003e\n*Ye Yu, William A. P. Smith.*\u003cbr\u003e\nCVPR 2019. [[Paper](http://openaccess.thecvf.com/content_CVPR_2019/html/Yu_InverseRenderNet_Learning_Single_Image_Inverse_Rendering_CVPR_2019_paper.html)] [[Code](https://github.com/YeeU/InverseRenderNet)] [[IIW Dataset](http://opensurfaces.cs.cornell.edu/publications/intrinsic/#download)] \n\n## Neural Rerendering\n\n* **Hybrid Neural Fusion for Full-frame Video Stabilization.**\u003cbr\u003e\n*[Yu-Lun Liu](https://www.cmlab.csie.ntu.edu.tw/~nothinglo/), [Wei-Sheng Lai](https://www.wslai.net/), [Ming-Hsuan Yang](https://faculty.ucmerced.edu/mhyang/), [Yung-Yu Chuang](https://www.csie.ntu.edu.tw/~cyy/), [Jia-Bin Huang](https://filebox.ece.vt.edu/~jbhuang/).*\u003cbr\u003e\nICCV 2021. [[Paper](https://arxiv.org/abs/2102.06205)] [[Code](https://alex04072000.github.io/NeRViS/)]\n\n* **Neural Lumigraph Rendering.**\u003cbr\u003e\n*Petr Kellnhofer, Lars Jebe, Andrew Jones, Ryan Spicer, Kari Pulli, Gordon Wetzstein.*\u003cbr\u003e\nCVPR 2021. [[Paper](https://arxiv.org/abs/2103.11571)] [[Project](http://www.computationalimaging.org/publications/nlr/)] [[Data](https://drive.google.com/file/d/1BBpIfrqwZNYmG1TiFljlCnwsmL2OUxNT/view?usp=sharing)]\n\n* **Neural Re-Rendering of Humans from a Single Image.**\u003cbr\u003e\n*Kripasindhu Sarkar, Dushyant Mehta, Weipeng Xu, Vladislav Golyanik, Christian Theobalt.*\u003cbr\u003e\nECCV 2020. [[Paper](https://arxiv.org/abs/2101.04104)]\n\n* **Neural Rerendering in the Wild.**\u003cbr\u003e\n*Moustafa Meshry, Dan B Goldman, Sameh Khamis, Hugues Hoppe, Rohit Pandey, Noah Snavely, Ricardo Martin-Brualla.*\u003cbr\u003e\nCVPR 2019. [[Paper](https://arxiv.org/abs/1904.04290)]\n\n* **Revealing Scenes by Inverting Structure from Motion Reconstructions.**\u003cbr\u003e\n*Francesco Pittaluga, Sanjeev J. Koppal, Sing Bing Kang, Sudipta N. Sinha.*\u003cbr\u003e\nCVPR 2019. [[Paper](https://arxiv.org/abs/1904.03303)]\n\nDatasets\n------------------\n\nSummary of popular 3D-aware image synthesis datasets.\n\n### Multi-view image collections\n\nThe images are rendered or collected according to different experimental settings, such as Synthetic-NeRF dataset, the DTU dataset, and the Tanks and Temples dataset for general purposes, the crowded Phototourism dataset for varying lighting conditions, the Blender Forward Facing (BLEFF) dataset to benchmark camera parameter estimation and novel view synthesis quality, and the San Francisco Alamo Square Dataset for large-scale scenes.\n\nExamples of multi-view image datasets.\n\n| **dataset**       | **published in**     |     **# scene**       |   **# samples per scene**   |   **range (m × m)**    |   **resolution**    |   **keyword**          |\n|:-----------------:|:--------------------:|:---------------------:|:---------------------------:|:----------------------:|:-------------------:|:-----------------------:|\n| DeepVoxels        | CVPR 2019            | 4 simple objects      | 479 / 1,000                 | \\                      | 512 × 512           | synthetic, 360 degree   |\n| NeRF Synthetics   | ECCV 2020            | 8 complex objects     | 100 / 200                   | \\                      | 800 ×800            | synthetic, 360 degree   |\n| NeRF Captured     | ECCV 2020            | 8 complex scenes      | 20-62                       | a few                  | 1,008 × 756         | real, forward-facing    |\n| DTU               | CVPR 2014            | 124 scenes            | 49 or 64                    | a few to thousand      | 1,600 × 1,200       | often used in few-views |\n| Tanks and Temples | CVPR 2015            | 14 objects and scenes | 4,395 - 21,871              | dozen to thousand      | 8-megapixel         | real, large-scale       |\n| Phototourism      | IJCV 2021            | 6 landmarks           | 763-2,000                   | dozen to thousand      | 564-1,417 megapixel | varying illumination    |\n| Alamo Square      | CVPR 2022            | San Francisco         | 2,818,745                   | 570 × 960              | 1,200 × 900         | real, large-scale       |\n\n### Single-view image collections\n\nSummary of popular single-view image datasets organized by their major categories and sorted by their popularity.\n\n| **dataset** | **year**     | **category**           | **# samples** | **resolution**   | **keyword**            |\n|:-----------:|:------------:|:----------------------:|:-------------:|:------------------:|:----------------------:|\n| FFHQ        | CVPR 2019    | Human Face             | 70k           | 1024 × 1024    | single simple-shape   |\n| AFHQ        | CVPR 2020    | Cat, Dog, and Wildlife | 15k           | 512  × 512     | single simple-shape    |\n| CompCars    | CVPR 2015    | Real Car               | 136K          | 256  × 256     | single simple-shape    |\n| CARLA       | CoRL 2017    | Synthetic Car          | 10k           | 128  × 128     | single simple-shape    |\n| CLEVR       | CVPR 2017    | Objects                | 100k          | 256  × 256     | multiple, simple-shape |\n| LSUN        | 2015         | Bedroom                | 300K          | 256  × 256     | single, simple-shape   |\n| CelebA      | ICCV 2015    | Human Face             | 200k          | 178  × 218     | single simple-shape    |\n| CelebA-HQ   | ICLR 2018    | Human Face             | 30k           | 1024 × 1024    | single, simple-shape   |\n| MetFaces    | NeurIPS 2020 | Art Face               | 1336          | 1024 × 1024    | single, simple-shape   |\n| M-Plants    | NeurIPS 2022 | Variable-Shape         | 141,824       | 256  × 256     | single, variable-shape |\n| M-Food      | NeurIPS 2022 | Variable-Shape         | 25,472        | 256  × 256     | single, variable-shape |\n\nCitation\n------------------\n\nIf this repository benefits your research, please consider citing our paper.\n\n```bibtex\n  @inproceedings{xia2023survey,\n    title={A Survey on Deep Generative 3D-aware Image Synthesis},\n    author={Xia, Weihao and Xue, Jing-Hao},\n    booktitle={ACM Computing Surveys (CSUR)},\n    year={2023}\n  }\n```\n\nLicense\n------------------\n\n\u003ca rel=\"license\" href=\"http://creativecommons.org/licenses/by/4.0/\"\u003e\u003cimg alt=\"Creative Commons License\" style=\"border-width:0\" src=\"https://i.creativecommons.org/l/by/4.0/88x31.png\" /\u003e\u003c/a\u003e\u003cbr /\u003eThis work is licensed under a \u003ca rel=\"license\" href=\"http://creativecommons.org/licenses/by/4.0/\"\u003eCreative Commons Attribution 4.0 International License\u003c/a\u003e.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fweihaox%2Fgen3d","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fweihaox%2Fgen3d","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fweihaox%2Fgen3d/lists"}