World-Simulator
Simulating the Real World: Survey & Resources, which contains our survey "Simulating the Real World: A Unified Survey of Multimodal Generative Models" and Awesome-Text2X-Resources. Watch this repository for the latest updates! 🔥
https://github.com/ALEEEHU/World-Simulator
Last synced: 12 days ago
JSON representation
-
3D Scene Subsection
-
🎉 3D Scene Accepted Papers
-
-
4D Subsection
-
🎉 4D Accepted Papers
-
💡 4D ArXiv Papers
- Link - - | [Link](https://melonienimasha.github.io/Pixel-to-4D-Website/) |
- Link - - | [Link](https://yanzhelyu.github.io/chord/) |
- Link - to-4.github.io/) |
- Link
- Link
- Live Demo - world) | [Link](https://inspatio.github.io/inspatio-world/) |
- Link - - | [Link](https://zhaochongan.github.io/projects/VGGRPO/) |
- Link - - | [Link](https://paper.pnu-cvsp.com/LivingWorld/) |
- Link - - | [Link](https://noodle-lab.github.io/turbo4dgen/) |
- Link - - | -- |
- Link - - | -- |
-
-
Other Related Resources
-
World Foundation Model Platform
- NVIDIA Cosmos - cosmos)] [[Paper](https://arxiv.org/abs/2501.03575)]): NVIDIA Cosmos is a world foundation model platform for accelerating the development of physical AI systems.
- Cosmos-Transfer1 - to-world transfer model designed to bridge the perceptual divide between simulated and real-world environments.
- Cosmos-Predict1 - purpose world foundation models for Physical AI that can be fine-tuned into customized world models for downstream applications.
- Cosmos-Reason1 - of-thought reasoning processes.
- Genie3
-
World Model Benchmark
- arXiv 2025 - Team/WorldModelBench)] [[Project Page](https://worldmodelbench-team.github.io/)]
-
-
📜 Our Survey Paper Collection
-
Paradigms
-
2D Generation
- NeurIPS 2022
- ICML 2021 - E)]
- arXiv 2022
- [Platform Link
- [GitHub
- CVPR 2022 - diffusion)]
- ICLR 2024 spotlight - AI/generative-models)]
- [Platform Link
-
3D Generation
- ECCV 2024 - UCLA/DreamScene360)] [[Project Page](https://dreamscene360.github.io/)]
- ECCV 2024 - Project/DreamScene)] [[Project Page](https://dreamscene-project.github.io/)]
- NeurIPS 2023 - Research/DreamWaltz)] [[Project Page](https://idea-research.github.io/DreamWaltz/)]
- NeurIPS 2023 Spotlight - human.github.io/)]
- CVPR 2024 Highlight - vision/vivid123)] [[Project Page](https://jgkwak95.github.io/ViVid-1-to-3/)]
- arXiv 2023
- arXiv 2022
- arXiv 2022 - e)]
- arXiv 2023 - e)]
- NeurIPS 2023
- ICCV 2023 - ai/ATT3D/)]
- ICLR 2023 Spotlight
- CVPR 2023 - SDF)] [[Project Page](https://ttlmh.github.io/DiffusionSDF/)]
- ICML 2024
- ECCV 2024 - ai/LATTE3D/)]
- arXiv 2024 - research/AToM)] [[Project Page](https://snap-research.github.io/AToM/)]
- ICLR 2023 notable top 5%
- CVPR 2023 Highlight
- CVPR 2023
- ICCV 2023 - Lab-SCUT/Fantasia3D)] [[Project Page](https://fantasia3d.github.io/)]
- NeurIPS 2023 Spotlight - ml/prolificdreamer)] [[Project Page](https://ml.cs.tsinghua.edu.cn/prolificdreamer/)]
- ICLR 2024 Poster - dream.github.io/)]
- ICLR 2024 Oral
- CVPR 2024
- CVPR 2024 - cvpr24.github.io/)]
- CVPR 2024
- CVPR 2024
- CVPR 2024
- ICLR 2024 Poster
- CVPR 2024 - direct2.5)] [[Project Page](https://nju-3dv.github.io/projects/direct25/)]
- CVPR 2024
- arXiv 2023
- NeurIPS 2024
- SIGGRAPH 2024 Best Paper Honorable Mention - 3D/OpenCLAY)] [[Project Page](https://sites.google.com/view/clay-3dlm)]
- arXiv 2024 - 98/CraftsMan3D)] [[Project Page](https://craftsman3d.github.io/)]
- arXiv 2024
- arXiv 2023 - 123.github.io/)]
- arXiv 2023 - dream.github.io/)]
- CVPR 2023
- ICCV 2023 - columbia/zero123)] [[Project Page](https://zero123.cs.columbia.edu/)]
- ICLR 2024 Poster
- ICLR 2024 Poster - Research/TOSS)] [[Project Page](https://toss3d.github.io/)]
- ICLR 2024 Spotlight - pal/SyncDreamer)] [[Project Page](https://liuyuan-pal.github.io/SyncDreamer/)]
- CVPR 2024
- NeurIPS 2023 - 2-3-45/One-2-3-45)] [[Project Page](https://one-2-3-45.github.io/)]
- ECCV 2024 - ml/CRM)] [[Project Page](https://ml.cs.tsinghua.edu.cn/~zhengyi/CRM/)]
- arXiv 2024
- ICLR 2024 Oral
- NeurIPS 2024
- ICML 2024 - 3D/)]
- arXiv 2024
- ECCV 2024 Oral
- NeurIPS 2024 Oral
- CVPR 2023
- SIGGRAPH 2023
- NeurIPS 2023
- ACM MM 2023
- TVCG 2024
- arXiv 2024
- arXiv 2024
- ECCV 2022 - Group/INS)] [[Project Page](https://zhiwenfan.github.io/INS/)]
- ECCV 2022 - 46/ARF-svox2)] [[Project Page](https://www.cs.cornell.edu/projects/arf/)]
- SIGGRAPH Asia 2022
- CVPR 2022
- SIGGRAPH 2023
- ICCV 2023
- ICCV 2023 Oral - nerf2nerf)] [[Project Page](https://instruct-nerf2nerf.github.io/)]
- ICLR 2025
-
4D Generation
- arXiv 2023 - a-video3d.github.io/)]
- CVPR 2024
- CVPR 2024 - in-4d)] [[Project Page](https://research.nvidia.com/labs/nxp/dream-in-4d/)]
- CVPR 2024 - ai/AlignYourGaussians/)]
- CVPR 2024
- ECCV 2024
- ECCV 2024
- ECCV 2024 - yifei/STAG4D)] [[Project Page](https://nju-3dv.github.io/projects/STAG4D/)]
- NeurIPS 2024
- NeurIPS 2024 - Group/Diffusion4D)] [[Project Page](https://vita-group.github.io/Diffusion4D/)] [[Dataset](https://huggingface.co/datasets/hw-liang/Diffusion4D)]
- NeurIPS 2024 - dgs.github.io/)]
- NeurIPS 2024 - research.github.io/4Real/)]
- NeurIPS 2024 - tlabs/L4GM-official)] [[Project Page](https://research.nvidia.com/labs/toronto-ai/l4gm/)]
- NeurIPS 2024
- NeurIPS 2024 - us/research/project/compositional-3d-aware-video-generation/)]
- ICLR 2023 notable top 25% - diffusion-model)] [[Project Page](https://guytevet.github.io/mdm-page/)]
- NeurIPS 2023 - gpt.github.io/)]
- CVPR 2024 - codes)] [[Project Page](https://ericguo5513.github.io/momask/)]
- ICML 2024 - Research/HumanTOMATO)] [[Project Page](https://lhchen.top/HumanTOMATO/)]
- NeurIPS 2024 - CVGL/DreamMesh4D)] [[Project Page](https://lizhiqi49.github.io/DreamMesh4D/)]
- CVPR 2024 - M/Instruct-4D-to-4D/)] [[Project Page](https://immortalco.github.io/Instruct-4D-to-4D/)]
- SIGGRAPH 2020
- CVPR 2022 - to-motion)] [[Project Page](https://ericguo5513.github.io/text-to-motion/)]
- SCA 2023
- CVPR 2023 - zys/T2M-GPT)] [[Project Page](https://mael-zys.github.io/T2M-GPT/)]
- CVPR 2024 - ronghui/LODGE)] [[Project Page](https://li-ronghui.github.io/lodge)]
- arXiv 2024
-
Video Generation
- ICLR 2025 Poster
- AIRC 2023
- arXiv 2021 - research/fitvid)] [[Project Page](https://sites.google.com/view/fitvidpaper)]
- ICLR 2018 Poster
- CVPR 2018
- CVPR 2022 - v)] [[Project Page](https://skor.sh/stylegan-v)]
- ICLR 2022 - yu/digan)] [[Project Page](https://sihyun.me/digan/)]
- ICCV 2023 - ntu.com/project/styleinv/index.html)]
- NeurIPS 2022 - diffusion.github.io/)]
- arXiv 2022
- arXiv 2022
- ICLR 2023 Poster - a-video.github.io/)]
- ICCV 2023 - 1)]
- ICCV 2023
- CVPR 2023 - ai/VideoLDM/)]
- IJCV 2024 - 1)] [[Project Page](https://showlab.github.io/Show-1/)]
- NeurIPS 2024 - vilab/videocomposer)] [[Project Page](https://videocomposer.github.io/)]
- ICLR 2024 Spotlight
- CVPR 2024
- ECCV 2024 - video.metademolab.com/)]
- SIGGRAPH Asia 2024 - video.github.io/)]
- ICLR 2024 Poster - 2023.github.io/)]
- ECCV 2024 - video-diffusion.github.io/)]
- CVPR 2024 - research.github.io/snapvideo/)]
- CVPR 2024
- ICLR 2025 Spotlight - VLLM/Lumina-T2X)]
- CVPR 2021 Oral - transformers)]
- CVPR 2023 Highlight - research/magvit)] [[Project Page](https://magvit.cs.cmu.edu/)]
- ICLR 2023 Poster
- ICML 2024
- ICLR 2024 Poster
- arXiv 2024 - Voken)]
- arXiv 2024
- ICLR 2025 Poster - T2I-AR-with-SJD/)]
- ICCV 2023 - A-Video)] [[Project Page](https://tuneavideo.github.io/)]
- ICCV 2023
- CVPR 2024 - diffusion.github.io/)]
- CVPR 2024 - research/Video-P2P)] [[Project Page](https://video-p2p.github.io/)]
- CVPR 2024 Highlight - research/CoDeF)] [[Project Page](https://qiuyu96.github.io/CoDeF/)]
- NeurIPS 2024
- ICLR 2024 Poster - A-Video/Ground-A-Video)] [[Project Page](https://ground-a-video.github.io/)]
- arXiv 2024
- TMLR 2024 - AI-Lab/AnyV2V)] [[Project Page](https://tiger-ai-lab.github.io/AnyV2V/)]
- arXiv 2024
- ICLR 2025 Poster - CameraCtrl/)]
- ICLR 2025 Poster - Zhiyu/NVS_Solver)]
- ICCV 2019
- ICCV 2019 - lab/impersonator)] [[Project Page](https://svip-lab.github.io/project/impersonator.html)] [[Dataset](https://svip-lab.github.io/dataset/iPER_dataset.html)]
- NeurIPS 2019 - order-model)] [[Project Page](https://aliaksandrsiarohin.github.io/first-order-model-website/)]
- ICCV 2023
- ICCV 2023 - Research/HumanSD)] [[Project Page](https://idea-research.github.io/HumanSD/)]
- CVPR 2023 - humans/editable-humans)] [[Project Page](https://custom-humans.github.io/)] [[Dataset](https://custom-humans.ait.ethz.ch/)]
- CVPR 2023 - anyone/)]
- CVPRW 2024 - eldesokey/latentman)] [[Project Page](https://abdo-eldesokey.github.io/latentman/)]
- IJCAI 2024
- arXiv 2024 - vilab/UniAnimate)] [[Project Page](https://unianimate.github.io/)]
- arXiv 2024
- arXiv 2021
- arXiv 2025 - 1-code/)] [[Project Page](https://dorniwang.github.io/UniVerse-1/)]
- Seminal Work 2024
- arXiv 2025 - cosmos/cosmos-predict1)]
-
-
Related Resources
-
Survey and Awesome Repos
- Awesome Digital Human
- CVPR 2024 - 3D-Gaussians)] [[Project Page](https://ingra14m.github.io/Deformable-Gaussians/)]
- CVPR 2024
- CVPR 2024 - GS)] [[Project Page](https://yihua7.github.io/SC-GS-web/)]
- CVPR 2024 Highlight
- SIGGRAPH 2024
- ICLR 2024 - zvg/4d-gaussian-splatting)] [[Project Page](https://fudan-zvg.github.io/4d-gaussian-splatting/)]
- CVPR 2024 Highlight - 3DV/Gaussian-Flow)] [[Project Page](https://nju-3dv.github.io/projects/Gaussian-Flow/)]
- 3DV 2024
- arXiv 6 May 2024
- arXiv 17 Mar 2024
- IEEE TVCG 2024
- A Survey on 3D Gaussian Splatting
-
Programming Languages
Categories
Sub Categories
3D Generation
68
Video Generation
61
💡 4D ArXiv Papers
50
🎉 Motion Accepted Papers
38
Survey and Awesome Repos
36
4D Generation
27
🎉 Human Accepted Papers
24
🎉 4D Accepted Papers
24
💡 Motion ArXiv Papers
22
💡 Video ArXiv Papers
19
💡 3D Scene ArXiv Papers
18
💡 T2V ArXiv Papers
16
🎉 Scene Accepted Papers
15
💡 Scene ArXiv Papers
13
Previous Papers
12
🎉 T2V Accepted Papers
11
World Foundation Model Platform
9
📚 Dataset Works
9
💡 Human ArXiv Papers
9
🎉 3D Scene Accepted Papers
8
2D Generation
8
🎉 Video Accepted Papers
7
Text to 'other tasks'
6
Year 2023
4
World Model Benchmark
1
Other 4D Additional Info
1
Previous Papers and Other Awesome Repos
1
Year 2024
1
Keywords
nerf
4
neural-rendering
4
text-to-3d
4
3d-gaussian-splatting
3
3dgs
3
3d-generation
3
gaussian-splatting
2
image-to-3d
2
t23d
2
tt3d
2
avatar
2
3d-reconstruction
2
smpl
2
3d-aigc
2
aigc
2
3d
2
smpl-model
1
4d
1
embodied-ai
1
3d-keypoints
1
2d-keypoints
1
virtual-try-on
1
digital-human
1
clothed-people-digitalization
1
physics
1
survey
1
t2v
1
v2v
1
video-generation
1
diffusion-to-3d
1
world-models
1
world-simulator
1
360-video
1
generative-ai
1
sdf
1
motion-generation
1
humannerf
1
diffusion
1
3dreconstruction
1
3d-learning-from-2d
1
generation
1
computer-vision
1
computer-graphics
1
stable-diffusion
1
shape-generation
1
novel-view-synthesis
1
vae
1
prior
1
pose-estimation
1
pose
1