https://github.com/BraveGroup/Drive-WM

[CVPR 2024] A world model for autonomous driving.
https://github.com/BraveGroup/Drive-WM

Last synced: 19 days ago
JSON representation

[CVPR 2024] A world model for autonomous driving.

• Host: GitHub
• URL: https://github.com/BraveGroup/Drive-WM
• Owner: BraveGroup
• License: apache-2.0
• Created: 2023-11-18T01:40:55.000Z (12 months ago)
• Default Branch: master
• Last Pushed: 2023-12-07T02:40:39.000Z (12 months ago)
• Last Synced: 2024-08-01T03:34:03.263Z (4 months ago)
• Language: Python
• Homepage:
• Size: 2.01 MB
• Stars: 254
• Watchers: 22
• Forks: 4
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Citation: CITATION.cff

Awesome Lists containing this project

• Awesome-LLM4AD - Drive-WM

README

        
# Drive-WM

## Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving

[Yuqi Wang*](https://robertwyq.github.io/), [Jiawei He*](https://jiaweihe.com/), [Lue Fan*](https://lue.fan/), [Hongxin Li*](https://github.com/ZJULiHongxin), [Yuntao Chen†](https://scholar.google.com/citations?user=iLOoUqIAAAAJ), [Zhaoxiang Zhang†](https://zhaoxiangzhang.net/)

(*: Equal Contribution; †: Corresponding Author)

[[arXiv](https://arxiv.org/abs/2311.17918)] [[Project page](https://drive-wm.github.io/)]

![logo](https://github.com/BraveGroup/Drive-WM/assets/27729041/8418123e-35fa-450a-abd6-da266461cb78)

## TO DO

- [ ] Conditional image generation model weights (coming soon🚀)

- [ ] Conditional video generation model weights

- [ ] Action-conditioned video forecast model weights

- [ ] Training codes for all models

## Get Started

Our code is based on the open-source project diffusers.

## Citation

```

@article{wang2023driving,

  title={Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving},

  author={Wang, Yuqi and He, Jiawei and Fan, Lue and Li, Hongxin and Chen, Yuntao and Zhang, Zhaoxiang},

  journal={arXiv preprint arXiv:2311.17918},

  year={2023}

}

```

## Acknowledgement 

Many thanks to the following open-source projects:

* [diffusers](https://github.com/huggingface/diffusers)