https://abdo-eldesokey.github.io/text2ac-zero

This is the official repository for "LatentMan: Generating Consistent Animated Characters using Image Diffusion Models" [CVPRW 2024]
https://abdo-eldesokey.github.io/text2ac-zero

Last synced: 3 months ago
JSON representation

This is the official repository for "LatentMan: Generating Consistent Animated Characters using Image Diffusion Models" [CVPRW 2024]

• Host: GitHub
• URL: https://abdo-eldesokey.github.io/text2ac-zero
• Owner: abdo-eldesokey
• Created: 2023-12-12T06:43:11.000Z (about 1 year ago)
• Default Branch: master
• Last Pushed: 2024-07-21T10:54:41.000Z (6 months ago)
• Last Synced: 2024-10-02T20:04:24.520Z (3 months ago)
• Language: Jupyter Notebook
• Homepage: https://abdo-eldesokey.github.io/latentman/
• Size: 98.1 MB
• Stars: 21
• Watchers: 4
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-diffusion-categorized - [Project

README

        
# LatentMan : Generating Consistent Animated Characters using Image Diffusion Models

CVPRW 2024




 



## Environment

This code was tested on Python 3.8 with Cuda 12.1 and PyTorch 2.3.

- To setup up the environemnt, simply create a Conda environemnt by running:

```

conda env create -f environment.yml

```

- Follow the instructions for parts 2,3 in MDM's [README.md](https://github.com/GuyTevet/motion-diffusion-model/tree/main) to download the required files for Motion-Diffusion-Model code located in `external/MDM`.

- You can download some examples of generated motions to `workspace` by running:

```

gdown "1IdaCPpRWrmRX5AVXXUXymwFVHXt2CNnW&confirm=t"

unzip workspace.zip

```

## Getting Started

Please refer to `getting_started.ipynb`.

## Acknowledgements 

Parts of this code base are adapted from [MDM](https://github.com/GuyTevet/motion-diffusion-model/tree/main), [Detectron2](https://github.com/facebookresearch/detectron2), and [MvDeCor](https://github.com/nv-tlabs/MvDeCor).

## Citation

If you use this code or parts of it, please cite our paper:

```

@inproceedings{eldesokey2024latentman,

  title={LATENTMAN: Generating Consistent Animated Characters using Image Diffusion Models},

  author={Eldesokey, Abdelrahman and Wonka, Peter},

  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},

  pages={7510--7519},

  year={2024}

}

```