Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/camenduru/text-to-video-synthesis-colab
Text To Video Synthesis Colab
https://github.com/camenduru/text-to-video-synthesis-colab
colab colab-notebook colaboratory t2v text-to-video
Last synced: 6 days ago
JSON representation
Text To Video Synthesis Colab
- Host: GitHub
- URL: https://github.com/camenduru/text-to-video-synthesis-colab
- Owner: camenduru
- License: unlicense
- Created: 2023-03-19T17:29:13.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-03-28T08:15:17.000Z (9 months ago)
- Last Synced: 2024-11-21T06:36:06.451Z (22 days ago)
- Topics: colab, colab-notebook, colaboratory, t2v, text-to-video
- Language: Jupyter Notebook
- Homepage:
- Size: 164 KB
- Stars: 1,467
- Watchers: 22
- Forks: 177
- Open Issues: 11
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
- Awesome-Video-Diffusion - text-to-video-synthesis-colab
- Awesome-Video-Diffusion-Models - T2V Synthesis Colab - to-video-synthesis-colab.svg?style=social&label=Star)](https://github.com/camenduru/text-to-video-synthesis-colab)| (Open-source Toolboxes and Foundation Models)
README
🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru
## 🦒 Colab
| Colab | Type
| --- | --- |
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/longscope_text_to_video_colab.ipynb) | longscope_text_to_video_colab [polyware-ai/longscope](https://huggingface.co/polyware-ai/longscope)
(Thanks to [@polyware_ai](https://twitter.com/polyware_ai) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/zeroscope_v2_xl_text_to_video_colab.ipynb) | zeroscope_v2_xl_text_to_video_colab [cerspense/zeroscope_v2_XL](https://huggingface.co/cerspense/zeroscope_v2_XL)
(Thanks to [@cerspense](https://twitter.com/cerspense) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/zeroscope_v2_576w_text_to_video_colab.ipynb) | zeroscope_v2_576w_text_to_video_colab [cerspense/zeroscope_v2_576w](https://huggingface.co/cerspense/zeroscope_v2_576w)
(Thanks to [@cerspense](https://twitter.com/cerspense) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/potat1_exp1_text_to_video_colab.ipynb) | potat1_exp1_text_to_video_colab (Thanks to [lambda labs](https://lambdalabs.com/) ❤ for the gpu)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/zeroscope_v2_dark_text_to_video_colab.ipynb) | zeroscope_v2_dark_text_to_video_colab [cerspense/zeroscope_v2_dark_30x448x256](https://huggingface.co/cerspense/zeroscope_v2_dark_30x448x256)
(Thanks to [@cerspense](https://twitter.com/cerspense) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/zeroscope_v2_30x448x256_text_to_video_colab.ipynb) | zeroscope_v2_30x448x256_text_to_video_colab [cerspense/zeroscope_v2_30x448x256](https://huggingface.co/cerspense/zeroscope_v2_30x448x256)
(Thanks to [@cerspense](https://twitter.com/cerspense) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/zeroscope_v1_1_320s_text_to_video_colab.ipynb) | zeroscope_v1_1_320s_text_to_video_colab [cerspense/zeroscope_v1-1_320s](https://huggingface.co/cerspense/zeroscope_v1-1_320s)
(Thanks to [@cerspense](https://twitter.com/cerspense) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/potat1_text_to_video_colab.ipynb) | potat1_text_to_video_colab [camenduru/potat1](https://huggingface.co/camenduru/potat1) (Thanks to [lambda labs](https://lambdalabs.com/) ❤ for the gpu)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/zeroscope_v1_320s_text_to_video_colab.ipynb) | zeroscope_v1_320s_text_to_video_colab [cerspense/zeroscope_v1_320s](https://huggingface.co/cerspense/zeroscope_v1_320s)
(Thanks to [@cerspense](https://twitter.com/cerspense) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/ms_1_7b_text_to_video_colab.ipynb) | ms_1_7b_text_to_video_colab [damo-vilab/text-to-video-ms-1.7b](https://huggingface.co/damo-vilab/text-to-video-ms-1.7b)
(Thanks to [damo](https://damo.alibaba.com) ❤ [damo-vilab](https://github.com/damo-vilab) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/animov_512x_text_to_video_colab.ipynb) | animov_512x_text_to_video_colab [strangeman3107/animov-512x](https://huggingface.co/strangeman3107/animov-512x)
(Thanks to [@bRuefiRe](https://twitter.com/bRuefiRe) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/animov_0_1_1_text_to_video_colab.ipynb) | animov_0_1_1_text_to_video_colab [strangeman3107/animov-0.1.1](https://huggingface.co/strangeman3107/animov-0.1.1)
(Thanks to [@bRuefiRe](https://twitter.com/bRuefiRe) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/animov_0_1_text_to_video_colab.ipynb) | animov_0_1_text_to_video_colab [strangeman3107/animov-0.1.1](https://huggingface.co/strangeman3107/animov-0.1)
(Thanks to [@bRuefiRe](https://twitter.com/bRuefiRe) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/watermark_remover_gradio.ipynb) | Watermark Remover
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/text_to_video_synthesis.ipynb) | text_to_video_synthesis
(Thanks to [damo](https://damo.alibaba.com) ❤ [damo-vilab](https://github.com/damo-vilab) ❤ for the model)
[](https://colab.research.google.com/github/camenduru/text-to-video-synthesis-colab/blob/main/text_to_video_synthesis_diffusers.ipynb) | text_to_video_synthesis_diffusers
(Thanks to [damo](https://damo.alibaba.com) ❤ [damo-vilab](https://github.com/damo-vilab) ❤ for the model)
## 🦒 Community Colab
| Colab | Function | Author | Readme
| --- | --- | --- | --- |
[](https://colab.research.google.com/drive/1TsZmatSu1-1lNBeOqz3_9Zq5P2c0xTTq) | potat1_text_to_video_colab_ALM (Thanks to snydjos ❤) | snydjos [AILostMedia](https://twitter.com/AILostMedia) | [Readme](https://www.ailostmedia.com/post/the-ai-lost-media-text-to-video-colab-workspace)
## Tutorials
https://www.youtube.com/watch?v=WHcjD-uraUs (for zeroscope_video_webui_colab and zeroscope_upscale_video_webui_colab)
https://www.youtube.com/watch?v=E45AO1w9gRU (for Potat 1️⃣ and Zeroscope)
https://www.youtube.com/watch?v=b8D4am73e6I
## Main Repo
https://www.modelscope.cn/models/damo/text-to-video-synthesis/summary
https://github.com/modelscope/modelscope
https://github.com/huggingface/diffusers
## Paper
https://arxiv.org/abs/2308.06571
## Models License
Apache License 2.0
## Examples
## Potat 1️⃣
https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/604a8817-5ad3-421a-9240-e5d3b195074d
https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/842da028-df43-4dba-bb14-a41d66edeb4e
https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/c5201c8a-2815-4533-9474-1e312c564f4e
https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/281d1a9e-b930-4e8a-9554-5203e15b4425
https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/0bb74810-13bf-4e20-950f-b569a60ea5c8
https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/1025f302-9fa1-4bd3-8996-1da94697151e
## Base Model
A giraffe underneath a microwave.
A goldendoodle playing in a park by a lake.
A panda bear driving a car.
A teddy bear running in New York City.
Drone flythrough of a fast food restaurant
on a dystopian alien planet.
A dog wearing a Superhero outfit with red cape
flying through the sky.
Monkey learning to play the piano.
A litter of puppies running through the yard.
Robot dancing in times square.
## Related Colab
https://github.com/camenduru/text2video-zero-colab