Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/amey-thakur/zero-shot-video-generation

Zero-Shot Text to Video Generation
https://github.com/amey-thakur/zero-shot-video-generation

amey ameythakur computer-engineering engineering jupyter-notebook machine-learning master-of-engineering meng meng-ece project python t2v text-to-video text-to-video-generation university-of-windsor uwindsor zero-shot-learning

Last synced: 8 days ago
JSON representation

Zero-Shot Text to Video Generation

Awesome Lists containing this project

README

        

# ZERO-SHOT-VIDEO-GENERATION

👍🏻 ELEC8900: ML - Project [SEMESTER II]

- [X] **GENG8900: [ML](https://github.com/Amey-Thakur/MACHINE--LEARNING)**

---

>**Machine Learning Project**

- [Project Proposal](https://github.com/Amey-Thakur/MACHINE--LEARNING/blob/main/ML%20Project/Zero-Shot%20Video%20Generation%20-%20Project%20Proposal.pdf)

- [Project Presentation](https://github.com/Amey-Thakur/MACHINE--LEARNING/blob/main/ML%20Project/Zero-Shot%20Video%20Generation.pdf)

- [Project Demo](https://youtu.be/za9hId6UPoY)

- [Report](https://github.com/Amey-Thakur/MACHINE--LEARNING/blob/main/ML%20Project/Zero-Shot%20Video%20Generation%20Project%20Report.pdf)

---

## Introduction
The Zero-Shot Video Generation ML Project is an innovative solution for transforming text into dynamic video content. This README guides you through setting up and running the project on your local machine.

## Prerequisites
- Python 3.8+

## Installation

### Step 1: Clone the Repository
```bash
git clone https://github.com/Amey-Thakur/ZERO-SHOT-VIDEO-GENERATION
# Or download and extract the zip file
```

### Step 2: Install Dependencies
Navigate to the project directory and run:
```bash
pip install -r requirements.txt
```
This installs necessary libraries like `torch`, `numpy`, `opencv`, `gradio`, and `moviepy`.

### Step 3: Starting the Project
In the project directory, run:
```bash
python app.py
```
This starts the server and initializes the Text2Video model.

## Usage

### Step 4: Accessing the Local Server
Copy the localhost link (typically `http://127.0.0.1:7860`) from the terminal into your web browser.

### Step 5: Interacting with the Text2Video Model
Enter the desired text into the model's interface on the server page to start video generation.

### Step 6: Generating Video
Trigger the model to process the text and generate the video.

### Step 7: Viewing Results
Review the generated video displayed on the webpage directly in the browser.

## Conclusion
Enjoy transforming text into videos with ease and efficiency! For further details, refer to the project documentation.

---

👉🏻 Presented as a part of the 3rd Semester Project @ University of Windsor 👈🏻

👷 Project Authors: Amey Thakur, Jithin Gijo and Ritika Agarwal (Batch of 2024)



✌🏻 Back To Engineering ✌🏻