https://github.com/etched-ai/open-oasis

Inference script for Oasis 500M
https://github.com/etched-ai/open-oasis

Last synced: about 1 month ago
JSON representation

Inference script for Oasis 500M

• Host: GitHub
• URL: https://github.com/etched-ai/open-oasis
• Owner: etched-ai
• License: mit
• Created: 2024-10-31T09:10:45.000Z (about 1 month ago)
• Default Branch: master
• Last Pushed: 2024-10-31T21:56:12.000Z (about 1 month ago)
• Last Synced: 2024-10-31T22:27:57.681Z (about 1 month ago)
• Language: Python
• Size: 27.9 MB
• Stars: 5
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• ai-game-devtools - Oasis

README

        
# Oasis 500M

![](./media/arch.png)

![](./media/thumb.png)

Oasis is an interactive world model developed by [Decart](https://www.decart.ai/) and [Etched](https://www.etched.com/). Based on diffusion transformers, Oasis takes in user keyboard input and generates gameplay in an autoregressive manner. We release the weights for Oasis 500M, a downscaled version of the model, along with inference code for action-conditional frame generation. 

For more details, see our [joint blog post](https://oasis-model.github.io/) to learn more.

And to use the most powerful version of the model, be sure to check out the [live demo](https://oasis.us.decart.ai/) as well!

## Setup

```

git clone https://github.com/etched-ai/open-oasis.git

cd open-oasis

pip install -r requirements.txt

```

## Download the model weights

```

huggingface-cli login

huggingface-cli download Etched/oasis-500m oasis500m.pt # DiT checkpoint

huggingface-cli download Etched/oasis-500m vit-l-20.pt  # ViT VAE checkpoint

```

## Basic Usage

We include a basic inference script that loads a prompt frame from a video and generates additional frames conditioned on actions.

```

python generate.py

```

The resulting video will be saved to `video.mp4`. Here's are some examples of a generation from this 500M model!

![](media/sample_0.gif)

![](media/sample_1.gif)

> Hint: try swapping out the `.mp4` input file in the script to try different environments!