Spaces:
Runtime error
Oasis 500M
Oasis is an interactive world model developed by Decart and Etched. Based on diffusion transformers, Oasis takes in user keyboard input and generates gameplay in an autoregressive manner. We release the weights for Oasis 500M, a downscaled version of the model, along with inference code for action-conditional frame generation.
For more details, see our joint blog post to learn more.
And to use the most powerful version of the model, be sure to check out the live demo as well!
Setup
git clone https://github.com/etched-ai/open-oasis.git
cd open-oasis
pip install -r requirements.txt
Download the model weights
huggingface-cli login
huggingface-cli download Etched/oasis-500m oasis500m.pt # DiT checkpoint
huggingface-cli download Etched/oasis-500m vit-l-20.pt # ViT VAE checkpoint
Basic Usage
We include a basic inference script that loads a prompt frame from a video and generates additional frames conditioned on actions.
python generate.py
The resulting video will be saved to video.mp4
. Here's are some examples of a generation from this 500M model!
Hint: try swapping out the
.mp4
input file in the script to try different environments!