nlml commited on
Commit
ed91eab
·
verified ·
1 Parent(s): 03f83f6

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - diffusion
5
+ - world-models
6
+ - video-generation
7
+ - carracing
8
+ - reinforcement-learning
9
+ - pytorch
10
+ ---
11
+
12
+ # Interactive Diffusion: A Playable World Model
13
+
14
+ This repository hosts the trained model weights and sample data for the project [**Demystifying World Models: A Playable Diffusion Model**](https://github.com/nlml/interactive-diffusion).
15
+
16
+ - **GitHub Repository**: [nlml/interactive-diffusion](https://github.com/nlml/interactive-diffusion)
17
+ - **Blog Post**: [A Playable Diffusion Model](https://github.com/nlml/interactive-diffusion/blob/main/post.md)
18
+
19
+ ## Contents
20
+
21
+ - `model.pt`: 145 MB checkpoint (optimizer stripped) of the `CausalSpatiotemporalDiT` trained with context noise augmentation (50,000 steps).
22
+ - `sample_data/`: Sample shard 0 of `CarRacing-v3` gameplay frames, actions, and episode masks to test training or rollout generation out of the box.
23
+
24
+ ## Quickstart
25
+
26
+ Clone the GitHub repository and run the live driving server:
27
+
28
+ ```bash
29
+ git clone https://github.com/nlml/interactive-diffusion.git
30
+ cd interactive-diffusion
31
+ pip install -e .
32
+
33
+ # Run the live interactive driving server:
34
+ python webapp/server.py --checkpoint nlml/interactive-diffusion --data_dir ./carracing_data
35
+ ```