Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,27 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/6310d1226f21f539e52b9d77/7zw2xPWGRpFrwK62CkFqJ.mp4"></video>
|
| 6 |
+
_Prompt: A young man walks alone by the seaside."_
|
| 7 |
+
|
| 8 |
+
__Text2Bricks__ is a fine-tuned [Open Sora](https://github.com/hpcaitech/Open-Sora) model that generates toy brick-style short stop animations.
|
| 9 |
+
|
| 10 |
+
|
| 11 |
+
`text2bricks-360p-32f` is fine-tuned to generated up to 360p/64-frames outputs.
|
| 12 |
+
|
| 13 |
+
It was trained on Lambda's [1-Click Clusters](https://lambdalabs.com/service/gpu-cloud/1-click-clusters) in ~1,000 H100 GPU hours. See this [Weights $ Biases report](https://api.wandb.ai/links/lambdalabs/2cbrtx45) for details.
|
| 14 |
+
|
| 15 |
+
Extra code and data process steps can be found in this [tutorial](https://github.com/LambdaLabsML/Open-Sora/blob/lambda_bricks/TUTORIAL.md).
|
| 16 |
+
|
| 17 |
+
|
| 18 |
+
# Usage
|
| 19 |
+
|
| 20 |
+
Use [Lambda's fork](https://github.com/LambdaLabsML/Open-Sora/tree/lambda_bricks) of Open-Sora.
|
| 21 |
+
|
| 22 |
+
```
|
| 23 |
+
python scripts/inference.py \
|
| 24 |
+
configs/opensora-v1-1/inference/text2bricks-360p-64f.py \
|
| 25 |
+
--prompt "A young man walks alone by the seaside." \
|
| 26 |
+
--num-frames 64
|
| 27 |
+
```
|