Update README.md
Browse files
README.md
CHANGED
|
@@ -20,10 +20,10 @@ This model is the primary output of the paper: **"Visual Reasoning Transfer: Lev
|
|
| 20 |
|
| 21 |
The model does not generate images. Instead, it acts as a dynamics engine in latent space. When given a latent representation of a physical state (encoded as a "spatial field image"), it predicts the latent representation of the next physical state.
|
| 22 |
|
| 23 |
-
This LoRA
|
| 24 |
|
| 25 |
* **Research Project Repository:** [https://github.com/sandner-art/SC-Visual-Reasoning](https://github.com/sandner-art/SC-Visual-Reasoning)
|
| 26 |
-
* **Training Dataset:** [huggingface.co/datasets/
|
| 27 |
|
| 28 |
## How to Use
|
| 29 |
|
|
@@ -42,4 +42,19 @@ pipeline.to("cuda")
|
|
| 42 |
|
| 43 |
# Now the `pipeline.unet` component is ready for physics simulation.
|
| 44 |
unet = pipeline.unet
|
| 45 |
-
# ...
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
The model does not generate images. Instead, it acts as a dynamics engine in latent space. When given a latent representation of a physical state (encoded as a "spatial field image"), it predicts the latent representation of the next physical state.
|
| 22 |
|
| 23 |
+
This LoRA was trained for 15,000 steps on a synthetic dataset of 10,000 N-body trajectories.
|
| 24 |
|
| 25 |
* **Research Project Repository:** [https://github.com/sandner-art/SC-Visual-Reasoning](https://github.com/sandner-art/SC-Visual-Reasoning)
|
| 26 |
+
* **Training Dataset:** [huggingface.co/datasets/YourUsername/n-body-trajectories-for-vrlora](https://huggingface.co/datasets/YourUsername/n-body-trajectories-for-vrlora) (Replace with your link)
|
| 27 |
|
| 28 |
## How to Use
|
| 29 |
|
|
|
|
| 42 |
|
| 43 |
# Now the `pipeline.unet` component is ready for physics simulation.
|
| 44 |
unet = pipeline.unet
|
| 45 |
+
# ...
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
## Training Procedure
|
| 49 |
+
|
| 50 |
+
The model was trained using the `train_vr_lora.py` script from the project repository. Key hyperparameters:
|
| 51 |
+
|
| 52 |
+
* **Learning Rate:** 1e-4
|
| 53 |
+
* **Batch Size:** 32
|
| 54 |
+
* **Max Steps:** 15,000
|
| 55 |
+
* **Optimizer:** AdamW
|
| 56 |
+
* **Scheduler:** Cosine
|
| 57 |
+
|
| 58 |
+
## Citing this Work
|
| 59 |
+
|
| 60 |
+
If you use this model in your research, please cite our paper (BibTeX entry coming soon).
|