sandner commited on
Commit
b57606c
·
verified ·
1 Parent(s): e9a1bcb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -3
README.md CHANGED
@@ -1,3 +1,45 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: runwayml/stable-diffusion-v1-5
4
+ tags:
5
+ - stable-diffusion
6
+ - diffusers
7
+ - lora
8
+ - scientific-machine-learning
9
+ - physics-simulation
10
+ - visual-reasoning
11
+ ---
12
+
13
+ # VR-LoRA: N-Body Physics Simulator (SD-v1.5)
14
+
15
+ This repository contains a Visual Reasoning LoRA (VR-LoRA) fine-tuned on `runwayml/stable-diffusion-v1-5` to predict the temporal evolution of a 3-body gravitational system.
16
+
17
+ This model is the primary output of the paper: **"Visual Reasoning Transfer: Leveraging Pretrained Visual Models for Physical and Temporal Prediction"** (link to paper coming soon).
18
+
19
+ ## Model Description
20
+
21
+ The model does not generate images. Instead, it acts as a dynamics engine in latent space. When given a latent representation of a physical state (encoded as a "spatial field image"), it predicts the latent representation of the next physical state.
22
+
23
+ This LoRA (final) was trained for 15,000 steps on a synthetic dataset of 10,000 N-body trajectories.
24
+
25
+ * **Research Project Repository:** [https://github.com/sandner-art/SC-Visual-Reasoning](https://github.com/sandner-art/SC-Visual-Reasoning)
26
+ * **Training Dataset:** [huggingface.co/datasets/sandner/n-body-trajectories-for-vrlora](https://huggingface.co/datasets/YourUsername/n-body-trajectories-for-vrlora) (Replace with your link)
27
+
28
+ ## How to Use
29
+
30
+ This LoRA is designed to be used with the evaluation script found in the main research repository. It is not intended for standard text-to-image generation.
31
+
32
+ ```python
33
+ # See the evaluate_vr_lora.py script in the main GitHub repo for a full example.
34
+ from diffusers import StableDiffusionPipeline
35
+
36
+ base_model = "runwayml/stable-diffusion-v1-5"
37
+ lora_model = "YourUsername/vr-lora-physics-sd15" # Replace with your repo name
38
+
39
+ pipeline = StableDiffusionPipeline.from_pretrained(base_model)
40
+ pipeline.load_lora_weights(lora_model)
41
+ pipeline.to("cuda")
42
+
43
+ # Now the `pipeline.unet` component is ready for physics simulation.
44
+ unet = pipeline.unet
45
+ # ...