Update README.md

README.md

@@ -18,28 +18,48 @@ base_model: stabilityai/stable-diffusion-2-1
 inference: true
 ---
 
-<!-- This model card has been generated automatically according to the information the training script had access to. You
-should probably proofread and complete it, then remove this comment. -->
 
 
 # LoRA text2image fine-tuning - remi349/sd_trained_3D_lora
-These are LoRA adaption weights for stabilityai/stable-diffusion-2-1. The weights were fine-tuned on the remi349/finetuning_dataset_for_3D_training dataset. You can find some example images in the following. 
-
-
 
+These are LoRA adaption weights are for stabilityai/stable-diffusion-2-1. The weights were fine-tuned on the remi349/finetuning_dataset_for_3D_training dataset. 
 
 ## Intended uses & limitations
 
+This model aims at generating images of isolated objects, compatible with 2D_to_3D models like [Triposr](https://github.com/VAST-AI-Research/TripoSR) or [CRM](https://huggingface.co/Zhengyi/CRM).
+It was finetuned in order to create after a pipeline of prompt-to-3D model.
+
 #### How to use
 
 ```python
-# TODO: add an example code snippet for running this diffusion pipeline
+# first load the basic architecture and everything
+import torch
+import os
+from diffusers import StableDiffusionPipeline 
+pipe = StableDiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-2-1", torch_dtype=torch.float16)
+
+# Then add the lora weights to the model stable diffusion 2
+pipe.unet.load_attn_procs('remi349/sd_trained_3D_lora')
+pipe.to("cuda")
+
+# Then you can begin the inference process on a prompt and save the image generated
+
+prompt = 'a rabbit with a yellow jacket'
+image = pipe(prompt, num_inference_steps=30, guidance_scale=7.5).images[0]
+image.save("my_image.png")
 ```
 
 #### Limitations and bias
 
-[TODO: provide examples of latent issues and potential remediations]
+This model is a first try some hyperparameters tuning should be done, but for that we would need a solid automated benchmark.
 
 ## Training details
+The model finetuned model is [Stable Diffusion 2](https://huggingface.co/stabilityai/stable-diffusion-2).
+The data used to train this model is the dataset available on uggingface at 'remi349/finetuning_dataset_for_3D_training'. 
+you can download it thanks to the command
+```python
+from datasets import load_dataset
+dataset = load_dataset("remi349/finetuning_dataset_for_3D_training", split = 'train')
+```
 
-[TODO: describe the data used to train the model]
+This dataset is a subset of the dataset [Objaverse](https://objaverse.allenai.org/).