Duplicate from jasperai/LBM_relighting

Co-authored-by: Clément Chadebec <clementchadebec@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,36 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+assets/relight.jpg filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,64 @@
+---
+license: cc-by-nc-4.0
+base_model:
+- stabilityai/stable-diffusion-xl-base-1.0
+tags:
+- image-to-image
+inference: false
+pipeline_tag: image-to-image
+---
+# ✨ Latent Bridge Matching for Image Relighting ✨
+
+Latent Bridge Matching (LBM) is a new, versatile and scalable method proposed in [LBM: Latent Bridge Matching for Fast Image-to-Image Translation](https://arxiv.org/abs/2503.07535) that relies on Bridge Matching in a latent space to achieve fast image-to-image translation.
+This model was trained to relight a foreground object according to a provided background.
+See our [live demo](https://huggingface.co/spaces/jasperai/LBM_relighting) and official [Github repo](https://github.com/gojasper/LBM).
+
+<p align="center">
+   <img style="width:700px;" src="assets/relight.jpg">
+</p>
+
+## How to use?
+To use this model you need first to install the associated `lbm` library by running the following
+```bash
+pip install git+https://github.com/gojasper/LBM.git
+```
+
+Then, you can infer with the model on your input images 
+```python
+import torch
+from diffusers.utils import load_image
+from lbm.inference import evaluate, get_model
+
+# Load model
+model = get_model(
+  "jasperai/LBM_relighting",
+  torch_dtype=torch.bfloat16,
+  device="cuda",
+)
+
+# Load a source image
+source_image = load_image(
+  "https://huggingface.co/jasperai/LBM_relighting/resolve/main/assets/source_image.jpg"
+)
+
+# Perform inference
+output_image = evaluate(model, source_image, num_sampling_steps=1)
+output_image
+```
+<p align="center">
+   <img style="width:500px;" src="assets/output.jpg">
+</p>
+
+## License
+This code is released under the **Creative Commons BY-NC 4.0 license**.
+
+## Citation
+If you find this work useful or use it in your research, please consider citing us
+```bibtex
+@article{chadebec2025lbm,
+      title={LBM: Latent Bridge Matching for Fast Image-to-Image Translation}, 
+      author={Clément Chadebec and Onur Tasar and Sanjeev Sreetharan and Benjamin Aubin},
+      year={2025},
+      journal = {arXiv preprint arXiv:2503.07535},
+}
+```

config.yaml

@@ -0,0 +1,11 @@
+backbone_signature: stabilityai/stable-diffusion-xl-base-1.0
+vae_num_channels: 4
+unet_input_channels: 4
+timestep_sampling: custom_timesteps
+selected_timesteps: [250, 500, 750, 1000]
+prob: [0.25, 0.25, 0.25, 0.25]
+conditioning_images_keys: []
+conditioning_masks_keys: []
+source_key: source_image
+target_key: source_image_paste
+bridge_noise_sigma: 0.005

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3862fe208cabd245b0f9212f7451d80723a5a9e4978a0af728f8b033cba7397a
+size 5020040640