clementchadebec commited on
Commit
457f311
·
verified ·
1 Parent(s): 6014450

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -3
README.md CHANGED
@@ -1,3 +1,64 @@
1
- ---
2
- license: cc-by-nc-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ base_model:
4
+ - stabilityai/stable-diffusion-xl-base-1.0
5
+ tags:
6
+ - image-to-image
7
+ inference: false
8
+ ---
9
+ # ✨ Latent Bridge Matching for Depth Estimation ✨
10
+
11
+ Latent Bridge Matching (LBM) is a new, versatile and scalable method proposed in [LBM: Latent Bridge Matching for Fast Image-to-Image Translation](https://arxiv.org/abs/2503.07535) that relies on Bridge Matching in a latent space to achieve fast image-to-image translation.
12
+ This model was trained to estimate the depth map from a given input image.
13
+ See also our [live demo](https://huggingface.co/spaces/jasperai/LBM_relighting) for image relighting and official [Github repo](https://github.com/gojasper/LBM).
14
+
15
+ ## How to use?
16
+ To use this model you need first to install the associated `lbm` library by running the following
17
+ ```bash
18
+ pip install git+https://github.com/gojasper/LBM.git
19
+ ```
20
+
21
+ Then, you can infer with the model on your input images
22
+ ```python
23
+ import torch
24
+ fron PIL import Image
25
+ from lbm.inference import evaluate, get_model
26
+
27
+ # Load model
28
+ model = get_model(
29
+ "jasperai/LBM_relighting",
30
+ torch_dtype=torch.bfloat16,
31
+ device="cuda",
32
+ )
33
+
34
+ # Load a source image
35
+ source_image = Image.open("your_image")
36
+
37
+ # Perform inference
38
+ output_image = evaluate(model, source_image, num_sampling_steps=1)
39
+ ```
40
+
41
+ ## Metrics
42
+ This model achieves the following metrics
43
+
44
+ | Metrics | AbsRel ↓ | δ1 ↑ | δ2 ↑ |
45
+ |---------|-----------|------|------|
46
+ | NYUv2 | 5.6 | 97.2 | 99.2 |
47
+ | Kitti | 9.4 | 93.0 | 98.9 |
48
+ | ETH3D | 6.3 | 96.5 | 99.3 |
49
+ | ScanNet | 5.7 | 97.0 | 99.2 |
50
+ | DIODE | 30.3 | 77.5 | 89.3 |
51
+
52
+ ## License
53
+ This code is released under the Creative Commons BY-NC 4.0 license.
54
+
55
+ ## Citation
56
+ If you find this work useful or use it in your research, please consider citing us
57
+ ```bibtex
58
+ @article{chadebec2025lbm,
59
+ title={LBM: Latent Bridge Matching for Fast Image-to-Image Translation},
60
+ author={Clément Chadebec and Onur Tasar and Sanjeev Sreetharan and Benjamin Aubin},
61
+ year={2025},
62
+ journal = {arXiv preprint arXiv:2503.07535},
63
+ }
64
+ ```